2023-10-06T23:40:03.926 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T23:40:03.926 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797 --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/orig.config.yaml 2023-10-06T23:40:03.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T23:40:04.059 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797 branch: rishabh-cephfs-mon description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} email: null first_in_suite: false job_id: '7414797' kernel: flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-cephfs-mon ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_client_delegate_inos_pct: 50 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 14d8d032507701c76ca224e769ee65a96b660a8c subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 14d8d032507701c76ca224e769ee65a96b660a8c kclient: client.0: mount_subvol_num: 1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-cephfs-mon sha1: 14d8d032507701c76ca224e769ee65a96b660a8c owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7175 sha1: 14d8d032507701c76ca224e769ee65a96b660a8c sleep_before_teardown: 0 subset: 59/512 suite: fs suite_branch: rishabh-cephfs-mon suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 14d8d032507701c76ca224e769ee65a96b660a8c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-06_11:56:52 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T23:40:04.060 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa; will attempt to use it 2023-10-06T23:40:04.061 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks 2023-10-06T23:40:04.061 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T23:40:04.063 INFO:teuthology.task.internal:Checking packages... 2023-10-06T23:40:04.087 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '14d8d032507701c76ca224e769ee65a96b660a8c' 2023-10-06T23:40:04.087 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T23:40:04.087 INFO:teuthology.packaging:ref: None 2023-10-06T23:40:04.087 INFO:teuthology.packaging:tag: None 2023-10-06T23:40:04.087 INFO:teuthology.packaging:branch: rishabh-cephfs-mon 2023-10-06T23:40:04.087 INFO:teuthology.packaging:sha1: 14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:40:04.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-cephfs-mon 2023-10-06T23:40:04.302 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6616.g14d8d032 2023-10-06T23:40:04.302 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T23:40:04.310 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T23:40:04.310 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T23:40:04.317 INFO:teuthology.task.internal:Saving configuration 2023-10-06T23:40:04.337 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T23:40:04.344 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T23:40:04.368 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 23:34:31.878706', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T23:40:04.393 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 23:34:31.877309', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T23:40:04.415 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 23:34:31.875884', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T23:40:04.415 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T23:40:04.423 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-06T23:40:04.423 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-06T23:40:04.423 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-06T23:40:04.423 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T23:40:04.553 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f536842ddc0>, signals=[15]) 2023-10-06T23:40:04.554 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T23:40:04.562 INFO:teuthology.task.internal:Opening connections... 2023-10-06T23:40:04.562 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2023-10-06T23:40:04.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:40:04.630 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T23:40:04.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:40:04.697 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T23:40:04.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:40:04.764 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T23:40:04.771 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-10-06T23:40:04.796 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-10-06T23:40:04.796 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-10-06T23:40:04.856 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T23:40:04.856 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T23:40:04.856 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T23:40:04.857 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T23:40:04.858 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T23:40:04.858 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T23:40:04.858 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-10-06T23:40:04.880 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-10-06T23:40:04.901 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-10-06T23:40:04.901 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-10-06T23:40:04.960 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T23:40:04.960 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T23:40:04.960 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T23:40:04.961 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T23:40:04.962 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:40:04.962 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T23:40:04.962 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T23:40:04.962 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T23:40:04.962 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T23:40:04.962 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-10-06T23:40:04.980 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-10-06T23:40:05.000 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-10-06T23:40:05.000 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-10-06T23:40:05.060 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T23:40:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T23:40:05.062 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T23:40:05.062 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T23:40:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:40:05.062 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T23:40:05.062 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T23:40:05.062 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T23:40:05.062 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T23:40:05.062 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-10-06T23:40:05.080 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T23:40:05.091 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T23:40:05.098 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T23:40:05.098 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2023-10-06T23:40:05.100 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-10-06T23:40:05.102 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2023-10-06T23:40:05.120 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T23:40:05.128 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T23:40:05.128 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2023-10-06T23:40:05.160 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-10-06T23:40:05.163 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2023-10-06T23:40:05.195 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T23:40:05.274 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T23:40:05.294 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-06T23:40:05.294 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, timeout 300 2023-10-06T23:40:05.294 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T23:40:05.295 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T23:40:05.295 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T23:40:05.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:40:05.314 DEBUG:teuthology.task.kernel:sha1 for mon.c is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.314 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T23:40:05.315 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-10-06T23:40:05.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:40:05.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:40:05.316 DEBUG:teuthology.task.kernel:sha1 for mon.a is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.317 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T23:40:05.317 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-10-06T23:40:05.317 DEBUG:teuthology.task.kernel:sha1 for mon.b is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.317 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T23:40:05.317 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-10-06T23:40:05.373 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-06T23:40:05.373 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.373 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T23:40:05.374 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-06T23:40:05.377 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.377 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T23:40:05.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.380 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-06T23:40:05.381 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.381 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T23:40:05.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:05.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum upgrade -y linux-firmware 2023-10-06T23:40:05.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum upgrade -y linux-firmware 2023-10-06T23:40:05.525 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum upgrade -y linux-firmware 2023-10-06T23:40:06.677 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T23:40:06.677 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2023-10-06T23:40:06.703 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T23:40:06.703 INFO:teuthology.orchestra.run.smithi088.stdout:Unable to read consumer identity 2023-10-06T23:40:06.727 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-06T23:40:06.727 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-10-06T23:40:08.091 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-06T23:40:08.167 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-06T23:40:08.393 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2023-10-06T23:40:08.800 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-06T23:40:09.144 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-06T23:40:09.659 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-06T23:40:12.318 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 453 kB/s | 24 kB 00:00 2023-10-06T23:40:12.918 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 404 kB/s | 24 kB 00:00 2023-10-06T23:40:13.051 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-10-06T23:40:13.053 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2023-10-06T23:40:13.053 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-10-06T23:40:13.171 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.c... 2023-10-06T23:40:13.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:13.179 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 366 kB/s | 24 kB 00:00 2023-10-06T23:40:13.404 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T23:40:13.404 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T23:40:13.410 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi112.front.sepia.ceph.com to complete... 2023-10-06T23:40:13.659 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-06T23:40:13.660 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-10-06T23:40:13.660 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-06T23:40:13.776 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.a... 2023-10-06T23:40:13.777 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:13.941 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-06T23:40:13.942 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-10-06T23:40:13.942 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-06T23:40:14.013 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T23:40:14.013 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T23:40:14.018 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi005.front.sepia.ceph.com to complete... 2023-10-06T23:40:14.059 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.b... 2023-10-06T23:40:14.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T23:40:14.279 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T23:40:14.279 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T23:40:14.281 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi088.front.sepia.ceph.com to complete... 2023-10-06T23:40:47.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-06 23:40:47 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T23:40:47.700 INFO:teuthology.orchestra.run.smithi005.stderr:FINISHED --2023-10-06 23:40:47-- 2023-10-06T23:40:47.700 INFO:teuthology.orchestra.run.smithi005.stderr:Total wall clock time: 34s 2023-10-06T23:40:47.700 INFO:teuthology.orchestra.run.smithi005.stderr:Downloaded: 1 files, 363M in 33s (10.9 MB/s) 2023-10-06T23:40:47.713 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.a... 2023-10-06T23:40:47.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T23:40:49.584 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying... ######################################## 2023-10-06T23:40:49.642 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing... ######################################## 2023-10-06T23:40:49.730 INFO:teuthology.orchestra.run.smithi005.stdout:Updating / installing... 2023-10-06T23:41:00.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06 23:41:00 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T23:41:00.259 INFO:teuthology.orchestra.run.smithi112.stderr:FINISHED --2023-10-06 23:41:00-- 2023-10-06T23:41:00.259 INFO:teuthology.orchestra.run.smithi112.stderr:Total wall clock time: 47s 2023-10-06T23:41:00.259 INFO:teuthology.orchestra.run.smithi112.stderr:Downloaded: 1 files, 363M in 47s (7.81 MB/s) 2023-10-06T23:41:00.261 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.c... 2023-10-06T23:41:00.261 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T23:41:01.844 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying... ######################################## 2023-10-06T23:41:01.915 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing... ######################################## 2023-10-06T23:41:02.003 INFO:teuthology.orchestra.run.smithi112.stdout:Updating / installing... 2023-10-06T23:41:30.142 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T23:41:40.449 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T23:41:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06 23:41:51 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T23:41:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:FINISHED --2023-10-06 23:41:51-- 2023-10-06T23:41:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:Total wall clock time: 1m 37s 2023-10-06T23:41:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:Downloaded: 1 files, 363M in 1m 36s (3.77 MB/s) 2023-10-06T23:41:51.166 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.b... 2023-10-06T23:41:51.167 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T23:41:52.988 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying... ######################################## 2023-10-06T23:41:53.048 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing... ######################################## 2023-10-06T23:41:53.134 INFO:teuthology.orchestra.run.smithi088.stdout:Updating / installing... 2023-10-06T23:41:54.680 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T23:41:54.680 DEBUG:teuthology.orchestra.run.smithi005:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T23:41:54.749 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:54.749 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:54.749 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:54.749 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:54.749 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T23:41:54.749 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T23:41:54.749 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T23:41:54.750 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T23:41:54.751 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T23:41:54.752 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T23:41:54.752 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T23:41:54.752 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T23:41:54.752 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T23:41:54.752 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T23:41:54.752 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T23:41:54.752 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T23:41:54.752 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T23:41:54.753 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T23:41:54.754 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T23:41:54.754 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T23:41:54.754 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T23:41:54.754 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T23:41:54.754 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T23:41:54.754 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T23:41:54.754 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T23:41:54.754 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T23:41:54.755 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T23:41:54.756 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T23:41:54.756 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T23:41:54.756 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T23:41:54.756 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T23:41:54.756 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T23:41:54.756 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T23:41:54.756 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T23:41:54.756 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T23:41:54.757 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T23:41:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T23:41:54.759 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T23:41:54.760 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T23:41:54.761 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T23:41:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T23:41:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T23:41:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T23:41:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T23:41:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T23:41:54.767 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T23:41:54.768 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T23:41:54.769 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T23:41:54.770 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T23:41:54.770 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T23:41:54.770 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T23:41:54.770 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T23:41:54.770 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T23:41:54.770 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T23:41:54.771 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T23:41:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T23:41:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T23:41:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T23:41:54.775 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T23:41:54.776 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T23:41:54.776 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T23:41:54.776 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T23:41:54.776 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T23:41:54.776 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T23:41:54.776 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T23:41:54.776 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T23:41:54.777 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T23:41:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T23:41:54.779 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T23:41:54.780 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T23:41:54.781 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T23:41:54.781 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T23:41:54.781 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T23:41:54.781 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T23:41:54.781 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T23:41:54.781 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T23:41:54.781 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T23:41:54.782 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T23:41:54.783 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T23:41:54.784 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T23:41:54.785 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T23:41:54.786 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T23:41:54.786 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T23:41:54.786 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T23:41:54.786 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T23:41:54.786 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T23:41:54.786 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T23:41:54.786 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T23:41:54.787 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T23:41:54.788 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T23:41:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T23:41:54.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T23:41:54.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T23:41:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T23:41:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T23:41:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T23:41:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T23:41:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T23:41:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T23:41:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T23:41:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T23:41:54.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T23:41:54.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T23:41:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T23:41:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T23:41:54.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T23:41:54.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T23:41:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T23:41:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T23:41:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T23:41:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T23:41:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T23:41:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T23:41:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T23:41:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T23:41:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T23:41:54.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T23:41:54.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T23:41:54.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T23:41:54.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T23:41:54.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T23:41:54.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T23:41:54.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T23:41:54.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T23:41:54.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T23:41:54.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T23:41:54.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T23:41:54.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T23:41:54.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T23:41:54.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T23:41:54.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T23:41:54.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T23:41:54.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T23:41:54.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T23:41:54.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T23:41:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T23:41:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T23:41:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T23:41:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T23:41:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T23:41:54.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T23:41:54.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T23:41:54.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T23:41:54.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T23:41:54.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T23:41:54.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T23:41:54.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T23:41:54.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T23:41:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T23:41:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T23:41:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T23:41:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T23:41:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T23:41:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T23:41:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T23:41:54.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T23:41:54.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T23:41:54.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T23:41:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T23:41:54.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T23:41:54.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T23:41:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T23:41:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T23:41:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T23:41:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T23:41:54.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T23:41:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T23:41:54.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T23:41:54.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T23:41:54.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T23:41:54.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T23:41:54.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T23:41:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T23:41:54.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T23:41:54.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T23:41:54.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T23:41:54.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T23:41:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T23:41:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T23:41:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T23:41:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T23:41:54.840 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T23:41:54.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T23:41:54.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T23:41:54.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T23:41:54.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T23:41:54.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T23:41:54.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T23:41:54.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T23:41:54.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T23:41:54.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T23:41:54.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T23:41:54.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T23:41:54.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T23:41:54.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T23:41:54.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T23:41:54.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T23:41:54.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T23:41:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T23:41:54.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T23:41:54.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T23:41:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T23:41:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T23:41:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T23:41:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T23:41:54.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T23:41:54.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T23:41:54.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T23:41:54.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T23:41:54.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T23:41:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T23:41:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T23:41:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T23:41:54.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T23:41:54.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T23:41:54.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T23:41:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T23:41:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T23:41:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T23:41:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T23:41:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T23:41:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T23:41:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T23:41:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T23:41:54.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T23:41:54.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T23:41:54.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T23:41:54.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T23:41:54.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T23:41:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T23:41:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T23:41:54.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T23:41:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T23:41:54.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T23:41:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T23:41:54.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T23:41:54.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T23:41:54.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T23:41:54.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T23:41:54.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T23:41:54.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T23:41:54.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T23:41:54.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T23:41:54.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T23:41:54.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T23:41:54.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T23:41:54.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T23:41:54.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T23:41:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T23:41:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T23:41:54.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T23:41:54.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T23:41:54.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T23:41:54.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T23:41:54.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T23:41:54.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T23:41:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T23:41:54.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T23:41:54.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T23:41:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T23:41:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T23:41:54.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T23:41:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T23:41:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T23:41:54.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T23:41:54.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T23:41:54.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T23:41:54.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T23:41:54.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T23:41:54.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T23:41:54.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T23:41:54.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T23:41:54.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T23:41:54.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T23:41:54.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T23:41:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T23:41:54.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T23:41:54.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T23:41:54.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T23:41:54.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T23:41:54.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T23:41:54.931 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:54.932 DEBUG:teuthology.orchestra.run.smithi005:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T23:41:54.959 INFO:teuthology.orchestra.run.smithi005.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T23:41:54.959 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T23:41:54.959 INFO:teuthology.orchestra.run.smithi005.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:41:54.960 INFO:teuthology.orchestra.run.smithi005.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:41:54.960 INFO:teuthology.orchestra.run.smithi005.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:54.960 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:41:54.960 INFO:teuthology.orchestra.run.smithi005.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:41:54.960 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2023-10-06T23:41:54.960 INFO:teuthology.orchestra.run.smithi005.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T23:41:54.960 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T23:41:54.960 INFO:teuthology.orchestra.run.smithi005.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T23:41:54.961 INFO:teuthology.orchestra.run.smithi005.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T23:41:54.961 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:54.961 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2023-10-06T23:41:54.961 INFO:teuthology.orchestra.run.smithi005.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T23:41:54.962 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T23:41:54.962 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:54.962 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2023-10-06T23:41:54.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2023-10-06T23:41:55.041 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2023-10-06T23:41:55.042 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2023-10-06T23:41:55.042 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.02 2023-10-06T23:41:55.042 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 123.el8 2023-10-06T23:41:55.042 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2023-10-06T23:41:55.042 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-06T23:41:55.042 INFO:teuthology.orchestra.run.smithi005.stdout:Group : System Environment/Base 2023-10-06T23:41:55.043 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 9265450 2023-10-06T23:41:55.043 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2023-10-06T23:41:55.043 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-06T23:41:55.043 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-06T23:41:55.043 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-06T23:41:55.043 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-06T23:41:55.043 INFO:teuthology.orchestra.run.smithi005.stdout:Relocations : (not relocatable) 2023-10-06T23:41:55.044 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : Red Hat, Inc. 2023-10-06T23:41:55.044 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : Red Hat, Inc. 2023-10-06T23:41:55.044 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T23:41:55.044 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2023-10-06T23:41:55.044 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2023-10-06T23:41:55.044 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:41:55.044 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T23:41:55.045 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T23:41:55.045 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T23:41:55.045 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2023-10-06T23:41:55.045 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:41:55.045 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T23:41:55.046 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T23:41:55.046 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:41:55.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T23:41:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2023-10-06T23:42:00.518 INFO:teuthology.orchestra.run.smithi005.stderr:done 2023-10-06T23:42:00.520 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2023-10-06T23:42:00.542 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.xDNgWQQjWF 2023-10-06T23:42:00.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xDNgWQQjWF 2023-10-06T23:42:00.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.xDNgWQQjWF 2023-10-06T23:42:00.755 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.xDNgWQQjWF is 6KB 2023-10-06T23:42:00.802 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.xDNgWQQjWF 2023-10-06T23:42:00.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T23:42:00.889 INFO:teuthology.orchestra.run.smithi005.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-06T23:42:00.889 INFO:teuthology.orchestra.run.smithi005.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-06T23:42:00.889 INFO:teuthology.orchestra.run.smithi005.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T23:42:00.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:01.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2023-10-06T23:42:04.016 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T23:42:04.016 DEBUG:teuthology.orchestra.run.smithi112:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T23:42:04.080 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T23:42:04.081 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T23:42:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T23:42:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T23:42:04.084 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T23:42:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T23:42:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T23:42:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T23:42:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T23:42:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T23:42:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T23:42:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T23:42:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T23:42:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T23:42:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T23:42:04.088 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T23:42:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T23:42:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T23:42:04.091 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T23:42:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T23:42:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T23:42:04.094 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T23:42:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T23:42:04.096 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T23:42:04.096 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T23:42:04.096 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T23:42:04.096 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T23:42:04.096 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T23:42:04.096 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T23:42:04.096 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T23:42:04.096 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T23:42:04.097 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T23:42:04.097 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T23:42:04.097 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T23:42:04.097 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T23:42:04.097 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T23:42:04.097 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T23:42:04.097 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T23:42:04.098 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T23:42:04.098 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T23:42:04.098 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T23:42:04.098 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T23:42:04.098 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T23:42:04.098 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T23:42:04.098 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T23:42:04.098 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T23:42:04.099 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T23:42:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T23:42:04.101 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T23:42:04.102 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T23:42:04.103 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T23:42:04.104 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T23:42:04.105 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T23:42:04.106 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T23:42:04.107 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T23:42:04.107 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T23:42:04.107 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T23:42:04.107 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T23:42:04.107 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T23:42:04.107 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T23:42:04.107 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T23:42:04.108 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T23:42:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T23:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T23:42:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T23:42:04.112 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T23:42:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T23:42:04.114 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T23:42:04.115 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T23:42:04.116 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T23:42:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T23:42:04.118 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T23:42:04.119 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T23:42:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T23:42:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T23:42:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T23:42:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T23:42:04.124 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T23:42:04.125 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T23:42:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T23:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T23:42:04.128 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T23:42:04.129 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T23:42:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T23:42:04.131 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T23:42:04.132 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T23:42:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T23:42:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T23:42:04.135 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T23:42:04.136 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T23:42:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T23:42:04.138 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T23:42:04.139 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T23:42:04.140 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T23:42:04.141 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T23:42:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T23:42:04.143 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T23:42:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T23:42:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T23:42:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T23:42:04.147 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T23:42:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T23:42:04.149 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T23:42:04.150 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T23:42:04.150 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T23:42:04.150 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T23:42:04.150 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T23:42:04.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T23:42:04.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T23:42:04.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T23:42:04.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T23:42:04.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T23:42:04.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T23:42:04.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T23:42:04.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T23:42:04.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T23:42:04.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T23:42:04.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T23:42:04.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T23:42:04.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T23:42:04.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T23:42:04.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T23:42:04.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T23:42:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T23:42:04.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T23:42:04.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T23:42:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T23:42:04.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T23:42:04.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T23:42:04.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T23:42:04.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T23:42:04.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T23:42:04.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T23:42:04.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T23:42:04.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T23:42:04.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T23:42:04.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T23:42:04.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T23:42:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T23:42:04.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T23:42:04.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T23:42:04.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T23:42:04.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T23:42:04.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T23:42:04.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T23:42:04.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T23:42:04.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T23:42:04.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T23:42:04.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T23:42:04.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T23:42:04.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T23:42:04.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T23:42:04.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T23:42:04.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T23:42:04.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T23:42:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T23:42:04.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T23:42:04.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T23:42:04.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T23:42:04.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T23:42:04.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T23:42:04.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T23:42:04.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T23:42:04.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T23:42:04.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T23:42:04.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T23:42:04.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T23:42:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T23:42:04.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T23:42:04.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T23:42:04.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T23:42:04.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T23:42:04.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T23:42:04.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T23:42:04.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T23:42:04.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T23:42:04.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T23:42:04.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T23:42:04.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T23:42:04.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T23:42:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T23:42:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T23:42:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T23:42:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T23:42:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T23:42:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T23:42:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T23:42:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T23:42:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T23:42:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T23:42:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T23:42:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T23:42:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T23:42:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T23:42:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T23:42:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T23:42:04.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T23:42:04.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T23:42:04.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T23:42:04.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T23:42:04.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T23:42:04.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T23:42:04.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T23:42:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T23:42:04.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T23:42:04.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T23:42:04.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T23:42:04.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T23:42:04.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T23:42:04.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T23:42:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T23:42:04.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T23:42:04.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T23:42:04.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T23:42:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T23:42:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T23:42:04.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T23:42:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T23:42:04.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T23:42:04.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T23:42:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T23:42:04.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T23:42:04.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T23:42:04.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T23:42:04.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T23:42:04.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T23:42:04.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T23:42:04.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T23:42:04.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T23:42:04.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T23:42:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T23:42:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T23:42:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T23:42:04.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T23:42:04.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T23:42:04.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T23:42:04.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T23:42:04.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T23:42:04.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T23:42:04.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T23:42:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T23:42:04.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T23:42:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T23:42:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T23:42:04.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T23:42:04.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T23:42:04.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T23:42:04.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T23:42:04.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T23:42:04.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T23:42:04.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T23:42:04.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T23:42:04.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T23:42:04.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T23:42:04.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T23:42:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T23:42:04.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T23:42:04.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T23:42:04.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T23:42:04.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T23:42:04.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T23:42:04.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T23:42:04.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T23:42:04.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T23:42:04.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T23:42:04.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T23:42:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T23:42:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T23:42:04.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T23:42:04.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T23:42:04.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T23:42:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T23:42:04.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T23:42:04.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T23:42:04.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T23:42:04.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T23:42:04.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T23:42:04.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T23:42:04.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T23:42:04.265 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.266 DEBUG:teuthology.orchestra.run.smithi112:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T23:42:04.292 INFO:teuthology.orchestra.run.smithi112.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T23:42:04.292 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T23:42:04.292 INFO:teuthology.orchestra.run.smithi112.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:42:04.292 INFO:teuthology.orchestra.run.smithi112.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:42:04.292 INFO:teuthology.orchestra.run.smithi112.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.292 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:42:04.292 INFO:teuthology.orchestra.run.smithi112.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:42:04.292 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.293 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2023-10-06T23:42:04.294 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2023-10-06T23:42:04.372 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2023-10-06T23:42:04.372 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2023-10-06T23:42:04.372 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.02 2023-10-06T23:42:04.372 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 123.el8 2023-10-06T23:42:04.372 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2023-10-06T23:42:04.372 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-06T23:42:04.373 INFO:teuthology.orchestra.run.smithi112.stdout:Group : System Environment/Base 2023-10-06T23:42:04.373 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 9265450 2023-10-06T23:42:04.373 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2023-10-06T23:42:04.373 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-06T23:42:04.373 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout:Relocations : (not relocatable) 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : Red Hat, Inc. 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : Red Hat, Inc. 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2023-10-06T23:42:04.374 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:42:04.375 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T23:42:04.375 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T23:42:04.375 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T23:42:04.375 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2023-10-06T23:42:04.375 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:42:04.376 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T23:42:04.376 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T23:42:04.377 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:04.377 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T23:42:08.848 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2023-10-06T23:42:10.913 INFO:teuthology.orchestra.run.smithi112.stderr:done 2023-10-06T23:42:10.915 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2023-10-06T23:42:10.956 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.XAJUBv6xoP 2023-10-06T23:42:10.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XAJUBv6xoP 2023-10-06T23:42:11.029 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.XAJUBv6xoP 2023-10-06T23:42:11.181 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.XAJUBv6xoP is 6KB 2023-10-06T23:42:11.229 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.XAJUBv6xoP 2023-10-06T23:42:11.245 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T23:42:11.310 INFO:teuthology.orchestra.run.smithi112.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-06T23:42:11.311 INFO:teuthology.orchestra.run.smithi112.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-06T23:42:11.311 INFO:teuthology.orchestra.run.smithi112.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T23:42:11.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:11.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2023-10-06T23:42:31.027 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T23:42:31.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-06T23:42:31.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:42:31.079 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T23:42:41.488 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-10-06T23:42:41.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T23:42:41.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:42:57.584 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T23:42:57.585 DEBUG:teuthology.orchestra.run.smithi088:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T23:42:57.643 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.644 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.644 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T23:42:57.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T23:42:57.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T23:42:57.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T23:42:57.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T23:42:57.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T23:42:57.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T23:42:57.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T23:42:57.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T23:42:57.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T23:42:57.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T23:42:57.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T23:42:57.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T23:42:57.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T23:42:57.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T23:42:57.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T23:42:57.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T23:42:57.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T23:42:57.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T23:42:57.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T23:42:57.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T23:42:57.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T23:42:57.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T23:42:57.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T23:42:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T23:42:57.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T23:42:57.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T23:42:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T23:42:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T23:42:57.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T23:42:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T23:42:57.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T23:42:57.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T23:42:57.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T23:42:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T23:42:57.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T23:42:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T23:42:57.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T23:42:57.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T23:42:57.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T23:42:57.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T23:42:57.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T23:42:57.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T23:42:57.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T23:42:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T23:42:57.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T23:42:57.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T23:42:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T23:42:57.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T23:42:57.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T23:42:57.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T23:42:57.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T23:42:57.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T23:42:57.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T23:42:57.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T23:42:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T23:42:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T23:42:57.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T23:42:57.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T23:42:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T23:42:57.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T23:42:57.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T23:42:57.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T23:42:57.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T23:42:57.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T23:42:57.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T23:42:57.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T23:42:57.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T23:42:57.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T23:42:57.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T23:42:57.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T23:42:57.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T23:42:57.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T23:42:57.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T23:42:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T23:42:57.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T23:42:57.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T23:42:57.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T23:42:57.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T23:42:57.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T23:42:57.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T23:42:57.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T23:42:57.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T23:42:57.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T23:42:57.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T23:42:57.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T23:42:57.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T23:42:57.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T23:42:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T23:42:57.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T23:42:57.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T23:42:57.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T23:42:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T23:42:57.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T23:42:57.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T23:42:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T23:42:57.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T23:42:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T23:42:57.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T23:42:57.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T23:42:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T23:42:57.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T23:42:57.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T23:42:57.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T23:42:57.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T23:42:57.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T23:42:57.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T23:42:57.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T23:42:57.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T23:42:57.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T23:42:57.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T23:42:57.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T23:42:57.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T23:42:57.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T23:42:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T23:42:57.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T23:42:57.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T23:42:57.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T23:42:57.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T23:42:57.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T23:42:57.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T23:42:57.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T23:42:57.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T23:42:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T23:42:57.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T23:42:57.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T23:42:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T23:42:57.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T23:42:57.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T23:42:57.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T23:42:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T23:42:57.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T23:42:57.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T23:42:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T23:42:57.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T23:42:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T23:42:57.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T23:42:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T23:42:57.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T23:42:57.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T23:42:57.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T23:42:57.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T23:42:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T23:42:57.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T23:42:57.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T23:42:57.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T23:42:57.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T23:42:57.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T23:42:57.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T23:42:57.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T23:42:57.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T23:42:57.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T23:42:57.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T23:42:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T23:42:57.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T23:42:57.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T23:42:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T23:42:57.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T23:42:57.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T23:42:57.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T23:42:57.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T23:42:57.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T23:42:57.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T23:42:57.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T23:42:57.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T23:42:57.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T23:42:57.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T23:42:57.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T23:42:57.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T23:42:57.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T23:42:57.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T23:42:57.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T23:42:57.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T23:42:57.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T23:42:57.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T23:42:57.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T23:42:57.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T23:42:57.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T23:42:57.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T23:42:57.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T23:42:57.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T23:42:57.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T23:42:57.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T23:42:57.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T23:42:57.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T23:42:57.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T23:42:57.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T23:42:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T23:42:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T23:42:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T23:42:57.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T23:42:57.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T23:42:57.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T23:42:57.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T23:42:57.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T23:42:57.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T23:42:57.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T23:42:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T23:42:57.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T23:42:57.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T23:42:57.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T23:42:57.820 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.820 DEBUG:teuthology.orchestra.run.smithi088:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T23:42:57.847 INFO:teuthology.orchestra.run.smithi088.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T23:42:57.847 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T23:42:57.848 INFO:teuthology.orchestra.run.smithi088.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T23:42:57.849 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.849 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-10-06T23:42:57.849 INFO:teuthology.orchestra.run.smithi088.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T23:42:57.849 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T23:42:57.849 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.849 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-10-06T23:42:57.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2023-10-06T23:42:57.926 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2023-10-06T23:42:57.926 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2023-10-06T23:42:57.926 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2023-10-06T23:42:57.926 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 123.el8 2023-10-06T23:42:57.926 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9265450 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : Red Hat, Inc. 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : Red Hat, Inc. 2023-10-06T23:42:57.927 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:42:57.928 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T23:42:57.929 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T23:42:57.929 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:42:57.929 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T23:43:00.201 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-10-06T23:43:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-10-06T23:43:02.625 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-10-06T23:43:02.641 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.jxHuzTqrGQ 2023-10-06T23:43:02.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jxHuzTqrGQ 2023-10-06T23:43:02.714 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.jxHuzTqrGQ 2023-10-06T23:43:02.872 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.jxHuzTqrGQ is 6KB 2023-10-06T23:43:02.920 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.jxHuzTqrGQ 2023-10-06T23:43:02.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T23:43:03.007 INFO:teuthology.orchestra.run.smithi088.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-06T23:43:03.007 INFO:teuthology.orchestra.run.smithi088.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-06T23:43:03.008 INFO:teuthology.orchestra.run.smithi088.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T23:43:03.009 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-06T23:43:03.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2023-10-06T23:43:31.058 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T23:43:33.166 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T23:43:33.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T23:43:33.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:43:40.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-06T23:43:40.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:43:40.511 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-10-06T23:43:40.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-06T23:43:40.921 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T23:43:40.921 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-10-06T23:43:40.963 INFO:teuthology.orchestra.run.smithi005.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T23:43:40.963 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:43:40.963 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T23:43:40.963 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T23:43:41.491 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T23:43:41.964 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T23:43:41.964 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T23:43:42.113 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2023-10-06T23:43:42.153 DEBUG:teuthology.parallel:result is None 2023-10-06T23:43:50.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T23:43:50.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:43:53.925 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-10-06T23:43:54.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T23:43:54.347 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T23:43:54.347 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-10-06T23:43:54.391 INFO:teuthology.orchestra.run.smithi112.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T23:43:54.391 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:43:54.391 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T23:43:54.391 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T23:43:55.392 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-10-06T23:43:55.392 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T23:43:55.663 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2023-10-06T23:43:55.690 DEBUG:teuthology.parallel:result is None 2023-10-06T23:44:07.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-06T23:44:16.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T23:44:16.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:44:19.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-06T23:44:31.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T23:44:31.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:44:50.298 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-06T23:45:05.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T23:45:05.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:45:05.876 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-10-06T23:45:06.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T23:45:06.335 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T23:45:06.335 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-10-06T23:45:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T23:45:06.376 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T23:45:06.376 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T23:45:06.376 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T23:45:07.377 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T23:45:07.377 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T23:45:07.503 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2023-10-06T23:45:07.539 DEBUG:teuthology.parallel:result is None 2023-10-06T23:45:07.539 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T23:45:07.546 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T23:45:07.546 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T23:45:07.552 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T23:45:07.558 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T23:45:07.609 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T23:45:07.615 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T23:45:07.623 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T23:45:07.624 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T23:45:07.628 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T23:45:07.644 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T23:45:07.713 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T23:45:07.719 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T23:45:07.719 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T23:45:07.724 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T23:45:07.733 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T23:45:07.795 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T23:45:07.808 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T23:45:07.818 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T23:45:07.824 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T23:45:07.835 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T23:45:07.846 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T23:45:07.849 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T23:45:07.857 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T23:45:07.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T23:45:07.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T23:45:07.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T23:45:07.933 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T23:45:07.973 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T23:45:07.974 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T23:45:07.978 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T23:45:07.982 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T23:45:08.025 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T23:45:08.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T23:45:08.219 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T23:45:08.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T23:45:08.373 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-06T23:45:08.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T23:45:08.441 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T23:45:08.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T23:45:08.596 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T23:45:08.666 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T23:45:08.749 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T23:45:08.749 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T23:45:08.817 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T23:45:08.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T23:45:08.981 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T23:45:09.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T23:45:09.135 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T23:45:09.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T23:45:09.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2023-10-06T23:45:09.207 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-10-06T23:45:09.211 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2023-10-06T23:45:09.339 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T23:45:09.359 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T23:45:09.387 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T23:45:09.778 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T23:45:09.787 INFO:teuthology.task.internal:Starting timer... 2023-10-06T23:45:09.787 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T23:45:09.840 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T23:45:09.849 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T23:45:09.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2023-10-06T23:45:09.972 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2023-10-06T23:45:09.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-10-06T23:45:10.082 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2023-10-06T23:45:10.085 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2023-10-06T23:45:10.210 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2023-10-06T23:45:10.213 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T23:45:10.214 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2023-10-06T23:45:10.266 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2023-10-06T23:45:10.266 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-10-06T23:45:10.320 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-10-06T23:45:10.321 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2023-10-06T23:45:10.387 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2023-10-06T23:45:10.387 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive'} 2023-10-06T23:45:10.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T23:45:10.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:45:10.460 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T23:45:10.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:45:10.528 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T23:45:10.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:45:10.600 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T23:45:10.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2023-10-06T23:45:10.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-10-06T23:45:10.739 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2023-10-06T23:45:10.822 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T23:45:10.832 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T23:45:10.833 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T23:45:10.851 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T23:45:10.852 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi088.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T23:58:56.011 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2023-10-06T23:58:56.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-06T23:58:56.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:58:56.103 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-10-06T23:58:56.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-06T23:58:56.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T23:58:56.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:58:56.310 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-10-06T23:58:56.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T23:58:56.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T23:58:56.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T23:58:56.523 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-10-06T23:58:56.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T23:58:56.636 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T23:58:56.647 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T23:58:56.647 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T23:58:56.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T23:58:56.652 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T23:58:56.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T23:58:56.657 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T23:58:56.657 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T23:58:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T23:58:56.729 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T23:58:56.754 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T23:58:56.765 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T23:58:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T23:58:56.789 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T23:58:56.861 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2023-10-06T23:58:56.863 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-10-06T23:58:56.879 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2023-10-06T23:58:56.891 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2023-10-06T23:58:56.892 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-10-06T23:58:56.909 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2023-10-06T23:58:56.926 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T23:58:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T23:58:56.959 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T23:58:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T23:58:56.977 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T23:58:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-10-06T23:58:57.056 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T23:58:57.056 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-10-06T23:58:57.056 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.056 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.056 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.056 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.059 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2023-10-06T23:58:57.062 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2023-10-06T23:58:57.067 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T23:58:57.067 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-10-06T23:58:57.067 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.067 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.067 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.067 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.069 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T23:58:57.069 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2023-10-06T23:58:57.069 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.070 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.070 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.070 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:58:57.071 INFO:teuthology.run_tasks:Running task pexec... 2023-10-06T23:58:57.080 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-06T23:58:57.081 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi005.front.sepia.ceph.com 2023-10-06T23:58:57.081 DEBUG:teuthology.orchestra.run.smithi005:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T23:58:57.082 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T23:58:57.082 DEBUG:teuthology.orchestra.run.smithi088:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T23:58:57.082 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T23:58:57.082 DEBUG:teuthology.orchestra.run.smithi112:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T23:58:57.562 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T23:58:57.564 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T23:58:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-06T23:58:58.718 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:27 ago on Fri 06 Oct 2023 11:56:31 PM UTC. 2023-10-06T23:58:58.723 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:02:23 ago on Fri 06 Oct 2023 11:56:35 PM UTC. 2023-10-06T23:58:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:06 ago on Fri 06 Oct 2023 11:56:52 PM UTC. 2023-10-06T23:59:00.535 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-10-06T23:59:00.537 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-10-06T23:59:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2023-10-06T23:59:00.537 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-10-06T23:59:00.537 INFO:teuthology.orchestra.run.smithi112.stdout:Resetting modules: 2023-10-06T23:59:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: container-tools 2023-10-06T23:59:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:00.537 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2023-10-06T23:59:00.537 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-10-06T23:59:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:00.564 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-06T23:59:00.565 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-06T23:59:00.565 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-10-06T23:59:00.565 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-06T23:59:00.565 INFO:teuthology.orchestra.run.smithi088.stdout:Resetting modules: 2023-10-06T23:59:00.565 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools 2023-10-06T23:59:00.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:00.566 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-06T23:59:00.566 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-06T23:59:00.566 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:00.815 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-06T23:59:00.816 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-10-06T23:59:00.816 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2023-10-06T23:59:00.816 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-10-06T23:59:00.816 INFO:teuthology.orchestra.run.smithi005.stdout:Resetting modules: 2023-10-06T23:59:00.816 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools 2023-10-06T23:59:00.816 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:00.817 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-10-06T23:59:00.817 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-10-06T23:59:00.817 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:01.776 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:02:26 ago on Fri 06 Oct 2023 11:56:35 PM UTC. 2023-10-06T23:59:01.805 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:30 ago on Fri 06 Oct 2023 11:56:31 PM UTC. 2023-10-06T23:59:02.091 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:09 ago on Fri 06 Oct 2023 11:56:52 PM UTC. 2023-10-06T23:59:05.103 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-10-06T23:59:05.193 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-06T23:59:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-06T23:59:05.710 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:05.776 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:05.939 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:06.965 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:02:31 ago on Fri 06 Oct 2023 11:56:35 PM UTC. 2023-10-06T23:59:07.110 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:35 ago on Fri 06 Oct 2023 11:56:31 PM UTC. 2023-10-06T23:59:07.730 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:15 ago on Fri 06 Oct 2023 11:56:52 PM UTC. 2023-10-06T23:59:08.740 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================================ 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================================ 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout:Installing group/module packages: 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-06T23:59:08.839 INFO:teuthology.orchestra.run.smithi112.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout:Installing module profiles: 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout: container-tools/common 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling module streams: 2023-10-06T23:59:08.840 INFO:teuthology.orchestra.run.smithi112.stdout: container-tools rhel8 2023-10-06T23:59:08.841 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:08.841 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2023-10-06T23:59:08.841 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================================ 2023-10-06T23:59:08.841 INFO:teuthology.orchestra.run.smithi112.stdout:Install 10 Packages 2023-10-06T23:59:08.841 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:08.841 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 18 M 2023-10-06T23:59:08.842 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 65 M 2023-10-06T23:59:08.842 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2023-10-06T23:59:08.961 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-06T23:59:09.060 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================================ 2023-10-06T23:59:09.060 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-10-06T23:59:09.060 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================================ 2023-10-06T23:59:09.060 INFO:teuthology.orchestra.run.smithi088.stdout:Installing group/module packages: 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-06T23:59:09.061 INFO:teuthology.orchestra.run.smithi088.stdout:Installing module profiles: 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools/common 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling module streams: 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools rhel8 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================================ 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout:Install 10 Packages 2023-10-06T23:59:09.062 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:09.063 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 18 M 2023-10-06T23:59:09.063 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 65 M 2023-10-06T23:59:09.063 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-06T23:59:09.121 INFO:teuthology.orchestra.run.smithi112.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 336 kB/s | 94 kB 00:00 2023-10-06T23:59:09.197 INFO:teuthology.orchestra.run.smithi112.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 70 kB/s | 25 kB 00:00 2023-10-06T23:59:09.214 INFO:teuthology.orchestra.run.smithi112.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 110 kB/s | 41 kB 00:00 2023-10-06T23:59:09.217 INFO:teuthology.orchestra.run.smithi088.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 612 kB/s | 94 kB 00:00 2023-10-06T23:59:09.242 INFO:teuthology.orchestra.run.smithi088.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 139 kB/s | 25 kB 00:00 2023-10-06T23:59:09.247 INFO:teuthology.orchestra.run.smithi112.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 393 kB/s | 49 kB 00:00 2023-10-06T23:59:09.269 INFO:teuthology.orchestra.run.smithi088.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 200 kB/s | 41 kB 00:00 2023-10-06T23:59:09.360 INFO:teuthology.orchestra.run.smithi088.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 347 kB/s | 49 kB 00:00 2023-10-06T23:59:09.422 INFO:teuthology.orchestra.run.smithi112.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.3 MB/s | 524 kB 00:00 2023-10-06T23:59:09.468 INFO:teuthology.orchestra.run.smithi088.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.3 MB/s | 524 kB 00:00 2023-10-06T23:59:09.485 INFO:teuthology.orchestra.run.smithi088.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.2 MB/s | 149 kB 00:00 2023-10-06T23:59:09.498 INFO:teuthology.orchestra.run.smithi112.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 597 kB/s | 149 kB 00:00 2023-10-06T23:59:09.640 INFO:teuthology.orchestra.run.smithi112.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 981 kB/s | 213 kB 00:00 2023-10-06T23:59:09.702 INFO:teuthology.orchestra.run.smithi088.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 911 kB/s | 213 kB 00:00 2023-10-06T23:59:09.861 INFO:teuthology.orchestra.run.smithi088.stdout:(8/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 19 MB/s | 7.0 MB 00:00 2023-10-06T23:59:09.865 INFO:teuthology.orchestra.run.smithi112.stdout:(8/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 19 MB/s | 7.0 MB 00:00 2023-10-06T23:59:09.875 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-06T23:59:09.974 INFO:teuthology.orchestra.run.smithi112.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 10 MB/s | 8.0 MB 00:00 2023-10-06T23:59:09.982 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================================ 2023-10-06T23:59:09.982 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-10-06T23:59:09.982 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================================ 2023-10-06T23:59:09.982 INFO:teuthology.orchestra.run.smithi005.stdout:Installing group/module packages: 2023-10-06T23:59:09.982 INFO:teuthology.orchestra.run.smithi005.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-06T23:59:09.982 INFO:teuthology.orchestra.run.smithi005.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-06T23:59:09.983 INFO:teuthology.orchestra.run.smithi005.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-06T23:59:09.984 INFO:teuthology.orchestra.run.smithi005.stdout:Installing module profiles: 2023-10-06T23:59:09.984 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools/common 2023-10-06T23:59:09.984 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:09.984 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2023-10-06T23:59:09.984 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools rhel8 2023-10-06T23:59:09.984 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:09.984 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-10-06T23:59:09.984 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================================ 2023-10-06T23:59:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:Install 10 Packages 2023-10-06T23:59:09.985 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 18 M 2023-10-06T23:59:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 65 M 2023-10-06T23:59:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-10-06T23:59:10.036 INFO:teuthology.orchestra.run.smithi088.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 10 MB/s | 8.0 MB 00:00 2023-10-06T23:59:10.040 INFO:teuthology.orchestra.run.smithi112.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 5.5 MB/s | 2.2 MB 00:00 2023-10-06T23:59:10.041 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2023-10-06T23:59:10.041 INFO:teuthology.orchestra.run.smithi112.stdout:Total 15 MB/s | 18 MB 00:01 2023-10-06T23:59:10.087 INFO:teuthology.orchestra.run.smithi088.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 5.7 MB/s | 2.2 MB 00:00 2023-10-06T23:59:10.087 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-06T23:59:10.087 INFO:teuthology.orchestra.run.smithi088.stdout:Total 18 MB/s | 18 MB 00:01 2023-10-06T23:59:10.149 INFO:teuthology.orchestra.run.smithi005.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 576 kB/s | 94 kB 00:00 2023-10-06T23:59:10.182 INFO:teuthology.orchestra.run.smithi005.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 126 kB/s | 25 kB 00:00 2023-10-06T23:59:10.207 INFO:teuthology.orchestra.run.smithi005.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 184 kB/s | 41 kB 00:00 2023-10-06T23:59:10.274 INFO:teuthology.orchestra.run.smithi005.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 393 kB/s | 49 kB 00:00 2023-10-06T23:59:10.325 INFO:teuthology.orchestra.run.smithi005.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.6 MB/s | 524 kB 00:00 2023-10-06T23:59:10.370 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2023-10-06T23:59:10.392 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2023-10-06T23:59:10.393 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2023-10-06T23:59:10.400 INFO:teuthology.orchestra.run.smithi005.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.2 MB/s | 149 kB 00:00 2023-10-06T23:59:10.417 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-06T23:59:10.439 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-06T23:59:10.440 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-06T23:59:10.467 INFO:teuthology.orchestra.run.smithi005.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.5 MB/s | 213 kB 00:00 2023-10-06T23:59:10.692 INFO:teuthology.orchestra.run.smithi005.stdout:(8/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 24 MB/s | 7.0 MB 00:00 2023-10-06T23:59:10.793 INFO:teuthology.orchestra.run.smithi005.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 14 MB/s | 8.0 MB 00:00 2023-10-06T23:59:10.868 INFO:teuthology.orchestra.run.smithi005.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 5.5 MB/s | 2.2 MB 00:00 2023-10-06T23:59:10.868 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-10-06T23:59:10.868 INFO:teuthology.orchestra.run.smithi005.stdout:Total 21 MB/s | 18 MB 00:00 2023-10-06T23:59:10.901 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2023-10-06T23:59:10.906 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2023-10-06T23:59:10.953 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-06T23:59:10.958 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-06T23:59:11.211 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-10-06T23:59:11.236 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-10-06T23:59:11.236 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-10-06T23:59:11.490 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2023-10-06T23:59:11.541 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-06T23:59:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-06T23:59:11.732 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-10-06T23:59:11.737 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-10-06T23:59:11.752 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-06T23:59:11.882 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T23:59:11.955 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T23:59:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-06T23:59:12.216 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-06T23:59:12.280 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-10-06T23:59:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-06T23:59:12.466 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-06T23:59:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-06T23:59:12.649 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T23:59:12.752 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-06T23:59:12.840 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-06T23:59:12.861 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-06T23:59:13.070 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-06T23:59:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-06T23:59:13.607 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-06T23:59:13.666 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-06T23:59:14.318 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-06T23:59:14.565 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-06T23:59:14.603 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-06T23:59:14.827 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-06T23:59:14.892 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-06T23:59:14.979 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-06T23:59:15.051 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-06T23:59:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T23:59:15.251 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T23:59:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-06T23:59:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-06T23:59:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-06T23:59:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-06T23:59:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-06T23:59:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-06T23:59:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-06T23:59:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-06T23:59:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-06T23:59:17.007 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-06T23:59:17.007 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:02:41 ago on Fri 06 Oct 2023 11:56:35 PM UTC. 2023-10-06T23:59:17.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-06T23:59:17.147 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:45 ago on Fri 06 Oct 2023 11:56:31 PM UTC. 2023-10-06T23:59:17.757 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-06T23:59:17.757 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:25 ago on Fri 06 Oct 2023 11:56:52 PM UTC. 2023-10-06T23:59:21.587 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-10-06T23:59:21.600 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2023-10-06T23:59:21.773 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-06T23:59:21.803 INFO:teuthology.orchestra.run.smithi088.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:21.804 INFO:teuthology.orchestra.run.smithi088.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:21.804 INFO:teuthology.orchestra.run.smithi088.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T23:59:21.804 INFO:teuthology.orchestra.run.smithi088.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-06T23:59:21.804 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:21.804 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-06T23:59:21.818 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:21.818 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2023-10-06T23:59:21.819 INFO:teuthology.orchestra.run.smithi112.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:21.819 INFO:teuthology.orchestra.run.smithi112.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T23:59:21.819 INFO:teuthology.orchestra.run.smithi112.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:21.819 INFO:teuthology.orchestra.run.smithi112.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-06T23:59:21.819 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-06T23:59:21.819 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-06T23:59:21.820 INFO:teuthology.orchestra.run.smithi112.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:21.820 INFO:teuthology.orchestra.run.smithi112.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:21.820 INFO:teuthology.orchestra.run.smithi112.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T23:59:21.820 INFO:teuthology.orchestra.run.smithi112.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-06T23:59:21.820 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:21.821 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-10-06T23:59:22.009 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:22.010 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-10-06T23:59:22.010 INFO:teuthology.orchestra.run.smithi005.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:22.010 INFO:teuthology.orchestra.run.smithi005.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T23:59:22.010 INFO:teuthology.orchestra.run.smithi005.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:22.010 INFO:teuthology.orchestra.run.smithi005.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-06T23:59:22.010 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-06T23:59:22.011 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-06T23:59:22.011 INFO:teuthology.orchestra.run.smithi005.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:22.011 INFO:teuthology.orchestra.run.smithi005.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T23:59:22.011 INFO:teuthology.orchestra.run.smithi005.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T23:59:22.011 INFO:teuthology.orchestra.run.smithi005.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-06T23:59:22.011 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:22.011 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-06T23:59:22.037 DEBUG:teuthology.parallel:result is None 2023-10-06T23:59:22.045 DEBUG:teuthology.parallel:result is None 2023-10-06T23:59:22.230 DEBUG:teuthology.parallel:result is None 2023-10-06T23:59:22.230 INFO:teuthology.run_tasks:Running task install... 2023-10-06T23:59:22.239 DEBUG:teuthology.task.install:project ceph 2023-10-06T23:59:22.239 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c'}} 2023-10-06T23:59:22.239 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c'} 2023-10-06T23:59:22.239 INFO:teuthology.task.install:Using flavor: default 2023-10-06T23:59:22.245 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T23:59:22.245 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T23:59:22.245 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'tag': None, 'wait_for_package': False} 2023-10-06T23:59:22.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:59:22.247 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'tag': None, 'wait_for_package': False} 2023-10-06T23:59:22.248 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:59:22.249 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'tag': None, 'wait_for_package': False} 2023-10-06T23:59:22.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:59:22.389 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/ 2023-10-06T23:59:22.389 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6616.g14d8d032 2023-10-06T23:59:22.395 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/ 2023-10-06T23:59:22.395 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6616.g14d8d032 2023-10-06T23:59:22.478 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/ 2023-10-06T23:59:22.479 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6616.g14d8d032 2023-10-06T23:59:22.669 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T23:59:22.670 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-06T23:59:22.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T23:59:22.674 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T23:59:22.674 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T23:59:22.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T23:59:22.741 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-06T23:59:22.741 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/14d8d032507701c76ca224e769ee65a96b660a8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T23:59:22.746 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-06T23:59:22.746 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/14d8d032507701c76ca224e769ee65a96b660a8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T23:59:22.748 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T23:59:22.749 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T23:59:22.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T23:59:22.818 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-06T23:59:22.818 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/14d8d032507701c76ca224e769ee65a96b660a8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T23:59:22.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T23:59:22.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T23:59:22.931 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T23:59:22.951 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T23:59:22.955 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T23:59:23.018 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-10-06T23:59:23.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-10-06T23:59:23.029 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2023-10-06T23:59:23.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2023-10-06T23:59:23.034 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T23:59:23.103 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2023-10-06T23:59:23.106 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2023-10-06T23:59:23.467 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:23.574 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:23.592 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:23.778 INFO:teuthology.orchestra.run.smithi088.stdout:44 files removed 2023-10-06T23:59:23.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-06T23:59:23.917 INFO:teuthology.orchestra.run.smithi005.stdout:44 files removed 2023-10-06T23:59:23.936 INFO:teuthology.orchestra.run.smithi112.stdout:44 files removed 2023-10-06T23:59:23.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-06T23:59:23.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-06T23:59:24.278 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:24.474 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:24.525 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-06T23:59:25.362 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 134 kB/s | 81 kB 00:00 2023-10-06T23:59:25.682 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 113 kB/s | 81 kB 00:00 2023-10-06T23:59:25.742 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 116 kB/s | 81 kB 00:00 2023-10-06T23:59:26.046 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-10-06T23:59:26.367 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-10-06T23:59:26.383 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-10-06T23:59:26.530 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 3.2 kB/s | 1.5 kB 00:00 2023-10-06T23:59:26.643 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 5.9 kB/s | 1.5 kB 00:00 2023-10-06T23:59:26.698 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-06T23:59:26.719 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-10-06T23:59:26.794 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-06T23:59:26.927 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-10-06T23:59:27.820 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-06T23:59:28.873 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-10-06T23:59:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 16 MB 00:02 2023-10-06T23:59:32.399 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 497 kB/s | 24 kB 00:00 2023-10-06T23:59:33.123 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 435 kB/s | 24 kB 00:00 2023-10-06T23:59:33.241 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-10-06T23:59:33.709 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 53 MB 00:01 2023-10-06T23:59:34.325 INFO:teuthology.orchestra.run.smithi088.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-10-06T23:59:34.945 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 29 MB/s | 47 MB 00:01 2023-10-06T23:59:43.684 INFO:teuthology.orchestra.run.smithi088.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 MB/s | 47 MB 00:01 2023-10-06T23:59:43.950 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 MB/s | 47 MB 00:01 2023-10-06T23:59:44.325 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 MB/s | 53 MB 00:01 2023-10-06T23:59:55.780 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T23:59:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T23:59:55.797 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-06T23:59:55.798 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-06T23:59:55.800 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-06T23:59:55.801 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T23:59:55.803 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T23:59:55.807 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T23:59:55.808 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T23:59:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-06T23:59:55.971 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================================================== 2023-10-06T23:59:55.972 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-10-06T23:59:55.972 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================================================== 2023-10-06T23:59:55.972 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-06T23:59:55.972 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-06T23:59:55.972 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T23:59:55.972 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.4 k 2023-10-06T23:59:55.972 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 5.4 M 2023-10-06T23:59:55.972 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 918 k 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 167 k 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 1.6 M 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 132 k 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 1.8 M 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 7.4 M 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 47 k 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 14 M 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 49 M 2023-10-06T23:59:55.973 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 261 k 2023-10-06T23:59:55.974 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 192 k 2023-10-06T23:59:55.974 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 260 k 2023-10-06T23:59:55.974 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 18 k 2023-10-06T23:59:55.974 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-06T23:59:55.974 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T23:59:55.974 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T23:59:55.974 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 31 k 2023-10-06T23:59:55.974 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 840 k 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 139 k 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 196 k 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 371 k 2023-10-06T23:59:55.975 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 364 k 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 107 k 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 94 k 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.6 M 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 179 k 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T23:59:55.976 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-10-06T23:59:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T23:59:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 23 M 2023-10-06T23:59:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 23 k 2023-10-06T23:59:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 2.3 M 2023-10-06T23:59:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 242 k 2023-10-06T23:59:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 4.6 M 2023-10-06T23:59:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 18 M 2023-10-06T23:59:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 15 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 24 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 183 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-06T23:59:55.978 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T23:59:55.979 INFO:teuthology.orchestra.run.smithi088.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-06T23:59:55.979 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-06T23:59:55.979 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T23:59:55.979 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 518 k 2023-10-06T23:59:55.979 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-06T23:59:55.979 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.9 M 2023-10-06T23:59:55.979 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T23:59:55.980 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 45 k 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 126 k 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T23:59:55.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-06T23:59:55.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T23:59:55.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T23:59:55.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T23:59:55.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T23:59:55.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T23:59:55.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T23:59:55.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T23:59:55.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T23:59:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T23:59:55.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T23:59:55.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T23:59:55.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T23:59:55.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T23:59:55.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T23:59:55.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-06T23:59:55.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T23:59:55.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T23:59:55.985 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T23:59:55.986 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T23:59:55.986 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T23:59:55.986 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T23:59:55.986 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T23:59:55.986 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T23:59:55.986 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T23:59:55.986 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling module streams: 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql 10 2023-10-06T23:59:55.987 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:55.988 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-06T23:59:55.988 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================================================== 2023-10-06T23:59:55.988 INFO:teuthology.orchestra.run.smithi088.stdout:Install 128 Packages 2023-10-06T23:59:55.988 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 3 Packages 2023-10-06T23:59:55.988 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T23:59:55.988 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 208 M 2023-10-06T23:59:55.989 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-06T23:59:56.246 INFO:teuthology.orchestra.run.smithi088.stdout:(1/131): ceph-18.0.0-6616.g14d8d032.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2023-10-06T23:59:56.587 INFO:teuthology.orchestra.run.smithi088.stdout:(2/131): ceph-fuse-18.0.0-6616.g14d8d032.el8.x8 2.6 MB/s | 918 kB 00:00 2023-10-06T23:59:56.663 INFO:teuthology.orchestra.run.smithi088.stdout:(3/131): ceph-immutable-object-cache-18.0.0-661 2.2 MB/s | 167 kB 00:00 2023-10-06T23:59:56.764 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T23:59:56.765 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T23:59:56.780 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-06T23:59:56.781 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-06T23:59:56.783 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-06T23:59:56.784 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T23:59:56.786 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T23:59:56.790 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T23:59:56.791 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T23:59:56.923 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T23:59:56.924 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T23:59:56.939 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-06T23:59:56.940 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-06T23:59:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-06T23:59:56.941 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-06T23:59:56.943 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T23:59:56.945 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T23:59:56.948 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T23:59:56.950 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.4 k 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 5.4 M 2023-10-06T23:59:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 918 k 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 167 k 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 1.6 M 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 132 k 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 1.8 M 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 7.4 M 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 47 k 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 14 M 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 49 M 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 261 k 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 192 k 2023-10-06T23:59:56.956 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 260 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 18 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 31 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 840 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 139 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T23:59:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 196 k 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 371 k 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 364 k 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 107 k 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 94 k 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.6 M 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 179 k 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2023-10-06T23:59:56.958 INFO:teuthology.orchestra.run.smithi005.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 23 M 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 23 k 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 2.3 M 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 242 k 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 4.6 M 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 18 M 2023-10-06T23:59:56.959 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 15 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 24 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 183 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-06T23:59:56.960 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 518 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.9 M 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T23:59:56.961 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T23:59:56.962 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-06T23:59:56.962 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T23:59:56.962 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T23:59:56.962 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T23:59:56.962 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T23:59:56.962 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T23:59:56.962 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T23:59:56.962 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T23:59:56.963 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T23:59:56.964 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 45 k 2023-10-06T23:59:56.964 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 126 k 2023-10-06T23:59:56.964 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T23:59:56.964 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-06T23:59:56.964 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T23:59:56.965 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T23:59:56.965 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T23:59:56.965 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T23:59:56.965 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T23:59:56.965 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T23:59:56.965 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T23:59:56.966 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T23:59:56.966 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T23:59:56.966 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T23:59:56.966 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T23:59:56.966 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T23:59:56.967 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T23:59:56.967 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T23:59:56.967 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T23:59:56.967 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T23:59:56.967 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T23:59:56.968 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T23:59:56.968 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T23:59:56.968 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T23:59:56.968 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T23:59:56.968 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T23:59:56.968 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-06T23:59:56.969 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T23:59:56.969 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T23:59:56.969 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-06T23:59:56.969 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T23:59:56.969 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T23:59:56.970 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T23:59:56.970 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T23:59:56.970 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T23:59:56.970 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-06T23:59:56.970 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T23:59:56.971 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T23:59:56.971 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T23:59:56.971 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T23:59:56.971 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T23:59:56.971 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T23:59:56.971 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T23:59:56.972 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T23:59:56.972 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T23:59:56.972 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T23:59:56.972 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-06T23:59:56.972 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T23:59:56.973 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-06T23:59:56.973 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T23:59:56.973 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T23:59:56.973 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2023-10-06T23:59:56.973 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql 10 2023-10-06T23:59:56.973 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:56.973 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-10-06T23:59:56.973 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-06T23:59:56.974 INFO:teuthology.orchestra.run.smithi005.stdout:Install 128 Packages 2023-10-06T23:59:56.974 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 3 Packages 2023-10-06T23:59:56.974 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-06T23:59:56.975 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 208 M 2023-10-06T23:59:56.975 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-10-06T23:59:57.088 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-10-06T23:59:57.096 INFO:teuthology.orchestra.run.smithi088.stdout:(4/131): ceph-mds-18.0.0-6616.g14d8d032.el8.x86 5.3 MB/s | 2.3 MB 00:00 2023-10-06T23:59:57.101 INFO:teuthology.orchestra.run.smithi112.stdout:=========================================================================================================================== 2023-10-06T23:59:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2023-10-06T23:59:57.101 INFO:teuthology.orchestra.run.smithi112.stdout:=========================================================================================================================== 2023-10-06T23:59:57.101 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2023-10-06T23:59:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-06T23:59:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T23:59:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.4 k 2023-10-06T23:59:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 5.4 M 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 918 k 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 167 k 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 1.6 M 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 132 k 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 1.8 M 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 7.4 M 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 47 k 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 14 M 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 49 M 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 261 k 2023-10-06T23:59:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 192 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 260 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 18 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 31 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 840 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 139 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T23:59:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 196 k 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 371 k 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 364 k 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 107 k 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 94 k 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.6 M 2023-10-06T23:59:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 179 k 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 23 M 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 23 k 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 2.3 M 2023-10-06T23:59:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 242 k 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 4.6 M 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 18 M 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 15 k 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 24 k 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-06T23:59:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 183 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 518 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.9 M 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T23:59:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T23:59:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 45 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 126 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T23:59:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T23:59:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-06T23:59:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T23:59:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-06T23:59:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling module streams: 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql 10 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout:=========================================================================================================================== 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout:Install 128 Packages 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 3 Packages 2023-10-06T23:59:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T23:59:57.115 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 208 M 2023-10-06T23:59:57.115 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2023-10-06T23:59:57.180 INFO:teuthology.orchestra.run.smithi088.stdout:(5/131): ceph-base-18.0.0-6616.g14d8d032.el8.x8 4.7 MB/s | 5.4 MB 00:01 2023-10-06T23:59:57.229 INFO:teuthology.orchestra.run.smithi005.stdout:(1/131): ceph-18.0.0-6616.g14d8d032.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-10-06T23:59:57.414 INFO:teuthology.orchestra.run.smithi112.stdout:(1/131): ceph-18.0.0-6616.g14d8d032.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-10-06T23:59:57.447 INFO:teuthology.orchestra.run.smithi088.stdout:(6/131): ceph-mgr-18.0.0-6616.g14d8d032.el8.x86 4.6 MB/s | 1.6 MB 00:00 2023-10-06T23:59:57.897 INFO:teuthology.orchestra.run.smithi088.stdout:(7/131): ceph-mon-18.0.0-6616.g14d8d032.el8.x86 6.4 MB/s | 4.6 MB 00:00 2023-10-06T23:59:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:(2/131): ceph-fuse-18.0.0-6616.g14d8d032.el8.x8 1.0 MB/s | 918 kB 00:00 2023-10-06T23:59:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:(3/131): ceph-immutable-object-cache-18.0.0-661 835 kB/s | 167 kB 00:00 2023-10-06T23:59:58.405 INFO:teuthology.orchestra.run.smithi112.stdout:(2/131): ceph-fuse-18.0.0-6616.g14d8d032.el8.x8 926 kB/s | 918 kB 00:00 2023-10-06T23:59:58.922 INFO:teuthology.orchestra.run.smithi112.stdout:(3/131): ceph-immutable-object-cache-18.0.0-661 324 kB/s | 167 kB 00:00 2023-10-06T23:59:59.729 INFO:teuthology.orchestra.run.smithi005.stdout:(4/131): ceph-mds-18.0.0-6616.g14d8d032.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-10-06T23:59:59.889 INFO:teuthology.orchestra.run.smithi088.stdout:(8/131): ceph-radosgw-18.0.0-6616.g14d8d032.el8 7.0 MB/s | 14 MB 00:01 2023-10-06T23:59:59.981 INFO:teuthology.orchestra.run.smithi112.stdout:(4/131): ceph-base-18.0.0-6616.g14d8d032.el8.x8 1.9 MB/s | 5.4 MB 00:02 2023-10-07T00:00:00.081 INFO:teuthology.orchestra.run.smithi088.stdout:(9/131): ceph-osd-18.0.0-6616.g14d8d032.el8.x86 6.8 MB/s | 18 MB 00:02 2023-10-07T00:00:00.098 INFO:teuthology.orchestra.run.smithi088.stdout:(10/131): ceph-selinux-18.0.0-6616.g14d8d032.el 117 kB/s | 24 kB 00:00 2023-10-07T00:00:00.146 INFO:teuthology.orchestra.run.smithi005.stdout:(5/131): ceph-base-18.0.0-6616.g14d8d032.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-10-07T00:00:00.198 INFO:teuthology.orchestra.run.smithi088.stdout:(11/131): cephfs-mirror-18.0.0-6616.g14d8d032.e 2.5 MB/s | 260 kB 00:00 2023-10-07T00:00:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:(6/131): ceph-mgr-18.0.0-6616.g14d8d032.el8.x86 3.1 MB/s | 1.6 MB 00:00 2023-10-07T00:00:00.282 INFO:teuthology.orchestra.run.smithi088.stdout:(12/131): libcephfs-devel-18.0.0-6616.g14d8d032 373 kB/s | 31 kB 00:00 2023-10-07T00:00:00.548 INFO:teuthology.orchestra.run.smithi112.stdout:(5/131): ceph-mgr-18.0.0-6616.g14d8d032.el8.x86 2.9 MB/s | 1.6 MB 00:00 2023-10-07T00:00:00.624 INFO:teuthology.orchestra.run.smithi088.stdout:(13/131): ceph-common-18.0.0-6616.g14d8d032.el8 4.9 MB/s | 23 MB 00:04 2023-10-07T00:00:00.682 INFO:teuthology.orchestra.run.smithi088.stdout:(14/131): libcephfs2-18.0.0-6616.g14d8d032.el8. 2.1 MB/s | 840 kB 00:00 2023-10-07T00:00:00.733 INFO:teuthology.orchestra.run.smithi088.stdout:(15/131): libcephsqlite-18.0.0-6616.g14d8d032.e 1.7 MB/s | 183 kB 00:00 2023-10-07T00:00:00.766 INFO:teuthology.orchestra.run.smithi088.stdout:(16/131): librados-devel-18.0.0-6616.g14d8d032. 1.6 MB/s | 139 kB 00:00 2023-10-07T00:00:00.815 INFO:teuthology.orchestra.run.smithi112.stdout:(6/131): ceph-mds-18.0.0-6616.g14d8d032.el8.x86 1.2 MB/s | 2.3 MB 00:01 2023-10-07T00:00:00.883 INFO:teuthology.orchestra.run.smithi088.stdout:(17/131): libradosstriper1-18.0.0-6616.g14d8d03 3.4 MB/s | 518 kB 00:00 2023-10-07T00:00:00.984 INFO:teuthology.orchestra.run.smithi088.stdout:(18/131): python3-ceph-argparse-18.0.0-6616.g14 447 kB/s | 45 kB 00:00 2023-10-07T00:00:01.100 INFO:teuthology.orchestra.run.smithi088.stdout:(19/131): python3-ceph-common-18.0.0-6616.g14d8 1.1 MB/s | 126 kB 00:00 2023-10-07T00:00:01.200 INFO:teuthology.orchestra.run.smithi088.stdout:(20/131): python3-cephfs-18.0.0-6616.g14d8d032. 1.9 MB/s | 196 kB 00:00 2023-10-07T00:00:01.367 INFO:teuthology.orchestra.run.smithi088.stdout:(21/131): python3-rados-18.0.0-6616.g14d8d032.e 2.2 MB/s | 371 kB 00:00 2023-10-07T00:00:01.543 INFO:teuthology.orchestra.run.smithi088.stdout:(22/131): python3-rbd-18.0.0-6616.g14d8d032.el8 2.0 MB/s | 364 kB 00:00 2023-10-07T00:00:01.635 INFO:teuthology.orchestra.run.smithi088.stdout:(23/131): python3-rgw-18.0.0-6616.g14d8d032.el8 1.1 MB/s | 107 kB 00:00 2023-10-07T00:00:01.743 INFO:teuthology.orchestra.run.smithi088.stdout:(24/131): rbd-fuse-18.0.0-6616.g14d8d032.el8.x8 866 kB/s | 94 kB 00:00 2023-10-07T00:00:01.835 INFO:teuthology.orchestra.run.smithi088.stdout:(25/131): librgw2-18.0.0-6616.g14d8d032.el8.x86 6.5 MB/s | 6.9 MB 00:01 2023-10-07T00:00:01.944 INFO:teuthology.orchestra.run.smithi088.stdout:(26/131): rbd-nbd-18.0.0-6616.g14d8d032.el8.x86 1.6 MB/s | 179 kB 00:00 2023-10-07T00:00:02.036 INFO:teuthology.orchestra.run.smithi088.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6616.g 252 kB/s | 23 kB 00:00 2023-10-07T00:00:02.127 INFO:teuthology.orchestra.run.smithi088.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6616.g14d8d03 1.4 MB/s | 132 kB 00:00 2023-10-07T00:00:02.155 INFO:teuthology.orchestra.run.smithi005.stdout:(7/131): ceph-mon-18.0.0-6616.g14d8d032.el8.x86 2.3 MB/s | 4.6 MB 00:02 2023-10-07T00:00:02.232 INFO:teuthology.orchestra.run.smithi112.stdout:(7/131): ceph-mon-18.0.0-6616.g14d8d032.el8.x86 2.7 MB/s | 4.6 MB 00:01 2023-10-07T00:00:02.453 INFO:teuthology.orchestra.run.smithi088.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6616.g14d8d 5.4 MB/s | 1.8 MB 00:00 2023-10-07T00:00:02.637 INFO:teuthology.orchestra.run.smithi088.stdout:(30/131): rbd-mirror-18.0.0-6616.g14d8d032.el8. 4.0 MB/s | 3.6 MB 00:00 2023-10-07T00:00:02.762 INFO:teuthology.orchestra.run.smithi088.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6616.g14 1.9 MB/s | 242 kB 00:00 2023-10-07T00:00:02.871 INFO:teuthology.orchestra.run.smithi088.stdout:(32/131): ceph-mgr-rook-18.0.0-6616.g14d8d032.e 438 kB/s | 47 kB 00:00 2023-10-07T00:00:02.977 INFO:teuthology.orchestra.run.smithi088.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6616.g1 145 kB/s | 15 kB 00:00 2023-10-07T00:00:03.091 INFO:teuthology.orchestra.run.smithi088.stdout:(34/131): ceph-volume-18.0.0-6616.g14d8d032.el8 2.2 MB/s | 261 kB 00:00 2023-10-07T00:00:03.206 INFO:teuthology.orchestra.run.smithi088.stdout:(35/131): cephadm-18.0.0-6616.g14d8d032.el8.noa 1.6 MB/s | 192 kB 00:00 2023-10-07T00:00:03.297 INFO:teuthology.orchestra.run.smithi088.stdout:(36/131): cephfs-top-18.0.0-6616.g14d8d032.el8. 198 kB/s | 18 kB 00:00 2023-10-07T00:00:03.614 INFO:teuthology.orchestra.run.smithi088.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 6.4 MB/s | 7.4 MB 00:01 2023-10-07T00:00:03.672 INFO:teuthology.orchestra.run.smithi088.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 816 kB/s | 306 kB 00:00 2023-10-07T00:00:03.731 INFO:teuthology.orchestra.run.smithi088.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-10-07T00:00:03.815 INFO:teuthology.orchestra.run.smithi088.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 293 kB/s | 59 kB 00:00 2023-10-07T00:00:03.870 INFO:teuthology.orchestra.run.smithi088.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.4 MB/s | 476 kB 00:00 2023-10-07T00:00:03.899 INFO:teuthology.orchestra.run.smithi088.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 524 kB/s | 44 kB 00:00 2023-10-07T00:00:03.941 INFO:teuthology.orchestra.run.smithi088.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.6 MB/s | 185 kB 00:00 2023-10-07T00:00:03.966 INFO:teuthology.orchestra.run.smithi088.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 494 kB/s | 33 kB 00:00 2023-10-07T00:00:04.001 INFO:teuthology.orchestra.run.smithi088.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 278 kB/s | 16 kB 00:00 2023-10-07T00:00:04.075 INFO:teuthology.orchestra.run.smithi088.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-10-07T00:00:04.108 INFO:teuthology.orchestra.run.smithi088.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-10-07T00:00:04.167 INFO:teuthology.orchestra.run.smithi088.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 884 kB/s | 81 kB 00:00 2023-10-07T00:00:04.192 INFO:teuthology.orchestra.run.smithi088.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-07T00:00:04.234 INFO:teuthology.orchestra.run.smithi088.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 263 kB/s | 18 kB 00:00 2023-10-07T00:00:04.301 INFO:teuthology.orchestra.run.smithi088.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 731 kB/s | 49 kB 00:00 2023-10-07T00:00:04.368 INFO:teuthology.orchestra.run.smithi088.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 881 kB/s | 59 kB 00:00 2023-10-07T00:00:04.435 INFO:teuthology.orchestra.run.smithi088.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 906 kB/s | 60 kB 00:00 2023-10-07T00:00:04.493 INFO:teuthology.orchestra.run.smithi088.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 3.9 MB/s | 1.2 MB 00:00 2023-10-07T00:00:04.560 INFO:teuthology.orchestra.run.smithi088.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-07T00:00:04.586 INFO:teuthology.orchestra.run.smithi088.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-10-07T00:00:04.628 INFO:teuthology.orchestra.run.smithi088.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 504 kB/s | 34 kB 00:00 2023-10-07T00:00:04.695 INFO:teuthology.orchestra.run.smithi088.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-07T00:00:04.902 INFO:teuthology.orchestra.run.smithi088.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 234 kB/s | 64 kB 00:00 2023-10-07T00:00:04.929 INFO:teuthology.orchestra.run.smithi088.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 80 kB/s | 19 kB 00:00 2023-10-07T00:00:04.971 INFO:teuthology.orchestra.run.smithi088.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 351 kB/s | 24 kB 00:00 2023-10-07T00:00:04.996 INFO:teuthology.orchestra.run.smithi088.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 438 kB/s | 29 kB 00:00 2023-10-07T00:00:05.038 INFO:teuthology.orchestra.run.smithi088.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 412 kB/s | 27 kB 00:00 2023-10-07T00:00:05.113 INFO:teuthology.orchestra.run.smithi088.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-07T00:00:05.189 INFO:teuthology.orchestra.run.smithi088.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-10-07T00:00:05.214 INFO:teuthology.orchestra.run.smithi088.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 613 kB/s | 61 kB 00:00 2023-10-07T00:00:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:(8/131): ceph-common-18.0.0-6616.g14d8d032.el8. 2.8 MB/s | 23 MB 00:08 2023-10-07T00:00:05.256 INFO:teuthology.orchestra.run.smithi088.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-10-07T00:00:05.281 INFO:teuthology.orchestra.run.smithi088.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 343 kB/s | 23 kB 00:00 2023-10-07T00:00:05.305 INFO:teuthology.orchestra.run.smithi005.stdout:(9/131): ceph-selinux-18.0.0-6616.g14d8d032.el8 419 kB/s | 24 kB 00:00 2023-10-07T00:00:05.321 INFO:teuthology.orchestra.run.smithi088.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 70 kB 00:00 2023-10-07T00:00:05.374 INFO:teuthology.orchestra.run.smithi088.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 896 kB/s | 47 kB 00:00 2023-10-07T00:00:05.415 INFO:teuthology.orchestra.run.smithi088.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-10-07T00:00:05.449 INFO:teuthology.orchestra.run.smithi088.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-10-07T00:00:05.516 INFO:teuthology.orchestra.run.smithi088.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-10-07T00:00:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-10-07T00:00:05.600 INFO:teuthology.orchestra.run.smithi088.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-10-07T00:00:05.642 INFO:teuthology.orchestra.run.smithi088.stdout:(76/131): thrift-0.13.0-2.el8.x86_64.rpm 4.5 MB/s | 1.7 MB 00:00 2023-10-07T00:00:05.667 INFO:teuthology.orchestra.run.smithi088.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 639 kB/s | 43 kB 00:00 2023-10-07T00:00:05.717 INFO:teuthology.orchestra.run.smithi088.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-10-07T00:00:05.743 INFO:teuthology.orchestra.run.smithi088.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.2 MB/s | 229 kB 00:00 2023-10-07T00:00:05.776 INFO:teuthology.orchestra.run.smithi088.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-10-07T00:00:05.802 INFO:teuthology.orchestra.run.smithi088.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 319 kB/s | 19 kB 00:00 2023-10-07T00:00:05.819 INFO:teuthology.orchestra.run.smithi088.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-10-07T00:00:05.860 INFO:teuthology.orchestra.run.smithi088.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-10-07T00:00:05.911 INFO:teuthology.orchestra.run.smithi088.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 195 kB/s | 18 kB 00:00 2023-10-07T00:00:05.953 INFO:teuthology.orchestra.run.smithi088.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-10-07T00:00:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-10-07T00:00:06.028 INFO:teuthology.orchestra.run.smithi088.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-10-07T00:00:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-07T00:00:06.129 INFO:teuthology.orchestra.run.smithi088.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-10-07T00:00:06.139 INFO:teuthology.orchestra.run.smithi005.stdout:(10/131): ceph-osd-18.0.0-6616.g14d8d032.el8.x8 3.0 MB/s | 18 MB 00:05 2023-10-07T00:00:06.247 INFO:teuthology.orchestra.run.smithi005.stdout:(11/131): cephfs-mirror-18.0.0-6616.g14d8d032.e 2.4 MB/s | 260 kB 00:00 2023-10-07T00:00:06.314 INFO:teuthology.orchestra.run.smithi005.stdout:(12/131): libcephfs-devel-18.0.0-6616.g14d8d032 467 kB/s | 31 kB 00:00 2023-10-07T00:00:06.465 INFO:teuthology.orchestra.run.smithi005.stdout:(13/131): ceph-radosgw-18.0.0-6616.g14d8d032.el 3.2 MB/s | 14 MB 00:04 2023-10-07T00:00:06.515 INFO:teuthology.orchestra.run.smithi005.stdout:(14/131): libcephsqlite-18.0.0-6616.g14d8d032.e 3.6 MB/s | 183 kB 00:00 2023-10-07T00:00:06.532 INFO:teuthology.orchestra.run.smithi112.stdout:(8/131): ceph-common-18.0.0-6616.g14d8d032.el8. 2.4 MB/s | 23 MB 00:09 2023-10-07T00:00:06.565 INFO:teuthology.orchestra.run.smithi005.stdout:(15/131): librados-devel-18.0.0-6616.g14d8d032. 2.7 MB/s | 139 kB 00:00 2023-10-07T00:00:06.588 INFO:teuthology.orchestra.run.smithi088.stdout:(90/131): ceph-test-18.0.0-6616.g14d8d032.el8.x 7.5 MB/s | 49 MB 00:06 2023-10-07T00:00:06.599 INFO:teuthology.orchestra.run.smithi005.stdout:(16/131): libcephfs2-18.0.0-6616.g14d8d032.el8. 2.9 MB/s | 840 kB 00:00 2023-10-07T00:00:06.613 INFO:teuthology.orchestra.run.smithi088.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 110 kB/s | 60 kB 00:00 2023-10-07T00:00:06.638 INFO:teuthology.orchestra.run.smithi088.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-07T00:00:06.666 INFO:teuthology.orchestra.run.smithi005.stdout:(17/131): libradosstriper1-18.0.0-6616.g14d8d03 5.1 MB/s | 518 kB 00:00 2023-10-07T00:00:06.682 INFO:teuthology.orchestra.run.smithi112.stdout:(9/131): ceph-radosgw-18.0.0-6616.g14d8d032.el8 3.1 MB/s | 14 MB 00:04 2023-10-07T00:00:06.705 INFO:teuthology.orchestra.run.smithi088.stdout:(93/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 171 kB/s | 98 kB 00:00 2023-10-07T00:00:06.716 INFO:teuthology.orchestra.run.smithi005.stdout:(18/131): python3-ceph-argparse-18.0.0-6616.g14 898 kB/s | 45 kB 00:00 2023-10-07T00:00:06.739 INFO:teuthology.orchestra.run.smithi088.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 308 kB/s | 39 kB 00:00 2023-10-07T00:00:06.740 INFO:teuthology.orchestra.run.smithi112.stdout:(10/131): ceph-selinux-18.0.0-6616.g14d8d032.el 117 kB/s | 24 kB 00:00 2023-10-07T00:00:06.764 INFO:teuthology.orchestra.run.smithi088.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.8 MB/s | 171 kB 00:00 2023-10-07T00:00:06.789 INFO:teuthology.orchestra.run.smithi088.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-07T00:00:06.823 INFO:teuthology.orchestra.run.smithi088.stdout:(97/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.5 MB/s | 644 kB 00:00 2023-10-07T00:00:06.833 INFO:teuthology.orchestra.run.smithi005.stdout:(19/131): python3-ceph-common-18.0.0-6616.g14d8 1.1 MB/s | 126 kB 00:00 2023-10-07T00:00:06.848 INFO:teuthology.orchestra.run.smithi088.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-07T00:00:06.849 INFO:teuthology.orchestra.run.smithi112.stdout:(11/131): cephfs-mirror-18.0.0-6616.g14d8d032.e 2.4 MB/s | 260 kB 00:00 2023-10-07T00:00:06.874 INFO:teuthology.orchestra.run.smithi088.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-07T00:00:06.907 INFO:teuthology.orchestra.run.smithi088.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-07T00:00:06.908 INFO:teuthology.orchestra.run.smithi005.stdout:(20/131): python3-cephfs-18.0.0-6616.g14d8d032. 2.6 MB/s | 196 kB 00:00 2023-10-07T00:00:06.916 INFO:teuthology.orchestra.run.smithi112.stdout:(12/131): libcephfs-devel-18.0.0-6616.g14d8d032 466 kB/s | 31 kB 00:00 2023-10-07T00:00:06.941 INFO:teuthology.orchestra.run.smithi088.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-07T00:00:06.966 INFO:teuthology.orchestra.run.smithi088.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-10-07T00:00:07.008 INFO:teuthology.orchestra.run.smithi088.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-07T00:00:07.030 INFO:teuthology.orchestra.run.smithi005.stdout:(21/131): python3-rados-18.0.0-6616.g14d8d032.e 3.0 MB/s | 371 kB 00:00 2023-10-07T00:00:07.041 INFO:teuthology.orchestra.run.smithi088.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-10-07T00:00:07.067 INFO:teuthology.orchestra.run.smithi088.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-07T00:00:07.117 INFO:teuthology.orchestra.run.smithi005.stdout:(22/131): python3-rbd-18.0.0-6616.g14d8d032.el8 4.1 MB/s | 364 kB 00:00 2023-10-07T00:00:07.125 INFO:teuthology.orchestra.run.smithi088.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-10-07T00:00:07.167 INFO:teuthology.orchestra.run.smithi005.stdout:(23/131): python3-rgw-18.0.0-6616.g14d8d032.el8 2.1 MB/s | 107 kB 00:00 2023-10-07T00:00:07.174 INFO:teuthology.orchestra.run.smithi112.stdout:(13/131): libcephfs2-18.0.0-6616.g14d8d032.el8. 3.2 MB/s | 840 kB 00:00 2023-10-07T00:00:07.175 INFO:teuthology.orchestra.run.smithi088.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 6.4 MB/s | 713 kB 00:00 2023-10-07T00:00:07.217 INFO:teuthology.orchestra.run.smithi088.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 642 kB/s | 27 kB 00:00 2023-10-07T00:00:07.218 INFO:teuthology.orchestra.run.smithi005.stdout:(24/131): rbd-fuse-18.0.0-6616.g14d8d032.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-07T00:00:07.249 INFO:teuthology.orchestra.run.smithi112.stdout:(14/131): libcephsqlite-18.0.0-6616.g14d8d032.e 2.4 MB/s | 183 kB 00:00 2023-10-07T00:00:07.268 INFO:teuthology.orchestra.run.smithi088.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-07T00:00:07.310 INFO:teuthology.orchestra.run.smithi088.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-07T00:00:07.317 INFO:teuthology.orchestra.run.smithi112.stdout:(15/131): librados-devel-18.0.0-6616.g14d8d032. 2.0 MB/s | 139 kB 00:00 2023-10-07T00:00:07.460 INFO:teuthology.orchestra.run.smithi088.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2023-10-07T00:00:07.492 INFO:teuthology.orchestra.run.smithi112.stdout:(16/131): libradosstriper1-18.0.0-6616.g14d8d03 2.9 MB/s | 518 kB 00:00 2023-10-07T00:00:07.527 INFO:teuthology.orchestra.run.smithi088.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 6.8 MB/s | 457 kB 00:00 2023-10-07T00:00:07.594 INFO:teuthology.orchestra.run.smithi088.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 13 MB/s | 3.7 MB 00:00 2023-10-07T00:00:07.627 INFO:teuthology.orchestra.run.smithi088.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.2 MB/s | 225 kB 00:00 2023-10-07T00:00:07.653 INFO:teuthology.orchestra.run.smithi088.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-10-07T00:00:07.678 INFO:teuthology.orchestra.run.smithi088.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.4 MB/s | 126 kB 00:00 2023-10-07T00:00:07.705 INFO:teuthology.orchestra.run.smithi088.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 381 kB/s | 20 kB 00:00 2023-10-07T00:00:07.730 INFO:teuthology.orchestra.run.smithi088.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.9 MB/s | 103 kB 00:00 2023-10-07T00:00:07.773 INFO:teuthology.orchestra.run.smithi088.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-07T00:00:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-10-07T00:00:07.885 INFO:teuthology.orchestra.run.smithi005.stdout:(25/131): rbd-mirror-18.0.0-6616.g14d8d032.el8. 5.4 MB/s | 3.6 MB 00:00 2023-10-07T00:00:07.952 INFO:teuthology.orchestra.run.smithi005.stdout:(26/131): rbd-nbd-18.0.0-6616.g14d8d032.el8.x86 2.6 MB/s | 179 kB 00:00 2023-10-07T00:00:08.002 INFO:teuthology.orchestra.run.smithi005.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6616.g 463 kB/s | 23 kB 00:00 2023-10-07T00:00:08.049 INFO:teuthology.orchestra.run.smithi088.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 11 MB/s | 14 MB 00:01 2023-10-07T00:00:08.061 INFO:teuthology.orchestra.run.smithi005.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6616.g14d8d03 2.2 MB/s | 132 kB 00:00 2023-10-07T00:00:08.107 INFO:teuthology.orchestra.run.smithi088.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-10-07T00:00:08.166 INFO:teuthology.orchestra.run.smithi088.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-10-07T00:00:08.211 INFO:teuthology.orchestra.run.smithi005.stdout:(29/131): librgw2-18.0.0-6616.g14d8d032.el8.x86 4.3 MB/s | 6.9 MB 00:01 2023-10-07T00:00:08.267 INFO:teuthology.orchestra.run.smithi088.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 9.1 MB/s | 4.9 MB 00:00 2023-10-07T00:00:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:(125/131): postgresql-contrib-10.21-2.module+el 9.5 MB/s | 808 kB 00:00 2023-10-07T00:00:08.425 INFO:teuthology.orchestra.run.smithi088.stdout:(126/131): openblas-0.3.15-3.el8.x86_64.rpm 7.7 MB/s | 4.7 MB 00:00 2023-10-07T00:00:08.428 INFO:teuthology.orchestra.run.smithi005.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6616.g14d8d 4.8 MB/s | 1.8 MB 00:00 2023-10-07T00:00:08.493 INFO:teuthology.orchestra.run.smithi088.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-07T00:00:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6616.g14 2.6 MB/s | 242 kB 00:00 2023-10-07T00:00:08.579 INFO:teuthology.orchestra.run.smithi005.stdout:(32/131): ceph-mgr-rook-18.0.0-6616.g14d8d032.e 818 kB/s | 47 kB 00:00 2023-10-07T00:00:08.609 INFO:teuthology.orchestra.run.smithi088.stdout:(128/131): postgresql-server-10.21-2.module+el8 11 MB/s | 5.1 MB 00:00 2023-10-07T00:00:08.629 INFO:teuthology.orchestra.run.smithi005.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6616.g1 290 kB/s | 15 kB 00:00 2023-10-07T00:00:08.668 INFO:teuthology.orchestra.run.smithi088.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-07T00:00:08.713 INFO:teuthology.orchestra.run.smithi005.stdout:(34/131): ceph-volume-18.0.0-6616.g14d8d032.el8 3.1 MB/s | 261 kB 00:00 2023-10-07T00:00:08.759 INFO:teuthology.orchestra.run.smithi112.stdout:(17/131): ceph-osd-18.0.0-6616.g14d8d032.el8.x8 2.3 MB/s | 18 MB 00:07 2023-10-07T00:00:08.780 INFO:teuthology.orchestra.run.smithi005.stdout:(35/131): cephadm-18.0.0-6616.g14d8d032.el8.noa 2.8 MB/s | 192 kB 00:00 2023-10-07T00:00:08.855 INFO:teuthology.orchestra.run.smithi005.stdout:(36/131): cephfs-top-18.0.0-6616.g14d8d032.el8. 242 kB/s | 18 kB 00:00 2023-10-07T00:00:08.875 INFO:teuthology.orchestra.run.smithi112.stdout:(18/131): python3-ceph-argparse-18.0.0-6616.g14 385 kB/s | 45 kB 00:00 2023-10-07T00:00:08.984 INFO:teuthology.orchestra.run.smithi112.stdout:(19/131): python3-ceph-common-18.0.0-6616.g14d8 1.1 MB/s | 126 kB 00:00 2023-10-07T00:00:09.064 INFO:teuthology.orchestra.run.smithi005.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-10-07T00:00:09.105 INFO:teuthology.orchestra.run.smithi005.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-10-07T00:00:09.181 INFO:teuthology.orchestra.run.smithi005.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-10-07T00:00:09.184 INFO:teuthology.orchestra.run.smithi112.stdout:(20/131): python3-cephfs-18.0.0-6616.g14d8d032. 983 kB/s | 196 kB 00:00 2023-10-07T00:00:09.243 INFO:teuthology.orchestra.run.smithi088.stdout:(130/131): librados2-18.0.0-6616.g14d8d032.el8. 4.6 MB/s | 3.7 MB 00:00 2023-10-07T00:00:09.293 INFO:teuthology.orchestra.run.smithi112.stdout:(21/131): librgw2-18.0.0-6616.g14d8d032.el8.x86 3.8 MB/s | 6.9 MB 00:01 2023-10-07T00:00:09.327 INFO:teuthology.orchestra.run.smithi088.stdout:(131/131): librbd1-18.0.0-6616.g14d8d032.el8.x8 4.5 MB/s | 3.7 MB 00:00 2023-10-07T00:00:09.329 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-07T00:00:09.329 INFO:teuthology.orchestra.run.smithi088.stdout:Total 16 MB/s | 208 MB 00:13 2023-10-07T00:00:09.333 INFO:teuthology.orchestra.run.smithi005.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2023-10-07T00:00:09.343 INFO:teuthology.orchestra.run.smithi112.stdout:(22/131): python3-rados-18.0.0-6616.g14d8d032.e 2.3 MB/s | 371 kB 00:00 2023-10-07T00:00:09.374 INFO:teuthology.orchestra.run.smithi005.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-10-07T00:00:09.410 INFO:teuthology.orchestra.run.smithi112.stdout:(23/131): python3-rbd-18.0.0-6616.g14d8d032.el8 3.1 MB/s | 364 kB 00:00 2023-10-07T00:00:09.436 INFO:teuthology.orchestra.run.smithi112.stdout:(24/131): python3-rgw-18.0.0-6616.g14d8d032.el8 1.1 MB/s | 107 kB 00:00 2023-10-07T00:00:09.470 INFO:teuthology.orchestra.run.smithi112.stdout:(25/131): rbd-fuse-18.0.0-6616.g14d8d032.el8.x8 1.6 MB/s | 94 kB 00:00 2023-10-07T00:00:09.499 INFO:teuthology.orchestra.run.smithi005.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-10-07T00:00:09.528 INFO:teuthology.orchestra.run.smithi112.stdout:(26/131): rbd-nbd-18.0.0-6616.g14d8d032.el8.x86 3.0 MB/s | 179 kB 00:00 2023-10-07T00:00:09.566 INFO:teuthology.orchestra.run.smithi005.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 494 kB/s | 33 kB 00:00 2023-10-07T00:00:09.595 INFO:teuthology.orchestra.run.smithi112.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6616.g 347 kB/s | 23 kB 00:00 2023-10-07T00:00:09.617 INFO:teuthology.orchestra.run.smithi005.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 327 kB/s | 16 kB 00:00 2023-10-07T00:00:09.654 INFO:teuthology.orchestra.run.smithi112.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6616.g14d8d03 2.2 MB/s | 132 kB 00:00 2023-10-07T00:00:09.709 INFO:teuthology.orchestra.run.smithi005.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-07T00:00:09.909 INFO:teuthology.orchestra.run.smithi005.stdout:(46/131): ceph-mgr-diskprediction-local-18.0.0- 4.4 MB/s | 7.4 MB 00:01 2023-10-07T00:00:09.934 INFO:teuthology.orchestra.run.smithi005.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-10-07T00:00:09.993 INFO:teuthology.orchestra.run.smithi005.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 208 kB/s | 11 kB 00:00 2023-10-07T00:00:10.052 INFO:teuthology.orchestra.run.smithi005.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 302 kB/s | 18 kB 00:00 2023-10-07T00:00:10.062 INFO:teuthology.orchestra.run.smithi112.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6616.g14d8d 4.3 MB/s | 1.8 MB 00:00 2023-10-07T00:00:10.094 INFO:teuthology.orchestra.run.smithi005.stdout:(50/131): python3-google-auth-1.1.1-10.el8.noar 441 kB/s | 81 kB 00:00 2023-10-07T00:00:10.136 INFO:teuthology.orchestra.run.smithi005.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-10-07T00:00:10.178 INFO:teuthology.orchestra.run.smithi005.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-10-07T00:00:10.237 INFO:teuthology.orchestra.run.smithi005.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-10-07T00:00:10.271 INFO:teuthology.orchestra.run.smithi112.stdout:(30/131): rbd-mirror-18.0.0-6616.g14d8d032.el8. 4.3 MB/s | 3.6 MB 00:00 2023-10-07T00:00:10.377 INFO:teuthology.orchestra.run.smithi005.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.0 MB/s | 283 kB 00:00 2023-10-07T00:00:10.379 INFO:teuthology.orchestra.run.smithi112.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6616.g14 2.2 MB/s | 242 kB 00:00 2023-10-07T00:00:10.455 INFO:teuthology.orchestra.run.smithi112.stdout:(32/131): ceph-mgr-rook-18.0.0-6616.g14d8d032.e 634 kB/s | 47 kB 00:00 2023-10-07T00:00:10.462 INFO:teuthology.orchestra.run.smithi005.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 183 kB/s | 16 kB 00:00 2023-10-07T00:00:10.513 INFO:teuthology.orchestra.run.smithi005.stdout:(56/131): python3-kubernetes-11.0.0-6.el8.noarc 2.5 MB/s | 1.2 MB 00:00 2023-10-07T00:00:10.513 INFO:teuthology.orchestra.run.smithi112.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6616.g1 249 kB/s | 15 kB 00:00 2023-10-07T00:00:10.538 INFO:teuthology.orchestra.run.smithi005.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-10-07T00:00:10.597 INFO:teuthology.orchestra.run.smithi005.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-07T00:00:10.622 INFO:teuthology.orchestra.run.smithi112.stdout:(34/131): ceph-volume-18.0.0-6616.g14d8d032.el8 2.4 MB/s | 261 kB 00:00 2023-10-07T00:00:10.630 INFO:teuthology.orchestra.run.smithi005.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-10-07T00:00:10.656 INFO:teuthology.orchestra.run.smithi005.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2023-10-07T00:00:10.681 INFO:teuthology.orchestra.run.smithi005.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 475 kB/s | 24 kB 00:00 2023-10-07T00:00:10.689 INFO:teuthology.orchestra.run.smithi112.stdout:(35/131): cephadm-18.0.0-6616.g14d8d032.el8.noa 2.8 MB/s | 192 kB 00:00 2023-10-07T00:00:10.698 INFO:teuthology.orchestra.run.smithi005.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 701 kB/s | 29 kB 00:00 2023-10-07T00:00:10.715 INFO:teuthology.orchestra.run.smithi005.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 819 kB/s | 27 kB 00:00 2023-10-07T00:00:10.748 INFO:teuthology.orchestra.run.smithi112.stdout:(36/131): cephfs-top-18.0.0-6616.g14d8d032.el8. 311 kB/s | 18 kB 00:00 2023-10-07T00:00:10.798 INFO:teuthology.orchestra.run.smithi005.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-07T00:00:10.831 INFO:teuthology.orchestra.run.smithi112.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 3.6 MB/s | 306 kB 00:00 2023-10-07T00:00:10.832 INFO:teuthology.orchestra.run.smithi005.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-10-07T00:00:10.849 INFO:teuthology.orchestra.run.smithi005.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-07T00:00:10.865 INFO:teuthology.orchestra.run.smithi112.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2023-10-07T00:00:10.883 INFO:teuthology.orchestra.run.smithi005.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 685 kB/s | 23 kB 00:00 2023-10-07T00:00:10.899 INFO:teuthology.orchestra.run.smithi112.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 2.2 MB/s | 75 kB 00:00 2023-10-07T00:00:10.908 INFO:teuthology.orchestra.run.smithi005.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-07T00:00:10.933 INFO:teuthology.orchestra.run.smithi005.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-10-07T00:00:10.949 INFO:teuthology.orchestra.run.smithi112.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 9.3 MB/s | 476 kB 00:00 2023-10-07T00:00:10.992 INFO:teuthology.orchestra.run.smithi005.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 803 kB/s | 47 kB 00:00 2023-10-07T00:00:11.002 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-07T00:00:11.013 INFO:teuthology.orchestra.run.smithi112.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 686 kB/s | 44 kB 00:00 2023-10-07T00:00:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-10-07T00:00:11.049 INFO:teuthology.orchestra.run.smithi112.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 5.0 MB/s | 185 kB 00:00 2023-10-07T00:00:11.076 INFO:teuthology.orchestra.run.smithi005.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-07T00:00:11.083 INFO:teuthology.orchestra.run.smithi112.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 985 kB/s | 33 kB 00:00 2023-10-07T00:00:11.117 INFO:teuthology.orchestra.run.smithi112.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 487 kB/s | 16 kB 00:00 2023-10-07T00:00:11.126 INFO:teuthology.orchestra.run.smithi005.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-07T00:00:11.143 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-07T00:00:11.143 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-07T00:00:11.150 INFO:teuthology.orchestra.run.smithi112.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 5.1 MB/s | 173 kB 00:00 2023-10-07T00:00:11.169 INFO:teuthology.orchestra.run.smithi005.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-10-07T00:00:11.184 INFO:teuthology.orchestra.run.smithi112.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 11 MB/s | 384 kB 00:00 2023-10-07T00:00:11.210 INFO:teuthology.orchestra.run.smithi112.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 3.2 MB/s | 81 kB 00:00 2023-10-07T00:00:11.210 INFO:teuthology.orchestra.run.smithi005.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-10-07T00:00:11.243 INFO:teuthology.orchestra.run.smithi112.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 333 kB/s | 11 kB 00:00 2023-10-07T00:00:11.252 INFO:teuthology.orchestra.run.smithi005.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-10-07T00:00:11.277 INFO:teuthology.orchestra.run.smithi112.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 531 kB/s | 18 kB 00:00 2023-10-07T00:00:11.294 INFO:teuthology.orchestra.run.smithi005.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2023-10-07T00:00:11.327 INFO:teuthology.orchestra.run.smithi112.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 23 MB/s | 1.2 MB 00:00 2023-10-07T00:00:11.336 INFO:teuthology.orchestra.run.smithi005.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-10-07T00:00:11.369 INFO:teuthology.orchestra.run.smithi112.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-10-07T00:00:11.387 INFO:teuthology.orchestra.run.smithi005.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 11 MB/s | 560 kB 00:00 2023-10-07T00:00:11.429 INFO:teuthology.orchestra.run.smithi005.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 448 kB/s | 19 kB 00:00 2023-10-07T00:00:11.471 INFO:teuthology.orchestra.run.smithi005.stdout:(81/131): thrift-0.13.0-2.el8.x86_64.rpm 3.0 MB/s | 1.7 MB 00:00 2023-10-07T00:00:11.495 INFO:teuthology.orchestra.run.smithi112.stdout:(52/131): ceph-mgr-diskprediction-local-18.0.0- 5.2 MB/s | 7.4 MB 00:01 2023-10-07T00:00:11.504 INFO:teuthology.orchestra.run.smithi005.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2023-10-07T00:00:11.520 INFO:teuthology.orchestra.run.smithi112.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 390 kB/s | 59 kB 00:00 2023-10-07T00:00:11.554 INFO:teuthology.orchestra.run.smithi112.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 8.3 MB/s | 283 kB 00:00 2023-10-07T00:00:11.563 INFO:teuthology.orchestra.run.smithi005.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-10-07T00:00:11.579 INFO:teuthology.orchestra.run.smithi112.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 718 kB/s | 60 kB 00:00 2023-10-07T00:00:11.604 INFO:teuthology.orchestra.run.smithi112.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-10-07T00:00:11.605 INFO:teuthology.orchestra.run.smithi005.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 4.1 MB/s | 559 kB 00:00 2023-10-07T00:00:11.630 INFO:teuthology.orchestra.run.smithi112.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 673 kB/s | 34 kB 00:00 2023-10-07T00:00:11.639 INFO:teuthology.orchestra.run.smithi005.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.8 MB/s | 605 kB 00:00 2023-10-07T00:00:11.655 INFO:teuthology.orchestra.run.smithi112.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-10-07T00:00:11.680 INFO:teuthology.orchestra.run.smithi112.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-10-07T00:00:11.689 INFO:teuthology.orchestra.run.smithi005.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-10-07T00:00:11.706 INFO:teuthology.orchestra.run.smithi112.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-10-07T00:00:11.731 INFO:teuthology.orchestra.run.smithi112.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 476 kB/s | 24 kB 00:00 2023-10-07T00:00:11.731 INFO:teuthology.orchestra.run.smithi005.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-10-07T00:00:11.756 INFO:teuthology.orchestra.run.smithi112.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2023-10-07T00:00:11.773 INFO:teuthology.orchestra.run.smithi005.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-07T00:00:11.781 INFO:teuthology.orchestra.run.smithi112.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 548 kB/s | 27 kB 00:00 2023-10-07T00:00:11.807 INFO:teuthology.orchestra.run.smithi112.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-10-07T00:00:11.823 INFO:teuthology.orchestra.run.smithi005.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-10-07T00:00:11.832 INFO:teuthology.orchestra.run.smithi112.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-10-07T00:00:11.848 INFO:teuthology.orchestra.run.smithi005.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 799 kB/s | 60 kB 00:00 2023-10-07T00:00:11.857 INFO:teuthology.orchestra.run.smithi112.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-07T00:00:11.905 INFO:teuthology.orchestra.run.smithi112.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-10-07T00:00:11.933 INFO:teuthology.orchestra.run.smithi112.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-10-07T00:00:11.958 INFO:teuthology.orchestra.run.smithi112.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-10-07T00:00:12.008 INFO:teuthology.orchestra.run.smithi005.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 533 kB/s | 98 kB 00:00 2023-10-07T00:00:12.017 INFO:teuthology.orchestra.run.smithi112.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2023-10-07T00:00:12.075 INFO:teuthology.orchestra.run.smithi112.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-10-07T00:00:12.109 INFO:teuthology.orchestra.run.smithi112.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-10-07T00:00:12.151 INFO:teuthology.orchestra.run.smithi112.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-07T00:00:12.202 INFO:teuthology.orchestra.run.smithi112.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-10-07T00:00:12.244 INFO:teuthology.orchestra.run.smithi112.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 938 kB/s | 39 kB 00:00 2023-10-07T00:00:12.302 INFO:teuthology.orchestra.run.smithi112.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-10-07T00:00:12.333 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-07T00:00:12.338 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-07T00:00:12.357 INFO:teuthology.orchestra.run.smithi005.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 113 kB/s | 58 kB 00:00 2023-10-07T00:00:12.360 INFO:teuthology.orchestra.run.smithi112.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 9.1 MB/s | 538 kB 00:00 2023-10-07T00:00:12.383 INFO:teuthology.orchestra.run.smithi005.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 103 kB/s | 39 kB 00:00 2023-10-07T00:00:12.411 INFO:teuthology.orchestra.run.smithi112.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-10-07T00:00:12.433 INFO:teuthology.orchestra.run.smithi005.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 8.4 MB/s | 644 kB 00:00 2023-10-07T00:00:12.459 INFO:teuthology.orchestra.run.smithi005.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.2 MB/s | 171 kB 00:00 2023-10-07T00:00:12.501 INFO:teuthology.orchestra.run.smithi005.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.0 MB/s | 138 kB 00:00 2023-10-07T00:00:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-10-07T00:00:12.562 INFO:teuthology.orchestra.run.smithi112.stdout:(79/131): python3-scipy-1.0.0-21.module+el8.5.0 23 MB/s | 14 MB 00:00 2023-10-07T00:00:12.595 INFO:teuthology.orchestra.run.smithi112.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-10-07T00:00:12.637 INFO:teuthology.orchestra.run.smithi112.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-10-07T00:00:12.679 INFO:teuthology.orchestra.run.smithi112.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 640 kB/s | 27 kB 00:00 2023-10-07T00:00:12.729 INFO:teuthology.orchestra.run.smithi112.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-07T00:00:12.788 INFO:teuthology.orchestra.run.smithi112.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 755 kB/s | 44 kB 00:00 2023-10-07T00:00:12.872 INFO:teuthology.orchestra.run.smithi112.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-10-07T00:00:12.939 INFO:teuthology.orchestra.run.smithi112.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2023-10-07T00:00:12.981 INFO:teuthology.orchestra.run.smithi112.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-07T00:00:13.043 INFO:teuthology.orchestra.run.smithi005.stdout:(98/131): ceph-test-18.0.0-6616.g14d8d032.el8.x 6.3 MB/s | 49 MB 00:07 2023-10-07T00:00:13.047 INFO:teuthology.orchestra.run.smithi112.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-10-07T00:00:13.068 INFO:teuthology.orchestra.run.smithi005.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 105 kB/s | 54 kB 00:00 2023-10-07T00:00:13.073 INFO:teuthology.orchestra.run.smithi112.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 697 kB/s | 64 kB 00:00 2023-10-07T00:00:13.098 INFO:teuthology.orchestra.run.smithi112.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-07T00:00:13.123 INFO:teuthology.orchestra.run.smithi112.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-10-07T00:00:13.135 INFO:teuthology.orchestra.run.smithi005.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-10-07T00:00:13.149 INFO:teuthology.orchestra.run.smithi112.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-07T00:00:13.161 INFO:teuthology.orchestra.run.smithi005.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2023-10-07T00:00:13.203 INFO:teuthology.orchestra.run.smithi005.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 581 kB/s | 39 kB 00:00 2023-10-07T00:00:13.216 INFO:teuthology.orchestra.run.smithi112.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2023-10-07T00:00:13.245 INFO:teuthology.orchestra.run.smithi005.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.0 MB/s | 688 kB 00:00 2023-10-07T00:00:13.274 INFO:teuthology.orchestra.run.smithi112.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-07T00:00:13.295 INFO:teuthology.orchestra.run.smithi005.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.7 MB/s | 538 kB 00:00 2023-10-07T00:00:13.312 INFO:teuthology.orchestra.run.smithi005.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-07T00:00:13.345 INFO:teuthology.orchestra.run.smithi005.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-07T00:00:13.375 INFO:teuthology.orchestra.run.smithi112.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-10-07T00:00:13.396 INFO:teuthology.orchestra.run.smithi005.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 8.4 MB/s | 713 kB 00:00 2023-10-07T00:00:13.425 INFO:teuthology.orchestra.run.smithi112.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-10-07T00:00:13.463 INFO:teuthology.orchestra.run.smithi005.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 397 kB/s | 27 kB 00:00 2023-10-07T00:00:13.483 INFO:teuthology.orchestra.run.smithi112.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.0 MB/s | 354 kB 00:00 2023-10-07T00:00:13.513 INFO:teuthology.orchestra.run.smithi005.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-07T00:00:13.555 INFO:teuthology.orchestra.run.smithi005.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-07T00:00:13.559 INFO:teuthology.orchestra.run.smithi112.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-07T00:00:13.647 INFO:teuthology.orchestra.run.smithi005.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-10-07T00:00:13.651 INFO:teuthology.orchestra.run.smithi112.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 8.6 MB/s | 808 kB 00:00 2023-10-07T00:00:13.732 INFO:teuthology.orchestra.run.smithi005.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 5.3 MB/s | 457 kB 00:00 2023-10-07T00:00:13.759 INFO:teuthology.orchestra.run.smithi112.stdout:(100/131): postgresql-server-10.21-2.module+el8 18 MB/s | 5.1 MB 00:00 2023-10-07T00:00:13.801 INFO:teuthology.orchestra.run.smithi112.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 10 MB/s | 1.5 MB 00:00 2023-10-07T00:00:13.818 INFO:teuthology.orchestra.run.smithi112.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 802 kB/s | 47 kB 00:00 2023-10-07T00:00:13.844 INFO:teuthology.orchestra.run.smithi112.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.6 MB/s | 200 kB 00:00 2023-10-07T00:00:13.860 INFO:teuthology.orchestra.run.smithi112.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-07T00:00:13.889 INFO:teuthology.orchestra.run.smithi005.stdout:(113/131): python3-scipy-1.0.0-21.module+el8.5. 9.6 MB/s | 14 MB 00:01 2023-10-07T00:00:13.894 INFO:teuthology.orchestra.run.smithi112.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-07T00:00:13.915 INFO:teuthology.orchestra.run.smithi005.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.2 MB/s | 225 kB 00:00 2023-10-07T00:00:13.920 INFO:teuthology.orchestra.run.smithi112.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 818 kB/s | 48 kB 00:00 2023-10-07T00:00:13.940 INFO:teuthology.orchestra.run.smithi005.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-10-07T00:00:13.945 INFO:teuthology.orchestra.run.smithi112.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-07T00:00:13.965 INFO:teuthology.orchestra.run.smithi005.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-07T00:00:13.970 INFO:teuthology.orchestra.run.smithi112.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 851 kB/s | 43 kB 00:00 2023-10-07T00:00:13.990 INFO:teuthology.orchestra.run.smithi005.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-10-07T00:00:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-07T00:00:14.091 INFO:teuthology.orchestra.run.smithi005.stdout:(119/131): python3-numpy-1.14.3-10.el8.x86_64.r 7.0 MB/s | 3.7 MB 00:00 2023-10-07T00:00:14.125 INFO:teuthology.orchestra.run.smithi005.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2023-10-07T00:00:14.150 INFO:teuthology.orchestra.run.smithi005.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-07T00:00:14.192 INFO:teuthology.orchestra.run.smithi005.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-07T00:00:14.242 INFO:teuthology.orchestra.run.smithi005.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 7.0 MB/s | 354 kB 00:00 2023-10-07T00:00:14.376 INFO:teuthology.orchestra.run.smithi005.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-10-07T00:00:14.413 INFO:teuthology.orchestra.run.smithi112.stdout:(109/131): ceph-test-18.0.0-6616.g14d8d032.el8. 6.3 MB/s | 49 MB 00:07 2023-10-07T00:00:14.438 INFO:teuthology.orchestra.run.smithi112.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 222 kB/s | 109 kB 00:00 2023-10-07T00:00:14.468 INFO:teuthology.orchestra.run.smithi005.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-10-07T00:00:14.497 INFO:teuthology.orchestra.run.smithi112.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 435 kB/s | 229 kB 00:00 2023-10-07T00:00:14.522 INFO:teuthology.orchestra.run.smithi112.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 239 kB/s | 19 kB 00:00 2023-10-07T00:00:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.0 MB/s | 808 kB 00:00 2023-10-07T00:00:14.547 INFO:teuthology.orchestra.run.smithi112.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-07T00:00:14.581 INFO:teuthology.orchestra.run.smithi112.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-07T00:00:14.594 INFO:teuthology.orchestra.run.smithi005.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-07T00:00:14.606 INFO:teuthology.orchestra.run.smithi112.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 306 kB/s | 18 kB 00:00 2023-10-07T00:00:14.648 INFO:teuthology.orchestra.run.smithi112.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.4 MB/s | 559 kB 00:00 2023-10-07T00:00:14.678 INFO:teuthology.orchestra.run.smithi005.stdout:(128/131): postgresql-server-10.21-2.module+el8 12 MB/s | 5.1 MB 00:00 2023-10-07T00:00:14.681 INFO:teuthology.orchestra.run.smithi112.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-10-07T00:00:14.715 INFO:teuthology.orchestra.run.smithi112.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-10-07T00:00:14.737 INFO:teuthology.orchestra.run.smithi005.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-07T00:00:14.741 INFO:teuthology.orchestra.run.smithi112.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-07T00:00:14.766 INFO:teuthology.orchestra.run.smithi112.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-07T00:00:14.782 INFO:teuthology.orchestra.run.smithi112.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-10-07T00:00:14.808 INFO:teuthology.orchestra.run.smithi112.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-10-07T00:00:14.825 INFO:teuthology.orchestra.run.smithi112.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-10-07T00:00:14.850 INFO:teuthology.orchestra.run.smithi112.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 926 kB/s | 39 kB 00:00 2023-10-07T00:00:14.926 INFO:teuthology.orchestra.run.smithi112.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 6.3 MB/s | 644 kB 00:00 2023-10-07T00:00:14.951 INFO:teuthology.orchestra.run.smithi112.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.7 MB/s | 171 kB 00:00 2023-10-07T00:00:14.976 INFO:teuthology.orchestra.run.smithi112.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-07T00:00:15.035 INFO:teuthology.orchestra.run.smithi112.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.0 MB/s | 2.3 MB 00:00 2023-10-07T00:00:15.093 INFO:teuthology.orchestra.run.smithi112.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-07T00:00:15.128 INFO:teuthology.orchestra.run.smithi005.stdout:(130/131): librbd1-18.0.0-6616.g14d8d032.el8.x8 7.0 MB/s | 3.7 MB 00:00 2023-10-07T00:00:15.312 INFO:teuthology.orchestra.run.smithi005.stdout:(131/131): librados2-18.0.0-6616.g14d8d032.el8. 4.8 MB/s | 3.7 MB 00:00 2023-10-07T00:00:15.315 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-10-07T00:00:15.315 INFO:teuthology.orchestra.run.smithi005.stdout:Total 11 MB/s | 208 MB 00:18 2023-10-07T00:00:15.643 INFO:teuthology.orchestra.run.smithi112.stdout:(130/131): librbd1-18.0.0-6616.g14d8d032.el8.x8 5.6 MB/s | 3.7 MB 00:00 2023-10-07T00:00:15.919 INFO:teuthology.orchestra.run.smithi112.stdout:(131/131): librados2-18.0.0-6616.g14d8d032.el8. 3.9 MB/s | 3.7 MB 00:00 2023-10-07T00:00:15.922 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2023-10-07T00:00:15.923 INFO:teuthology.orchestra.run.smithi112.stdout:Total 11 MB/s | 208 MB 00:18 2023-10-07T00:00:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-10-07T00:00:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-10-07T00:00:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-10-07T00:00:17.589 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2023-10-07T00:00:17.606 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-07T00:00:17.724 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2023-10-07T00:00:17.724 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2023-10-07T00:00:17.821 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-07T00:00:18.015 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-07T00:00:18.197 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-07T00:00:18.307 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-07T00:00:18.427 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-10-07T00:00:18.432 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-10-07T00:00:18.572 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-07T00:00:19.048 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-07T00:00:19.314 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 5/134 2023-10-07T00:00:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2023-10-07T00:00:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2023-10-07T00:00:19.783 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 5/134 2023-10-07T00:00:19.972 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:00:20.317 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:00:20.571 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:00:20.687 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:00:20.894 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-07T00:00:21.056 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-07T00:00:21.364 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-07T00:00:21.585 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-07T00:00:22.019 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-07T00:00:22.305 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-07T00:00:22.454 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-07T00:00:22.604 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-07T00:00:22.746 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-07T00:00:22.932 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-07T00:00:23.144 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-07T00:00:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-10-07T00:00:23.380 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-07T00:00:23.444 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-07T00:00:23.569 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-07T00:00:23.622 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-07T00:00:23.737 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-07T00:00:23.795 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-07T00:00:23.896 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-07T00:00:23.920 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-07T00:00:24.054 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-07T00:00:24.120 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-07T00:00:24.478 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2023-10-07T00:00:24.617 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-07T00:00:24.687 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-07T00:00:24.769 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-07T00:00:24.819 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 5/134 2023-10-07T00:00:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-07T00:00:24.987 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-07T00:00:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-07T00:00:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 5/134 2023-10-07T00:00:25.330 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-07T00:00:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-07T00:00:25.494 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:00:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:00:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-07T00:00:25.819 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:00:25.870 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-07T00:00:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-07T00:00:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:00:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-07T00:00:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-07T00:00:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-07T00:00:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-07T00:00:26.696 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:00:26.701 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-07T00:00:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-07T00:00:27.003 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-07T00:00:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-07T00:00:27.189 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-07T00:00:27.197 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:00:27.345 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-07T00:00:27.346 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:00:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-07T00:00:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-07T00:00:27.515 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:00:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-07T00:00:27.669 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 26/134 2023-10-07T00:00:27.713 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-07T00:00:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-07T00:00:27.832 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-07T00:00:27.833 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 27/134 2023-10-07T00:00:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-07T00:00:28.063 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 28/134 2023-10-07T00:00:28.070 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 9/134 2023-10-07T00:00:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-07T00:00:28.278 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-07T00:00:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-07T00:00:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-07T00:00:28.534 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-07T00:00:28.594 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-07T00:00:28.660 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-07T00:00:28.858 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-07T00:00:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-07T00:00:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-07T00:00:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-07T00:00:29.404 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-07T00:00:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-07T00:00:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-07T00:00:29.765 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-07T00:00:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-07T00:00:29.927 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-07T00:00:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-07T00:00:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-07T00:00:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-07T00:00:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-07T00:00:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-07T00:00:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-07T00:00:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-07T00:00:31.187 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-07T00:00:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-07T00:00:31.664 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-07T00:00:31.817 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-07T00:00:31.863 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-07T00:00:31.893 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-07T00:00:32.045 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-07T00:00:32.132 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-07T00:00:32.152 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-07T00:00:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-07T00:00:32.438 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-07T00:00:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 26/134 2023-10-07T00:00:32.690 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-07T00:00:32.707 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 27/134 2023-10-07T00:00:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-07T00:00:32.899 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-07T00:00:32.942 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 28/134 2023-10-07T00:00:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 36/134 2023-10-07T00:00:33.119 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-07T00:00:33.126 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-07T00:00:33.327 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 37/134 2023-10-07T00:00:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-07T00:00:33.512 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-07T00:00:33.577 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-07T00:00:33.655 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-07T00:00:33.780 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-07T00:00:33.893 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-07T00:00:33.982 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-07T00:00:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-07T00:00:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-07T00:00:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-07T00:00:34.411 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 26/134 2023-10-07T00:00:34.466 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-07T00:00:34.583 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 27/134 2023-10-07T00:00:34.663 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-07T00:00:34.752 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-07T00:00:34.995 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-07T00:00:35.206 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-07T00:00:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-07T00:00:35.386 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-07T00:00:35.606 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 28/134 2023-10-07T00:00:35.613 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-07T00:00:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-07T00:00:35.969 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-07T00:00:35.982 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-07T00:00:36.220 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-07T00:00:36.222 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-07T00:00:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-07T00:00:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-07T00:00:36.516 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-07T00:00:36.761 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-07T00:00:36.855 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-07T00:00:36.937 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-07T00:00:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-07T00:00:37.293 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-07T00:00:37.356 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-07T00:00:37.536 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-07T00:00:37.549 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-07T00:00:37.751 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-07T00:00:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-07T00:00:37.934 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 36/134 2023-10-07T00:00:38.062 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-07T00:00:38.143 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 37/134 2023-10-07T00:00:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-07T00:00:38.370 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-07T00:00:38.421 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-07T00:00:38.578 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-07T00:00:38.593 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-07T00:00:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-07T00:00:38.811 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-07T00:00:38.829 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-07T00:00:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-07T00:00:39.062 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-07T00:00:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-07T00:00:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-07T00:00:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-07T00:00:39.275 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-07T00:00:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-07T00:00:39.375 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-07T00:00:39.431 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-07T00:00:39.568 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-07T00:00:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-07T00:00:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-07T00:00:39.769 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 36/134 2023-10-07T00:00:39.811 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-07T00:00:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-07T00:00:39.958 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 37/134 2023-10-07T00:00:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-07T00:00:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-07T00:00:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-07T00:00:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-07T00:00:40.306 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-07T00:00:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-07T00:00:40.422 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-07T00:00:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-07T00:00:40.584 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-07T00:00:40.684 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-07T00:00:40.695 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-07T00:00:40.802 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-07T00:00:40.894 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-07T00:00:40.945 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-07T00:00:41.075 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-07T00:00:41.208 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-07T00:00:41.367 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-07T00:00:41.411 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-07T00:00:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-07T00:00:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-07T00:00:41.725 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-07T00:00:41.789 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-07T00:00:41.859 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-07T00:00:41.929 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-07T00:00:41.950 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-07T00:00:42.156 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-07T00:00:42.168 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-07T00:00:42.213 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-07T00:00:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-07T00:00:42.392 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-07T00:00:42.553 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-07T00:00:42.581 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-07T00:00:42.606 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-07T00:00:42.745 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-07T00:00:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-07T00:00:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-07T00:00:42.915 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-07T00:00:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-07T00:00:43.147 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-07T00:00:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-07T00:00:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-07T00:00:43.421 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-07T00:00:43.440 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-07T00:00:43.580 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-07T00:00:43.628 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-07T00:00:43.640 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-07T00:00:43.816 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-07T00:00:43.829 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-07T00:00:43.889 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-07T00:00:44.018 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-07T00:00:44.142 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-07T00:00:44.169 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-07T00:00:44.199 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-07T00:00:44.334 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-07T00:00:44.429 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-07T00:00:44.526 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-07T00:00:44.588 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-07T00:00:44.694 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-07T00:00:44.809 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-07T00:00:44.904 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-07T00:00:45.060 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-07T00:00:45.083 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-07T00:00:45.234 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-07T00:00:45.311 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-07T00:00:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-07T00:00:45.541 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-07T00:00:45.689 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-07T00:00:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-07T00:00:45.902 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-07T00:00:45.913 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-07T00:00:45.922 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-07T00:00:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-07T00:00:46.056 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-07T00:00:46.242 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-07T00:00:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-07T00:00:46.286 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-07T00:00:46.417 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-07T00:00:46.449 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-07T00:00:46.581 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-07T00:00:46.600 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-07T00:00:46.602 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-07T00:00:46.723 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-07T00:00:46.762 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-07T00:00:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-07T00:00:46.921 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-07T00:00:46.958 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-07T00:00:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-07T00:00:47.182 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-07T00:00:47.226 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-07T00:00:47.245 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-07T00:00:47.390 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-07T00:00:47.409 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-07T00:00:47.461 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-07T00:00:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-07T00:00:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-07T00:00:47.832 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-07T00:00:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-07T00:00:48.026 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-07T00:00:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-07T00:00:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-07T00:00:48.305 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-07T00:00:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-07T00:00:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-07T00:00:48.515 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-07T00:00:48.581 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-07T00:00:48.614 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-07T00:00:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-07T00:00:48.807 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 93/134 2023-10-07T00:00:48.884 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-07T00:00:49.030 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-07T00:00:49.167 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-07T00:00:49.410 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-07T00:00:49.642 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-07T00:00:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-07T00:00:50.025 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-07T00:00:50.126 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-07T00:00:50.313 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-07T00:00:50.353 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-07T00:00:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-07T00:00:50.590 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-07T00:00:50.742 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-07T00:00:50.940 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-07T00:00:51.201 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-07T00:00:51.380 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-07T00:00:52.062 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-07T00:00:52.272 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-07T00:00:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-07T00:00:52.432 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-07T00:00:52.528 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-07T00:00:52.641 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-07T00:00:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 93/134 2023-10-07T00:00:53.026 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-07T00:00:53.303 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-07T00:00:53.472 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-07T00:00:54.053 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:00:54.298 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:00:54.369 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-07T00:00:54.551 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-07T00:00:54.642 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-07T00:00:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 93/134 2023-10-07T00:00:54.966 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:00:55.350 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-07T00:00:55.515 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-07T00:00:55.656 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-07T00:00:57.885 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:00:58.090 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:00:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:00:59.227 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-07T00:00:59.344 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-07T00:00:59.456 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-07T00:00:59.981 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:01:00.217 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:01:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-07T00:01:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-07T00:01:01.335 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-07T00:01:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-07T00:01:16.299 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-07T00:01:16.299 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-10-07T00:01:16.299 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-10-07T00:01:16.300 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-10-07T00:01:16.300 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2023-10-07T00:01:16.300 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-10-07T00:01:16.300 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-10-07T00:01:16.300 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-10-07T00:01:16.300 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-10-07T00:01:16.301 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-10-07T00:01:16.301 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-07T00:01:16.727 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-07T00:01:18.466 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-07T00:01:18.719 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-07T00:01:18.989 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-07T00:01:19.209 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-07T00:01:19.733 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-07T00:01:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-07T00:01:20.001 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-07T00:01:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-07T00:01:20.552 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2023-10-07T00:01:20.552 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2023-10-07T00:01:20.552 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-10-07T00:01:20.552 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /run 2023-10-07T00:01:20.553 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2023-10-07T00:01:20.553 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2023-10-07T00:01:20.553 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2023-10-07T00:01:20.553 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2023-10-07T00:01:20.553 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-10-07T00:01:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:01:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-07T00:01:22.565 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-07T00:01:22.565 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2023-10-07T00:01:22.565 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2023-10-07T00:01:22.565 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2023-10-07T00:01:22.565 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /run 2023-10-07T00:01:22.565 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2023-10-07T00:01:22.566 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2023-10-07T00:01:22.566 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2023-10-07T00:01:22.566 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2023-10-07T00:01:22.566 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2023-10-07T00:01:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-07T00:01:22.813 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-07T00:01:22.833 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-07T00:01:22.956 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-07T00:01:22.998 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-07T00:01:23.032 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-07T00:01:23.163 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 102/134 2023-10-07T00:01:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-07T00:01:23.373 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 103/134 2023-10-07T00:01:23.561 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-07T00:01:23.608 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-07T00:01:23.873 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-07T00:01:24.084 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-07T00:01:24.121 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-07T00:01:24.320 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-07T00:01:24.364 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-07T00:01:24.699 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-07T00:01:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-07T00:01:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-07T00:01:25.192 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-07T00:01:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-07T00:01:25.391 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-07T00:01:25.522 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-07T00:01:25.883 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 107/134 2023-10-07T00:01:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-07T00:01:26.106 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-07T00:01:26.106 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-07T00:01:26.148 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-07T00:01:26.172 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-07T00:01:26.415 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-07T00:01:26.444 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-07T00:01:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-07T00:01:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-07T00:01:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 102/134 2023-10-07T00:01:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 103/134 2023-10-07T00:01:27.881 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 110/134 2023-10-07T00:01:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-07T00:01:28.091 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-07T00:01:28.153 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-07T00:01:28.223 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-07T00:01:28.340 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-07T00:01:28.412 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-07T00:01:28.413 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-07T00:01:28.573 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-07T00:01:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-07T00:01:28.996 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-07T00:01:29.128 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-07T00:01:29.198 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-07T00:01:29.279 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 102/134 2023-10-07T00:01:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 103/134 2023-10-07T00:01:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-07T00:01:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-07T00:01:29.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-07T00:01:29.929 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-07T00:01:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-07T00:01:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-07T00:01:30.272 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 107/134 2023-10-07T00:01:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-07T00:01:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-07T00:01:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-07T00:01:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-07T00:01:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-07T00:01:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-07T00:01:31.635 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-07T00:01:32.031 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 107/134 2023-10-07T00:01:32.298 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-07T00:01:32.364 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-07T00:01:32.503 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 110/134 2023-10-07T00:01:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-07T00:01:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-07T00:01:32.724 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-07T00:01:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-07T00:01:32.926 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-07T00:01:33.000 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-07T00:01:33.143 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-07T00:01:33.591 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-07T00:01:33.760 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-07T00:01:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 110/134 2023-10-07T00:01:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-07T00:01:34.275 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-07T00:01:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-07T00:01:34.498 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-07T00:01:34.567 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-07T00:01:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-07T00:01:35.145 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-07T00:01:35.322 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-07T00:01:35.569 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 115/134 2023-10-07T00:01:35.898 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-07T00:01:36.119 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 117/134 2023-10-07T00:01:36.356 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-07T00:01:36.571 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-07T00:01:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-07T00:01:37.060 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-07T00:01:37.260 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 121/134 2023-10-07T00:01:37.389 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-07T00:01:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-07T00:01:40.399 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-07T00:01:40.497 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 115/134 2023-10-07T00:01:40.713 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 115/134 2023-10-07T00:01:40.763 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:40.824 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-07T00:01:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-07T00:01:41.023 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 117/134 2023-10-07T00:01:41.063 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:41.099 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-07T00:01:41.264 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-07T00:01:41.380 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 124/134 2023-10-07T00:01:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-07T00:01:41.580 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 125/134 2023-10-07T00:01:41.699 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-07T00:01:41.914 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-07T00:01:41.951 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 126/134 2023-10-07T00:01:42.080 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 121/134 2023-10-07T00:01:42.218 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-07T00:01:42.320 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-07T00:01:42.392 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-07T00:01:42.545 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-07T00:01:42.645 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-07T00:01:42.739 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-07T00:01:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-07T00:01:42.914 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-07T00:01:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 119/134 2023-10-07T00:01:43.086 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-07T00:01:43.109 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-07T00:01:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-07T00:01:43.264 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-07T00:01:43.265 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:43.316 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 121/134 2023-10-07T00:01:43.446 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-07T00:01:43.484 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:43.484 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-07T00:01:43.792 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-07T00:01:44.019 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:44.313 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:44.313 INFO:teuthology.orchestra.run.smithi088.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-07T00:01:44.313 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-07T00:01:44.922 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 1/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 3/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 4/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 5/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 9/134 2023-10-07T00:01:44.923 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 10/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 11/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 12/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 13/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 14/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 15/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 16/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 17/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 18/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 19/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 20/134 2023-10-07T00:01:44.924 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 21/134 2023-10-07T00:01:44.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 22/134 2023-10-07T00:01:44.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 23/134 2023-10-07T00:01:44.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 24/134 2023-10-07T00:01:44.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 25/134 2023-10-07T00:01:44.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 26/134 2023-10-07T00:01:44.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 27/134 2023-10-07T00:01:44.936 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 28/134 2023-10-07T00:01:44.936 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 29/134 2023-10-07T00:01:44.936 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 30/134 2023-10-07T00:01:44.936 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 31/134 2023-10-07T00:01:44.936 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 32/134 2023-10-07T00:01:44.936 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 33/134 2023-10-07T00:01:44.936 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 34/134 2023-10-07T00:01:44.936 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 35/134 2023-10-07T00:01:44.937 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 36/134 2023-10-07T00:01:44.937 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 37/134 2023-10-07T00:01:44.937 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 38/134 2023-10-07T00:01:44.937 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-07T00:01:44.938 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-07T00:01:44.939 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-07T00:01:44.939 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-07T00:01:44.939 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-07T00:01:44.939 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-07T00:01:44.939 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-07T00:01:44.939 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-07T00:01:44.940 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-07T00:01:44.941 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-07T00:01:44.941 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-07T00:01:44.941 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-07T00:01:44.941 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-07T00:01:44.941 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-07T00:01:44.941 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-07T00:01:44.941 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-07T00:01:44.941 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-07T00:01:44.942 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-07T00:01:44.943 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-07T00:01:44.943 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-07T00:01:44.943 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-07T00:01:44.943 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-07T00:01:44.943 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-07T00:01:44.944 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-07T00:01:44.944 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-07T00:01:44.944 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-07T00:01:44.944 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-07T00:01:44.944 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-07T00:01:44.944 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-07T00:01:44.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-07T00:01:44.946 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-07T00:01:44.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-07T00:01:44.948 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-07T00:01:44.948 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 129/134 2023-10-07T00:01:44.948 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-07T00:01:44.948 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 131/134 2023-10-07T00:01:44.948 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:44.948 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-07T00:01:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:46.008 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:46.047 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:46.367 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 124/134 2023-10-07T00:01:46.551 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 125/134 2023-10-07T00:01:46.835 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 126/134 2023-10-07T00:01:47.128 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:47.166 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-07T00:01:47.184 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-07T00:01:47.357 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-07T00:01:47.412 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 124/134 2023-10-07T00:01:47.462 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-07T00:01:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 125/134 2023-10-07T00:01:47.654 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:47.654 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:05 ago on Fri 06 Oct 2023 11:59:42 PM UTC. 2023-10-07T00:01:47.682 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-07T00:01:47.712 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-07T00:01:47.882 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-07T00:01:47.906 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-07T00:01:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 126/134 2023-10-07T00:01:48.069 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-07T00:01:48.070 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-07T00:01:48.289 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:48.289 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-07T00:01:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-07T00:01:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-07T00:01:48.539 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-07T00:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-07T00:01:48.724 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:48.835 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-07T00:01:48.937 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-07T00:01:48.990 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:48.990 INFO:teuthology.orchestra.run.smithi005.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-07T00:01:48.990 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:01:49.177 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-07T00:01:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-07T00:01:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:49.409 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:49.409 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-07T00:01:49.620 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 1/134 2023-10-07T00:01:49.620 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2/134 2023-10-07T00:01:49.620 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 3/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 4/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 5/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 9/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 10/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 11/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 12/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 13/134 2023-10-07T00:01:49.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 14/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 15/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 16/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 17/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 18/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 19/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 20/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 21/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 22/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 23/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 24/134 2023-10-07T00:01:49.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 25/134 2023-10-07T00:01:49.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 26/134 2023-10-07T00:01:49.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 27/134 2023-10-07T00:01:49.632 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 28/134 2023-10-07T00:01:49.632 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 29/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 30/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 31/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 32/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 33/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 34/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 35/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 36/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 37/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 38/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-07T00:01:49.633 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-07T00:01:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-07T00:01:49.635 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-07T00:01:49.636 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-07T00:01:49.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-07T00:01:49.638 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-07T00:01:49.639 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-07T00:01:49.640 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 129/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-07T00:01:49.641 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 131/134 2023-10-07T00:01:49.642 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:49.642 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-07T00:01:49.666 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-07T00:01:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:50.126 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-07T00:01:50.127 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-07T00:01:50.458 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-10-07T00:01:50.705 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-07T00:01:50.705 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.1-7.el8.noarch 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.0.4-10.el8.x86_64 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.706 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.707 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.1-9.el8.x86_64 2023-10-07T00:01:50.708 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-3.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-07T00:01:50.709 INFO:teuthology.orchestra.run.smithi088.stdout: libpq-13.5-1.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-07T00:01:50.710 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:50.711 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-07T00:01:50.712 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-07T00:01:50.713 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-07T00:01:50.714 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-07T00:01:50.715 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:50.717 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-07T00:01:50.717 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-07T00:01:50.717 INFO:teuthology.orchestra.run.smithi088.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-07T00:01:50.717 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-07T00:01:50.717 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-07T00:01:50.717 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-07T00:01:50.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-07T00:01:50.717 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-07T00:01:50.748 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 1/134 2023-10-07T00:01:50.771 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2/134 2023-10-07T00:01:50.771 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 3/134 2023-10-07T00:01:50.771 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 4/134 2023-10-07T00:01:50.771 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 5/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 9/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 10/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 11/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 12/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 13/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 14/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 15/134 2023-10-07T00:01:50.772 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 16/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 17/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 18/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 19/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 20/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 21/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 22/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 23/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 24/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 25/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 26/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 27/134 2023-10-07T00:01:50.773 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 28/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 29/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 30/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 31/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 32/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 33/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 34/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 35/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 36/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 37/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 38/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-07T00:01:50.774 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-07T00:01:50.775 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-07T00:01:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-07T00:01:50.777 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-07T00:01:50.778 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-07T00:01:50.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-07T00:01:50.780 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-07T00:01:50.781 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 129/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 131/134 2023-10-07T00:01:50.782 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-07T00:01:50.783 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-07T00:01:51.260 DEBUG:teuthology.parallel:result is None 2023-10-07T00:01:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:52.308 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:09 ago on Fri 06 Oct 2023 11:59:43 PM UTC. 2023-10-07T00:01:53.517 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-07T00:01:53.518 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:02:10 ago on Fri 06 Oct 2023 11:59:43 PM UTC. 2023-10-07T00:01:55.217 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2023-10-07T00:01:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:01:55.458 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2023-10-07T00:01:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-07T00:01:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.458 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.1-7.el8.noarch 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.0.4-10.el8.x86_64 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.459 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.1-9.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-3.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-07T00:01:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: libpq-13.5-1.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-07T00:01:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-07T00:01:55.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-07T00:01:55.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-07T00:01:55.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-2.6-1.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-07T00:01:55.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-07T00:01:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-07T00:01:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-07T00:01:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-07T00:01:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-07T00:01:55.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.470 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:55.470 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-07T00:01:55.470 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-07T00:01:55.470 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-07T00:01:55.470 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-07T00:01:55.470 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-07T00:01:55.470 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-07T00:01:55.471 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:01:55.471 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-07T00:01:55.798 DEBUG:teuthology.parallel:result is None 2023-10-07T00:01:58.501 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2023-10-07T00:01:58.728 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-07T00:01:58.728 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.1-7.el8.noarch 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.0.4-10.el8.x86_64 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.729 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.730 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.730 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.730 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.730 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.730 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.730 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.730 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.730 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.731 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.1-9.el8.x86_64 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: jq-1.6-3.el8.x86_64 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-07T00:01:58.732 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-07T00:01:58.733 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-07T00:01:58.733 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.733 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.733 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.733 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-07T00:01:58.733 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-07T00:01:58.733 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-07T00:01:58.733 INFO:teuthology.orchestra.run.smithi112.stdout: libpq-13.5-1.el8.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-07T00:01:58.734 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-07T00:01:58.735 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-07T00:01:58.736 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-07T00:01:58.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-07T00:01:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-2.6-1.el8.noarch 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-07T00:01:58.739 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-07T00:01:58.740 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-07T00:01:58.740 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-07T00:01:58.740 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-07T00:01:58.740 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-07T00:01:58.740 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.740 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.740 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-07T00:01:58.740 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-07T00:01:58.741 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-07T00:01:58.742 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-07T00:01:58.742 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-07T00:01:58.742 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-07T00:01:58.742 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-07T00:01:58.742 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-07T00:01:58.742 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.742 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.742 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-07T00:01:58.743 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-07T00:01:58.743 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-07T00:01:58.743 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-07T00:01:58.743 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-07T00:01:58.743 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-07T00:01:58.744 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-07T00:01:58.744 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-07T00:01:58.744 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-10-07T00:01:59.130 DEBUG:teuthology.parallel:result is None 2023-10-07T00:01:59.131 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-07T00:01:59.270 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-07T00:01:59.330 INFO:teuthology.orchestra.run.smithi005.stdout:18.0.0-6616.g14d8d032.el8 2023-10-07T00:01:59.331 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6616.g14d8d032.el8 2023-10-07T00:01:59.331 INFO:teuthology.task.install:The correct ceph version 18.0.0-6616.g14d8d032 is installed. 2023-10-07T00:01:59.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-07T00:01:59.543 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-07T00:01:59.604 INFO:teuthology.orchestra.run.smithi088.stdout:18.0.0-6616.g14d8d032.el8 2023-10-07T00:01:59.604 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6616.g14d8d032.el8 2023-10-07T00:01:59.604 INFO:teuthology.task.install:The correct ceph version 18.0.0-6616.g14d8d032 is installed. 2023-10-07T00:01:59.605 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-07T00:01:59.818 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-07T00:01:59.874 INFO:teuthology.orchestra.run.smithi112.stdout:18.0.0-6616.g14d8d032.el8 2023-10-07T00:01:59.874 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6616.g14d8d032.el8 2023-10-07T00:01:59.874 INFO:teuthology.task.install:The correct ceph version 18.0.0-6616.g14d8d032 is installed. 2023-10-07T00:01:59.875 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-07T00:01:59.875 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:01:59.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-07T00:01:59.978 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:01:59.978 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-07T00:02:00.073 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:02:00.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-07T00:02:00.162 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-07T00:02:00.162 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:02:00.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2023-10-07T00:02:00.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-07T00:02:00.348 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:02:00.348 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-10-07T00:02:00.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-07T00:02:00.528 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:02:00.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2023-10-07T00:02:00.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-07T00:02:00.704 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-07T00:02:00.704 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:02:00.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-07T00:02:00.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-07T00:02:00.890 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:02:00.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-07T00:02:00.959 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-07T00:02:01.066 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:02:01.066 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-07T00:02:01.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-07T00:02:01.240 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-07T00:02:01.241 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:02:01.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2023-10-07T00:02:01.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-07T00:02:01.421 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:02:01.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2023-10-07T00:02:01.490 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-07T00:02:01.598 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:02:01.598 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2023-10-07T00:02:01.672 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-07T00:02:01.781 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-07T00:02:01.872 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_client_delegate_inos_pct': 50, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-07T00:02:01.872 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-07T00:02:01.872 INFO:tasks.cephadm:Cluster fsid is bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:01.873 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-07T00:02:01.873 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.5', 'mon.b': '172.21.15.88', 'mon.c': '172.21.15.112'} 2023-10-07T00:02:01.873 INFO:tasks.cephadm:First mon is mon.a on smithi005 2023-10-07T00:02:01.873 INFO:tasks.cephadm:First mgr is x 2023-10-07T00:02:01.873 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-07T00:02:01.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2023-10-07T00:02:01.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname $(hostname -s) 2023-10-07T00:02:02.024 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2023-10-07T00:02:02.094 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-07T00:02:02.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-07T00:02:02.307 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73047/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6616-g14d8d032', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6616.g14d8d032'}, 'url': 'https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-06 10:46:00.441906', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-cephfs-mon', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-07T00:02:02.442 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref rishabh-cephfs-mon, sha1 14d8d032507701c76ca224e769ee65a96b660a8c from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-07T00:02:02.443 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/x86_64/flavors/default/cephadm 2023-10-07T00:02:02.443 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:02.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 7 00:02 /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:02.884 DEBUG:teuthology.orchestra.run.smithi088:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:03.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 7 00:02 /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:03.952 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:04.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 7 00:02 /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:04.382 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:04.433 DEBUG:teuthology.orchestra.run.smithi088:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:04.483 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-07T00:02:04.556 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c on all hosts... 2023-10-07T00:02:04.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c pull 2023-10-07T00:02:04.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c pull 2023-10-07T00:02:04.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c pull 2023-10-07T00:02:06.964 INFO:teuthology.orchestra.run.smithi088.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-07T00:02:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-07T00:02:09.042 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-07T00:02:36.844 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-10-07T00:02:36.844 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev)", 2023-10-07T00:02:36.844 INFO:teuthology.orchestra.run.smithi088.stdout: "image_id": "c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14", 2023-10-07T00:02:36.844 INFO:teuthology.orchestra.run.smithi088.stdout: "repo_digests": [ 2023-10-07T00:02:36.844 INFO:teuthology.orchestra.run.smithi088.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:80f40c42893bd196d52fcd70174d853855d3acb22cdc6bd7eee5f6d87be734f7" 2023-10-07T00:02:36.844 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-07T00:02:36.844 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-10-07T00:02:37.705 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-07T00:02:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev)", 2023-10-07T00:02:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14", 2023-10-07T00:02:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2023-10-07T00:02:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:80f40c42893bd196d52fcd70174d853855d3acb22cdc6bd7eee5f6d87be734f7" 2023-10-07T00:02:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-07T00:02:37.706 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-07T00:02:38.491 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:02:38.491 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev)", 2023-10-07T00:02:38.491 INFO:teuthology.orchestra.run.smithi005.stdout: "image_id": "c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14", 2023-10-07T00:02:38.491 INFO:teuthology.orchestra.run.smithi005.stdout: "repo_digests": [ 2023-10-07T00:02:38.492 INFO:teuthology.orchestra.run.smithi005.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:80f40c42893bd196d52fcd70174d853855d3acb22cdc6bd7eee5f6d87be734f7" 2023-10-07T00:02:38.492 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:02:38.492 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:02:38.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2023-10-07T00:02:38.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph 2023-10-07T00:02:38.672 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2023-10-07T00:02:38.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2023-10-07T00:02:38.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /etc/ceph 2023-10-07T00:02:38.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2023-10-07T00:02:38.955 INFO:tasks.cephadm:Writing seed config... 2023-10-07T00:02:38.956 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-10-07T00:02:38.956 INFO:tasks.cephadm: override: [client] debug client = 20 2023-10-07T00:02:38.956 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-10-07T00:02:38.956 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-10-07T00:02:38.956 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-10-07T00:02:38.956 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-10-07T00:02:38.957 INFO:tasks.cephadm: override: [mds] mds_client_delegate_inos_pct = 50 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-10-07T00:02:38.958 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-07T00:02:38.959 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-07T00:02:38.960 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-07T00:02:38.960 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-10-07T00:02:38.960 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-07T00:02:38.960 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-10-07T00:02:38.960 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:02:38.961 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-07T00:02:39.003 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bdea4c58-64a4-11ee-8db5-212e2dc638e7 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_client_delegate_inos_pct = 50 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-10-07T00:02:39.004 DEBUG:teuthology.orchestra.run.smithi005:mon.a> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-07T00:02:39.048 DEBUG:teuthology.orchestra.run.smithi005:mgr.x> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-07T00:02:39.092 INFO:tasks.cephadm:Bootstrapping... 2023-10-07T00:02:39.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c -v bootstrap --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.5 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:02:39.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:02:39.161 INFO:journalctl@ceph.mgr.x.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:02:39.332 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-10-07T00:02:39.333 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c', '-v', 'bootstrap', '--fsid', 'bdea4c58-64a4-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.5', '--skip-admin-label'] 2023-10-07T00:02:39.507 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.1.1 2023-10-07T00:02:39.508 INFO:teuthology.orchestra.run.smithi005.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-07T00:02:39.508 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying podman|docker is present... 2023-10-07T00:02:39.680 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.1.1 2023-10-07T00:02:39.680 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying lvm2 is present... 2023-10-07T00:02:39.680 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying time synchronization is in place... 2023-10-07T00:02:39.694 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-07T00:02:39.694 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-07T00:02:39.707 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-07T00:02:39.708 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-07T00:02:39.721 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2023-10-07T00:02:39.735 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2023-10-07T00:02:39.735 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2023-10-07T00:02:39.735 INFO:teuthology.orchestra.run.smithi005.stdout:Repeating the final host check... 2023-10-07T00:02:39.905 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.1.1 2023-10-07T00:02:39.906 INFO:teuthology.orchestra.run.smithi005.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-07T00:02:39.906 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl is present 2023-10-07T00:02:39.906 INFO:teuthology.orchestra.run.smithi005.stdout:lvcreate is present 2023-10-07T00:02:39.919 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-07T00:02:39.919 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-07T00:02:39.931 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-07T00:02:39.931 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-07T00:02:39.945 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2023-10-07T00:02:39.958 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2023-10-07T00:02:39.958 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2023-10-07T00:02:39.958 INFO:teuthology.orchestra.run.smithi005.stdout:Host looks OK 2023-10-07T00:02:39.958 INFO:teuthology.orchestra.run.smithi005.stdout:Cluster fsid: bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:39.958 INFO:teuthology.orchestra.run.smithi005.stdout:Acquiring lock 139916365060640 on /run/cephadm/bdea4c58-64a4-11ee-8db5-212e2dc638e7.lock 2023-10-07T00:02:39.959 INFO:teuthology.orchestra.run.smithi005.stdout:Lock 139916365060640 acquired on /run/cephadm/bdea4c58-64a4-11ee-8db5-212e2dc638e7.lock 2023-10-07T00:02:39.959 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 3300 ... 2023-10-07T00:02:39.959 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 6789 ... 2023-10-07T00:02:39.960 INFO:teuthology.orchestra.run.smithi005.stdout:Base mon IP(s) is [172.21.15.5:3300, 172.21.15.5:6789], mon addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2023-10-07T00:02:39.968 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-07T00:02:39.968 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 metric 100 2023-10-07T00:02:39.974 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-07T00:02:39.974 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-07T00:02:39.975 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1771sec hoplimit 64 pref medium 2023-10-07T00:02:39.981 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-07T00:02:39.981 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-07T00:02:39.981 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-07T00:02:39.981 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-07T00:02:39.981 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-07T00:02:39.981 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-07T00:02:39.982 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2023-10-07T00:02:39.982 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2023-10-07T00:02:39.982 INFO:teuthology.orchestra.run.smithi005.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-07T00:02:39.983 INFO:teuthology.orchestra.run.smithi005.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-07T00:02:39.984 INFO:teuthology.orchestra.run.smithi005.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-07T00:02:40.460 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14 2023-10-07T00:02:40.460 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-07T00:02:40.461 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Getting image source signatures 2023-10-07T00:02:40.461 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:a951a90ba2bd822dba777faf493a1625bb5a2f5c5042f0fdc315d633d2c600c8 2023-10-07T00:02:40.461 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-07T00:02:40.461 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying config sha256:c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14 2023-10-07T00:02:40.461 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-07T00:02:40.462 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Storing signatures 2023-10-07T00:02:41.332 INFO:teuthology.orchestra.run.smithi005.stdout:ceph: stdout ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev) 2023-10-07T00:02:41.332 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph version: ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev) 2023-10-07T00:02:41.332 INFO:teuthology.orchestra.run.smithi005.stdout:Extracting ceph user uid/gid from container image... 2023-10-07T00:02:42.109 INFO:teuthology.orchestra.run.smithi005.stdout:stat: stdout 167 167 2023-10-07T00:02:42.109 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial keys... 2023-10-07T00:02:42.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQAioCBlKvy1HhAAvKFXw8MYDvY7q3yJkOqixw== 2023-10-07T00:02:43.656 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQAjoCBlpqIkERAAEdwvHtKADDQ2B+J8zONWxw== 2023-10-07T00:02:44.535 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQAkoCBlYdhCBRAATt/Z/AxTZQkmYziFZWePlA== 2023-10-07T00:02:44.536 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial monmap... 2023-10-07T00:02:45.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-07T00:02:45.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-07T00:02:45.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:45.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-07T00:02:45.310 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool for a [v2:172.21.15.5:3300,v1:172.21.15.5:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-07T00:02:45.310 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2023-10-07T00:02:45.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: set fsid to bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:45.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-07T00:02:45.310 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:02:45.310 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mon... 2023-10-07T00:02:46.083 INFO:teuthology.orchestra.run.smithi005.stdout:create mon.a on 2023-10-07T00:02:46.325 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-07T00:02:46.537 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-07T00:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7.target. 2023-10-07T00:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7.target. 2023-10-07T00:02:47.282 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.a 2023-10-07T00:02:47.282 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-07T00:02:47.492 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7.target.wants/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@.service. 2023-10-07T00:02:47.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:47 smithi005 systemd[1]: Starting Ceph mon.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:02:48.273 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:47 smithi005 podman[128854]: 2023-10-07T00:02:48.274 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:48 smithi005 bash[128854]: ba8fb4ea47dcc602c7bba03dc6acbd8b10cd807325c0d4bfee95b4dc7104b670 2023-10-07T00:02:48.298 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-07T00:02:48.298 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2023-10-07T00:02:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-07T00:02:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-07T00:02:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2023-10-07T00:02:48.313 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2023-10-07T00:02:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon to start... 2023-10-07T00:02:48.314 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon... 2023-10-07T00:02:48.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:48 smithi005 ceph-mon[128894]: mkfs bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:48.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:48 smithi005 systemd[1]: Started Ceph mon.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:02:48.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:48 smithi005 ceph-mon[128894]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-07T00:02:49.404 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout cluster: 2023-10-07T00:02:49.404 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout id: bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:49.404 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-07T00:02:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:02:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout services: 2023-10-07T00:02:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.691753s) 2023-10-07T00:02:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-07T00:02:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-07T00:02:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:02:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout data: 2023-10-07T00:02:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pgs: 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.872+0000 7f12622a7700 1 Processor -- start 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.872+0000 7f12622a7700 1 -- start start 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.873+0000 7f12622a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c07a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.873+0000 7f12622a7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c07a870 con 0x7f125c07be40 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.873+0000 7f125bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c07a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:49.406 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.874+0000 7f125bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c07a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57298/0 (socket says 172.21.15.5:57298) 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.874+0000 7f125bfff700 1 -- 172.21.15.5:0/856765959 learned_addr learned my addr 172.21.15.5:0/856765959 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.874+0000 7f125bfff700 1 -- 172.21.15.5:0/856765959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c07a9b0 con 0x7f125c07be40 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.874+0000 7f125bfff700 1 --2- 172.21.15.5:0/856765959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c07a2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098a0 tx=0x7f124c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1393746b9d32ff4e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.874+0000 7f125b7fe700 1 -- 172.21.15.5:0/856765959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f124c004160 con 0x7f125c07be40 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.874+0000 7f125b7fe700 1 -- 172.21.15.5:0/856765959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c0042c0 con 0x7f125c07be40 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.874+0000 7f125b7fe700 1 -- 172.21.15.5:0/856765959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f124c0045a0 con 0x7f125c07be40 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.875+0000 7f12622a7700 1 -- 172.21.15.5:0/856765959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 msgr2=0x7f125c07a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.875+0000 7f12622a7700 1 --2- 172.21.15.5:0/856765959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c07a2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098a0 tx=0x7f124c009bb0 comp rx=0 tx=0).stop 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.875+0000 7f12622a7700 1 -- 172.21.15.5:0/856765959 shutdown_connections 2023-10-07T00:02:49.407 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.875+0000 7f12622a7700 1 --2- 172.21.15.5:0/856765959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c07a2a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.875+0000 7f12622a7700 1 -- 172.21.15.5:0/856765959 >> 172.21.15.5:0/856765959 conn(0x7f125c101b30 msgr2=0x7f125c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.875+0000 7f12622a7700 1 -- 172.21.15.5:0/856765959 shutdown_connections 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.875+0000 7f12622a7700 1 -- 172.21.15.5:0/856765959 wait complete. 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.876+0000 7f12622a7700 1 Processor -- start 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.876+0000 7f12622a7700 1 -- start start 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.877+0000 7f12622a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.877+0000 7f12622a7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c19c0b0 con 0x7f125c07be40 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.877+0000 7f125bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:49.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.877+0000 7f125bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c19bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57302/0 (socket says 172.21.15.5:57302) 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.877+0000 7f125bfff700 1 -- 172.21.15.5:0/2495057733 learned_addr learned my addr 172.21.15.5:0/2495057733 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.877+0000 7f125bfff700 1 -- 172.21.15.5:0/2495057733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c009550 con 0x7f125c07be40 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.878+0000 7f125bfff700 1 --2- 172.21.15.5:0/2495057733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c19bb70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f125c07b310 tx=0x7f124c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.878+0000 7f1259ffb700 1 -- 172.21.15.5:0/2495057733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f124c011630 con 0x7f125c07be40 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.878+0000 7f1259ffb700 1 -- 172.21.15.5:0/2495057733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c011790 con 0x7f125c07be40 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.878+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c19c2b0 con 0x7f125c07be40 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.878+0000 7f1259ffb700 1 -- 172.21.15.5:0/2495057733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f124c011a30 con 0x7f125c07be40 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.878+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c19c6d0 con 0x7f125c07be40 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.878+0000 7f1259ffb700 1 -- 172.21.15.5:0/2495057733 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f124c022070 con 0x7f125c07be40 2023-10-07T00:02:49.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.878+0000 7f1259ffb700 1 -- 172.21.15.5:0/2495057733 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f124c01c450 con 0x7f125c07be40 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.879+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c195b20 con 0x7f125c07be40 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.882+0000 7f1259ffb700 1 -- 172.21.15.5:0/2495057733 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f124c01b450 con 0x7f125c07be40 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.958+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f125c07ad20 con 0x7f125c07be40 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.959+0000 7f1259ffb700 1 -- 172.21.15.5:0/2495057733 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f124c01b5f0 con 0x7f125c07be40 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.960+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 msgr2=0x7f125c19bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.960+0000 7f12622a7700 1 --2- 172.21.15.5:0/2495057733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c19bb70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f125c07b310 tx=0x7f124c004750 comp rx=0 tx=0).stop 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.960+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 shutdown_connections 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.960+0000 7f12622a7700 1 --2- 172.21.15.5:0/2495057733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c07be40 0x7f125c19bb70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:49.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.960+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 >> 172.21.15.5:0/2495057733 conn(0x7f125c101b30 msgr2=0x7f125c1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:49.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.960+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 shutdown_connections 2023-10-07T00:02:49.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:48.960+0000 7f12622a7700 1 -- 172.21.15.5:0/2495057733 wait complete. 2023-10-07T00:02:49.411 INFO:teuthology.orchestra.run.smithi005.stdout:mon is available 2023-10-07T00:02:49.411 INFO:teuthology.orchestra.run.smithi005.stdout:Assimilating anything we can from ceph.conf... 2023-10-07T00:02:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:49 smithi005 ceph-mon[128894]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-07T00:02:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:49 smithi005 ceph-mon[128894]: monmap e1: 1 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} 2023-10-07T00:02:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:49 smithi005 ceph-mon[128894]: fsmap 2023-10-07T00:02:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:49 smithi005 ceph-mon[128894]: osdmap e1: 0 total, 0 up, 0 in 2023-10-07T00:02:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:49 smithi005 ceph-mon[128894]: mgrmap e1: no daemons active 2023-10-07T00:02:49.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:49 smithi005 ceph-mon[128894]: from='client.? 172.21.15.5:0/2495057733' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-07T00:02:50.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:50 smithi005 ceph-mon[128894]: from='client.? 172.21.15.5:0/4164309233' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-07T00:02:50.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:50 smithi005 ceph-mon[128894]: from='client.? 172.21.15.5:0/4164309233' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-07T00:02:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:02:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2023-10-07T00:02:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2023-10-07T00:02:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-07T00:02:50.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-07T00:02:50.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-07T00:02:50.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-07T00:02:50.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:02:50.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-07T00:02:50.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-07T00:02:50.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:02:50.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.936+0000 7f7ac86bf700 1 Processor -- start 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.937+0000 7f7ac86bf700 1 -- start start 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.937+0000 7f7ac86bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac007a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.937+0000 7f7ac86bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac007a890 con 0x7f7ac007be60 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.938+0000 7f7ac645b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac007a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:50.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.938+0000 7f7ac645b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac007a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57318/0 (socket says 172.21.15.5:57318) 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.938+0000 7f7ac645b700 1 -- 172.21.15.5:0/207981924 learned_addr learned my addr 172.21.15.5:0/207981924 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.938+0000 7f7ac645b700 1 -- 172.21.15.5:0/207981924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac007a9d0 con 0x7f7ac007be60 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.938+0000 7f7ac645b700 1 --2- 172.21.15.5:0/207981924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac007a2c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0098a0 tx=0x7f7abc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9402a5142366936 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac5459700 1 -- 172.21.15.5:0/207981924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7abc004160 con 0x7f7ac007be60 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac5459700 1 -- 172.21.15.5:0/207981924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc0042c0 con 0x7f7ac007be60 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac5459700 1 -- 172.21.15.5:0/207981924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7abc0045a0 con 0x7f7ac007be60 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac86bf700 1 -- 172.21.15.5:0/207981924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 msgr2=0x7f7ac007a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac86bf700 1 --2- 172.21.15.5:0/207981924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac007a2c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0098a0 tx=0x7f7abc009bb0 comp rx=0 tx=0).stop 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac86bf700 1 -- 172.21.15.5:0/207981924 shutdown_connections 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac86bf700 1 --2- 172.21.15.5:0/207981924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac007a2c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:50.487 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac86bf700 1 -- 172.21.15.5:0/207981924 >> 172.21.15.5:0/207981924 conn(0x7f7ac0101b30 msgr2=0x7f7ac0103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:50.488 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac86bf700 1 -- 172.21.15.5:0/207981924 shutdown_connections 2023-10-07T00:02:50.488 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.939+0000 7f7ac86bf700 1 -- 172.21.15.5:0/207981924 wait complete. 2023-10-07T00:02:50.488 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.941+0000 7f7ac86bf700 1 Processor -- start 2023-10-07T00:02:50.488 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.941+0000 7f7ac86bf700 1 -- start start 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.942+0000 7f7ac86bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.942+0000 7f7ac86bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac019c0e0 con 0x7f7ac007be60 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.942+0000 7f7ac645b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.942+0000 7f7ac645b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57322/0 (socket says 172.21.15.5:57322) 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.942+0000 7f7ac645b700 1 -- 172.21.15.5:0/4164309233 learned_addr learned my addr 172.21.15.5:0/4164309233 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.942+0000 7f7ac645b700 1 -- 172.21.15.5:0/4164309233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc009550 con 0x7f7ac007be60 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.942+0000 7f7ac645b700 1 --2- 172.21.15.5:0/4164309233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac019bba0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7ac007b330 tx=0x7f7abc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.943+0000 7f7ab77fe700 1 -- 172.21.15.5:0/4164309233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7abc011630 con 0x7f7ac007be60 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.943+0000 7f7ab77fe700 1 -- 172.21.15.5:0/4164309233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc011790 con 0x7f7ac007be60 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.943+0000 7f7ab77fe700 1 -- 172.21.15.5:0/4164309233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7abc011a30 con 0x7f7ac007be60 2023-10-07T00:02:50.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.943+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac019c2e0 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.943+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac019c700 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.943+0000 7f7ab77fe700 1 -- 172.21.15.5:0/4164309233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7abc022070 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.943+0000 7f7ab77fe700 1 -- 172.21.15.5:0/4164309233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7abc01c450 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.944+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac0195b70 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:49.947+0000 7f7ab77fe700 1 -- 172.21.15.5:0/4164309233 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7abc01b450 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.019+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f7ac007af80 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.023+0000 7f7ab77fe700 1 -- 172.21.15.5:0/4164309233 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f7abc01b5f0 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.024+0000 7f7ab77fe700 1 -- 172.21.15.5:0/4164309233 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7abc01b790 con 0x7f7ac007be60 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.024+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 msgr2=0x7f7ac019bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.025+0000 7f7ac86bf700 1 --2- 172.21.15.5:0/4164309233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac019bba0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7ac007b330 tx=0x7f7abc004750 comp rx=0 tx=0).stop 2023-10-07T00:02:50.490 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.025+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 shutdown_connections 2023-10-07T00:02:50.491 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.025+0000 7f7ac86bf700 1 --2- 172.21.15.5:0/4164309233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ac007be60 0x7f7ac019bba0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:50.491 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.025+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 >> 172.21.15.5:0/4164309233 conn(0x7f7ac0101b30 msgr2=0x7f7ac0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:50.491 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.025+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 shutdown_connections 2023-10-07T00:02:50.491 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:50.025+0000 7f7ac86bf700 1 -- 172.21.15.5:0/4164309233 wait complete. 2023-10-07T00:02:50.491 INFO:teuthology.orchestra.run.smithi005.stdout:Generating new minimal ceph.conf... 2023-10-07T00:02:51.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:51 smithi005 ceph-mon[128894]: from='client.? 172.21.15.5:0/2167841036' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:02:51.466 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.002+0000 7fe6b2b33700 1 Processor -- start 2023-10-07T00:02:51.466 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.002+0000 7fe6b2b33700 1 -- start start 2023-10-07T00:02:51.466 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.002+0000 7fe6b2b33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:51.466 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.002+0000 7fe6b2b33700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac07a890 con 0x7fe6ac07be60 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.003+0000 7fe6b08cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.003+0000 7fe6b08cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57328/0 (socket says 172.21.15.5:57328) 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.003+0000 7fe6b08cf700 1 -- 172.21.15.5:0/773521341 learned_addr learned my addr 172.21.15.5:0/773521341 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.003+0000 7fe6b08cf700 1 -- 172.21.15.5:0/773521341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac07a9d0 con 0x7fe6ac07be60 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.003+0000 7fe6b08cf700 1 --2- 172.21.15.5:0/773521341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac07a2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00098a0 tx=0x7fe6a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a8863cd5686be3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6ab7fe700 1 -- 172.21.15.5:0/773521341 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6a0004160 con 0x7fe6ac07be60 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6ab7fe700 1 -- 172.21.15.5:0/773521341 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe6a00042c0 con 0x7fe6ac07be60 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6ab7fe700 1 -- 172.21.15.5:0/773521341 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6a0011940 con 0x7fe6ac07be60 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6b2b33700 1 -- 172.21.15.5:0/773521341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 msgr2=0x7fe6ac07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:51.467 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6b2b33700 1 --2- 172.21.15.5:0/773521341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac07a2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00098a0 tx=0x7fe6a0009bb0 comp rx=0 tx=0).stop 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6b2b33700 1 -- 172.21.15.5:0/773521341 shutdown_connections 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6b2b33700 1 --2- 172.21.15.5:0/773521341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac07a2c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6b2b33700 1 -- 172.21.15.5:0/773521341 >> 172.21.15.5:0/773521341 conn(0x7fe6ac101b30 msgr2=0x7fe6ac103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.004+0000 7fe6b2b33700 1 -- 172.21.15.5:0/773521341 shutdown_connections 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.005+0000 7fe6b2b33700 1 -- 172.21.15.5:0/773521341 wait complete. 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.005+0000 7fe6b2b33700 1 Processor -- start 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.006+0000 7fe6b2b33700 1 -- start start 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.006+0000 7fe6b2b33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.006+0000 7fe6b2b33700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac19c7d0 con 0x7fe6ac07be60 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.006+0000 7fe6b08cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.006+0000 7fe6b08cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57342/0 (socket says 172.21.15.5:57342) 2023-10-07T00:02:51.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.006+0000 7fe6b08cf700 1 -- 172.21.15.5:0/2167841036 learned_addr learned my addr 172.21.15.5:0/2167841036 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.007+0000 7fe6b08cf700 1 -- 172.21.15.5:0/2167841036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a0009550 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.007+0000 7fe6b08cf700 1 --2- 172.21.15.5:0/2167841036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac19c290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0006af0 tx=0x7fe6a0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.007+0000 7fe6a9ffb700 1 -- 172.21.15.5:0/2167841036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6a0003bf0 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.007+0000 7fe6a9ffb700 1 -- 172.21.15.5:0/2167841036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe6a001b8b0 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.007+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac19c9d0 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.007+0000 7fe6a9ffb700 1 -- 172.21.15.5:0/2167841036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6a0019880 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.007+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac19cdf0 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.007+0000 7fe6a9ffb700 1 -- 172.21.15.5:0/2167841036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe6a00233f0 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.008+0000 7fe6a9ffb700 1 -- 172.21.15.5:0/2167841036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe6a001a710 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.008+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac0624e0 con 0x7fe6ac07be60 2023-10-07T00:02:51.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.011+0000 7fe6a9ffb700 1 -- 172.21.15.5:0/2167841036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe6a0028060 con 0x7fe6ac07be60 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.086+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe6ac10cb90 con 0x7fe6ac07be60 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.086+0000 7fe6a9ffb700 1 -- 172.21.15.5:0/2167841036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7fe6a001bd70 con 0x7fe6ac07be60 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.087+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 msgr2=0x7fe6ac19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.087+0000 7fe6b2b33700 1 --2- 172.21.15.5:0/2167841036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac19c290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0006af0 tx=0x7fe6a0011a30 comp rx=0 tx=0).stop 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.087+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 shutdown_connections 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.087+0000 7fe6b2b33700 1 --2- 172.21.15.5:0/2167841036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac07be60 0x7fe6ac19c290 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.087+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 >> 172.21.15.5:0/2167841036 conn(0x7fe6ac101b30 msgr2=0x7fe6ac102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.087+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 shutdown_connections 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:51.088+0000 7fe6b2b33700 1 -- 172.21.15.5:0/2167841036 wait complete. 2023-10-07T00:02:51.470 INFO:teuthology.orchestra.run.smithi005.stdout:Restarting the monitor... 2023-10-07T00:02:51.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:51 smithi005 systemd[1]: Stopping Ceph mon.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:02:53.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:53 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a[128870]: 2023-10-07T00:02:53.039+0000 7f4744515700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:02:53.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:53 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a[128870]: 2023-10-07T00:02:53.039+0000 7f4744515700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-07T00:02:53.599 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:53 smithi005 bash[129232]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a 2023-10-07T00:02:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:53 smithi005 systemd[1]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-07T00:02:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:53 smithi005 systemd[1]: Stopped Ceph mon.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:02:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:53 smithi005 systemd[1]: Starting Ceph mon.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:02:54.486 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 podman[129365]: 2023-10-07T00:02:54.486 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 bash[129365]: cb6a74464855325aba3393f9cecd2f8d783ff04f35ccc5c0d5f464d1ac849c1a 2023-10-07T00:02:54.486 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: set uid:gid to 167:167 (ceph:ceph) 2023-10-07T00:02:54.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev), process ceph-mon, pid 7 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: pidfile_write: ignore empty --pid-file 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: load: jerasure load: lrc 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: RocksDB version: 7.9.2 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Git sha 0 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Compile date 2023-10-06 09:28:03 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: DB SUMMARY 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: DB Session ID: 94LCXU4CKVBBHVW8NRGZ 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: CURRENT file: CURRENT 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: IDENTITY file: IDENTITY 2023-10-07T00:02:54.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98300 ; 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.error_if_exists: 0 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.create_if_missing: 0 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.paranoid_checks: 1 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.env: 0x558d02099da0 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.fs: PosixFileSystem 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.info_log: 0x558d046215c0 2023-10-07T00:02:54.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_file_opening_threads: 16 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.statistics: (nil) 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.use_fsync: 0 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_log_file_size: 0 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.keep_log_file_num: 1000 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.recycle_log_file_num: 0 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.allow_fallocate: 1 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.allow_mmap_reads: 0 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.allow_mmap_writes: 0 2023-10-07T00:02:54.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.use_direct_reads: 0 2023-10-07T00:02:54.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-07T00:02:54.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.create_missing_column_families: 0 2023-10-07T00:02:54.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.db_log_dir: 2023-10-07T00:02:54.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.wal_dir: 2023-10-07T00:02:54.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.advise_random_on_open: 1 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.db_write_buffer_size: 0 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.write_buffer_manager: 0x558d045d9360 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-07T00:02:54.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.rate_limiter: (nil) 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.wal_recovery_mode: 2 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.enable_thread_tracking: 0 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.enable_pipelined_write: 0 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.unordered_write: 0 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.row_cache: None 2023-10-07T00:02:54.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.wal_filter: None 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.allow_ingest_behind: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.two_write_queues: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.manual_wal_flush: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.wal_compression: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.atomic_flush: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.log_readahead_size: 0 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-07T00:02:54.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.best_efforts_recovery: 0 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.allow_data_in_errors: 0 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.db_host_id: __hostname__ 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_background_jobs: 2 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_background_compactions: -1 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_subcompactions: 1 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-07T00:02:54.517 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_total_wal_size: 0 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_open_files: -1 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bytes_per_sync: 0 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_readahead_size: 0 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_background_flushes: -1 2023-10-07T00:02:54.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Compression algorithms supported: 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: kZSTD supported: 0 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: kXpressCompression supported: 0 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: kLZ4HCCompression supported: 1 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: kZlibCompression supported: 1 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: kSnappyCompression supported: 1 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: kLZ4Compression supported: 1 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: kBZip2Compression supported: 0 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-07T00:02:54.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.merge_operator: 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_filter: None 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_filter_factory: None 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.sst_partitioner_factory: None 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558d046216c0) 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks: 1 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-07T00:02:54.520 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_top_level_index_and_filter: 1 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_type: 0 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_index_type: 0 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_shortening: 1 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: checksum: 4 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: no_block_cache: 0 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache: 0x558d046771f0 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_name: BinnedLRUCache 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_options: 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: capacity : 536870912 2023-10-07T00:02:54.521 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_shard_bits : 4 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: strict_capacity_limit : 0 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: high_pri_pool_ratio: 0.000 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_compressed: (nil) 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: persistent_cache: (nil) 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size: 4096 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size_deviation: 10 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_restart_interval: 16 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_block_restart_interval: 1 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: metadata_block_size: 4096 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: partition_filters: 0 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: use_delta_encoding: 1 2023-10-07T00:02:54.522 INFO:journalctl@ceph.mon.a.smithi005.stdout: filter_policy: bloomfilter 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: whole_key_filtering: 1 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: verify_compression: 0 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: read_amp_bytes_per_bit: 0 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: format_version: 5 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_index_compression: 1 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_align: 0 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: max_auto_readahead_size: 262144 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: prepopulate_block_cache: 0 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: initial_auto_readahead_size: 8192 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_file_reads_for_auto_readahead: 2 2023-10-07T00:02:54.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.write_buffer_size: 33554432 2023-10-07T00:02:54.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_write_buffer_number: 2 2023-10-07T00:02:54.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression: NoCompression 2023-10-07T00:02:54.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression: Disabled 2023-10-07T00:02:54.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.prefix_extractor: nullptr 2023-10-07T00:02:54.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-07T00:02:54.555 INFO:teuthology.orchestra.run.smithi005.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-07T00:02:54.817 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.num_levels: 7 2023-10-07T00:02:54.817 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-07T00:02:54.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-07T00:02:54.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-07T00:02:54.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-07T00:02:54.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-07T00:02:54.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-07T00:02:54.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-07T00:02:54.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-07T00:02:54.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.level: 32767 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.strategy: 0 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-07T00:02:54.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-07T00:02:54.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-07T00:02:54.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.enabled: false 2023-10-07T00:02:54.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-07T00:02:54.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-07T00:02:54.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-07T00:02:54.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-07T00:02:54.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.target_file_size_base: 67108864 2023-10-07T00:02:54.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-07T00:02:54.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-07T00:02:54.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-07T00:02:54.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-07T00:02:54.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-07T00:02:54.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-07T00:02:54.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.arena_block_size: 1048576 2023-10-07T00:02:54.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-07T00:02:54.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-07T00:02:54.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.disable_auto_compactions: 0 2023-10-07T00:02:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-07T00:02:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-07T00:02:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-07T00:02:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-07T00:02:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-07T00:02:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-07T00:02:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-07T00:02:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-07T00:02:54.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-07T00:02:54.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-07T00:02:54.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.table_properties_collectors: 2023-10-07T00:02:54.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.inplace_update_support: 0 2023-10-07T00:02:54.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-07T00:02:54.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-07T00:02:54.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-07T00:02:54.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.bloom_locality: 0 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.max_successive_merges: 0 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.paranoid_file_checks: 0 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.force_consistency_checks: 1 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.report_bg_io_stats: 0 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.ttl: 2592000 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-07T00:02:54.825 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-07T00:02:54.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-07T00:02:54.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.enable_blob_files: false 2023-10-07T00:02:54.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.min_blob_size: 0 2023-10-07T00:02:54.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.blob_file_size: 268435456 2023-10-07T00:02:54.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-07T00:02:54.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-07T00:02:54.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-07T00:02:54.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.blob_file_starting_level: 0 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 81a22403-69ff-4ef3-a695-a2e6f43cab77 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696636974499066, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-07T00:02:54.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696636974501803, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93610, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 312, "table_properties": {"data_size": 91610, "index_size": 282, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13529, "raw_average_key_size": 49, "raw_value_size": 84219, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 271, "num_filter_entries": 271, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696636974, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "81a22403-69ff-4ef3-a695-a2e6f43cab77", "db_session_id": "94LCXU4CKVBBHVW8NRGZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-07T00:02:54.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696636974502011, "job": 1, "event": "recovery_finished"} 2023-10-07T00:02:54.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-07T00:02:54.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-07T00:02:54.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558d04714000 2023-10-07T00:02:54.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: DB pointer 0x558d04700000 2023-10-07T00:02:54.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-07T00:02:54.829 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-07T00:02:54.829 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** DB Stats ** 2023-10-07T00:02:54.829 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-07T00:02:54.829 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-07T00:02:54.829 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-07T00:02:54.830 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-07T00:02:54.830 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-07T00:02:54.830 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-07T00:02:54.830 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-07T00:02:54.830 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-07T00:02:54.830 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2023-10-07T00:02:54.831 INFO:journalctl@ceph.mon.a.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-07T00:02:54.831 INFO:journalctl@ceph.mon.a.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-07T00:02:54.831 INFO:journalctl@ceph.mon.a.smithi005.stdout: L0 2/0 93.25 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 51.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-10-07T00:02:54.831 INFO:journalctl@ceph.mon.a.smithi005.stdout: Sum 2/0 93.25 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 51.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-10-07T00:02:54.831 INFO:journalctl@ceph.mon.a.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 51.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-10-07T00:02:54.831 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-07T00:02:54.831 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2023-10-07T00:02:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-07T00:02:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-07T00:02:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 51.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-10-07T00:02:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-07T00:02:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-07T00:02:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-07T00:02:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-07T00:02:54.833 INFO:journalctl@ceph.mon.a.smithi005.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-07T00:02:54.833 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-07T00:02:54.833 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-07T00:02:54.833 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-07T00:02:54.833 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-07T00:02:54.833 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative compaction: 0.00 GB write, 9.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-07T00:02:54.833 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval compaction: 0.00 GB write, 9.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache BinnedLRUCache@0x558d046771f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: starting mon.a rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a@-1(???) e1 preinit fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a@-1(???).mds e1 new map 2023-10-07T00:02:54.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a@-1(???).mds e1 print_map 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout: e1 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout: legacy client fscid: -1 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout: No filesystems configured 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:02:54.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta expand map: {default=false} 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta from 'false' to 'false' 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta expanded map: {default=false} 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta expand map: {default=info} 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta from 'info' to 'info' 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta expanded map: {default=info} 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta expand map: {default=daemon} 2023-10-07T00:02:54.836 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta expanded map: {default=daemon} 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta expand map: {default=debug} 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta from 'debug' to 'debug' 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: expand_channel_meta expanded map: {default=debug} 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 systemd[1]: Started Ceph mon.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: monmap e1: 1 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: fsmap 2023-10-07T00:02:54.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: osdmap e1: 0 total, 0 up, 0 in 2023-10-07T00:02:54.838 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:54 smithi005 ceph-mon[129406]: mgrmap e1: no daemons active 2023-10-07T00:02:55.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.082+0000 7f619cc57700 1 Processor -- start 2023-10-07T00:02:55.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.082+0000 7f619cc57700 1 -- start start 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.082+0000 7f619cc57700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619807a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.082+0000 7f619cc57700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619807a8d0 con 0x7f619807bea0 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.083+0000 7f619659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619807a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.083+0000 7f619659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619807a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60578/0 (socket says 172.21.15.5:60578) 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.083+0000 7f619659c700 1 -- 172.21.15.5:0/2966443671 learned_addr learned my addr 172.21.15.5:0/2966443671 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.084+0000 7f619659c700 1 -- 172.21.15.5:0/2966443671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619807aa10 con 0x7f619807bea0 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.084+0000 7f619659c700 1 --2- 172.21.15.5:0/2966443671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619807a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f61880098a0 tx=0x7f6188009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3efac8c28bc7fe server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.084+0000 7f619559a700 1 -- 172.21.15.5:0/2966443671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6188004160 con 0x7f619807bea0 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.084+0000 7f619559a700 1 -- 172.21.15.5:0/2966443671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f61880042c0 con 0x7f619807bea0 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.084+0000 7f619559a700 1 -- 172.21.15.5:0/2966443671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6188011940 con 0x7f619807bea0 2023-10-07T00:02:55.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.085+0000 7f619cc57700 1 -- 172.21.15.5:0/2966443671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 msgr2=0x7f619807a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.085+0000 7f619cc57700 1 --2- 172.21.15.5:0/2966443671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619807a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f61880098a0 tx=0x7f6188009bb0 comp rx=0 tx=0).stop 2023-10-07T00:02:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.085+0000 7f619cc57700 1 -- 172.21.15.5:0/2966443671 shutdown_connections 2023-10-07T00:02:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.085+0000 7f619cc57700 1 --2- 172.21.15.5:0/2966443671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619807a300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.085+0000 7f619cc57700 1 -- 172.21.15.5:0/2966443671 >> 172.21.15.5:0/2966443671 conn(0x7f6198101b00 msgr2=0x7f6198103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.085+0000 7f619cc57700 1 -- 172.21.15.5:0/2966443671 shutdown_connections 2023-10-07T00:02:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.085+0000 7f619cc57700 1 -- 172.21.15.5:0/2966443671 wait complete. 2023-10-07T00:02:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.086+0000 7f619cc57700 1 Processor -- start 2023-10-07T00:02:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.086+0000 7f619cc57700 1 -- start start 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.086+0000 7f619cc57700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619819c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.086+0000 7f619cc57700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619819c780 con 0x7f619807bea0 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.087+0000 7f619659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619819c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.087+0000 7f619659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619819c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60594/0 (socket says 172.21.15.5:60594) 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.087+0000 7f619659c700 1 -- 172.21.15.5:0/3194840634 learned_addr learned my addr 172.21.15.5:0/3194840634 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.087+0000 7f619659c700 1 -- 172.21.15.5:0/3194840634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188009550 con 0x7f619807bea0 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.087+0000 7f619659c700 1 --2- 172.21.15.5:0/3194840634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619819c240 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6188000c00 tx=0x7f6188011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.088+0000 7f61877fe700 1 -- 172.21.15.5:0/3194840634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61880036a0 con 0x7f619807bea0 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.088+0000 7f61877fe700 1 -- 172.21.15.5:0/3194840634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f618801b440 con 0x7f619807bea0 2023-10-07T00:02:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.088+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619819c980 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.088+0000 7f61877fe700 1 -- 172.21.15.5:0/3194840634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61880193f0 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.088+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619819cda0 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.088+0000 7f61877fe700 1 -- 172.21.15.5:0/3194840634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6188019930 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.088+0000 7f61877fe700 1 -- 172.21.15.5:0/3194840634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f618801a3d0 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.089+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619810c8d0 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.092+0000 7f61877fe700 1 -- 172.21.15.5:0/3194840634 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6188029060 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.164+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f619819fa80 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.166+0000 7f61877fe700 1 -- 172.21.15.5:0/3194840634 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f618801f070 con 0x7f619807bea0 2023-10-07T00:02:55.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.167+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 msgr2=0x7f619819c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:55.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.167+0000 7f619cc57700 1 --2- 172.21.15.5:0/3194840634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619819c240 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6188000c00 tx=0x7f6188011e70 comp rx=0 tx=0).stop 2023-10-07T00:02:55.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.167+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 shutdown_connections 2023-10-07T00:02:55.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.167+0000 7f619cc57700 1 --2- 172.21.15.5:0/3194840634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f619807bea0 0x7f619819c240 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:55.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.167+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 >> 172.21.15.5:0/3194840634 conn(0x7f6198101b00 msgr2=0x7f6198102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:55.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.167+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 shutdown_connections 2023-10-07T00:02:55.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:55.168+0000 7f619cc57700 1 -- 172.21.15.5:0/3194840634 wait complete. 2023-10-07T00:02:55.546 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-07T00:02:55.563 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:02:55.563 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mgr... 2023-10-07T00:02:55.564 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-07T00:02:55.564 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-07T00:02:55.945 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.x 2023-10-07T00:02:55.946 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-07T00:02:56.154 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7.target.wants/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@.service. 2023-10-07T00:02:56.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:56 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3194840634' entity='client.admin' 2023-10-07T00:02:56.359 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:56 smithi005 systemd[1]: Starting Ceph mgr.x for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:02:56.942 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:56 smithi005 podman[129637]: 2023-10-07T00:02:56.943 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:56 smithi005 bash[129637]: 998a9cb206a15b77e8a400bfb521ee8c4e7e42abebb1dc396a00cc373ac2baf1 2023-10-07T00:02:56.966 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-07T00:02:56.967 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2023-10-07T00:02:56.985 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-07T00:02:56.985 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-07T00:02:56.985 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2023-10-07T00:02:56.985 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2023-10-07T00:02:57.001 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-07T00:02:57.002 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2023-10-07T00:02:57.018 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-07T00:02:57.019 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-07T00:02:57.019 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2023-10-07T00:02:57.019 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-07T00:02:57.019 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr to start... 2023-10-07T00:02:57.019 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr... 2023-10-07T00:02:57.306 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:56 smithi005 systemd[1]: Started Ceph mgr.x for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:02:57.306 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:57 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:57.062+0000 7fd75fbf2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T00:02:57.306 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:57 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:57.180+0000 7fd75fbf2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T00:02:57.608 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:57 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:57.308+0000 7fd75fbf2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T00:02:57.609 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:57 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:57.442+0000 7fd75fbf2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T00:02:58.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:02:57 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3364213019' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-07T00:02:58.035 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:57 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:57.681+0000 7fd75fbf2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T00:02:58.104 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:02:58.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-07T00:02:58.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:02:58.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2023-10-07T00:02:58.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-07T00:02:58.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-07T00:02:58.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-07T00:02:58.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-10-07T00:02:58.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-07T00:02:58.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-07T00:02:58.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-07T00:02:58.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-07T00:02:58.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-07T00:02:58.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:02:58.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-07T00:02:58.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-07T00:02:58.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:02:58.120 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2023-10-07T00:02:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2023-10-07T00:02:48.270329+0000", 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-07T00:02:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.572+0000 7f5608ce5700 1 Processor -- start 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.572+0000 7f5608ce5700 1 -- start start 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.572+0000 7f5608ce5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560407a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.572+0000 7f5608ce5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560407a8d0 con 0x7f560407bea0 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.573+0000 7f560259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560407a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.573+0000 7f560259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560407a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60624/0 (socket says 172.21.15.5:60624) 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.573+0000 7f560259c700 1 -- 172.21.15.5:0/3944726203 learned_addr learned my addr 172.21.15.5:0/3944726203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.573+0000 7f560259c700 1 -- 172.21.15.5:0/3944726203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560407aa10 con 0x7f560407bea0 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.574+0000 7f560259c700 1 --2- 172.21.15.5:0/3944726203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560407a300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f55f40098a0 tx=0x7f55f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5973d17e9fafee11 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.574+0000 7f560159a700 1 -- 172.21.15.5:0/3944726203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55f4004160 con 0x7f560407bea0 2023-10-07T00:02:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.574+0000 7f560159a700 1 -- 172.21.15.5:0/3944726203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f55f40042c0 con 0x7f560407bea0 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.574+0000 7f560159a700 1 -- 172.21.15.5:0/3944726203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55f4011940 con 0x7f560407bea0 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.575+0000 7f5608ce5700 1 -- 172.21.15.5:0/3944726203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 msgr2=0x7f560407a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.575+0000 7f5608ce5700 1 --2- 172.21.15.5:0/3944726203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560407a300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f55f40098a0 tx=0x7f55f4009bb0 comp rx=0 tx=0).stop 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.575+0000 7f5608ce5700 1 -- 172.21.15.5:0/3944726203 shutdown_connections 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.575+0000 7f5608ce5700 1 --2- 172.21.15.5:0/3944726203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560407a300 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.575+0000 7f5608ce5700 1 -- 172.21.15.5:0/3944726203 >> 172.21.15.5:0/3944726203 conn(0x7f5604101b30 msgr2=0x7f5604103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.575+0000 7f5608ce5700 1 -- 172.21.15.5:0/3944726203 shutdown_connections 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.575+0000 7f5608ce5700 1 -- 172.21.15.5:0/3944726203 wait complete. 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.576+0000 7f5608ce5700 1 Processor -- start 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.576+0000 7f5608ce5700 1 -- start start 2023-10-07T00:02:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.576+0000 7f5608ce5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.576+0000 7f5608ce5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560419c800 con 0x7f560407bea0 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.577+0000 7f560259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.577+0000 7f560259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560419c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60626/0 (socket says 172.21.15.5:60626) 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.577+0000 7f560259c700 1 -- 172.21.15.5:0/3364213019 learned_addr learned my addr 172.21.15.5:0/3364213019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.577+0000 7f560259c700 1 -- 172.21.15.5:0/3364213019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f4009550 con 0x7f560407bea0 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.577+0000 7f560259c700 1 --2- 172.21.15.5:0/3364213019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560419c2c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55f4006af0 tx=0x7f55f4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.578+0000 7f55f37fe700 1 -- 172.21.15.5:0/3364213019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55f4003bf0 con 0x7f560407bea0 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.578+0000 7f55f37fe700 1 -- 172.21.15.5:0/3364213019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f55f401b8b0 con 0x7f560407bea0 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.578+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560419ca00 con 0x7f560407bea0 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.578+0000 7f55f37fe700 1 -- 172.21.15.5:0/3364213019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55f40198b0 con 0x7f560407bea0 2023-10-07T00:02:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.578+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560419ce20 con 0x7f560407bea0 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.578+0000 7f55f37fe700 1 -- 172.21.15.5:0/3364213019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f55f40233f0 con 0x7f560407bea0 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.578+0000 7f55f37fe700 1 -- 172.21.15.5:0/3364213019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f55f401a710 con 0x7f560407bea0 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.579+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560410c8e0 con 0x7f560407bea0 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.581+0000 7f55f37fe700 1 -- 172.21.15.5:0/3364213019 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f55f4028060 con 0x7f560407bea0 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.658+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f560419fa10 con 0x7f560407bea0 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.659+0000 7f55f37fe700 1 -- 172.21.15.5:0/3364213019 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f55f401bd70 con 0x7f560407bea0 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.660+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 msgr2=0x7f560419c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.660+0000 7f5608ce5700 1 --2- 172.21.15.5:0/3364213019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560419c2c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55f4006af0 tx=0x7f55f4011a30 comp rx=0 tx=0).stop 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.660+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 shutdown_connections 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.660+0000 7f5608ce5700 1 --2- 172.21.15.5:0/3364213019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560407bea0 0x7f560419c2c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:02:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.660+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 >> 172.21.15.5:0/3364213019 conn(0x7f5604101b30 msgr2=0x7f5604102850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:02:58.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.660+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 shutdown_connections 2023-10-07T00:02:58.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:02:57.660+0000 7f5608ce5700 1 -- 172.21.15.5:0/3364213019 wait complete. 2023-10-07T00:02:58.127 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (1/15)... 2023-10-07T00:02:58.347 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:58 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:58.179+0000 7fd75fbf2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T00:02:58.608 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:58 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:58.345+0000 7fd75fbf2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T00:02:58.609 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:58 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:58.465+0000 7fd75fbf2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T00:02:58.609 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:58 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:58.593+0000 7fd75fbf2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T00:02:59.608 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:02:59 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:02:59.152+0000 7fd75fbf2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T00:03:00.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:00.065+0000 7fd75fbf2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T00:03:00.359 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:00.179+0000 7fd75fbf2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T00:03:01.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:00 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3748501678' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-07T00:03:01.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:03:01.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-07T00:03:01.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:03:01.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2023-10-07T00:03:01.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-07T00:03:01.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-07T00:03:01.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:03:01.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-07T00:03:01.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-07T00:03:01.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2023-10-07T00:03:01.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2023-10-07T00:02:48.270329+0000", 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.642+0000 7facb7329700 1 Processor -- start 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.642+0000 7facb7329700 1 -- start start 2023-10-07T00:03:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.643+0000 7facb7329700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb007a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.643+0000 7facb7329700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb007a8d0 con 0x7facb007bea0 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.643+0000 7facb50c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb007a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.643+0000 7facb50c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb007a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60640/0 (socket says 172.21.15.5:60640) 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.643+0000 7facb50c5700 1 -- 172.21.15.5:0/217424798 learned_addr learned my addr 172.21.15.5:0/217424798 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.644+0000 7facb50c5700 1 -- 172.21.15.5:0/217424798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb007aa10 con 0x7facb007bea0 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.644+0000 7facb50c5700 1 --2- 172.21.15.5:0/217424798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb007a300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7facac0098a0 tx=0x7facac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18fbf8c62950770 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.644+0000 7faca7fff700 1 -- 172.21.15.5:0/217424798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facac004160 con 0x7facb007bea0 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.644+0000 7faca7fff700 1 -- 172.21.15.5:0/217424798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7facac0042c0 con 0x7facb007bea0 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.644+0000 7faca7fff700 1 -- 172.21.15.5:0/217424798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facac011940 con 0x7facb007bea0 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.645+0000 7facb7329700 1 -- 172.21.15.5:0/217424798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 msgr2=0x7facb007a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.645+0000 7facb7329700 1 --2- 172.21.15.5:0/217424798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb007a300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7facac0098a0 tx=0x7facac009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.645+0000 7facb7329700 1 -- 172.21.15.5:0/217424798 shutdown_connections 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.645+0000 7facb7329700 1 --2- 172.21.15.5:0/217424798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb007a300 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.645+0000 7facb7329700 1 -- 172.21.15.5:0/217424798 >> 172.21.15.5:0/217424798 conn(0x7facb0101b30 msgr2=0x7facb0103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.645+0000 7facb7329700 1 -- 172.21.15.5:0/217424798 shutdown_connections 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.645+0000 7facb7329700 1 -- 172.21.15.5:0/217424798 wait complete. 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.646+0000 7facb7329700 1 Processor -- start 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.647+0000 7facb7329700 1 -- start start 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.647+0000 7facb7329700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.647+0000 7facb7329700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb019c800 con 0x7facb007bea0 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.647+0000 7facb50c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:01.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.647+0000 7facb50c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb019c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60654/0 (socket says 172.21.15.5:60654) 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.647+0000 7facb50c5700 1 -- 172.21.15.5:0/3748501678 learned_addr learned my addr 172.21.15.5:0/3748501678 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.647+0000 7facb50c5700 1 -- 172.21.15.5:0/3748501678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac009550 con 0x7facb007bea0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.648+0000 7facb50c5700 1 --2- 172.21.15.5:0/3748501678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb019c2c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7facac006af0 tx=0x7facac011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.648+0000 7faca67fc700 1 -- 172.21.15.5:0/3748501678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facac003bf0 con 0x7facb007bea0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.648+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb019ca00 con 0x7facb007bea0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.648+0000 7faca67fc700 1 -- 172.21.15.5:0/3748501678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7facac01b8b0 con 0x7facb007bea0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.648+0000 7faca67fc700 1 -- 172.21.15.5:0/3748501678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facac0198b0 con 0x7facb007bea0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.648+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb019ce20 con 0x7facb007bea0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.648+0000 7faca67fc700 1 -- 172.21.15.5:0/3748501678 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7facac0233f0 con 0x7facb007bea0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.649+0000 7faca67fc700 1 -- 172.21.15.5:0/3748501678 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7facac01a750 con 0x7facb007bea0 2023-10-07T00:03:01.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.649+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb00624e0 con 0x7facb007bea0 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.654+0000 7faca67fc700 1 -- 172.21.15.5:0/3748501678 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7facac028060 con 0x7facb007bea0 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.731+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7facb010c8e0 con 0x7facb007bea0 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.732+0000 7faca67fc700 1 -- 172.21.15.5:0/3748501678 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7facac01bd70 con 0x7facb007bea0 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.733+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 msgr2=0x7facb019c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.733+0000 7facb7329700 1 --2- 172.21.15.5:0/3748501678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb019c2c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7facac006af0 tx=0x7facac011a30 comp rx=0 tx=0).stop 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.733+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 shutdown_connections 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.733+0000 7facb7329700 1 --2- 172.21.15.5:0/3748501678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb007bea0 0x7facb019c2c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.733+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 >> 172.21.15.5:0/3748501678 conn(0x7facb0101b30 msgr2=0x7facb0102850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.733+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 shutdown_connections 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:00.733+0000 7facb7329700 1 -- 172.21.15.5:0/3748501678 wait complete. 2023-10-07T00:03:01.217 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (2/15)... 2023-10-07T00:03:01.583 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:01 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:01.224+0000 7fd75fbf2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:03:01.583 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:01 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:01.348+0000 7fd75fbf2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T00:03:01.858 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:01 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:01.581+0000 7fd75fbf2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:03:02.244 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:01 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:01.960+0000 7fd75fbf2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T00:03:02.608 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:02 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:02.242+0000 7fd75fbf2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T00:03:02.608 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:02 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:02.442+0000 7fd75fbf2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T00:03:03.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:02 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:02.797+0000 7fd75fbf2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T00:03:04.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:03 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:03.764+0000 7fd75fbf2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T00:03:04.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:03 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:03.944+0000 7fd75fbf2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T00:03:04.608 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:04 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:04.202+0000 7fd75fbf2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T00:03:04.609 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:04 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:04.354+0000 7fd75fbf2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T00:03:05.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:04 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:04.643+0000 7fd75fbf2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T00:03:06.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:05.756+0000 7fd75fbf2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T00:03:06.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: Activating manager daemon x 2023-10-07T00:03:06.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: mgrmap e2: x(active, starting, since 0.00408921s) 2023-10-07T00:03:06.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-07T00:03:06.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-07T00:03:06.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-07T00:03:06.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:03:06.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-07T00:03:06.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: Manager daemon x is now available 2023-10-07T00:03:06.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-07T00:03:06.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' 2023-10-07T00:03:06.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-07T00:03:06.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' 2023-10-07T00:03:06.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:05 smithi005 ceph-mon[129406]: from='mgr.14100 172.21.15.5:0/1626720310' entity='mgr.x' 2023-10-07T00:03:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:07 smithi005 ceph-mon[129406]: mgrmap e3: x(active, since 1.00975s) 2023-10-07T00:03:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:08 smithi005 ceph-mon[129406]: mgrmap e4: x(active, since 2s) 2023-10-07T00:03:12.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:11 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/848425936' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-07T00:03:12.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:03:12.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-07T00:03:12.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:03:12.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2023-10-07T00:03:12.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2023-10-07T00:03:12.112 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-07T00:03:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-07T00:03:12.123 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-07T00:03:12.124 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-07T00:03:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2023-10-07T00:02:48.270329+0000", 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-07T00:03:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.359+0000 7fe3dc9bf700 1 Processor -- start 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.359+0000 7fe3dc9bf700 1 -- start start 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.360+0000 7fe3dc9bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d807a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.360+0000 7fe3dc9bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d807a8d0 con 0x7fe3d807bea0 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.360+0000 7fe3d659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d807a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.360+0000 7fe3d659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d807a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53010/0 (socket says 172.21.15.5:53010) 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.360+0000 7fe3d659c700 1 -- 172.21.15.5:0/4117096281 learned_addr learned my addr 172.21.15.5:0/4117096281 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.361+0000 7fe3d659c700 1 -- 172.21.15.5:0/4117096281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d807aa10 con 0x7fe3d807bea0 2023-10-07T00:03:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.361+0000 7fe3d659c700 1 --2- 172.21.15.5:0/4117096281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d807a300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80098a0 tx=0x7fe3c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c49f097e392262 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.361+0000 7fe3d559a700 1 -- 172.21.15.5:0/4117096281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3c8004160 con 0x7fe3d807bea0 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.361+0000 7fe3d559a700 1 -- 172.21.15.5:0/4117096281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe3c80042c0 con 0x7fe3d807bea0 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.361+0000 7fe3d559a700 1 -- 172.21.15.5:0/4117096281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3c8011940 con 0x7fe3d807bea0 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.362+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/4117096281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 msgr2=0x7fe3d807a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.362+0000 7fe3dc9bf700 1 --2- 172.21.15.5:0/4117096281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d807a300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80098a0 tx=0x7fe3c8009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.362+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/4117096281 shutdown_connections 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.362+0000 7fe3dc9bf700 1 --2- 172.21.15.5:0/4117096281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d807a300 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.362+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/4117096281 >> 172.21.15.5:0/4117096281 conn(0x7fe3d8101b30 msgr2=0x7fe3d8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.362+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/4117096281 shutdown_connections 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.362+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/4117096281 wait complete. 2023-10-07T00:03:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.363+0000 7fe3dc9bf700 1 Processor -- start 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.363+0000 7fe3dc9bf700 1 -- start start 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.364+0000 7fe3dc9bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.364+0000 7fe3dc9bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d819c800 con 0x7fe3d807bea0 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.364+0000 7fe3d659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.364+0000 7fe3d659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d819c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53024/0 (socket says 172.21.15.5:53024) 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.364+0000 7fe3d659c700 1 -- 172.21.15.5:0/848425936 learned_addr learned my addr 172.21.15.5:0/848425936 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.364+0000 7fe3d659c700 1 -- 172.21.15.5:0/848425936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009550 con 0x7fe3d807bea0 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.364+0000 7fe3d659c700 1 --2- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d819c2c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8000c00 tx=0x7fe3c8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.365+0000 7fe3c77fe700 1 -- 172.21.15.5:0/848425936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3c80036a0 con 0x7fe3d807bea0 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.365+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d819ca00 con 0x7fe3d807bea0 2023-10-07T00:03:12.129 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.365+0000 7fe3c77fe700 1 -- 172.21.15.5:0/848425936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe3c801b440 con 0x7fe3d807bea0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.365+0000 7fe3c77fe700 1 -- 172.21.15.5:0/848425936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3c80193f0 con 0x7fe3d807bea0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.365+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d819ce20 con 0x7fe3d807bea0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.366+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d80624e0 con 0x7fe3d807bea0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.366+0000 7fe3c77fe700 1 -- 172.21.15.5:0/848425936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7fe3c8003800 con 0x7fe3d807bea0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.367+0000 7fe3c77fe700 1 --2- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fe3c00388e0 0x7fe3c003ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.367+0000 7fe3c77fe700 1 -- 172.21.15.5:0/848425936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe3c804c670 con 0x7fe3d807bea0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.367+0000 7fe3d5d9b700 1 --2- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fe3c00388e0 0x7fe3c003ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.367+0000 7fe3d5d9b700 1 --2- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fe3c00388e0 0x7fe3c003ada0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc006fd0 tx=0x7fe3cc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.373+0000 7fe3c77fe700 1 -- 172.21.15.5:0/848425936 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe3c801b5b0 con 0x7fe3d807bea0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.662+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe3d810c8e0 con 0x7fe3d807bea0 2023-10-07T00:03:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.663+0000 7fe3c77fe700 1 -- 172.21.15.5:0/848425936 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fe3c801f070 con 0x7fe3d807bea0 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.665+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fe3c00388e0 msgr2=0x7fe3c003ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.665+0000 7fe3dc9bf700 1 --2- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fe3c00388e0 0x7fe3c003ada0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc006fd0 tx=0x7fe3cc006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.665+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 msgr2=0x7fe3d819c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.665+0000 7fe3dc9bf700 1 --2- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d819c2c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8000c00 tx=0x7fe3c8011e70 comp rx=0 tx=0).stop 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.665+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 shutdown_connections 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.665+0000 7fe3dc9bf700 1 --2- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fe3c00388e0 0x7fe3c003ada0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.665+0000 7fe3dc9bf700 1 --2- 172.21.15.5:0/848425936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d807bea0 0x7fe3d819c2c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.666+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 >> 172.21.15.5:0/848425936 conn(0x7fe3d8101b30 msgr2=0x7fe3d8102850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.666+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 shutdown_connections 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:11.666+0000 7fe3dc9bf700 1 -- 172.21.15.5:0/848425936 wait complete. 2023-10-07T00:03:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:mgr is available 2023-10-07T00:03:13.280 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:12 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1319989014' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-07T00:03:13.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-07T00:03:13.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2023-10-07T00:03:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-07T00:03:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-07T00:03:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-07T00:03:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-07T00:03:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-07T00:03:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.632+0000 7fccdde78700 1 Processor -- start 2023-10-07T00:03:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.632+0000 7fccdde78700 1 -- start start 2023-10-07T00:03:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.632+0000 7fccdde78700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd807a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:13.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.632+0000 7fccdde78700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd807a890 con 0x7fccd807be60 2023-10-07T00:03:13.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.632+0000 7fccd77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd807a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:13.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.632+0000 7fccd77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd807a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39780/0 (socket says 172.21.15.5:39780) 2023-10-07T00:03:13.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.632+0000 7fccd77fe700 1 -- 172.21.15.5:0/4006075720 learned_addr learned my addr 172.21.15.5:0/4006075720 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:13.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.633+0000 7fccd77fe700 1 -- 172.21.15.5:0/4006075720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd807a9d0 con 0x7fccd807be60 2023-10-07T00:03:13.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.633+0000 7fccd77fe700 1 --2- 172.21.15.5:0/4006075720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd807a2c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fccc80098a0 tx=0x7fccc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e40955c6b320e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.633+0000 7fccd67fc700 1 -- 172.21.15.5:0/4006075720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccc8004160 con 0x7fccd807be60 2023-10-07T00:03:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.633+0000 7fccd67fc700 1 -- 172.21.15.5:0/4006075720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fccc80042c0 con 0x7fccd807be60 2023-10-07T00:03:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.633+0000 7fccd67fc700 1 -- 172.21.15.5:0/4006075720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccc8011940 con 0x7fccd807be60 2023-10-07T00:03:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.634+0000 7fccdde78700 1 -- 172.21.15.5:0/4006075720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 msgr2=0x7fccd807a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.634+0000 7fccdde78700 1 --2- 172.21.15.5:0/4006075720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd807a2c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fccc80098a0 tx=0x7fccc8009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:13.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.634+0000 7fccdde78700 1 -- 172.21.15.5:0/4006075720 shutdown_connections 2023-10-07T00:03:13.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.634+0000 7fccdde78700 1 --2- 172.21.15.5:0/4006075720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd807a2c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:13.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.634+0000 7fccdde78700 1 -- 172.21.15.5:0/4006075720 >> 172.21.15.5:0/4006075720 conn(0x7fccd8101b30 msgr2=0x7fccd8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:13.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.634+0000 7fccdde78700 1 -- 172.21.15.5:0/4006075720 shutdown_connections 2023-10-07T00:03:13.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.634+0000 7fccdde78700 1 -- 172.21.15.5:0/4006075720 wait complete. 2023-10-07T00:03:13.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.635+0000 7fccdde78700 1 Processor -- start 2023-10-07T00:03:13.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.635+0000 7fccdde78700 1 -- start start 2023-10-07T00:03:13.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.636+0000 7fccdde78700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:13.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.636+0000 7fccdde78700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd819c7d0 con 0x7fccd807be60 2023-10-07T00:03:13.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.636+0000 7fccd77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd819c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:13.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.636+0000 7fccd77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd819c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39784/0 (socket says 172.21.15.5:39784) 2023-10-07T00:03:13.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.636+0000 7fccd77fe700 1 -- 172.21.15.5:0/1319989014 learned_addr learned my addr 172.21.15.5:0/1319989014 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:13.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.636+0000 7fccd77fe700 1 -- 172.21.15.5:0/1319989014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8009550 con 0x7fccd807be60 2023-10-07T00:03:13.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.636+0000 7fccd77fe700 1 --2- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd819c290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fccc8006af0 tx=0x7fccc8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:13.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.637+0000 7fccd4ff9700 1 -- 172.21.15.5:0/1319989014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccc8003bf0 con 0x7fccd807be60 2023-10-07T00:03:13.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.637+0000 7fccd4ff9700 1 -- 172.21.15.5:0/1319989014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fccc801b8b0 con 0x7fccd807be60 2023-10-07T00:03:13.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.637+0000 7fccd4ff9700 1 -- 172.21.15.5:0/1319989014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccc8019880 con 0x7fccd807be60 2023-10-07T00:03:13.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.637+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd819c9d0 con 0x7fccd807be60 2023-10-07T00:03:13.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.637+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd819cdf0 con 0x7fccd807be60 2023-10-07T00:03:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.638+0000 7fccd4ff9700 1 -- 172.21.15.5:0/1319989014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7fccc801ba20 con 0x7fccd807be60 2023-10-07T00:03:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.638+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd810c920 con 0x7fccd807be60 2023-10-07T00:03:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.638+0000 7fccd4ff9700 1 --2- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fccc0038890 0x7fccc003ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.638+0000 7fccd4ff9700 1 -- 172.21.15.5:0/1319989014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fccc804ca90 con 0x7fccd807be60 2023-10-07T00:03:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.639+0000 7fccd6ffd700 1 --2- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fccc0038890 0x7fccc003ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.639+0000 7fccd6ffd700 1 --2- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fccc0038890 0x7fccc003ad50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcccc006fd0 tx=0x7fcccc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.644+0000 7fccd4ff9700 1 -- 172.21.15.5:0/1319989014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fccc8018530 con 0x7fccd807be60 2023-10-07T00:03:13.308 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.852+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fccd819f830 con 0x7fccd807be60 2023-10-07T00:03:13.308 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.853+0000 7fccd4ff9700 1 -- 172.21.15.5:0/1319989014 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fccc801f250 con 0x7fccd807be60 2023-10-07T00:03:13.308 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fccc0038890 msgr2=0x7fccc003ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:13.308 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 --2- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fccc0038890 0x7fccc003ad50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcccc006fd0 tx=0x7fcccc006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:13.308 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 msgr2=0x7fccd819c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:13.308 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 --2- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd819c290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fccc8006af0 tx=0x7fccc8011a30 comp rx=0 tx=0).stop 2023-10-07T00:03:13.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 shutdown_connections 2023-10-07T00:03:13.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 --2- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fccc0038890 0x7fccc003ad50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:13.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 --2- 172.21.15.5:0/1319989014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccd807be60 0x7fccd819c290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:13.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 >> 172.21.15.5:0/1319989014 conn(0x7fccd8101b30 msgr2=0x7fccd8102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:13.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 shutdown_connections 2023-10-07T00:03:13.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:12.856+0000 7fccdde78700 1 -- 172.21.15.5:0/1319989014 wait complete. 2023-10-07T00:03:13.310 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling cephadm module... 2023-10-07T00:03:14.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:14 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3484468686' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-07T00:03:14.442 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: ignoring --setuser ceph since I am not root 2023-10-07T00:03:14.442 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: ignoring --setgroup ceph since I am not root 2023-10-07T00:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.826+0000 7f3dfb886700 1 Processor -- start 2023-10-07T00:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.826+0000 7f3dfb886700 1 -- start start 2023-10-07T00:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.826+0000 7f3dfb886700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df407a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.826+0000 7f3dfb886700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df407a890 con 0x7f3df407be60 2023-10-07T00:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.827+0000 7f3df9622700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df407a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.827+0000 7f3df9622700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df407a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39788/0 (socket says 172.21.15.5:39788) 2023-10-07T00:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.827+0000 7f3df9622700 1 -- 172.21.15.5:0/409996668 learned_addr learned my addr 172.21.15.5:0/409996668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.827+0000 7f3df9622700 1 -- 172.21.15.5:0/409996668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df407a9d0 con 0x7f3df407be60 2023-10-07T00:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.827+0000 7f3df9622700 1 --2- 172.21.15.5:0/409996668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df407a2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3df00098a0 tx=0x7f3df0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654ab1bf808e1000 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3debfff700 1 -- 172.21.15.5:0/409996668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3df0004160 con 0x7f3df407be60 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3debfff700 1 -- 172.21.15.5:0/409996668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3df00042c0 con 0x7f3df407be60 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3debfff700 1 -- 172.21.15.5:0/409996668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3df0011940 con 0x7f3df407be60 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3dfb886700 1 -- 172.21.15.5:0/409996668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 msgr2=0x7f3df407a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3dfb886700 1 --2- 172.21.15.5:0/409996668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df407a2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3df00098a0 tx=0x7f3df0009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3dfb886700 1 -- 172.21.15.5:0/409996668 shutdown_connections 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3dfb886700 1 --2- 172.21.15.5:0/409996668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df407a2c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3dfb886700 1 -- 172.21.15.5:0/409996668 >> 172.21.15.5:0/409996668 conn(0x7f3df4101b00 msgr2=0x7f3df4103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3dfb886700 1 -- 172.21.15.5:0/409996668 shutdown_connections 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.828+0000 7f3dfb886700 1 -- 172.21.15.5:0/409996668 wait complete. 2023-10-07T00:03:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.829+0000 7f3dfb886700 1 Processor -- start 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.830+0000 7f3dfb886700 1 -- start start 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.830+0000 7f3dfb886700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.830+0000 7f3dfb886700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df419c770 con 0x7f3df407be60 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.830+0000 7f3df9622700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.830+0000 7f3df9622700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df419c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39796/0 (socket says 172.21.15.5:39796) 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.830+0000 7f3df9622700 1 -- 172.21.15.5:0/3484468686 learned_addr learned my addr 172.21.15.5:0/3484468686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.831+0000 7f3df9622700 1 -- 172.21.15.5:0/3484468686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0009550 con 0x7f3df407be60 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.831+0000 7f3df9622700 1 --2- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df419c230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3df0011dc0 tx=0x7f3df0011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.831+0000 7f3dea7fc700 1 -- 172.21.15.5:0/3484468686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3df00037d0 con 0x7f3df407be60 2023-10-07T00:03:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.831+0000 7f3dea7fc700 1 -- 172.21.15.5:0/3484468686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3df001b440 con 0x7f3df407be60 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.831+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df419c970 con 0x7f3df407be60 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.831+0000 7f3dea7fc700 1 -- 172.21.15.5:0/3484468686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3df001a560 con 0x7f3df407be60 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.831+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df419cd90 con 0x7f3df407be60 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.832+0000 7f3dea7fc700 1 -- 172.21.15.5:0/3484468686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f3df001b5b0 con 0x7f3df407be60 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.832+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df40624e0 con 0x7f3df407be60 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.833+0000 7f3dea7fc700 1 --2- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f3de0038890 0x7f3de003ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.833+0000 7f3dea7fc700 1 -- 172.21.15.5:0/3484468686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3df004c710 con 0x7f3df407be60 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.833+0000 7f3df8e21700 1 --2- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f3de0038890 0x7f3de003ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.833+0000 7f3df8e21700 1 --2- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f3de0038890 0x7f3de003ad50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3de4006fd0 tx=0x7f3de4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:13.838+0000 7f3dea7fc700 1 -- 172.21.15.5:0/3484468686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3df0023590 con 0x7f3df407be60 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.106+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f3df410c910 con 0x7f3df407be60 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.158+0000 7f3dea7fc700 1 -- 172.21.15.5:0/3484468686 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f3df001f090 con 0x7f3df407be60 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.159+0000 7f3dea7fc700 1 -- 172.21.15.5:0/3484468686 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f3df0020d40 con 0x7f3df407be60 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f3de0038890 msgr2=0x7f3de003ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 --2- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f3de0038890 0x7f3de003ad50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3de4006fd0 tx=0x7f3de4006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 msgr2=0x7f3df419c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 --2- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df419c230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3df0011dc0 tx=0x7f3df0011ea0 comp rx=0 tx=0).stop 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 shutdown_connections 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 --2- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f3de0038890 0x7f3de003ad50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 --2- 172.21.15.5:0/3484468686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3df407be60 0x7f3df419c230 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 >> 172.21.15.5:0/3484468686 conn(0x7f3df4101b00 msgr2=0x7f3df4102770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 shutdown_connections 2023-10-07T00:03:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:14.161+0000 7f3dfb886700 1 -- 172.21.15.5:0/3484468686 wait complete. 2023-10-07T00:03:14.814 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:14.440+0000 7fdf08d1f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T00:03:14.814 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:14.548+0000 7fdf08d1f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T00:03:14.814 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:14.687+0000 7fdf08d1f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T00:03:14.815 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:14.812+0000 7fdf08d1f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T00:03:15.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:15.051+0000 7fdf08d1f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T00:03:15.435 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:15 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3484468686' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-07T00:03:15.435 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:15 smithi005 ceph-mon[129406]: mgrmap e5: x(active, since 8s) 2023-10-07T00:03:15.708 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:15.539+0000 7fdf08d1f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T00:03:15.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-07T00:03:15.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-07T00:03:15.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-07T00:03:15.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-07T00:03:15.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-07T00:03:15.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-07T00:03:15.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.126+0000 7fb0d511a700 1 Processor -- start 2023-10-07T00:03:15.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.126+0000 7fb0d511a700 1 -- start start 2023-10-07T00:03:15.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.126+0000 7fb0d511a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d01069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:15.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.126+0000 7fb0d511a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d0106f80 con 0x7fb0d0106590 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.127+0000 7fb0ced9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d01069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.127+0000 7fb0ced9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d01069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39816/0 (socket says 172.21.15.5:39816) 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.127+0000 7fb0ced9d700 1 -- 172.21.15.5:0/3847102916 learned_addr learned my addr 172.21.15.5:0/3847102916 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.127+0000 7fb0ced9d700 1 -- 172.21.15.5:0/3847102916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0107790 con 0x7fb0d0106590 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.127+0000 7fb0ced9d700 1 --2- 172.21.15.5:0/3847102916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d01069b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00098a0 tx=0x7fb0c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9126f33ce3f4098 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.128+0000 7fb0cdd9b700 1 -- 172.21.15.5:0/3847102916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c0004160 con 0x7fb0d0106590 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.128+0000 7fb0cdd9b700 1 -- 172.21.15.5:0/3847102916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb0c00042c0 con 0x7fb0d0106590 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.128+0000 7fb0cdd9b700 1 -- 172.21.15.5:0/3847102916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c0011940 con 0x7fb0d0106590 2023-10-07T00:03:15.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.128+0000 7fb0d511a700 1 -- 172.21.15.5:0/3847102916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 msgr2=0x7fb0d01069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.128+0000 7fb0d511a700 1 --2- 172.21.15.5:0/3847102916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d01069b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00098a0 tx=0x7fb0c0009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.128+0000 7fb0d511a700 1 -- 172.21.15.5:0/3847102916 shutdown_connections 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.128+0000 7fb0d511a700 1 --2- 172.21.15.5:0/3847102916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d01069b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.128+0000 7fb0d511a700 1 -- 172.21.15.5:0/3847102916 >> 172.21.15.5:0/3847102916 conn(0x7fb0d0101b30 msgr2=0x7fb0d0103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.129+0000 7fb0d511a700 1 -- 172.21.15.5:0/3847102916 shutdown_connections 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.129+0000 7fb0d511a700 1 -- 172.21.15.5:0/3847102916 wait complete. 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.130+0000 7fb0d511a700 1 Processor -- start 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.130+0000 7fb0d511a700 1 -- start start 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.130+0000 7fb0d511a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.130+0000 7fb0d511a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d019c810 con 0x7fb0d0106590 2023-10-07T00:03:15.882 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.130+0000 7fb0ced9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.131+0000 7fb0ced9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d019c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39820/0 (socket says 172.21.15.5:39820) 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.131+0000 7fb0ced9d700 1 -- 172.21.15.5:0/2254800504 learned_addr learned my addr 172.21.15.5:0/2254800504 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.131+0000 7fb0ced9d700 1 -- 172.21.15.5:0/2254800504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c0009550 con 0x7fb0d0106590 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.131+0000 7fb0ced9d700 1 --2- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d019c2d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0006af0 tx=0x7fb0c0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.131+0000 7fb0b7fff700 1 -- 172.21.15.5:0/2254800504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c0003bf0 con 0x7fb0d0106590 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.131+0000 7fb0b7fff700 1 -- 172.21.15.5:0/2254800504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb0c001b8b0 con 0x7fb0d0106590 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.131+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d019ca10 con 0x7fb0d0106590 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.131+0000 7fb0b7fff700 1 -- 172.21.15.5:0/2254800504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00198b0 con 0x7fb0d0106590 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.132+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d019ce30 con 0x7fb0d0106590 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.133+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d00624e0 con 0x7fb0d0106590 2023-10-07T00:03:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.133+0000 7fb0b7fff700 1 -- 172.21.15.5:0/2254800504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fb0c0019b70 con 0x7fb0d0106590 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.134+0000 7fb0b7fff700 1 --2- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fb0b8038890 0x7fb0b803ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.134+0000 7fb0b7fff700 1 -- 172.21.15.5:0/2254800504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb0c004cce0 con 0x7fb0d0106590 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.134+0000 7fb0ce59c700 1 -- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fb0b8038890 msgr2=0x7fb0b803ad50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2264485294 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.134+0000 7fb0ce59c700 1 --2- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fb0b8038890 0x7fb0b803ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.139+0000 7fb0b7fff700 1 -- 172.21.15.5:0/2254800504 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb0c0010380 con 0x7fb0d0106590 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.335+0000 7fb0ce59c700 1 -- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fb0b8038890 msgr2=0x7fb0b803ad50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2264485294 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.335+0000 7fb0ce59c700 1 --2- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fb0b8038890 0x7fb0b803ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.409+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb0d019fb10 con 0x7fb0d0106590 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.409+0000 7fb0b7fff700 1 -- 172.21.15.5:0/2254800504 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb0c0018b40 con 0x7fb0d0106590 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fb0b8038890 msgr2=0x7fb0b803ad50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:03:15.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 --2- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fb0b8038890 0x7fb0b803ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 msgr2=0x7fb0d019c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 --2- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d019c2d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0006af0 tx=0x7fb0c0011a30 comp rx=0 tx=0).stop 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 shutdown_connections 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 --2- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7fb0b8038890 0x7fb0b803ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 --2- 172.21.15.5:0/2254800504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d0106590 0x7fb0d019c2d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 >> 172.21.15.5:0/2254800504 conn(0x7fb0d0101b30 msgr2=0x7fb0d01027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 shutdown_connections 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:15.412+0000 7fb0d511a700 1 -- 172.21.15.5:0/2254800504 wait complete. 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2023-10-07T00:03:15.885 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 5... 2023-10-07T00:03:15.964 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:15.706+0000 7fdf08d1f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T00:03:15.964 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:15.826+0000 7fdf08d1f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T00:03:16.230 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:16 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2254800504' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-07T00:03:16.230 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:15.963+0000 7fdf08d1f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T00:03:16.859 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:16 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:16.528+0000 7fdf08d1f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T00:03:17.859 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:17 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:17.399+0000 7fdf08d1f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T00:03:17.859 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:17 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:17.507+0000 7fdf08d1f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T00:03:18.847 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:18.492+0000 7fdf08d1f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:03:18.847 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:18.614+0000 7fdf08d1f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T00:03:19.111 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:18.845+0000 7fdf08d1f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:03:19.504 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:19.221+0000 7fdf08d1f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T00:03:19.858 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:19.502+0000 7fdf08d1f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T00:03:19.858 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:19.701+0000 7fdf08d1f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T00:03:20.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:20.054+0000 7fdf08d1f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T00:03:21.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:21.013+0000 7fdf08d1f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T00:03:21.359 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:21.194+0000 7fdf08d1f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T00:03:21.858 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:21.449+0000 7fdf08d1f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T00:03:21.859 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:21.599+0000 7fdf08d1f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T00:03:22.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:21.886+0000 7fdf08d1f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T00:03:23.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:22.986+0000 7fdf08d1f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T00:03:23.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: Active manager daemon x restarted 2023-10-07T00:03:23.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: Activating manager daemon x 2023-10-07T00:03:23.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: osdmap e2: 0 total, 0 up, 0 in 2023-10-07T00:03:23.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: mgrmap e6: x(active, starting, since 0.00368728s) 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: Manager daemon x is now available 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:03:23.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:23 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:03:24.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:24 smithi005 ceph-mon[129406]: Found migration_current of "None". Setting to last migration. 2023-10-07T00:03:24.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:24 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:03:24.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:24 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-07T00:03:24.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:24 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-07T00:03:24.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:24 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:24.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:24 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:24.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:24 smithi005 ceph-mon[129406]: mgrmap e7: x(active, since 1.00687s) 2023-10-07T00:03:24.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-07T00:03:24.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-07T00:03:24.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.427+0000 7f7aadff0700 1 Processor -- start 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.427+0000 7f7aadff0700 1 -- start start 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.427+0000 7f7aadff0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa807a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.427+0000 7f7aadff0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa807a8b0 con 0x7f7aa807be80 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.428+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa807a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.428+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa807a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39830/0 (socket says 172.21.15.5:39830) 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.428+0000 7f7aa77fe700 1 -- 172.21.15.5:0/3387189263 learned_addr learned my addr 172.21.15.5:0/3387189263 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.428+0000 7f7aa77fe700 1 -- 172.21.15.5:0/3387189263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa807a9f0 con 0x7f7aa807be80 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.429+0000 7f7aa77fe700 1 --2- 172.21.15.5:0/3387189263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa807a2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a980098a0 tx=0x7f7a98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3efabda286d859 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.429+0000 7f7aa67fc700 1 -- 172.21.15.5:0/3387189263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a98004160 con 0x7f7aa807be80 2023-10-07T00:03:24.384 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.429+0000 7f7aa67fc700 1 -- 172.21.15.5:0/3387189263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7a980042c0 con 0x7f7aa807be80 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.429+0000 7f7aa67fc700 1 -- 172.21.15.5:0/3387189263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a98011940 con 0x7f7aa807be80 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.429+0000 7f7aadff0700 1 -- 172.21.15.5:0/3387189263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 msgr2=0x7f7aa807a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.429+0000 7f7aadff0700 1 --2- 172.21.15.5:0/3387189263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa807a2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a980098a0 tx=0x7f7a98009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.430+0000 7f7aadff0700 1 -- 172.21.15.5:0/3387189263 shutdown_connections 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.430+0000 7f7aadff0700 1 --2- 172.21.15.5:0/3387189263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa807a2e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.430+0000 7f7aadff0700 1 -- 172.21.15.5:0/3387189263 >> 172.21.15.5:0/3387189263 conn(0x7f7aa8101b30 msgr2=0x7f7aa8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.430+0000 7f7aadff0700 1 -- 172.21.15.5:0/3387189263 shutdown_connections 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.430+0000 7f7aadff0700 1 -- 172.21.15.5:0/3387189263 wait complete. 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.431+0000 7f7aadff0700 1 Processor -- start 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.431+0000 7f7aadff0700 1 -- start start 2023-10-07T00:03:24.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.431+0000 7f7aadff0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.431+0000 7f7aadff0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa819c800 con 0x7f7aa807be80 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.431+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.431+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa819c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39842/0 (socket says 172.21.15.5:39842) 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.431+0000 7f7aa77fe700 1 -- 172.21.15.5:0/2347228836 learned_addr learned my addr 172.21.15.5:0/2347228836 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.432+0000 7f7aa77fe700 1 -- 172.21.15.5:0/2347228836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009550 con 0x7f7aa807be80 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.432+0000 7f7aa77fe700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa819c2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7a98000c00 tx=0x7f7a98011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.432+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a980036a0 con 0x7f7aa807be80 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.432+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7a9801b440 con 0x7f7aa807be80 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.432+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a980193f0 con 0x7f7aa807be80 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.432+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa819ca00 con 0x7f7aa807be80 2023-10-07T00:03:24.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.433+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa819ce20 con 0x7f7aa807be80 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.434+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f7a9801b5b0 con 0x7f7aa807be80 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.434+0000 7f7aa4ff9700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.434+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 --> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a9003b500 con 0x7f7a90038930 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.434+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7a9804c6d0 con 0x7f7aa807be80 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.434+0000 7f7aa6ffd700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 msgr2=0x7f7a9003adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2264485294 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.434+0000 7f7aa6ffd700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.635+0000 7f7aa6ffd700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 msgr2=0x7f7a9003adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2264485294 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:16.635+0000 7f7aa6ffd700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:17.036+0000 7f7aa6ffd700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 msgr2=0x7f7a9003adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2264485294 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:17.036+0000 7f7aa6ffd700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:17.837+0000 7f7aa6ffd700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 msgr2=0x7f7a9003adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2264485294 2023-10-07T00:03:24.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:17.837+0000 7f7aa6ffd700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:19.438+0000 7f7aa6ffd700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 msgr2=0x7f7a9003adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2264485294 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:19.438+0000 7f7aa6ffd700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:22.641+0000 7f7aa6ffd700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 msgr2=0x7f7a9003adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2264485294 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:22.641+0000 7f7aa6ffd700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:22.990+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 6) v1 ==== 45346+0+0 (secure 0 0 0) 0x7f7a98020d40 con 0x7f7aa807be80 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:22.991+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 msgr2=0x7f7a9003adf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:22.991+0000 7f7aa4ff9700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:23.992+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f7a98003990 con 0x7f7aa807be80 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:23.992+0000 7f7aa4ff9700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f7a9003bff0 0x7f7a9003e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:23.992+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a9003b500 con 0x7f7a9003bff0 2023-10-07T00:03:24.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:23.993+0000 7f7aa6ffd700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f7a9003bff0 0x7f7a9003e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:23.994+0000 7f7aa6ffd700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f7a9003bff0 0x7f7a9003e3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c003a10 tx=0x7f7a9c0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:23.995+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mgr.14118 v2:172.21.15.5:6800/968817192 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f7a9003b500 con 0x7f7a9003bff0 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.002+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7aa819d600 con 0x7f7a9003bff0 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.002+0000 7f7aa4ff9700 1 -- 172.21.15.5:0/2347228836 <== mgr.14118 v2:172.21.15.5:6800/968817192 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7aa819d600 con 0x7f7a9003bff0 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f7a9003bff0 msgr2=0x7f7a9003e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f7a9003bff0 0x7f7a9003e3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c003a10 tx=0x7f7a9c0092b0 comp rx=0 tx=0).stop 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 msgr2=0x7f7aa819c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa819c2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7a98000c00 tx=0x7f7a98011e70 comp rx=0 tx=0).stop 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 shutdown_connections 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f7a9003bff0 0x7f7a9003e3e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa807be80 0x7f7aa819c2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:24.389 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 --2- 172.21.15.5:0/2347228836 >> [v2:172.21.15.5:6800/2264485294,v1:172.21.15.5:6801/2264485294] conn(0x7f7a90038930 0x7f7a9003adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:24.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 >> 172.21.15.5:0/2347228836 conn(0x7f7aa8101b30 msgr2=0x7f7aa8102880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:24.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 shutdown_connections 2023-10-07T00:03:24.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.003+0000 7f7aadff0700 1 -- 172.21.15.5:0/2347228836 wait complete. 2023-10-07T00:03:24.390 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 5 is available 2023-10-07T00:03:24.390 INFO:teuthology.orchestra.run.smithi005.stdout:Setting orchestrator backend to cephadm... 2023-10-07T00:03:25.303 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:25 smithi005 ceph-mon[129406]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-07T00:03:25.303 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:25 smithi005 ceph-mon[129406]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-07T00:03:25.561 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.896+0000 7fcdda402700 1 Processor -- start 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.897+0000 7fcdda402700 1 -- start start 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.897+0000 7fcdda402700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd407a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.897+0000 7fcdda402700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd407a890 con 0x7fcdd407be60 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.897+0000 7fcdd3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd407a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.897+0000 7fcdd3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd407a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45970/0 (socket says 172.21.15.5:45970) 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.897+0000 7fcdd3fff700 1 -- 172.21.15.5:0/1725189086 learned_addr learned my addr 172.21.15.5:0/1725189086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.898+0000 7fcdd3fff700 1 -- 172.21.15.5:0/1725189086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd407a9d0 con 0x7fcdd407be60 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.898+0000 7fcdd3fff700 1 --2- 172.21.15.5:0/1725189086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd407a2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40098a0 tx=0x7fcdc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1e920b3b95ed8c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.898+0000 7fcdd2ffd700 1 -- 172.21.15.5:0/1725189086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdc4004160 con 0x7fcdd407be60 2023-10-07T00:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.898+0000 7fcdd2ffd700 1 -- 172.21.15.5:0/1725189086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fcdc40042c0 con 0x7fcdd407be60 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.898+0000 7fcdd2ffd700 1 -- 172.21.15.5:0/1725189086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdc4011940 con 0x7fcdd407be60 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.899+0000 7fcdda402700 1 -- 172.21.15.5:0/1725189086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 msgr2=0x7fcdd407a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.899+0000 7fcdda402700 1 --2- 172.21.15.5:0/1725189086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd407a2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40098a0 tx=0x7fcdc4009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.899+0000 7fcdda402700 1 -- 172.21.15.5:0/1725189086 shutdown_connections 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.899+0000 7fcdda402700 1 --2- 172.21.15.5:0/1725189086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd407a2c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.899+0000 7fcdda402700 1 -- 172.21.15.5:0/1725189086 >> 172.21.15.5:0/1725189086 conn(0x7fcdd4101b00 msgr2=0x7fcdd4103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.899+0000 7fcdda402700 1 -- 172.21.15.5:0/1725189086 shutdown_connections 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.899+0000 7fcdda402700 1 -- 172.21.15.5:0/1725189086 wait complete. 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.900+0000 7fcdda402700 1 Processor -- start 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.900+0000 7fcdda402700 1 -- start start 2023-10-07T00:03:25.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.901+0000 7fcdda402700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.901+0000 7fcdda402700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd419c770 con 0x7fcdd407be60 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.901+0000 7fcdd3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.901+0000 7fcdd3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd419c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45984/0 (socket says 172.21.15.5:45984) 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.901+0000 7fcdd3fff700 1 -- 172.21.15.5:0/1804541372 learned_addr learned my addr 172.21.15.5:0/1804541372 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.901+0000 7fcdd3fff700 1 -- 172.21.15.5:0/1804541372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc4009550 con 0x7fcdd407be60 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.902+0000 7fcdd3fff700 1 --2- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd419c230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4011dc0 tx=0x7fcdc4011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.902+0000 7fcdd17fa700 1 -- 172.21.15.5:0/1804541372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdc40037d0 con 0x7fcdd407be60 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.902+0000 7fcdd17fa700 1 -- 172.21.15.5:0/1804541372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fcdc401b440 con 0x7fcdd407be60 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.902+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd419c970 con 0x7fcdd407be60 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.902+0000 7fcdd17fa700 1 -- 172.21.15.5:0/1804541372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdc401a560 con 0x7fcdd407be60 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.902+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd419cd90 con 0x7fcdd407be60 2023-10-07T00:03:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.903+0000 7fcdd17fa700 1 -- 172.21.15.5:0/1804541372 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7fcdc401b5b0 con 0x7fcdd407be60 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.903+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd40624e0 con 0x7fcdd407be60 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.904+0000 7fcdd17fa700 1 --2- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fcdbc0387b0 0x7fcdbc03ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.904+0000 7fcdd17fa700 1 -- 172.21.15.5:0/1804541372 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcdc404c610 con 0x7fcdd407be60 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.904+0000 7fcdd37fe700 1 --2- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fcdbc0387b0 0x7fcdbc03ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.905+0000 7fcdd37fe700 1 --2- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fcdbc0387b0 0x7fcdbc03ac70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8006fd0 tx=0x7fcdc8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:24.910+0000 7fcdd17fa700 1 -- 172.21.15.5:0/1804541372 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcdc4023a00 con 0x7fcdd407be60 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.136+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdd4102e80 con 0x7fcdbc0387b0 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.142+0000 7fcdd17fa700 1 -- 172.21.15.5:0/1804541372 <== mgr.14118 v2:172.21.15.5:6800/968817192 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcdd4102e80 con 0x7fcdbc0387b0 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fcdbc0387b0 msgr2=0x7fcdbc03ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 --2- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fcdbc0387b0 0x7fcdbc03ac70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8006fd0 tx=0x7fcdc8006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:25.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 msgr2=0x7fcdd419c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:25.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 --2- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd419c230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4011dc0 tx=0x7fcdc4011ea0 comp rx=0 tx=0).stop 2023-10-07T00:03:25.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 shutdown_connections 2023-10-07T00:03:25.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 --2- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fcdbc0387b0 0x7fcdbc03ac70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:25.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 --2- 172.21.15.5:0/1804541372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd407be60 0x7fcdd419c230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:25.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 >> 172.21.15.5:0/1804541372 conn(0x7fcdd4101b00 msgr2=0x7fcdd4102770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:25.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 shutdown_connections 2023-10-07T00:03:25.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:25.145+0000 7fcdda402700 1 -- 172.21.15.5:0/1804541372 wait complete. 2023-10-07T00:03:26.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:26 smithi005 ceph-mon[129406]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:26.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:26 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:26.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:26 smithi005 ceph-mon[129406]: [07/Oct/2023:00:03:25] ENGINE Bus STARTING 2023-10-07T00:03:26.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:26 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:03:26.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:26 smithi005 ceph-mon[129406]: [07/Oct/2023:00:03:25] ENGINE Serving on https://172.21.15.5:7150 2023-10-07T00:03:26.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:26 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:03:26.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:26 smithi005 ceph-mon[129406]: mgrmap e8: x(active, since 2s) 2023-10-07T00:03:26.647 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.047+0000 7f1da335a700 1 Processor -- start 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.047+0000 7f1da335a700 1 -- start start 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.048+0000 7f1da335a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.048+0000 7f1da335a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c07a890 con 0x7f1d9c07be60 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.048+0000 7f1da10f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.048+0000 7f1da10f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45998/0 (socket says 172.21.15.5:45998) 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.048+0000 7f1da10f6700 1 -- 172.21.15.5:0/1252565640 learned_addr learned my addr 172.21.15.5:0/1252565640 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.048+0000 7f1da10f6700 1 -- 172.21.15.5:0/1252565640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c07a9d0 con 0x7f1d9c07be60 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.049+0000 7f1da10f6700 1 --2- 172.21.15.5:0/1252565640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c07a2c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1d980098a0 tx=0x7f1d98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbeae4fe85173b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.049+0000 7f1d93fff700 1 -- 172.21.15.5:0/1252565640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d98004160 con 0x7f1d9c07be60 2023-10-07T00:03:26.648 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.049+0000 7f1d93fff700 1 -- 172.21.15.5:0/1252565640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1d980042c0 con 0x7f1d9c07be60 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.049+0000 7f1d93fff700 1 -- 172.21.15.5:0/1252565640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d98011940 con 0x7f1d9c07be60 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.050+0000 7f1da335a700 1 -- 172.21.15.5:0/1252565640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 msgr2=0x7f1d9c07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.050+0000 7f1da335a700 1 --2- 172.21.15.5:0/1252565640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c07a2c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1d980098a0 tx=0x7f1d98009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.050+0000 7f1da335a700 1 -- 172.21.15.5:0/1252565640 shutdown_connections 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.050+0000 7f1da335a700 1 --2- 172.21.15.5:0/1252565640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c07a2c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.050+0000 7f1da335a700 1 -- 172.21.15.5:0/1252565640 >> 172.21.15.5:0/1252565640 conn(0x7f1d9c101b30 msgr2=0x7f1d9c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.050+0000 7f1da335a700 1 -- 172.21.15.5:0/1252565640 shutdown_connections 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.050+0000 7f1da335a700 1 -- 172.21.15.5:0/1252565640 wait complete. 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.051+0000 7f1da335a700 1 Processor -- start 2023-10-07T00:03:26.649 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.052+0000 7f1da335a700 1 -- start start 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.052+0000 7f1da335a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.052+0000 7f1da335a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c19c7d0 con 0x7f1d9c07be60 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.052+0000 7f1da10f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.052+0000 7f1da10f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46002/0 (socket says 172.21.15.5:46002) 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.052+0000 7f1da10f6700 1 -- 172.21.15.5:0/3540230235 learned_addr learned my addr 172.21.15.5:0/3540230235 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.053+0000 7f1da10f6700 1 -- 172.21.15.5:0/3540230235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98009550 con 0x7f1d9c07be60 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.053+0000 7f1da10f6700 1 --2- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c19c290 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1d98011dc0 tx=0x7f1d98011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.053+0000 7f1d927fc700 1 -- 172.21.15.5:0/3540230235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d980037d0 con 0x7f1d9c07be60 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.053+0000 7f1d927fc700 1 -- 172.21.15.5:0/3540230235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1d9801b440 con 0x7f1d9c07be60 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.053+0000 7f1d927fc700 1 -- 172.21.15.5:0/3540230235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d9801a560 con 0x7f1d9c07be60 2023-10-07T00:03:26.650 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.053+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c19c9d0 con 0x7f1d9c07be60 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.053+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c19cdf0 con 0x7f1d9c07be60 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.054+0000 7f1d927fc700 1 -- 172.21.15.5:0/3540230235 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f1d9801b5b0 con 0x7f1d9c07be60 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.054+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c0624e0 con 0x7f1d9c07be60 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.055+0000 7f1d927fc700 1 --2- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f1d88038930 0x7f1d8803adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.055+0000 7f1d927fc700 1 -- 172.21.15.5:0/3540230235 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1d9804c810 con 0x7f1d9c07be60 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.055+0000 7f1da08f5700 1 --2- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f1d88038930 0x7f1d8803adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.056+0000 7f1da08f5700 1 --2- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f1d88038930 0x7f1d8803adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c006fd0 tx=0x7f1d8c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.060+0000 7f1d927fc700 1 -- 172.21.15.5:0/3540230235 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1d98023590 con 0x7f1d9c07be60 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.272+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d9c102f30 con 0x7f1d88038930 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.273+0000 7f1d927fc700 1 -- 172.21.15.5:0/3540230235 <== mgr.14118 v2:172.21.15.5:6800/968817192 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f1d9c102f30 con 0x7f1d88038930 2023-10-07T00:03:26.651 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.275+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f1d88038930 msgr2=0x7f1d8803adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.275+0000 7f1da335a700 1 --2- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f1d88038930 0x7f1d8803adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c006fd0 tx=0x7f1d8c006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.275+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 msgr2=0x7f1d9c19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.275+0000 7f1da335a700 1 --2- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c19c290 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1d98011dc0 tx=0x7f1d98011ea0 comp rx=0 tx=0).stop 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.276+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 shutdown_connections 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.276+0000 7f1da335a700 1 --2- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f1d88038930 0x7f1d8803adf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.276+0000 7f1da335a700 1 --2- 172.21.15.5:0/3540230235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9c07be60 0x7f1d9c19c290 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.276+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 >> 172.21.15.5:0/3540230235 conn(0x7f1d9c101b30 msgr2=0x7f1d9c102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.276+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 shutdown_connections 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:26.276+0000 7f1da335a700 1 -- 172.21.15.5:0/3540230235 wait complete. 2023-10-07T00:03:26.652 INFO:teuthology.orchestra.run.smithi005.stdout:Generating ssh key... 2023-10-07T00:03:27.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-mon[129406]: [07/Oct/2023:00:03:25] ENGINE Serving on http://172.21.15.5:8765 2023-10-07T00:03:27.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-mon[129406]: [07/Oct/2023:00:03:25] ENGINE Bus STARTED 2023-10-07T00:03:27.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-mon[129406]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:28.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: Generating public/private rsa key pair. 2023-10-07T00:03:28.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: Your identification has been saved in /tmp/tmp7bs_nrd4/key. 2023-10-07T00:03:28.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: Your public key has been saved in /tmp/tmp7bs_nrd4/key.pub. 2023-10-07T00:03:28.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: The key fingerprint is: 2023-10-07T00:03:28.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: SHA256:EUcTymNcB1bZ1aC0nH4Q9ZTau/WM7qS2gJkmjujWWDk ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:03:28.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: The key's randomart image is: 2023-10-07T00:03:28.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: +---[RSA 3072]----+ 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | ..O+=+oo=| 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | o * =.=.+.| 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | B * o .| 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | . o . o . | 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | . S . . .| 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | E + . ..| 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | + .. = . .o+| 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | o..o o ..o..o| 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: | oo . . .o+o | 2023-10-07T00:03:28.110 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: +----[SHA256]-----+ 2023-10-07T00:03:28.230 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.163+0000 7f057df18700 1 Processor -- start 2023-10-07T00:03:28.230 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.164+0000 7f057df18700 1 -- start start 2023-10-07T00:03:28.230 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.164+0000 7f057df18700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f05781069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:28.230 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.164+0000 7f057df18700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578106f80 con 0x7f0578106590 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.164+0000 7f05777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f05781069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.164+0000 7f05777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f05781069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46018/0 (socket says 172.21.15.5:46018) 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.164+0000 7f05777fe700 1 -- 172.21.15.5:0/2210286250 learned_addr learned my addr 172.21.15.5:0/2210286250 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.165+0000 7f05777fe700 1 -- 172.21.15.5:0/2210286250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578107790 con 0x7f0578106590 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.165+0000 7f05777fe700 1 --2- 172.21.15.5:0/2210286250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f05781069b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05680098a0 tx=0x7f0568009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583a773e6becd4aa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.165+0000 7f05767fc700 1 -- 172.21.15.5:0/2210286250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0568004160 con 0x7f0578106590 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.165+0000 7f05767fc700 1 -- 172.21.15.5:0/2210286250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f05680042c0 con 0x7f0578106590 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.165+0000 7f05767fc700 1 -- 172.21.15.5:0/2210286250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0568011940 con 0x7f0578106590 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.166+0000 7f057df18700 1 -- 172.21.15.5:0/2210286250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 msgr2=0x7f05781069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.166+0000 7f057df18700 1 --2- 172.21.15.5:0/2210286250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f05781069b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05680098a0 tx=0x7f0568009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:28.231 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.166+0000 7f057df18700 1 -- 172.21.15.5:0/2210286250 shutdown_connections 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.166+0000 7f057df18700 1 --2- 172.21.15.5:0/2210286250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f05781069b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.166+0000 7f057df18700 1 -- 172.21.15.5:0/2210286250 >> 172.21.15.5:0/2210286250 conn(0x7f0578101b30 msgr2=0x7f0578103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.166+0000 7f057df18700 1 -- 172.21.15.5:0/2210286250 shutdown_connections 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.166+0000 7f057df18700 1 -- 172.21.15.5:0/2210286250 wait complete. 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.167+0000 7f057df18700 1 Processor -- start 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.167+0000 7f057df18700 1 -- start start 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.167+0000 7f057df18700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f057819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.167+0000 7f057df18700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057819c810 con 0x7f0578106590 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.168+0000 7f05777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f057819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:28.232 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.168+0000 7f05777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f057819c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46022/0 (socket says 172.21.15.5:46022) 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.168+0000 7f05777fe700 1 -- 172.21.15.5:0/3357142115 learned_addr learned my addr 172.21.15.5:0/3357142115 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.168+0000 7f05777fe700 1 -- 172.21.15.5:0/3357142115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009550 con 0x7f0578106590 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.168+0000 7f05777fe700 1 --2- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f057819c2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0568000c00 tx=0x7f0568011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.168+0000 7f0574ff9700 1 -- 172.21.15.5:0/3357142115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05680036a0 con 0x7f0578106590 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.168+0000 7f0574ff9700 1 -- 172.21.15.5:0/3357142115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f056801b440 con 0x7f0578106590 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.168+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057819ca10 con 0x7f0578106590 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.169+0000 7f0574ff9700 1 -- 172.21.15.5:0/3357142115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05680193f0 con 0x7f0578106590 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.169+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057819ce30 con 0x7f0578106590 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.170+0000 7f0574ff9700 1 -- 172.21.15.5:0/3357142115 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f056801b5b0 con 0x7f0578106590 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.170+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05780624e0 con 0x7f0578106590 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.170+0000 7f0574ff9700 1 --2- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f0560038930 0x7f056003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.170+0000 7f0574ff9700 1 -- 172.21.15.5:0/3357142115 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f056804c7a0 con 0x7f0578106590 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.170+0000 7f0576ffd700 1 --2- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f0560038930 0x7f056003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.171+0000 7f0576ffd700 1 --2- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f0560038930 0x7f056003adf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f056c006fd0 tx=0x7f056c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.175+0000 7f0574ff9700 1 -- 172.21.15.5:0/3357142115 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0568022950 con 0x7f0578106590 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.384+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0578102f00 con 0x7f0560038930 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.827+0000 7f0574ff9700 1 -- 172.21.15.5:0/3357142115 <== mgr.14118 v2:172.21.15.5:6800/968817192 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0578102f00 con 0x7f0560038930 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.829+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f0560038930 msgr2=0x7f056003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.829+0000 7f057df18700 1 --2- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f0560038930 0x7f056003adf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f056c006fd0 tx=0x7f056c006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.829+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 msgr2=0x7f057819c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.829+0000 7f057df18700 1 --2- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f057819c2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0568000c00 tx=0x7f0568011e70 comp rx=0 tx=0).stop 2023-10-07T00:03:28.234 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.829+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 shutdown_connections 2023-10-07T00:03:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.829+0000 7f057df18700 1 --2- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f0560038930 0x7f056003adf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.829+0000 7f057df18700 1 --2- 172.21.15.5:0/3357142115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0578106590 0x7f057819c2d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.829+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 >> 172.21.15.5:0/3357142115 conn(0x7f0578101b30 msgr2=0x7f05781027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.830+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 shutdown_connections 2023-10-07T00:03:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:27.830+0000 7f057df18700 1 -- 172.21.15.5:0/3357142115 wait complete. 2023-10-07T00:03:29.106 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:28 smithi005 ceph-mon[129406]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:29.106 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:28 smithi005 ceph-mon[129406]: Generating ssh key... 2023-10-07T00:03:29.106 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:28 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:29.106 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:28 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:29.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTcgx8BKz6eHdgHgsKsgDLQMGXYydXCNDTrU/2h1OSKDim9QMQN4Fzpd19awBjvtJ90W0O8/nNTDsq7Abv5ySCW1UFRKPWwv81Nst5WHhOL9uwb2d+3mrSSaBFn3Edy6EofWwnmKNcKPPAZwh/DNca3HjYs3eBzfbSYH03bVqmFSzihrBRXm6MTLyAP97EAKWidV/mruMvLo/D2zstEzLYkeCyOM9hv/60EfwwBpmyOoF/s2nSh3h63mIMDTU3I4rUHZWiUU6VqubV/t8HBhYDI2cfrjpz7e9myq9MBXYifKOglCPmggLiTrf4hD9ipEdEayay6kaIP97J63NlJWLpa28pv6zDwCrBfUchKFiw1lVuMnNs1sP9NeuqiANz1L6tWGs775vxzWsIC0mzVrZUYpCmKxCCy1RRYw6Pb/5m8yk3pcQeCnyGIkfGOzlgI2nqCbK+XW38oOYFW0e+7uqVGhIxaCQziBtQ++6EDnz45ci0FYgM1tpQSy3MR5wOIJc= ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.746+0000 7f36a2ba2700 1 Processor -- start 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.747+0000 7f36a2ba2700 1 -- start start 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.747+0000 7f36a2ba2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c07a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.747+0000 7f36a2ba2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c07a8b0 con 0x7f369c07be80 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.747+0000 7f36a093e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c07a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.747+0000 7f36a093e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c07a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46032/0 (socket says 172.21.15.5:46032) 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.747+0000 7f36a093e700 1 -- 172.21.15.5:0/2879929634 learned_addr learned my addr 172.21.15.5:0/2879929634 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.748+0000 7f36a093e700 1 -- 172.21.15.5:0/2879929634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c07a9f0 con 0x7f369c07be80 2023-10-07T00:03:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.748+0000 7f36a093e700 1 --2- 172.21.15.5:0/2879929634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c07a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f36900098a0 tx=0x7f3690009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1326cc3e649f96 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.748+0000 7f369b7fe700 1 -- 172.21.15.5:0/2879929634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3690004160 con 0x7f369c07be80 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.748+0000 7f369b7fe700 1 -- 172.21.15.5:0/2879929634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f36900042c0 con 0x7f369c07be80 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.748+0000 7f369b7fe700 1 -- 172.21.15.5:0/2879929634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3690011940 con 0x7f369c07be80 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.749+0000 7f36a2ba2700 1 -- 172.21.15.5:0/2879929634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 msgr2=0x7f369c07a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.749+0000 7f36a2ba2700 1 --2- 172.21.15.5:0/2879929634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c07a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f36900098a0 tx=0x7f3690009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.749+0000 7f36a2ba2700 1 -- 172.21.15.5:0/2879929634 shutdown_connections 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.749+0000 7f36a2ba2700 1 --2- 172.21.15.5:0/2879929634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c07a2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.749+0000 7f36a2ba2700 1 -- 172.21.15.5:0/2879929634 >> 172.21.15.5:0/2879929634 conn(0x7f369c101b30 msgr2=0x7f369c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.749+0000 7f36a2ba2700 1 -- 172.21.15.5:0/2879929634 shutdown_connections 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.749+0000 7f36a2ba2700 1 -- 172.21.15.5:0/2879929634 wait complete. 2023-10-07T00:03:29.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.751+0000 7f36a2ba2700 1 Processor -- start 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.751+0000 7f36a2ba2700 1 -- start start 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.751+0000 7f36a2ba2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.751+0000 7f36a2ba2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c19c800 con 0x7f369c07be80 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f36a093e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f36a093e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c19c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46036/0 (socket says 172.21.15.5:46036) 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f36a093e700 1 -- 172.21.15.5:0/1473035439 learned_addr learned my addr 172.21.15.5:0/1473035439 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f36a093e700 1 -- 172.21.15.5:0/1473035439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690009550 con 0x7f369c07be80 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f36a093e700 1 --2- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c19c2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3690000c00 tx=0x7f3690011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f3699ffb700 1 -- 172.21.15.5:0/1473035439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36900036a0 con 0x7f369c07be80 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c19ca00 con 0x7f369c07be80 2023-10-07T00:03:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f3699ffb700 1 -- 172.21.15.5:0/1473035439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f369001b440 con 0x7f369c07be80 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.752+0000 7f3699ffb700 1 -- 172.21.15.5:0/1473035439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36900193f0 con 0x7f369c07be80 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.753+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c19ce20 con 0x7f369c07be80 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.754+0000 7f3699ffb700 1 -- 172.21.15.5:0/1473035439 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f369001b5b0 con 0x7f369c07be80 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.754+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c0624e0 con 0x7f369c07be80 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.754+0000 7f3699ffb700 1 --2- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f368c0388e0 0x7f368c03ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.754+0000 7f3699ffb700 1 -- 172.21.15.5:0/1473035439 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f369004c730 con 0x7f369c07be80 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.754+0000 7f369bfff700 1 --2- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f368c0388e0 0x7f368c03ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.755+0000 7f369bfff700 1 --2- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f368c0388e0 0x7f368c03ada0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3688006fd0 tx=0x7f3688006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.759+0000 7f3699ffb700 1 -- 172.21.15.5:0/1473035439 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3690022950 con 0x7f369c07be80 2023-10-07T00:03:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.969+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f369c102f90 con 0x7f368c0388e0 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.970+0000 7f3699ffb700 1 -- 172.21.15.5:0/1473035439 <== mgr.14118 v2:172.21.15.5:6800/968817192 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f369c102f90 con 0x7f368c0388e0 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.972+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f368c0388e0 msgr2=0x7f368c03ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.972+0000 7f36a2ba2700 1 --2- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f368c0388e0 0x7f368c03ada0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3688006fd0 tx=0x7f3688006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.972+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 msgr2=0x7f369c19c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.972+0000 7f36a2ba2700 1 --2- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c19c2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3690000c00 tx=0x7f3690011e70 comp rx=0 tx=0).stop 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.972+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 shutdown_connections 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.972+0000 7f36a2ba2700 1 --2- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f368c0388e0 0x7f368c03ada0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.972+0000 7f36a2ba2700 1 --2- 172.21.15.5:0/1473035439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c07be80 0x7f369c19c2c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.972+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 >> 172.21.15.5:0/1473035439 conn(0x7f369c101b30 msgr2=0x7f369c102880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.973+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 shutdown_connections 2023-10-07T00:03:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:28.973+0000 7f36a2ba2700 1 -- 172.21.15.5:0/1473035439 wait complete. 2023-10-07T00:03:29.417 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-07T00:03:29.417 INFO:teuthology.orchestra.run.smithi005.stdout:Adding key to root@localhost authorized_keys... 2023-10-07T00:03:29.417 INFO:teuthology.orchestra.run.smithi005.stdout:Adding host smithi005... 2023-10-07T00:03:30.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:29 smithi005 ceph-mon[129406]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:30 smithi005 ceph-mon[129406]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:32.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:31 smithi005 ceph-mon[129406]: Deploying cephadm binary to smithi005 2023-10-07T00:03:33.900 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Added host 'smithi005' with addr '172.21.15.5' 2023-10-07T00:03:33.900 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.934+0000 7fab98d98700 1 Processor -- start 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.934+0000 7fab98d98700 1 -- start start 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.935+0000 7fab98d98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab941069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.935+0000 7fab98d98700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab94106f70 con 0x7fab94106580 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.935+0000 7fab9259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab941069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.935+0000 7fab9259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab941069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46044/0 (socket says 172.21.15.5:46044) 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.935+0000 7fab9259c700 1 -- 172.21.15.5:0/4149402197 learned_addr learned my addr 172.21.15.5:0/4149402197 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.936+0000 7fab9259c700 1 -- 172.21.15.5:0/4149402197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94107780 con 0x7fab94106580 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.936+0000 7fab9259c700 1 --2- 172.21.15.5:0/4149402197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab941069a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab840098a0 tx=0x7fab84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5631078e010b380e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.936+0000 7fab9159a700 1 -- 172.21.15.5:0/4149402197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab84004160 con 0x7fab94106580 2023-10-07T00:03:33.901 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.936+0000 7fab9159a700 1 -- 172.21.15.5:0/4149402197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fab840042c0 con 0x7fab94106580 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.936+0000 7fab9159a700 1 -- 172.21.15.5:0/4149402197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab84011940 con 0x7fab94106580 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.937+0000 7fab98d98700 1 -- 172.21.15.5:0/4149402197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 msgr2=0x7fab941069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.937+0000 7fab98d98700 1 --2- 172.21.15.5:0/4149402197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab941069a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab840098a0 tx=0x7fab84009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.937+0000 7fab98d98700 1 -- 172.21.15.5:0/4149402197 shutdown_connections 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.937+0000 7fab98d98700 1 --2- 172.21.15.5:0/4149402197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab941069a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.937+0000 7fab98d98700 1 -- 172.21.15.5:0/4149402197 >> 172.21.15.5:0/4149402197 conn(0x7fab94101b00 msgr2=0x7fab94103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.937+0000 7fab98d98700 1 -- 172.21.15.5:0/4149402197 shutdown_connections 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.937+0000 7fab98d98700 1 -- 172.21.15.5:0/4149402197 wait complete. 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.938+0000 7fab98d98700 1 Processor -- start 2023-10-07T00:03:33.902 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.938+0000 7fab98d98700 1 -- start start 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.938+0000 7fab98d98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab9419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.938+0000 7fab98d98700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9419a570 con 0x7fab94106580 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.939+0000 7fab9259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab9419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.939+0000 7fab9259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab9419a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46060/0 (socket says 172.21.15.5:46060) 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.939+0000 7fab9259c700 1 -- 172.21.15.5:0/2058454232 learned_addr learned my addr 172.21.15.5:0/2058454232 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.939+0000 7fab9259c700 1 -- 172.21.15.5:0/2058454232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009550 con 0x7fab94106580 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.939+0000 7fab9259c700 1 --2- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab9419a030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fab84000c00 tx=0x7fab84011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.939+0000 7fab837fe700 1 -- 172.21.15.5:0/2058454232 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab840036a0 con 0x7fab94106580 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.940+0000 7fab837fe700 1 -- 172.21.15.5:0/2058454232 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fab8401b440 con 0x7fab94106580 2023-10-07T00:03:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.940+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9419a770 con 0x7fab94106580 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.940+0000 7fab837fe700 1 -- 172.21.15.5:0/2058454232 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab840193f0 con 0x7fab94106580 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.940+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9419ab90 con 0x7fab94106580 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.941+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab940624e0 con 0x7fab94106580 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.941+0000 7fab837fe700 1 -- 172.21.15.5:0/2058454232 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fab8401b5b0 con 0x7fab94106580 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.941+0000 7fab837fe700 1 --2- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fab7c038930 0x7fab7c03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.941+0000 7fab837fe700 1 -- 172.21.15.5:0/2058454232 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fab8404c7a0 con 0x7fab94106580 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.942+0000 7fab91d9b700 1 --2- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fab7c038930 0x7fab7c03adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.942+0000 7fab91d9b700 1 --2- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fab7c038930 0x7fab7c03adf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fab88006fd0 tx=0x7fab88006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:29.946+0000 7fab837fe700 1 -- 172.21.15.5:0/2058454232 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fab84022950 con 0x7fab94106580 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:30.160+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}) v1 -- 0x7fab94102e70 con 0x7fab7c038930 2023-10-07T00:03:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.487+0000 7fab837fe700 1 -- 172.21.15.5:0/2058454232 <== mgr.14118 v2:172.21.15.5:6800/968817192 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fab94102e70 con 0x7fab7c038930 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fab7c038930 msgr2=0x7fab7c03adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 --2- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fab7c038930 0x7fab7c03adf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fab88006fd0 tx=0x7fab88006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 msgr2=0x7fab9419a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 --2- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab9419a030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fab84000c00 tx=0x7fab84011e70 comp rx=0 tx=0).stop 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 shutdown_connections 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 --2- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fab7c038930 0x7fab7c03adf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 --2- 172.21.15.5:0/2058454232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab94106580 0x7fab9419a030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 >> 172.21.15.5:0/2058454232 conn(0x7fab94101b00 msgr2=0x7fab94102760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 shutdown_connections 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:33.490+0000 7fab98d98700 1 -- 172.21.15.5:0/2058454232 wait complete. 2023-10-07T00:03:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mon service... 2023-10-07T00:03:34.754 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:34 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:34.755 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:34 smithi005 ceph-mon[129406]: Added host smithi005 2023-10-07T00:03:34.755 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:34 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.396+0000 7fec0b38c700 1 Processor -- start 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.396+0000 7fec0b38c700 1 -- start start 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.396+0000 7fec0b38c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec041069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.396+0000 7fec0b38c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04106f70 con 0x7fec04106580 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.397+0000 7fec09128700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec041069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.397+0000 7fec09128700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec041069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39436/0 (socket says 172.21.15.5:39436) 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.397+0000 7fec09128700 1 -- 172.21.15.5:0/855545947 learned_addr learned my addr 172.21.15.5:0/855545947 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:35.115 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.397+0000 7fec09128700 1 -- 172.21.15.5:0/855545947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04107780 con 0x7fec04106580 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.397+0000 7fec09128700 1 --2- 172.21.15.5:0/855545947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec041069a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec000098a0 tx=0x7fec00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a59708c82731cda server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.397+0000 7febfbfff700 1 -- 172.21.15.5:0/855545947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec00004160 con 0x7fec04106580 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.397+0000 7febfbfff700 1 -- 172.21.15.5:0/855545947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fec000042c0 con 0x7fec04106580 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.397+0000 7febfbfff700 1 -- 172.21.15.5:0/855545947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec00011940 con 0x7fec04106580 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.398+0000 7fec0b38c700 1 -- 172.21.15.5:0/855545947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 msgr2=0x7fec041069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.398+0000 7fec0b38c700 1 --2- 172.21.15.5:0/855545947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec041069a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec000098a0 tx=0x7fec00009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.398+0000 7fec0b38c700 1 -- 172.21.15.5:0/855545947 shutdown_connections 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.398+0000 7fec0b38c700 1 --2- 172.21.15.5:0/855545947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec041069a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.398+0000 7fec0b38c700 1 -- 172.21.15.5:0/855545947 >> 172.21.15.5:0/855545947 conn(0x7fec04101b00 msgr2=0x7fec04103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.398+0000 7fec0b38c700 1 -- 172.21.15.5:0/855545947 shutdown_connections 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.398+0000 7fec0b38c700 1 -- 172.21.15.5:0/855545947 wait complete. 2023-10-07T00:03:35.116 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.399+0000 7fec0b38c700 1 Processor -- start 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.400+0000 7fec0b38c700 1 -- start start 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.400+0000 7fec0b38c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec0419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.400+0000 7fec0b38c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0419c770 con 0x7fec04106580 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.400+0000 7fec09128700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec0419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.400+0000 7fec09128700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec0419c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39442/0 (socket says 172.21.15.5:39442) 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.400+0000 7fec09128700 1 -- 172.21.15.5:0/911347351 learned_addr learned my addr 172.21.15.5:0/911347351 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.400+0000 7fec09128700 1 -- 172.21.15.5:0/911347351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec00009550 con 0x7fec04106580 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.401+0000 7fec09128700 1 --2- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec0419c230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec00000c00 tx=0x7fec00011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.401+0000 7febfa7fc700 1 -- 172.21.15.5:0/911347351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec000036a0 con 0x7fec04106580 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.401+0000 7febfa7fc700 1 -- 172.21.15.5:0/911347351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fec0001b440 con 0x7fec04106580 2023-10-07T00:03:35.117 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.401+0000 7febfa7fc700 1 -- 172.21.15.5:0/911347351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec000193f0 con 0x7fec04106580 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.401+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0419c970 con 0x7fec04106580 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.401+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0419cd90 con 0x7fec04106580 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.402+0000 7febfa7fc700 1 -- 172.21.15.5:0/911347351 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fec0001b5b0 con 0x7fec04106580 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.402+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec040624e0 con 0x7fec04106580 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.403+0000 7febfa7fc700 1 --2- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7febf0038930 0x7febf003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.403+0000 7febfa7fc700 1 -- 172.21.15.5:0/911347351 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fec0004c760 con 0x7fec04106580 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.403+0000 7fec08927700 1 --2- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7febf0038930 0x7febf003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.403+0000 7fec08927700 1 --2- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7febf0038930 0x7febf003adf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7febf4006fd0 tx=0x7febf4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.408+0000 7febfa7fc700 1 -- 172.21.15.5:0/911347351 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fec00022950 con 0x7fec04106580 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.633+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fec04102e70 con 0x7febf0038930 2023-10-07T00:03:35.118 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.638+0000 7febfa7fc700 1 -- 172.21.15.5:0/911347351 <== mgr.14118 v2:172.21.15.5:6800/968817192 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fec04102e70 con 0x7febf0038930 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7febf0038930 msgr2=0x7febf003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 --2- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7febf0038930 0x7febf003adf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7febf4006fd0 tx=0x7febf4006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 msgr2=0x7fec0419c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 --2- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec0419c230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec00000c00 tx=0x7fec00011e70 comp rx=0 tx=0).stop 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 shutdown_connections 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 --2- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7febf0038930 0x7febf003adf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 --2- 172.21.15.5:0/911347351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec04106580 0x7fec0419c230 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 >> 172.21.15.5:0/911347351 conn(0x7fec04101b00 msgr2=0x7fec04102760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 shutdown_connections 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:34.641+0000 7fec0b38c700 1 -- 172.21.15.5:0/911347351 wait complete. 2023-10-07T00:03:35.119 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mgr service... 2023-10-07T00:03:35.798 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:35 smithi005 ceph-mon[129406]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:35.799 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:35 smithi005 ceph-mon[129406]: Saving service mon spec with placement count:5 2023-10-07T00:03:35.799 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:35 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:36.453 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-07T00:03:36.453 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.759+0000 7f7129fc8700 1 Processor -- start 2023-10-07T00:03:36.453 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.759+0000 7f7129fc8700 1 -- start start 2023-10-07T00:03:36.453 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.760+0000 7f7129fc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712407a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:36.453 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.760+0000 7f7129fc8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712407a890 con 0x7f712407be60 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.760+0000 7f71237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712407a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.760+0000 7f71237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712407a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39458/0 (socket says 172.21.15.5:39458) 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.760+0000 7f71237fe700 1 -- 172.21.15.5:0/2647745678 learned_addr learned my addr 172.21.15.5:0/2647745678 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.761+0000 7f71237fe700 1 -- 172.21.15.5:0/2647745678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712407a9d0 con 0x7f712407be60 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.761+0000 7f71237fe700 1 --2- 172.21.15.5:0/2647745678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712407a2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f71140098a0 tx=0x7f7114009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1677ec41dcba368 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.761+0000 7f71227fc700 1 -- 172.21.15.5:0/2647745678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7114004160 con 0x7f712407be60 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.761+0000 7f71227fc700 1 -- 172.21.15.5:0/2647745678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f71140042c0 con 0x7f712407be60 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.761+0000 7f71227fc700 1 -- 172.21.15.5:0/2647745678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7114011940 con 0x7f712407be60 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.762+0000 7f7129fc8700 1 -- 172.21.15.5:0/2647745678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 msgr2=0x7f712407a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:36.454 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.762+0000 7f7129fc8700 1 --2- 172.21.15.5:0/2647745678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712407a2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f71140098a0 tx=0x7f7114009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.762+0000 7f7129fc8700 1 -- 172.21.15.5:0/2647745678 shutdown_connections 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.762+0000 7f7129fc8700 1 --2- 172.21.15.5:0/2647745678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712407a2c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.762+0000 7f7129fc8700 1 -- 172.21.15.5:0/2647745678 >> 172.21.15.5:0/2647745678 conn(0x7f7124101b00 msgr2=0x7f7124103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.762+0000 7f7129fc8700 1 -- 172.21.15.5:0/2647745678 shutdown_connections 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.762+0000 7f7129fc8700 1 -- 172.21.15.5:0/2647745678 wait complete. 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.763+0000 7f7129fc8700 1 Processor -- start 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.763+0000 7f7129fc8700 1 -- start start 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.764+0000 7f7129fc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.764+0000 7f7129fc8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712419c770 con 0x7f712407be60 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.764+0000 7f71237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:36.455 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.764+0000 7f71237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712419c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39474/0 (socket says 172.21.15.5:39474) 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.764+0000 7f71237fe700 1 -- 172.21.15.5:0/1774808152 learned_addr learned my addr 172.21.15.5:0/1774808152 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.764+0000 7f71237fe700 1 -- 172.21.15.5:0/1774808152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009550 con 0x7f712407be60 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.764+0000 7f71237fe700 1 --2- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712419c230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7114011dc0 tx=0x7f7114011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.765+0000 7f7120ff9700 1 -- 172.21.15.5:0/1774808152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71140037d0 con 0x7f712407be60 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.765+0000 7f7120ff9700 1 -- 172.21.15.5:0/1774808152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f711401b440 con 0x7f712407be60 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.765+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712419c970 con 0x7f712407be60 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.765+0000 7f7120ff9700 1 -- 172.21.15.5:0/1774808152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f711401a560 con 0x7f712407be60 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.765+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712419cd90 con 0x7f712407be60 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.766+0000 7f7120ff9700 1 -- 172.21.15.5:0/1774808152 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f711401b5b0 con 0x7f712407be60 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.766+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712410c910 con 0x7f712407be60 2023-10-07T00:03:36.456 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.767+0000 7f7120ff9700 1 --2- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f710c038930 0x7f710c03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.767+0000 7f7120ff9700 1 -- 172.21.15.5:0/1774808152 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f711404c750 con 0x7f712407be60 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.767+0000 7f7122ffd700 1 --2- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f710c038930 0x7f710c03adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.767+0000 7f7122ffd700 1 --2- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f710c038930 0x7f710c03adf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7118006fd0 tx=0x7f7118006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:35.772+0000 7f7120ff9700 1 -- 172.21.15.5:0/1774808152 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7114023590 con 0x7f712407be60 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.000+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f712419f7d0 con 0x7f710c038930 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.004+0000 7f7120ff9700 1 -- 172.21.15.5:0/1774808152 <== mgr.14118 v2:172.21.15.5:6800/968817192 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f712419f7d0 con 0x7f710c038930 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f710c038930 msgr2=0x7f710c03adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 --2- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f710c038930 0x7f710c03adf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7118006fd0 tx=0x7f7118006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 msgr2=0x7f712419c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 --2- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712419c230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7114011dc0 tx=0x7f7114011ea0 comp rx=0 tx=0).stop 2023-10-07T00:03:36.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 shutdown_connections 2023-10-07T00:03:36.458 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 --2- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f710c038930 0x7f710c03adf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:36.458 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 --2- 172.21.15.5:0/1774808152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f712407be60 0x7f712419c230 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:36.458 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 >> 172.21.15.5:0/1774808152 conn(0x7f7124101b00 msgr2=0x7f7124102770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:36.458 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 shutdown_connections 2023-10-07T00:03:36.458 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.007+0000 7f7129fc8700 1 -- 172.21.15.5:0/1774808152 wait complete. 2023-10-07T00:03:37.006 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:37 smithi005 ceph-mon[129406]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:37.006 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:37 smithi005 ceph-mon[129406]: Saving service mgr spec with placement count:2 2023-10-07T00:03:37.006 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:37 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:37.006 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:37 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:37.260 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:37 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:37.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:36.999+0000 7fe6638bf700 1 Processor -- start 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.000+0000 7fe6638bf700 1 -- start start 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.000+0000 7fe6638bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.000+0000 7fe6638bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c07a890 con 0x7fe65c07be60 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.000+0000 7fe66165b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.000+0000 7fe66165b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39486/0 (socket says 172.21.15.5:39486) 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.000+0000 7fe66165b700 1 -- 172.21.15.5:0/1948158845 learned_addr learned my addr 172.21.15.5:0/1948158845 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.001+0000 7fe66165b700 1 -- 172.21.15.5:0/1948158845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c07a9d0 con 0x7fe65c07be60 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.001+0000 7fe66165b700 1 --2- 172.21.15.5:0/1948158845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c07a2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe6580098a0 tx=0x7fe658009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c5672c7cdd0239 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.001+0000 7fe653fff700 1 -- 172.21.15.5:0/1948158845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe658004160 con 0x7fe65c07be60 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.001+0000 7fe653fff700 1 -- 172.21.15.5:0/1948158845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6580042c0 con 0x7fe65c07be60 2023-10-07T00:03:37.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.001+0000 7fe653fff700 1 -- 172.21.15.5:0/1948158845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6580118e0 con 0x7fe65c07be60 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.002+0000 7fe6638bf700 1 -- 172.21.15.5:0/1948158845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 msgr2=0x7fe65c07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.002+0000 7fe6638bf700 1 --2- 172.21.15.5:0/1948158845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c07a2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe6580098a0 tx=0x7fe658009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.002+0000 7fe6638bf700 1 -- 172.21.15.5:0/1948158845 shutdown_connections 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.002+0000 7fe6638bf700 1 --2- 172.21.15.5:0/1948158845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c07a2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.002+0000 7fe6638bf700 1 -- 172.21.15.5:0/1948158845 >> 172.21.15.5:0/1948158845 conn(0x7fe65c101b30 msgr2=0x7fe65c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.002+0000 7fe6638bf700 1 -- 172.21.15.5:0/1948158845 shutdown_connections 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.002+0000 7fe6638bf700 1 -- 172.21.15.5:0/1948158845 wait complete. 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.004+0000 7fe6638bf700 1 Processor -- start 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.004+0000 7fe6638bf700 1 -- start start 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.005+0000 7fe6638bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c19c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:37.836 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.005+0000 7fe6638bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c19c8b0 con 0x7fe65c07be60 2023-10-07T00:03:37.837 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.005+0000 7fe66165b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c19c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:37.837 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.005+0000 7fe66165b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c19c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39490/0 (socket says 172.21.15.5:39490) 2023-10-07T00:03:37.837 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.005+0000 7fe66165b700 1 -- 172.21.15.5:0/969954483 learned_addr learned my addr 172.21.15.5:0/969954483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:37.837 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.005+0000 7fe66165b700 1 -- 172.21.15.5:0/969954483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658009550 con 0x7fe65c07be60 2023-10-07T00:03:37.837 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.006+0000 7fe66165b700 1 --2- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c19c370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe6580118f0 tx=0x7fe6580119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:37.837 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.006+0000 7fe6527fc700 1 -- 172.21.15.5:0/969954483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6580036a0 con 0x7fe65c07be60 2023-10-07T00:03:37.837 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.006+0000 7fe6527fc700 1 -- 172.21.15.5:0/969954483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe65801b440 con 0x7fe65c07be60 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.006+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c19cab0 con 0x7fe65c07be60 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.006+0000 7fe6527fc700 1 -- 172.21.15.5:0/969954483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6580193f0 con 0x7fe65c07be60 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.007+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c19ced0 con 0x7fe65c07be60 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.008+0000 7fe6527fc700 1 -- 172.21.15.5:0/969954483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fe658019660 con 0x7fe65c07be60 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.008+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c0624e0 con 0x7fe65c07be60 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.008+0000 7fe6527fc700 1 --2- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fe648038980 0x7fe64803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.008+0000 7fe6527fc700 1 -- 172.21.15.5:0/969954483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe65804c7b0 con 0x7fe65c07be60 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.009+0000 7fe660e5a700 1 --2- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fe648038980 0x7fe64803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:37.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.009+0000 7fe660e5a700 1 --2- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fe648038980 0x7fe64803ae40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe64c006fd0 tx=0x7fe64c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.013+0000 7fe6527fc700 1 -- 172.21.15.5:0/969954483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe658023770 con 0x7fe65c07be60 2023-10-07T00:03:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.229+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe65c10c970 con 0x7fe65c07be60 2023-10-07T00:03:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.231+0000 7fe6527fc700 1 -- 172.21.15.5:0/969954483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe65801f070 con 0x7fe65c07be60 2023-10-07T00:03:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.234+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fe648038980 msgr2=0x7fe64803ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.234+0000 7fe6638bf700 1 --2- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fe648038980 0x7fe64803ae40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe64c006fd0 tx=0x7fe64c006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.234+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 msgr2=0x7fe65c19c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.234+0000 7fe6638bf700 1 --2- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c19c370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe6580118f0 tx=0x7fe6580119d0 comp rx=0 tx=0).stop 2023-10-07T00:03:37.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.234+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 shutdown_connections 2023-10-07T00:03:37.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.234+0000 7fe6638bf700 1 --2- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fe648038980 0x7fe64803ae40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:37.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.234+0000 7fe6638bf700 1 --2- 172.21.15.5:0/969954483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe65c07be60 0x7fe65c19c370 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:37.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.234+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 >> 172.21.15.5:0/969954483 conn(0x7fe65c101b30 msgr2=0x7fe65c1028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:37.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.235+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 shutdown_connections 2023-10-07T00:03:37.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:37.235+0000 7fe6638bf700 1 -- 172.21.15.5:0/969954483 wait complete. 2023-10-07T00:03:38.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:38 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/969954483' entity='client.admin' 2023-10-07T00:03:39.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.363+0000 7fa5973d3700 1 Processor -- start 2023-10-07T00:03:39.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.363+0000 7fa5973d3700 1 -- start start 2023-10-07T00:03:39.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.363+0000 7fa5973d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa5901069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:39.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.363+0000 7fa5973d3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590106f70 con 0x7fa590106580 2023-10-07T00:03:39.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.364+0000 7fa59516f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa5901069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:39.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.364+0000 7fa59516f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa5901069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39492/0 (socket says 172.21.15.5:39492) 2023-10-07T00:03:39.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.364+0000 7fa59516f700 1 -- 172.21.15.5:0/2540986314 learned_addr learned my addr 172.21.15.5:0/2540986314 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.364+0000 7fa59516f700 1 -- 172.21.15.5:0/2540986314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590107780 con 0x7fa590106580 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.364+0000 7fa59516f700 1 --2- 172.21.15.5:0/2540986314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa5901069a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0098a0 tx=0x7fa58c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0f7a407e0c2bce server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa587fff700 1 -- 172.21.15.5:0/2540986314 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa58c004160 con 0x7fa590106580 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa587fff700 1 -- 172.21.15.5:0/2540986314 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa58c0042c0 con 0x7fa590106580 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa587fff700 1 -- 172.21.15.5:0/2540986314 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa58c0118e0 con 0x7fa590106580 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa5973d3700 1 -- 172.21.15.5:0/2540986314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 msgr2=0x7fa5901069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa5973d3700 1 --2- 172.21.15.5:0/2540986314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa5901069a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0098a0 tx=0x7fa58c009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa5973d3700 1 -- 172.21.15.5:0/2540986314 shutdown_connections 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa5973d3700 1 --2- 172.21.15.5:0/2540986314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa5901069a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:39.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa5973d3700 1 -- 172.21.15.5:0/2540986314 >> 172.21.15.5:0/2540986314 conn(0x7fa590101b00 msgr2=0x7fa590103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.365+0000 7fa5973d3700 1 -- 172.21.15.5:0/2540986314 shutdown_connections 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.366+0000 7fa5973d3700 1 -- 172.21.15.5:0/2540986314 wait complete. 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.367+0000 7fa5973d3700 1 Processor -- start 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.367+0000 7fa5973d3700 1 -- start start 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.368+0000 7fa5973d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa59019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.368+0000 7fa5973d3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59019a650 con 0x7fa590106580 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.368+0000 7fa59516f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa59019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.368+0000 7fa59516f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa59019a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39500/0 (socket says 172.21.15.5:39500) 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.368+0000 7fa59516f700 1 -- 172.21.15.5:0/2043268760 learned_addr learned my addr 172.21.15.5:0/2043268760 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.368+0000 7fa59516f700 1 -- 172.21.15.5:0/2043268760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c009550 con 0x7fa590106580 2023-10-07T00:03:39.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.369+0000 7fa59516f700 1 --2- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa59019a110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa58c000c00 tx=0x7fa58c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.369+0000 7fa5867fc700 1 -- 172.21.15.5:0/2043268760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa58c0036a0 con 0x7fa590106580 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.369+0000 7fa5867fc700 1 -- 172.21.15.5:0/2043268760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa58c01b440 con 0x7fa590106580 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.369+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59019a850 con 0x7fa590106580 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.369+0000 7fa5867fc700 1 -- 172.21.15.5:0/2043268760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa58c01a3d0 con 0x7fa590106580 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.369+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59019ac70 con 0x7fa590106580 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.370+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5900624e0 con 0x7fa590106580 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.370+0000 7fa5867fc700 1 -- 172.21.15.5:0/2043268760 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fa58c01b5b0 con 0x7fa590106580 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.371+0000 7fa5867fc700 1 --2- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fa57c0388e0 0x7fa57c03ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.371+0000 7fa5867fc700 1 -- 172.21.15.5:0/2043268760 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa58c04c770 con 0x7fa590106580 2023-10-07T00:03:39.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.371+0000 7fa59496e700 1 --2- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fa57c0388e0 0x7fa57c03ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.372+0000 7fa59496e700 1 --2- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fa57c0388e0 0x7fa57c03ada0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa580006fd0 tx=0x7fa580006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.376+0000 7fa5867fc700 1 -- 172.21.15.5:0/2043268760 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa58c023a00 con 0x7fa590106580 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.598+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fa59019d6b0 con 0x7fa590106580 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.601+0000 7fa5867fc700 1 -- 172.21.15.5:0/2043268760 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa58c01f070 con 0x7fa590106580 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.603+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fa57c0388e0 msgr2=0x7fa57c03ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.603+0000 7fa5973d3700 1 --2- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fa57c0388e0 0x7fa57c03ada0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa580006fd0 tx=0x7fa580006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.604+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 msgr2=0x7fa59019a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.604+0000 7fa5973d3700 1 --2- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa59019a110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa58c000c00 tx=0x7fa58c0119a0 comp rx=0 tx=0).stop 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.604+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 shutdown_connections 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.604+0000 7fa5973d3700 1 --2- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7fa57c0388e0 0x7fa57c03ada0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:39.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.604+0000 7fa5973d3700 1 --2- 172.21.15.5:0/2043268760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa590106580 0x7fa59019a110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:39.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.604+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 >> 172.21.15.5:0/2043268760 conn(0x7fa590101b00 msgr2=0x7fa590102840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:39.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.604+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 shutdown_connections 2023-10-07T00:03:39.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:38.604+0000 7fa5973d3700 1 -- 172.21.15.5:0/2043268760 wait complete. 2023-10-07T00:03:39.228 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling the dashboard module... 2023-10-07T00:03:39.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:39 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2043268760' entity='client.admin' 2023-10-07T00:03:39.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:39 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:40.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:40 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1902024416' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-07T00:03:40.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:40 smithi005 ceph-mon[129406]: from='mgr.14118 172.21.15.5:0/2354411550' entity='mgr.x' 2023-10-07T00:03:40.859 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:40 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: ignoring --setuser ceph since I am not root 2023-10-07T00:03:40.859 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:40 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: ignoring --setgroup ceph since I am not root 2023-10-07T00:03:41.105 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.792+0000 7f6a9be5c700 1 Processor -- start 2023-10-07T00:03:41.105 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.792+0000 7f6a9be5c700 1 -- start start 2023-10-07T00:03:41.106 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.792+0000 7f6a9be5c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a941069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:41.106 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.792+0000 7f6a9be5c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94106f70 con 0x7f6a94106580 2023-10-07T00:03:41.106 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.793+0000 7f6a99bf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a941069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:41.106 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.793+0000 7f6a99bf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a941069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39508/0 (socket says 172.21.15.5:39508) 2023-10-07T00:03:41.106 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.793+0000 7f6a99bf8700 1 -- 172.21.15.5:0/3843006727 learned_addr learned my addr 172.21.15.5:0/3843006727 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:41.106 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.793+0000 7f6a99bf8700 1 -- 172.21.15.5:0/3843006727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a94107780 con 0x7f6a94106580 2023-10-07T00:03:41.106 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.793+0000 7f6a99bf8700 1 --2- 172.21.15.5:0/3843006727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a941069a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a900098a0 tx=0x7f6a90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70454bddea125f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a98bf6700 1 -- 172.21.15.5:0/3843006727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a90004160 con 0x7f6a94106580 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a98bf6700 1 -- 172.21.15.5:0/3843006727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a900042c0 con 0x7f6a94106580 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a98bf6700 1 -- 172.21.15.5:0/3843006727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a900118e0 con 0x7f6a94106580 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a9be5c700 1 -- 172.21.15.5:0/3843006727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 msgr2=0x7f6a941069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a9be5c700 1 --2- 172.21.15.5:0/3843006727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a941069a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a900098a0 tx=0x7f6a90009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a9be5c700 1 -- 172.21.15.5:0/3843006727 shutdown_connections 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a9be5c700 1 --2- 172.21.15.5:0/3843006727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a941069a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a9be5c700 1 -- 172.21.15.5:0/3843006727 >> 172.21.15.5:0/3843006727 conn(0x7f6a94101b00 msgr2=0x7f6a94103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a9be5c700 1 -- 172.21.15.5:0/3843006727 shutdown_connections 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.794+0000 7f6a9be5c700 1 -- 172.21.15.5:0/3843006727 wait complete. 2023-10-07T00:03:41.107 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.795+0000 7f6a9be5c700 1 Processor -- start 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.796+0000 7f6a9be5c700 1 -- start start 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.796+0000 7f6a9be5c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a9419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.796+0000 7f6a9be5c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9419c850 con 0x7f6a94106580 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.796+0000 7f6a99bf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a9419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.796+0000 7f6a99bf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a9419c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39516/0 (socket says 172.21.15.5:39516) 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.796+0000 7f6a99bf8700 1 -- 172.21.15.5:0/1902024416 learned_addr learned my addr 172.21.15.5:0/1902024416 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.797+0000 7f6a99bf8700 1 -- 172.21.15.5:0/1902024416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a90009550 con 0x7f6a94106580 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.797+0000 7f6a99bf8700 1 --2- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a9419c310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a90000c00 tx=0x7f6a900119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.797+0000 7f6a8affd700 1 -- 172.21.15.5:0/1902024416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a900036a0 con 0x7f6a94106580 2023-10-07T00:03:41.109 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.797+0000 7f6a8affd700 1 -- 172.21.15.5:0/1902024416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9001b440 con 0x7f6a94106580 2023-10-07T00:03:41.109 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.797+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9419ca50 con 0x7f6a94106580 2023-10-07T00:03:41.109 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.797+0000 7f6a8affd700 1 -- 172.21.15.5:0/1902024416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a9001a3d0 con 0x7f6a94106580 2023-10-07T00:03:41.109 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.797+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9419ce70 con 0x7f6a94106580 2023-10-07T00:03:41.109 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.798+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a940624e0 con 0x7f6a94106580 2023-10-07T00:03:41.109 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.799+0000 7f6a8affd700 1 -- 172.21.15.5:0/1902024416 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f6a90003800 con 0x7f6a94106580 2023-10-07T00:03:41.109 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.800+0000 7f6a8affd700 1 --2- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f6a80038930 0x7f6a8003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:41.110 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.800+0000 7f6a8affd700 1 -- 172.21.15.5:0/1902024416 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6a9004c710 con 0x7f6a94106580 2023-10-07T00:03:41.110 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.800+0000 7f6a993f7700 1 --2- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f6a80038930 0x7f6a8003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:41.110 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.801+0000 7f6a993f7700 1 --2- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f6a80038930 0x7f6a8003adf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a84006fd0 tx=0x7f6a84006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:41.110 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:39.805+0000 7f6a8affd700 1 -- 172.21.15.5:0/1902024416 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6a9001b5b0 con 0x7f6a94106580 2023-10-07T00:03:41.110 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.091+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f6a9410a9b0 con 0x7f6a94106580 2023-10-07T00:03:41.110 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.603+0000 7f6a8affd700 1 -- 172.21.15.5:0/1902024416 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f6a9001f020 con 0x7f6a94106580 2023-10-07T00:03:41.110 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.605+0000 7f6a8affd700 1 -- 172.21.15.5:0/1902024416 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f6a9001a640 con 0x7f6a94106580 2023-10-07T00:03:41.110 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f6a80038930 msgr2=0x7f6a8003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 --2- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f6a80038930 0x7f6a8003adf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a84006fd0 tx=0x7f6a84006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 msgr2=0x7f6a9419c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 --2- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a9419c310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a90000c00 tx=0x7f6a900119a0 comp rx=0 tx=0).stop 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 shutdown_connections 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 --2- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f6a80038930 0x7f6a8003adf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 --2- 172.21.15.5:0/1902024416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94106580 0x7f6a9419c310 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a90000c00 tx=0x7f6a900119a0 comp rx=0 tx=0).stop 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 >> 172.21.15.5:0/1902024416 conn(0x7f6a94101b00 msgr2=0x7f6a94102800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 shutdown_connections 2023-10-07T00:03:41.111 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:40.607+0000 7f6a9be5c700 1 -- 172.21.15.5:0/1902024416 wait complete. 2023-10-07T00:03:41.273 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:40 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:40.909+0000 7f2767537200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T00:03:41.273 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:41.018+0000 7f2767537200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T00:03:41.273 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:41.141+0000 7f2767537200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T00:03:41.606 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:41.271+0000 7f2767537200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T00:03:41.606 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:41.514+0000 7f2767537200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T00:03:41.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:41 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1902024416' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-07T00:03:41.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:41 smithi005 ceph-mon[129406]: mgrmap e9: x(active, since 17s) 2023-10-07T00:03:42.325 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:42.024+0000 7f2767537200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T00:03:42.326 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:42.199+0000 7f2767537200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T00:03:42.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-07T00:03:42.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-07T00:03:42.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-07T00:03:42.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-07T00:03:42.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-07T00:03:42.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-07T00:03:42.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.633+0000 7f4464fb9700 1 Processor -- start 2023-10-07T00:03:42.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.633+0000 7f4464fb9700 1 -- start start 2023-10-07T00:03:42.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.633+0000 7f4464fb9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446007a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.633+0000 7f4464fb9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446007a8b0 con 0x7f446007be80 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.634+0000 7f445e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446007a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.634+0000 7f445e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446007a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39538/0 (socket says 172.21.15.5:39538) 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.634+0000 7f445e59c700 1 -- 172.21.15.5:0/412280033 learned_addr learned my addr 172.21.15.5:0/412280033 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.634+0000 7f445e59c700 1 -- 172.21.15.5:0/412280033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446007a9f0 con 0x7f446007be80 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.634+0000 7f445e59c700 1 --2- 172.21.15.5:0/412280033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446007a2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44500098a0 tx=0x7f4450009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5ab5cd27438553 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.634+0000 7f445d59a700 1 -- 172.21.15.5:0/412280033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4450004160 con 0x7f446007be80 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f445d59a700 1 -- 172.21.15.5:0/412280033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44500042c0 con 0x7f446007be80 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f445d59a700 1 -- 172.21.15.5:0/412280033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44500118e0 con 0x7f446007be80 2023-10-07T00:03:42.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f4464fb9700 1 -- 172.21.15.5:0/412280033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 msgr2=0x7f446007a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f4464fb9700 1 --2- 172.21.15.5:0/412280033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446007a2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44500098a0 tx=0x7f4450009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f4464fb9700 1 -- 172.21.15.5:0/412280033 shutdown_connections 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f4464fb9700 1 --2- 172.21.15.5:0/412280033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446007a2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f4464fb9700 1 -- 172.21.15.5:0/412280033 >> 172.21.15.5:0/412280033 conn(0x7f4460101b30 msgr2=0x7f4460103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f4464fb9700 1 -- 172.21.15.5:0/412280033 shutdown_connections 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.635+0000 7f4464fb9700 1 -- 172.21.15.5:0/412280033 wait complete. 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.636+0000 7f4464fb9700 1 Processor -- start 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.637+0000 7f4464fb9700 1 -- start start 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.637+0000 7f4464fb9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:42.393 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.637+0000 7f4464fb9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446019c8c0 con 0x7f446007be80 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.637+0000 7f445e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.637+0000 7f445e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446019c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39552/0 (socket says 172.21.15.5:39552) 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.637+0000 7f445e59c700 1 -- 172.21.15.5:0/2988260700 learned_addr learned my addr 172.21.15.5:0/2988260700 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.637+0000 7f445e59c700 1 -- 172.21.15.5:0/2988260700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450009550 con 0x7f446007be80 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.638+0000 7f445e59c700 1 --2- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446019c380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4450006af0 tx=0x7f4450011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.638+0000 7f444f7fe700 1 -- 172.21.15.5:0/2988260700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44500037d0 con 0x7f446007be80 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.638+0000 7f444f7fe700 1 -- 172.21.15.5:0/2988260700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f445001b440 con 0x7f446007be80 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.638+0000 7f444f7fe700 1 -- 172.21.15.5:0/2988260700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4450019560 con 0x7f446007be80 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.638+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446019cac0 con 0x7f446007be80 2023-10-07T00:03:42.394 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.638+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446019cee0 con 0x7f446007be80 2023-10-07T00:03:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.639+0000 7f444f7fe700 1 -- 172.21.15.5:0/2988260700 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f4450003930 con 0x7f446007be80 2023-10-07T00:03:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.640+0000 7f444f7fe700 1 --2- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f4448038980 0x7f444803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.640+0000 7f444f7fe700 1 -- 172.21.15.5:0/2988260700 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f445004c780 con 0x7f446007be80 2023-10-07T00:03:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.640+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44600624e0 con 0x7f446007be80 2023-10-07T00:03:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.640+0000 7f445dd9b700 1 -- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f4448038980 msgr2=0x7f444803ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/968817192 2023-10-07T00:03:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.640+0000 7f445dd9b700 1 --2- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f4448038980 0x7f444803ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T00:03:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.645+0000 7f444f7fe700 1 -- 172.21.15.5:0/2988260700 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f445002bab0 con 0x7f446007be80 2023-10-07T00:03:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.841+0000 7f445dd9b700 1 -- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f4448038980 msgr2=0x7f444803ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/968817192 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.841+0000 7f445dd9b700 1 --2- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f4448038980 0x7f444803ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.947+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f446010cad0 con 0x7f446007be80 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.948+0000 7f444f7fe700 1 -- 172.21.15.5:0/2988260700 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f445002bab0 con 0x7f446007be80 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.950+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f4448038980 msgr2=0x7f444803ae40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.950+0000 7f4464fb9700 1 --2- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f4448038980 0x7f444803ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.950+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 msgr2=0x7f446019c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.950+0000 7f4464fb9700 1 --2- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446019c380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4450006af0 tx=0x7f4450011e80 comp rx=0 tx=0).stop 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.950+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 shutdown_connections 2023-10-07T00:03:42.396 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.951+0000 7f4464fb9700 1 --2- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f4448038980 0x7f444803ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:42.397 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.951+0000 7f4464fb9700 1 --2- 172.21.15.5:0/2988260700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446007be80 0x7f446019c380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:42.397 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.951+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 >> 172.21.15.5:0/2988260700 conn(0x7f4460101b30 msgr2=0x7f4460102920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:42.397 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.951+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 shutdown_connections 2023-10-07T00:03:42.397 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:41.951+0000 7f4464fb9700 1 -- 172.21.15.5:0/2988260700 wait complete. 2023-10-07T00:03:42.397 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2023-10-07T00:03:42.397 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 9... 2023-10-07T00:03:42.607 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:42.323+0000 7f2767537200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T00:03:42.607 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:42.463+0000 7f2767537200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T00:03:42.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:42 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2988260700' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-07T00:03:43.359 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:43 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:43.038+0000 7f2767537200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T00:03:44.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:43 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:43.913+0000 7f2767537200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T00:03:44.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:44 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:44.022+0000 7f2767537200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T00:03:45.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:45.013+0000 7f2767537200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:03:45.359 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:45.138+0000 7f2767537200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T00:03:45.752 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:45.372+0000 7f2767537200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:03:46.035 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:45.751+0000 7f2767537200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T00:03:46.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:46.034+0000 7f2767537200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T00:03:46.359 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:46.234+0000 7f2767537200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T00:03:46.858 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:46.592+0000 7f2767537200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T00:03:47.858 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:47 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:47.558+0000 7f2767537200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T00:03:47.859 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:47 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:47.739+0000 7f2767537200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T00:03:48.358 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:47 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:47.997+0000 7f2767537200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T00:03:48.359 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:48 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:48.149+0000 7f2767537200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T00:03:48.860 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:48 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:48.436+0000 7f2767537200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T00:03:49.858 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:03:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:03:49.549+0000 7f2767537200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T00:03:50.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: Active manager daemon x restarted 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: Activating manager daemon x 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: osdmap e3: 0 total, 0 up, 0 in 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: mgrmap e10: x(active, starting, since 0.00394886s) 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: Manager daemon x is now available 2023-10-07T00:03:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:03:50.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:03:50.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-07T00:03:50.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-07T00:03:50.991 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-07T00:03:50.991 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.939+0000 7f75a40ee700 1 Processor -- start 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.940+0000 7f75a40ee700 1 -- start start 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.940+0000 7f75a40ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c07a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.940+0000 7f75a40ee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c07a8d0 con 0x7f759c07bea0 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.940+0000 7f75a1e8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c07a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.940+0000 7f75a1e8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c07a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37664/0 (socket says 172.21.15.5:37664) 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.940+0000 7f75a1e8a700 1 -- 172.21.15.5:0/3754874380 learned_addr learned my addr 172.21.15.5:0/3754874380 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.941+0000 7f75a1e8a700 1 -- 172.21.15.5:0/3754874380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c07aa10 con 0x7f759c07bea0 2023-10-07T00:03:50.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.941+0000 7f75a1e8a700 1 --2- 172.21.15.5:0/3754874380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c07a300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75980098a0 tx=0x7f7598009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08ee9c6eaf3cef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.941+0000 7f75a0e88700 1 -- 172.21.15.5:0/3754874380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7598004160 con 0x7f759c07bea0 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.941+0000 7f75a0e88700 1 -- 172.21.15.5:0/3754874380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75980042c0 con 0x7f759c07bea0 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.941+0000 7f75a0e88700 1 -- 172.21.15.5:0/3754874380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75980118e0 con 0x7f759c07bea0 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.942+0000 7f75a40ee700 1 -- 172.21.15.5:0/3754874380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 msgr2=0x7f759c07a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.942+0000 7f75a40ee700 1 --2- 172.21.15.5:0/3754874380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c07a300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75980098a0 tx=0x7f7598009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.942+0000 7f75a40ee700 1 -- 172.21.15.5:0/3754874380 shutdown_connections 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.942+0000 7f75a40ee700 1 --2- 172.21.15.5:0/3754874380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c07a300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.942+0000 7f75a40ee700 1 -- 172.21.15.5:0/3754874380 >> 172.21.15.5:0/3754874380 conn(0x7f759c101b30 msgr2=0x7f759c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.942+0000 7f75a40ee700 1 -- 172.21.15.5:0/3754874380 shutdown_connections 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.942+0000 7f75a40ee700 1 -- 172.21.15.5:0/3754874380 wait complete. 2023-10-07T00:03:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.943+0000 7f75a40ee700 1 Processor -- start 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.944+0000 7f75a40ee700 1 -- start start 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.944+0000 7f75a40ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.944+0000 7f75a40ee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c19c8a0 con 0x7f759c07bea0 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.944+0000 7f75a1e8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.944+0000 7f75a1e8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37668/0 (socket says 172.21.15.5:37668) 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.944+0000 7f75a1e8a700 1 -- 172.21.15.5:0/885919423 learned_addr learned my addr 172.21.15.5:0/885919423 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.944+0000 7f75a1e8a700 1 -- 172.21.15.5:0/885919423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598009550 con 0x7f759c07bea0 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.945+0000 7f75a1e8a700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c19c360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7598006af0 tx=0x7f7598011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.945+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75980037d0 con 0x7f759c07bea0 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.945+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c19caa0 con 0x7f759c07bea0 2023-10-07T00:03:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.945+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f759801b440 con 0x7f759c07bea0 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.945+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7598019560 con 0x7f759c07bea0 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.945+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c19cec0 con 0x7f759c07bea0 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.947+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f7598003930 con 0x7f759c07bea0 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.947+0000 7f7592ffd700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.947+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 --> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f758803b4b0 con 0x7f75880388e0 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.947+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f759804c7a0 con 0x7f759c07bea0 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.947+0000 7f75a1689700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 msgr2=0x7f758803ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/968817192 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:42.947+0000 7f75a1689700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:43.148+0000 7f75a1689700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 msgr2=0x7f758803ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/968817192 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:43.148+0000 7f75a1689700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T00:03:50.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:43.549+0000 7f75a1689700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 msgr2=0x7f758803ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/968817192 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:43.549+0000 7f75a1689700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:44.350+0000 7f75a1689700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 msgr2=0x7f758803ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/968817192 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:44.350+0000 7f75a1689700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:45.951+0000 7f75a1689700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 msgr2=0x7f758803ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/968817192 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:45.952+0000 7f75a1689700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:49.155+0000 7f75a1689700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 msgr2=0x7f758803ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/968817192 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:49.155+0000 7f75a1689700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:49.554+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 10) v1 ==== 45359+0+0 (secure 0 0 0) 0x7f75980223a0 con 0x7f759c07bea0 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:49.554+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 msgr2=0x7f758803ada0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:49.554+0000 7f7592ffd700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.557+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 11) v1 ==== 45486+0+0 (secure 0 0 0) 0x7f759804e430 con 0x7f759c07bea0 2023-10-07T00:03:50.997 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.557+0000 7f7592ffd700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f758803c380 0x7f758803e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:50.997 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.557+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f758803b4b0 con 0x7f758803c380 2023-10-07T00:03:50.997 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.558+0000 7f75a1689700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f758803c380 0x7f758803e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:50.997 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.559+0000 7f75a1689700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f758803c380 0x7f758803e770 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f758c003a10 tx=0x7f758c0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:50.997 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.560+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f758803b4b0 con 0x7f758803c380 2023-10-07T00:03:50.997 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.567+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f759c19d6a0 con 0x7f758803c380 2023-10-07T00:03:50.997 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.567+0000 7f7592ffd700 1 -- 172.21.15.5:0/885919423 <== mgr.14150 v2:172.21.15.5:6800/227111979 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f759c19d6a0 con 0x7f758803c380 2023-10-07T00:03:50.997 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f758803c380 msgr2=0x7f758803e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:50.998 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f758803c380 0x7f758803e770 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f758c003a10 tx=0x7f758c0092b0 comp rx=0 tx=0).stop 2023-10-07T00:03:50.998 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 msgr2=0x7f759c19c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:50.998 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c19c360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7598006af0 tx=0x7f7598011e80 comp rx=0 tx=0).stop 2023-10-07T00:03:50.998 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 shutdown_connections 2023-10-07T00:03:50.998 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f758803c380 0x7f758803e770 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:50.998 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f759c07bea0 0x7f759c19c360 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:50.998 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 --2- 172.21.15.5:0/885919423 >> [v2:172.21.15.5:6800/968817192,v1:172.21.15.5:6801/968817192] conn(0x7f75880388e0 0x7f758803ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:50.999 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 >> 172.21.15.5:0/885919423 conn(0x7f759c101b30 msgr2=0x7f759c1028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:50.999 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 shutdown_connections 2023-10-07T00:03:50.999 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:50.568+0000 7f75a40ee700 1 -- 172.21.15.5:0/885919423 wait complete. 2023-10-07T00:03:50.999 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 9 is available 2023-10-07T00:03:50.999 INFO:teuthology.orchestra.run.smithi005.stdout:Generating a dashboard self-signed certificate... 2023-10-07T00:03:51.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:51 smithi005 ceph-mon[129406]: [07/Oct/2023:00:03:50] ENGINE Bus STARTING 2023-10-07T00:03:51.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:51 smithi005 ceph-mon[129406]: [07/Oct/2023:00:03:50] ENGINE Serving on https://172.21.15.5:7150 2023-10-07T00:03:51.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:51 smithi005 ceph-mon[129406]: [07/Oct/2023:00:03:50] ENGINE Serving on http://172.21.15.5:8765 2023-10-07T00:03:51.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:51 smithi005 ceph-mon[129406]: [07/Oct/2023:00:03:50] ENGINE Bus STARTED 2023-10-07T00:03:51.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:51 smithi005 ceph-mon[129406]: mgrmap e11: x(active, since 1.00816s) 2023-10-07T00:03:51.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:51 smithi005 ceph-mon[129406]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-07T00:03:51.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:51 smithi005 ceph-mon[129406]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-07T00:03:52.479 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.824+0000 7f7938bc4700 1 Processor -- start 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.824+0000 7f7938bc4700 1 -- start start 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.824+0000 7f7938bc4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793407a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.824+0000 7f7938bc4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793407a8d0 con 0x7f793407bea0 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.825+0000 7f793259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793407a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.825+0000 7f793259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793407a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37738/0 (socket says 172.21.15.5:37738) 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.825+0000 7f793259c700 1 -- 172.21.15.5:0/3927411717 learned_addr learned my addr 172.21.15.5:0/3927411717 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.825+0000 7f793259c700 1 -- 172.21.15.5:0/3927411717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793407aa10 con 0x7f793407bea0 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.825+0000 7f793259c700 1 --2- 172.21.15.5:0/3927411717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793407a300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79240098a0 tx=0x7f7924009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd07d70a4779279 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.826+0000 7f793159a700 1 -- 172.21.15.5:0/3927411717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7924004160 con 0x7f793407bea0 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.826+0000 7f793159a700 1 -- 172.21.15.5:0/3927411717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79240042c0 con 0x7f793407bea0 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.826+0000 7f793159a700 1 -- 172.21.15.5:0/3927411717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79240118e0 con 0x7f793407bea0 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.826+0000 7f7938bc4700 1 -- 172.21.15.5:0/3927411717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 msgr2=0x7f793407a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.826+0000 7f7938bc4700 1 --2- 172.21.15.5:0/3927411717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793407a300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79240098a0 tx=0x7f7924009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.827+0000 7f7938bc4700 1 -- 172.21.15.5:0/3927411717 shutdown_connections 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.827+0000 7f7938bc4700 1 --2- 172.21.15.5:0/3927411717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793407a300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.827+0000 7f7938bc4700 1 -- 172.21.15.5:0/3927411717 >> 172.21.15.5:0/3927411717 conn(0x7f7934101b30 msgr2=0x7f7934103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.827+0000 7f7938bc4700 1 -- 172.21.15.5:0/3927411717 shutdown_connections 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.827+0000 7f7938bc4700 1 -- 172.21.15.5:0/3927411717 wait complete. 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.828+0000 7f7938bc4700 1 Processor -- start 2023-10-07T00:03:52.481 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.828+0000 7f7938bc4700 1 -- start start 2023-10-07T00:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.828+0000 7f7938bc4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.828+0000 7f7938bc4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793419c8a0 con 0x7f793407bea0 2023-10-07T00:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.828+0000 7f793259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.829+0000 7f793259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793419c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37752/0 (socket says 172.21.15.5:37752) 2023-10-07T00:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.829+0000 7f793259c700 1 -- 172.21.15.5:0/1035632203 learned_addr learned my addr 172.21.15.5:0/1035632203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.829+0000 7f793259c700 1 -- 172.21.15.5:0/1035632203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924009550 con 0x7f793407bea0 2023-10-07T00:03:52.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.829+0000 7f793259c700 1 --2- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793419c360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7924000c00 tx=0x7f79240119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.829+0000 7f79237fe700 1 -- 172.21.15.5:0/1035632203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79240036a0 con 0x7f793407bea0 2023-10-07T00:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.829+0000 7f79237fe700 1 -- 172.21.15.5:0/1035632203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f792401b440 con 0x7f793407bea0 2023-10-07T00:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.829+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793419caa0 con 0x7f793407bea0 2023-10-07T00:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.829+0000 7f79237fe700 1 -- 172.21.15.5:0/1035632203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f792401a3d0 con 0x7f793407bea0 2023-10-07T00:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.830+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793419cec0 con 0x7f793407bea0 2023-10-07T00:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.831+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79340624e0 con 0x7f793407bea0 2023-10-07T00:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.831+0000 7f79237fe700 1 -- 172.21.15.5:0/1035632203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f792401a690 con 0x7f793407bea0 2023-10-07T00:03:52.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.831+0000 7f79237fe700 1 --2- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f791c038930 0x7f791c03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.831+0000 7f79237fe700 1 -- 172.21.15.5:0/1035632203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f792404c8f0 con 0x7f793407bea0 2023-10-07T00:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.832+0000 7f7931d9b700 1 --2- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f791c038930 0x7f791c03adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.832+0000 7f7931d9b700 1 --2- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f791c038930 0x7f791c03adf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7928006fd0 tx=0x7f7928006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:51.837+0000 7f79237fe700 1 -- 172.21.15.5:0/1035632203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7924023770 con 0x7f793407bea0 2023-10-07T00:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.054+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f7934102fe0 con 0x7f791c038930 2023-10-07T00:03:52.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.096+0000 7f79237fe700 1 -- 172.21.15.5:0/1035632203 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f7934102fe0 con 0x7f791c038930 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.098+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f791c038930 msgr2=0x7f791c03adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.098+0000 7f7938bc4700 1 --2- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f791c038930 0x7f791c03adf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7928006fd0 tx=0x7f7928006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.098+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 msgr2=0x7f793419c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.098+0000 7f7938bc4700 1 --2- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793419c360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7924000c00 tx=0x7f79240119a0 comp rx=0 tx=0).stop 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.098+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 shutdown_connections 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.098+0000 7f7938bc4700 1 --2- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f791c038930 0x7f791c03adf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.098+0000 7f7938bc4700 1 --2- 172.21.15.5:0/1035632203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793407bea0 0x7f793419c360 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.098+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 >> 172.21.15.5:0/1035632203 conn(0x7f7934101b30 msgr2=0x7f79341028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:52.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.099+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 shutdown_connections 2023-10-07T00:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:52.099+0000 7f7938bc4700 1 -- 172.21.15.5:0/1035632203 wait complete. 2023-10-07T00:03:52.486 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial admin user... 2023-10-07T00:03:52.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:52 smithi005 ceph-mon[129406]: mgrmap e12: x(active, since 2s) 2023-10-07T00:03:52.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:03:52.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:03:52.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:03:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:53 smithi005 ceph-mon[129406]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:03:53.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$arlqw9z9NLfIXomX2BWbRue.aJjMBGN0knM3CHLmQsXc7xVQyR/SS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696637033, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-07T00:03:53.967 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.067+0000 7fd796a7f700 1 Processor -- start 2023-10-07T00:03:53.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.068+0000 7fd796a7f700 1 -- start start 2023-10-07T00:03:53.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.068+0000 7fd796a7f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd7901069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:53.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.068+0000 7fd796a7f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd790106f80 con 0x7fd790106590 2023-10-07T00:03:53.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.069+0000 7fd79481b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd7901069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:53.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.069+0000 7fd79481b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd7901069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48984/0 (socket says 172.21.15.5:48984) 2023-10-07T00:03:53.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.069+0000 7fd79481b700 1 -- 172.21.15.5:0/3925874369 learned_addr learned my addr 172.21.15.5:0/3925874369 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:53.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.069+0000 7fd79481b700 1 -- 172.21.15.5:0/3925874369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790107790 con 0x7fd790106590 2023-10-07T00:03:53.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.069+0000 7fd79481b700 1 --2- 172.21.15.5:0/3925874369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd7901069b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7840098a0 tx=0x7fd784009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f4ba1901fbeca4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:53.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.070+0000 7fd78f7fe700 1 -- 172.21.15.5:0/3925874369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd784004160 con 0x7fd790106590 2023-10-07T00:03:53.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.070+0000 7fd78f7fe700 1 -- 172.21.15.5:0/3925874369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7840042c0 con 0x7fd790106590 2023-10-07T00:03:53.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.070+0000 7fd78f7fe700 1 -- 172.21.15.5:0/3925874369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7840118e0 con 0x7fd790106590 2023-10-07T00:03:53.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.070+0000 7fd796a7f700 1 -- 172.21.15.5:0/3925874369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 msgr2=0x7fd7901069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:53.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.070+0000 7fd796a7f700 1 --2- 172.21.15.5:0/3925874369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd7901069b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7840098a0 tx=0x7fd784009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:53.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.071+0000 7fd796a7f700 1 -- 172.21.15.5:0/3925874369 shutdown_connections 2023-10-07T00:03:53.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.071+0000 7fd796a7f700 1 --2- 172.21.15.5:0/3925874369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd7901069b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:53.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.071+0000 7fd796a7f700 1 -- 172.21.15.5:0/3925874369 >> 172.21.15.5:0/3925874369 conn(0x7fd790101b30 msgr2=0x7fd790103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:53.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.071+0000 7fd796a7f700 1 -- 172.21.15.5:0/3925874369 shutdown_connections 2023-10-07T00:03:53.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.071+0000 7fd796a7f700 1 -- 172.21.15.5:0/3925874369 wait complete. 2023-10-07T00:03:53.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.072+0000 7fd796a7f700 1 Processor -- start 2023-10-07T00:03:53.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.072+0000 7fd796a7f700 1 -- start start 2023-10-07T00:03:53.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.073+0000 7fd796a7f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd79019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:53.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.073+0000 7fd796a7f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79019c910 con 0x7fd790106590 2023-10-07T00:03:53.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.073+0000 7fd79481b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd79019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:53.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.073+0000 7fd79481b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd79019c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48990/0 (socket says 172.21.15.5:48990) 2023-10-07T00:03:53.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.073+0000 7fd79481b700 1 -- 172.21.15.5:0/994384747 learned_addr learned my addr 172.21.15.5:0/994384747 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:53.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.073+0000 7fd79481b700 1 -- 172.21.15.5:0/994384747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784009550 con 0x7fd790106590 2023-10-07T00:03:53.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.074+0000 7fd79481b700 1 --2- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd79019c3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd784000c00 tx=0x7fd7840119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:53.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.074+0000 7fd78dffb700 1 -- 172.21.15.5:0/994384747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7840036a0 con 0x7fd790106590 2023-10-07T00:03:53.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.074+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79019cb10 con 0x7fd790106590 2023-10-07T00:03:53.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.074+0000 7fd78dffb700 1 -- 172.21.15.5:0/994384747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd78401b440 con 0x7fd790106590 2023-10-07T00:03:53.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.074+0000 7fd78dffb700 1 -- 172.21.15.5:0/994384747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd78401a3d0 con 0x7fd790106590 2023-10-07T00:03:53.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.074+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79019cf30 con 0x7fd790106590 2023-10-07T00:03:53.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.075+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7900624e0 con 0x7fd790106590 2023-10-07T00:03:53.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.076+0000 7fd78dffb700 1 -- 172.21.15.5:0/994384747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7fd784003800 con 0x7fd790106590 2023-10-07T00:03:53.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.076+0000 7fd78dffb700 1 --2- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd780038930 0x7fd78003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:53.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.076+0000 7fd78dffb700 1 -- 172.21.15.5:0/994384747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd78404c8b0 con 0x7fd790106590 2023-10-07T00:03:53.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.076+0000 7fd78ffff700 1 --2- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd780038930 0x7fd78003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:53.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.077+0000 7fd78ffff700 1 --2- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd780038930 0x7fd78003adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd77c006fd0 tx=0x7fd77c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:53.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.085+0000 7fd78dffb700 1 -- 172.21.15.5:0/994384747 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd78401b5b0 con 0x7fd790106590 2023-10-07T00:03:53.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.324+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd790062300 con 0x7fd780038930 2023-10-07T00:03:53.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.571+0000 7fd78dffb700 1 -- 172.21.15.5:0/994384747 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fd790062300 con 0x7fd780038930 2023-10-07T00:03:53.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd780038930 msgr2=0x7fd78003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:53.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 --2- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd780038930 0x7fd78003adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd77c006fd0 tx=0x7fd77c006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:53.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 msgr2=0x7fd79019c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:53.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 --2- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd79019c3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd784000c00 tx=0x7fd7840119a0 comp rx=0 tx=0).stop 2023-10-07T00:03:53.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 shutdown_connections 2023-10-07T00:03:53.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 --2- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd780038930 0x7fd78003adf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:53.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 --2- 172.21.15.5:0/994384747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd790106590 0x7fd79019c3d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:53.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 >> 172.21.15.5:0/994384747 conn(0x7fd790101b30 msgr2=0x7fd7901028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:53.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.574+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 shutdown_connections 2023-10-07T00:03:53.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:53.575+0000 7fd796a7f700 1 -- 172.21.15.5:0/994384747 wait complete. 2023-10-07T00:03:53.975 INFO:teuthology.orchestra.run.smithi005.stdout:Fetching dashboard port number... 2023-10-07T00:03:54.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:54 smithi005 ceph-mon[129406]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:03:54.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:03:55.249 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 8443 2023-10-07T00:03:55.249 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.497+0000 7eff23b85700 1 Processor -- start 2023-10-07T00:03:55.249 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.498+0000 7eff23b85700 1 -- start start 2023-10-07T00:03:55.249 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.498+0000 7eff23b85700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c108b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:55.249 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.498+0000 7eff23b85700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c109160 con 0x7eff1c108770 2023-10-07T00:03:55.249 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.498+0000 7eff21921700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c108b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.498+0000 7eff21921700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c108b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49002/0 (socket says 172.21.15.5:49002) 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.498+0000 7eff21921700 1 -- 172.21.15.5:0/182472445 learned_addr learned my addr 172.21.15.5:0/182472445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.499+0000 7eff21921700 1 -- 172.21.15.5:0/182472445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c109970 con 0x7eff1c108770 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.499+0000 7eff21921700 1 --2- 172.21.15.5:0/182472445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c108b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff180098a0 tx=0x7eff18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4075862cc5e0211 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.499+0000 7eff2091f700 1 -- 172.21.15.5:0/182472445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff18004160 con 0x7eff1c108770 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.499+0000 7eff2091f700 1 -- 172.21.15.5:0/182472445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff180042c0 con 0x7eff1c108770 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.499+0000 7eff2091f700 1 -- 172.21.15.5:0/182472445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff180118e0 con 0x7eff1c108770 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.500+0000 7eff23b85700 1 -- 172.21.15.5:0/182472445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 msgr2=0x7eff1c108b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.500+0000 7eff23b85700 1 --2- 172.21.15.5:0/182472445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c108b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff180098a0 tx=0x7eff18009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.500+0000 7eff23b85700 1 -- 172.21.15.5:0/182472445 shutdown_connections 2023-10-07T00:03:55.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.500+0000 7eff23b85700 1 --2- 172.21.15.5:0/182472445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c108b90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.500+0000 7eff23b85700 1 -- 172.21.15.5:0/182472445 >> 172.21.15.5:0/182472445 conn(0x7eff1c07bb20 msgr2=0x7eff1c1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.500+0000 7eff23b85700 1 -- 172.21.15.5:0/182472445 shutdown_connections 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.500+0000 7eff23b85700 1 -- 172.21.15.5:0/182472445 wait complete. 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.501+0000 7eff23b85700 1 Processor -- start 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.501+0000 7eff23b85700 1 -- start start 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.502+0000 7eff23b85700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.502+0000 7eff23b85700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c19c840 con 0x7eff1c108770 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.502+0000 7eff21921700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.502+0000 7eff21921700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c19c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49008/0 (socket says 172.21.15.5:49008) 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.502+0000 7eff21921700 1 -- 172.21.15.5:0/85657244 learned_addr learned my addr 172.21.15.5:0/85657244 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:55.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.503+0000 7eff21921700 1 -- 172.21.15.5:0/85657244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009550 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.503+0000 7eff21921700 1 --2- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c19c300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff18000c00 tx=0x7eff180119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.503+0000 7eff12ffd700 1 -- 172.21.15.5:0/85657244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff180036a0 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.503+0000 7eff12ffd700 1 -- 172.21.15.5:0/85657244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff1801b440 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.503+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c19ca40 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.503+0000 7eff12ffd700 1 -- 172.21.15.5:0/85657244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1801a3d0 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.503+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c19ce60 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.504+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c0624e0 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.504+0000 7eff12ffd700 1 -- 172.21.15.5:0/85657244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7eff1801b5b0 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.505+0000 7eff12ffd700 1 --2- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7eff08038980 0x7eff0803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.505+0000 7eff12ffd700 1 -- 172.21.15.5:0/85657244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7eff1804c860 con 0x7eff1c108770 2023-10-07T00:03:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.505+0000 7eff21120700 1 --2- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7eff08038980 0x7eff0803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.506+0000 7eff21120700 1 --2- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7eff08038980 0x7eff0803ae40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7eff0c006fd0 tx=0x7eff0c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.511+0000 7eff12ffd700 1 -- 172.21.15.5:0/85657244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7eff18023c00 con 0x7eff1c108770 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.724+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7eff1c10cba0 con 0x7eff1c108770 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.725+0000 7eff12ffd700 1 -- 172.21.15.5:0/85657244 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7eff1801f070 con 0x7eff1c108770 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.728+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7eff08038980 msgr2=0x7eff0803ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.728+0000 7eff23b85700 1 --2- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7eff08038980 0x7eff0803ae40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7eff0c006fd0 tx=0x7eff0c006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.728+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 msgr2=0x7eff1c19c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.728+0000 7eff23b85700 1 --2- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c19c300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff18000c00 tx=0x7eff180119a0 comp rx=0 tx=0).stop 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.729+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 shutdown_connections 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.729+0000 7eff23b85700 1 --2- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7eff08038980 0x7eff0803ae40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:55.253 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.729+0000 7eff23b85700 1 --2- 172.21.15.5:0/85657244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c108770 0x7eff1c19c300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:55.254 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.729+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 >> 172.21.15.5:0/85657244 conn(0x7eff1c07bb20 msgr2=0x7eff1c105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:55.254 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.729+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 shutdown_connections 2023-10-07T00:03:55.254 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:54.729+0000 7eff23b85700 1 -- 172.21.15.5:0/85657244 wait complete. 2023-10-07T00:03:55.266 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-07T00:03:55.266 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2023-10-07T00:03:55.286 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-07T00:03:55.286 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-07T00:03:55.286 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2023-10-07T00:03:55.286 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-07T00:03:55.288 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph Dashboard is now available at: 2023-10-07T00:03:55.288 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:55.288 INFO:teuthology.orchestra.run.smithi005.stdout: URL: https://smithi005.front.sepia.ceph.com:8443/ 2023-10-07T00:03:55.288 INFO:teuthology.orchestra.run.smithi005.stdout: User: admin 2023-10-07T00:03:55.289 INFO:teuthology.orchestra.run.smithi005.stdout: Password: bi89csdu6w 2023-10-07T00:03:55.289 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:55.289 INFO:teuthology.orchestra.run.smithi005.stdout:Saving cluster configuration to /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config directory 2023-10-07T00:03:55.289 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling autotune for osd_memory_target 2023-10-07T00:03:55.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:55 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/85657244' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-07T00:03:56.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.038+0000 7f812c5d9700 1 Processor -- start 2023-10-07T00:03:56.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.038+0000 7f812c5d9700 1 -- start start 2023-10-07T00:03:56.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.039+0000 7f812c5d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812407a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:56.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.039+0000 7f812c5d9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812407a890 con 0x7f812407be60 2023-10-07T00:03:56.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.039+0000 7f812a375700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812407a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:56.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.039+0000 7f812a375700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812407a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49010/0 (socket says 172.21.15.5:49010) 2023-10-07T00:03:56.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.039+0000 7f812a375700 1 -- 172.21.15.5:0/2512885713 learned_addr learned my addr 172.21.15.5:0/2512885713 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:56.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.040+0000 7f812a375700 1 -- 172.21.15.5:0/2512885713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812407a9d0 con 0x7f812407be60 2023-10-07T00:03:56.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.040+0000 7f812a375700 1 --2- 172.21.15.5:0/2512885713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812407a2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81200098a0 tx=0x7f8120009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603a3dea1e864e97 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:56.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.040+0000 7f8129373700 1 -- 172.21.15.5:0/2512885713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8120004160 con 0x7f812407be60 2023-10-07T00:03:56.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.040+0000 7f8129373700 1 -- 172.21.15.5:0/2512885713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81200042c0 con 0x7f812407be60 2023-10-07T00:03:56.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.040+0000 7f8129373700 1 -- 172.21.15.5:0/2512885713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81200118e0 con 0x7f812407be60 2023-10-07T00:03:56.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.041+0000 7f812c5d9700 1 -- 172.21.15.5:0/2512885713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 msgr2=0x7f812407a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:56.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.041+0000 7f812c5d9700 1 --2- 172.21.15.5:0/2512885713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812407a2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81200098a0 tx=0x7f8120009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:56.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.041+0000 7f812c5d9700 1 -- 172.21.15.5:0/2512885713 shutdown_connections 2023-10-07T00:03:56.774 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.041+0000 7f812c5d9700 1 --2- 172.21.15.5:0/2512885713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812407a2c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.041+0000 7f812c5d9700 1 -- 172.21.15.5:0/2512885713 >> 172.21.15.5:0/2512885713 conn(0x7f8124101b00 msgr2=0x7f8124103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.041+0000 7f812c5d9700 1 -- 172.21.15.5:0/2512885713 shutdown_connections 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.041+0000 7f812c5d9700 1 -- 172.21.15.5:0/2512885713 wait complete. 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.042+0000 7f812c5d9700 1 Processor -- start 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.042+0000 7f812c5d9700 1 -- start start 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.043+0000 7f812c5d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812419c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.043+0000 7f812c5d9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812419c810 con 0x7f812407be60 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.043+0000 7f812a375700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812419c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.043+0000 7f812a375700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812419c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49014/0 (socket says 172.21.15.5:49014) 2023-10-07T00:03:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.043+0000 7f812a375700 1 -- 172.21.15.5:0/2697262157 learned_addr learned my addr 172.21.15.5:0/2697262157 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.043+0000 7f812a375700 1 -- 172.21.15.5:0/2697262157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009550 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.044+0000 7f812a375700 1 --2- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812419c2d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81200118f0 tx=0x7f81200119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.044+0000 7f811b7fe700 1 -- 172.21.15.5:0/2697262157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81200036a0 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.044+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812419ca10 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.044+0000 7f811b7fe700 1 -- 172.21.15.5:0/2697262157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f812001b440 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.044+0000 7f811b7fe700 1 -- 172.21.15.5:0/2697262157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81200193f0 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.044+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812419ce30 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.045+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81240624e0 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.045+0000 7f811b7fe700 1 -- 172.21.15.5:0/2697262157 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f812001b5b0 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.046+0000 7f811b7fe700 1 --2- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81100389d0 0x7f811003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.046+0000 7f811b7fe700 1 -- 172.21.15.5:0/2697262157 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f812004c9d0 con 0x7f812407be60 2023-10-07T00:03:56.776 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.046+0000 7f8129b74700 1 --2- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81100389d0 0x7f811003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.046+0000 7f8129b74700 1 --2- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81100389d0 0x7f811003ae90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8114006fd0 tx=0x7f8114006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.051+0000 7f811b7fe700 1 -- 172.21.15.5:0/2697262157 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8120023c00 con 0x7f812407be60 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.259+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f812419f870 con 0x7f812407be60 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.260+0000 7f811b7fe700 1 -- 172.21.15.5:0/2697262157 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f812001f070 con 0x7f812407be60 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81100389d0 msgr2=0x7f811003ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 --2- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81100389d0 0x7f811003ae90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8114006fd0 tx=0x7f8114006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 msgr2=0x7f812419c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 --2- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812419c2d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81200118f0 tx=0x7f81200119d0 comp rx=0 tx=0).stop 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 shutdown_connections 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 --2- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81100389d0 0x7f811003ae90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:56.777 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 --2- 172.21.15.5:0/2697262157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f812407be60 0x7f812419c2d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:56.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 >> 172.21.15.5:0/2697262157 conn(0x7f8124101b00 msgr2=0x7f81241027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:56.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.262+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 shutdown_connections 2023-10-07T00:03:56.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:56.263+0000 7f812c5d9700 1 -- 172.21.15.5:0/2697262157 wait complete. 2023-10-07T00:03:56.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:56 smithi005 ceph-mon[129406]: mgrmap e13: x(active, since 6s) 2023-10-07T00:03:58.052 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.287+0000 7f318a7bc700 1 Processor -- start 2023-10-07T00:03:58.052 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.287+0000 7f318a7bc700 1 -- start start 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.287+0000 7f318a7bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318407a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.287+0000 7f318a7bc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318407a8d0 con 0x7f318407bea0 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.288+0000 7f31897ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318407a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.288+0000 7f31897ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318407a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49028/0 (socket says 172.21.15.5:49028) 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.288+0000 7f31897ba700 1 -- 172.21.15.5:0/818029675 learned_addr learned my addr 172.21.15.5:0/818029675 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.288+0000 7f31897ba700 1 -- 172.21.15.5:0/818029675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318407aa10 con 0x7f318407bea0 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.288+0000 7f31897ba700 1 --2- 172.21.15.5:0/818029675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318407a300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31800098a0 tx=0x7f3180009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1845d5a2c08284ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f317bfff700 1 -- 172.21.15.5:0/818029675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3180004160 con 0x7f318407bea0 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f317bfff700 1 -- 172.21.15.5:0/818029675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31800042c0 con 0x7f318407bea0 2023-10-07T00:03:58.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f317bfff700 1 -- 172.21.15.5:0/818029675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31800118e0 con 0x7f318407bea0 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f318a7bc700 1 -- 172.21.15.5:0/818029675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 msgr2=0x7f318407a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f318a7bc700 1 --2- 172.21.15.5:0/818029675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318407a300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31800098a0 tx=0x7f3180009bb0 comp rx=0 tx=0).stop 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f318a7bc700 1 -- 172.21.15.5:0/818029675 shutdown_connections 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f318a7bc700 1 --2- 172.21.15.5:0/818029675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318407a300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f318a7bc700 1 -- 172.21.15.5:0/818029675 >> 172.21.15.5:0/818029675 conn(0x7f3184101960 msgr2=0x7f3184103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.289+0000 7f318a7bc700 1 -- 172.21.15.5:0/818029675 shutdown_connections 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.290+0000 7f318a7bc700 1 -- 172.21.15.5:0/818029675 wait complete. 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.290+0000 7f318a7bc700 1 Processor -- start 2023-10-07T00:03:58.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.291+0000 7f318a7bc700 1 -- start start 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.291+0000 7f318a7bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318419c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.291+0000 7f318a7bc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318419c710 con 0x7f318407bea0 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.291+0000 7f31897ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318419c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.291+0000 7f31897ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318419c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49044/0 (socket says 172.21.15.5:49044) 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.291+0000 7f31897ba700 1 -- 172.21.15.5:0/3505257402 learned_addr learned my addr 172.21.15.5:0/3505257402 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.291+0000 7f31897ba700 1 -- 172.21.15.5:0/3505257402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3180009550 con 0x7f318407bea0 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.292+0000 7f31897ba700 1 --2- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318419c1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3180000c00 tx=0x7f31800119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.292+0000 7f317a7fc700 1 -- 172.21.15.5:0/3505257402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31800036a0 con 0x7f318407bea0 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.292+0000 7f317a7fc700 1 -- 172.21.15.5:0/3505257402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f318001b440 con 0x7f318407bea0 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.292+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318419c910 con 0x7f318407bea0 2023-10-07T00:03:58.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.292+0000 7f317a7fc700 1 -- 172.21.15.5:0/3505257402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f318001a3d0 con 0x7f318407bea0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.292+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318419cd30 con 0x7f318407bea0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.293+0000 7f317a7fc700 1 -- 172.21.15.5:0/3505257402 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f318001b5b0 con 0x7f318407bea0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.293+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31840624e0 con 0x7f318407bea0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.293+0000 7f317a7fc700 1 --2- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3170038a20 0x7f317003aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.294+0000 7f317a7fc700 1 -- 172.21.15.5:0/3505257402 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f318004c910 con 0x7f318407bea0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.294+0000 7f3188fb9700 1 --2- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3170038a20 0x7f317003aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.294+0000 7f3188fb9700 1 --2- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3170038a20 0x7f317003aee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3174006fd0 tx=0x7f3174006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.299+0000 7f317a7fc700 1 -- 172.21.15.5:0/3505257402 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3180023be0 con 0x7f318407bea0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.617+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f318410c760 con 0x7f318407bea0 2023-10-07T00:03:58.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.620+0000 7f317a7fc700 1 -- 172.21.15.5:0/3505257402 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f318001f070 con 0x7f318407bea0 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3170038a20 msgr2=0x7f317003aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 --2- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3170038a20 0x7f317003aee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3174006fd0 tx=0x7f3174006e40 comp rx=0 tx=0).stop 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 msgr2=0x7f318419c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 --2- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318419c1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3180000c00 tx=0x7f31800119a0 comp rx=0 tx=0).stop 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 shutdown_connections 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 --2- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3170038a20 0x7f317003aee0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 --2- 172.21.15.5:0/3505257402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318407bea0 0x7f318419c1d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 >> 172.21.15.5:0/3505257402 conn(0x7f3184101960 msgr2=0x7f3184102730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 shutdown_connections 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2023-10-07T00:03:57.622+0000 7f318a7bc700 1 -- 172.21.15.5:0/3505257402 wait complete. 2023-10-07T00:03:58.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout:Or, if you are only running a single cluster on this host: 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: ceph telemetry on 2023-10-07T00:03:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:58.059 INFO:teuthology.orchestra.run.smithi005.stdout:For more information see: 2023-10-07T00:03:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-07T00:03:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:03:58.059 INFO:teuthology.orchestra.run.smithi005.stdout:Bootstrap complete. 2023-10-07T00:03:58.112 INFO:tasks.cephadm:Fetching config... 2023-10-07T00:03:58.113 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:03:58.113 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-07T00:03:58.155 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-07T00:03:58.155 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:03:58.156 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-07T00:03:58.239 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-07T00:03:58.239 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:03:58.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-07T00:03:58.351 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-07T00:03:58.351 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:03:58.352 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-07T00:03:58.434 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-07T00:03:58.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTcgx8BKz6eHdgHgsKsgDLQMGXYydXCNDTrU/2h1OSKDim9QMQN4Fzpd19awBjvtJ90W0O8/nNTDsq7Abv5ySCW1UFRKPWwv81Nst5WHhOL9uwb2d+3mrSSaBFn3Edy6EofWwnmKNcKPPAZwh/DNca3HjYs3eBzfbSYH03bVqmFSzihrBRXm6MTLyAP97EAKWidV/mruMvLo/D2zstEzLYkeCyOM9hv/60EfwwBpmyOoF/s2nSh3h63mIMDTU3I4rUHZWiUU6VqubV/t8HBhYDI2cfrjpz7e9myq9MBXYifKOglCPmggLiTrf4hD9ipEdEayay6kaIP97J63NlJWLpa28pv6zDwCrBfUchKFiw1lVuMnNs1sP9NeuqiANz1L6tWGs775vxzWsIC0mzVrZUYpCmKxCCy1RRYw6Pb/5m8yk3pcQeCnyGIkfGOzlgI2nqCbK+XW38oOYFW0e+7uqVGhIxaCQziBtQ++6EDnz45ci0FYgM1tpQSy3MR5wOIJc= ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-07T00:03:58.581 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTcgx8BKz6eHdgHgsKsgDLQMGXYydXCNDTrU/2h1OSKDim9QMQN4Fzpd19awBjvtJ90W0O8/nNTDsq7Abv5ySCW1UFRKPWwv81Nst5WHhOL9uwb2d+3mrSSaBFn3Edy6EofWwnmKNcKPPAZwh/DNca3HjYs3eBzfbSYH03bVqmFSzihrBRXm6MTLyAP97EAKWidV/mruMvLo/D2zstEzLYkeCyOM9hv/60EfwwBpmyOoF/s2nSh3h63mIMDTU3I4rUHZWiUU6VqubV/t8HBhYDI2cfrjpz7e9myq9MBXYifKOglCPmggLiTrf4hD9ipEdEayay6kaIP97J63NlJWLpa28pv6zDwCrBfUchKFiw1lVuMnNs1sP9NeuqiANz1L6tWGs775vxzWsIC0mzVrZUYpCmKxCCy1RRYw6Pb/5m8yk3pcQeCnyGIkfGOzlgI2nqCbK+XW38oOYFW0e+7uqVGhIxaCQziBtQ++6EDnz45ci0FYgM1tpQSy3MR5wOIJc= ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:03:58.617 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTcgx8BKz6eHdgHgsKsgDLQMGXYydXCNDTrU/2h1OSKDim9QMQN4Fzpd19awBjvtJ90W0O8/nNTDsq7Abv5ySCW1UFRKPWwv81Nst5WHhOL9uwb2d+3mrSSaBFn3Edy6EofWwnmKNcKPPAZwh/DNca3HjYs3eBzfbSYH03bVqmFSzihrBRXm6MTLyAP97EAKWidV/mruMvLo/D2zstEzLYkeCyOM9hv/60EfwwBpmyOoF/s2nSh3h63mIMDTU3I4rUHZWiUU6VqubV/t8HBhYDI2cfrjpz7e9myq9MBXYifKOglCPmggLiTrf4hD9ipEdEayay6kaIP97J63NlJWLpa28pv6zDwCrBfUchKFiw1lVuMnNs1sP9NeuqiANz1L6tWGs775vxzWsIC0mzVrZUYpCmKxCCy1RRYw6Pb/5m8yk3pcQeCnyGIkfGOzlgI2nqCbK+XW38oOYFW0e+7uqVGhIxaCQziBtQ++6EDnz45ci0FYgM1tpQSy3MR5wOIJc= ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-07T00:03:58.721 INFO:teuthology.orchestra.run.smithi088.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTcgx8BKz6eHdgHgsKsgDLQMGXYydXCNDTrU/2h1OSKDim9QMQN4Fzpd19awBjvtJ90W0O8/nNTDsq7Abv5ySCW1UFRKPWwv81Nst5WHhOL9uwb2d+3mrSSaBFn3Edy6EofWwnmKNcKPPAZwh/DNca3HjYs3eBzfbSYH03bVqmFSzihrBRXm6MTLyAP97EAKWidV/mruMvLo/D2zstEzLYkeCyOM9hv/60EfwwBpmyOoF/s2nSh3h63mIMDTU3I4rUHZWiUU6VqubV/t8HBhYDI2cfrjpz7e9myq9MBXYifKOglCPmggLiTrf4hD9ipEdEayay6kaIP97J63NlJWLpa28pv6zDwCrBfUchKFiw1lVuMnNs1sP9NeuqiANz1L6tWGs775vxzWsIC0mzVrZUYpCmKxCCy1RRYw6Pb/5m8yk3pcQeCnyGIkfGOzlgI2nqCbK+XW38oOYFW0e+7uqVGhIxaCQziBtQ++6EDnz45ci0FYgM1tpQSy3MR5wOIJc= ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:03:58.752 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTcgx8BKz6eHdgHgsKsgDLQMGXYydXCNDTrU/2h1OSKDim9QMQN4Fzpd19awBjvtJ90W0O8/nNTDsq7Abv5ySCW1UFRKPWwv81Nst5WHhOL9uwb2d+3mrSSaBFn3Edy6EofWwnmKNcKPPAZwh/DNca3HjYs3eBzfbSYH03bVqmFSzihrBRXm6MTLyAP97EAKWidV/mruMvLo/D2zstEzLYkeCyOM9hv/60EfwwBpmyOoF/s2nSh3h63mIMDTU3I4rUHZWiUU6VqubV/t8HBhYDI2cfrjpz7e9myq9MBXYifKOglCPmggLiTrf4hD9ipEdEayay6kaIP97J63NlJWLpa28pv6zDwCrBfUchKFiw1lVuMnNs1sP9NeuqiANz1L6tWGs775vxzWsIC0mzVrZUYpCmKxCCy1RRYw6Pb/5m8yk3pcQeCnyGIkfGOzlgI2nqCbK+XW38oOYFW0e+7uqVGhIxaCQziBtQ++6EDnz45ci0FYgM1tpQSy3MR5wOIJc= ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-07T00:03:58.855 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTcgx8BKz6eHdgHgsKsgDLQMGXYydXCNDTrU/2h1OSKDim9QMQN4Fzpd19awBjvtJ90W0O8/nNTDsq7Abv5ySCW1UFRKPWwv81Nst5WHhOL9uwb2d+3mrSSaBFn3Edy6EofWwnmKNcKPPAZwh/DNca3HjYs3eBzfbSYH03bVqmFSzihrBRXm6MTLyAP97EAKWidV/mruMvLo/D2zstEzLYkeCyOM9hv/60EfwwBpmyOoF/s2nSh3h63mIMDTU3I4rUHZWiUU6VqubV/t8HBhYDI2cfrjpz7e9myq9MBXYifKOglCPmggLiTrf4hD9ipEdEayay6kaIP97J63NlJWLpa28pv6zDwCrBfUchKFiw1lVuMnNs1sP9NeuqiANz1L6tWGs775vxzWsIC0mzVrZUYpCmKxCCy1RRYw6Pb/5m8yk3pcQeCnyGIkfGOzlgI2nqCbK+XW38oOYFW0e+7uqVGhIxaCQziBtQ++6EDnz45ci0FYgM1tpQSy3MR5wOIJc= ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:03:58.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:03:58 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3505257402' entity='client.admin' 2023-10-07T00:03:58.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-07T00:03:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:04:01.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.401+0000 7f74f0df1700 1 -- 172.21.15.5:0/1464933632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 msgr2=0x7f74ec100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:01.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.401+0000 7f74f0df1700 1 --2- 172.21.15.5:0/1464933632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 0x7f74ec100e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009910 tx=0x7f74dc009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:01.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.401+0000 7f74f0df1700 1 -- 172.21.15.5:0/1464933632 shutdown_connections 2023-10-07T00:04:01.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.401+0000 7f74f0df1700 1 --2- 172.21.15.5:0/1464933632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 0x7f74ec100e20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:01.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.401+0000 7f74f0df1700 1 -- 172.21.15.5:0/1464933632 >> 172.21.15.5:0/1464933632 conn(0x7f74ec0fbf80 msgr2=0x7f74ec0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:01.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.401+0000 7f74f0df1700 1 -- 172.21.15.5:0/1464933632 shutdown_connections 2023-10-07T00:04:01.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.401+0000 7f74f0df1700 1 -- 172.21.15.5:0/1464933632 wait complete. 2023-10-07T00:04:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.402+0000 7f74f0df1700 1 Processor -- start 2023-10-07T00:04:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.402+0000 7f74f0df1700 1 -- start start 2023-10-07T00:04:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.402+0000 7f74f0df1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 0x7f74ec197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.402+0000 7f74f0df1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec198180 con 0x7f74ec100a00 2023-10-07T00:04:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.403+0000 7f74ea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 0x7f74ec197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:01.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.403+0000 7f74ea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 0x7f74ec197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49052/0 (socket says 172.21.15.5:49052) 2023-10-07T00:04:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.403+0000 7f74ea59c700 1 -- 172.21.15.5:0/1404613262 learned_addr learned my addr 172.21.15.5:0/1404613262 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:04:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.403+0000 7f74ea59c700 1 -- 172.21.15.5:0/1404613262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0095f0 con 0x7f74ec100a00 2023-10-07T00:04:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.403+0000 7f74ea59c700 1 --2- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 0x7f74ec197c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74dc005950 tx=0x7f74dc005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.403+0000 7f74db7fe700 1 -- 172.21.15.5:0/1404613262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74dc00ba90 con 0x7f74ec100a00 2023-10-07T00:04:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.404+0000 7f74db7fe700 1 -- 172.21.15.5:0/1404613262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74dc00bbf0 con 0x7f74ec100a00 2023-10-07T00:04:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.404+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec198380 con 0x7f74ec100a00 2023-10-07T00:04:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.404+0000 7f74db7fe700 1 -- 172.21.15.5:0/1404613262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74dc017440 con 0x7f74ec100a00 2023-10-07T00:04:01.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.404+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec198820 con 0x7f74ec100a00 2023-10-07T00:04:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.405+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec106600 con 0x7f74ec100a00 2023-10-07T00:04:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.405+0000 7f74db7fe700 1 -- 172.21.15.5:0/1404613262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f74dc00f460 con 0x7f74ec100a00 2023-10-07T00:04:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.405+0000 7f74db7fe700 1 --2- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f74d40388c0 0x7f74d403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.405+0000 7f74db7fe700 1 -- 172.21.15.5:0/1404613262 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f74dc04cae0 con 0x7f74ec100a00 2023-10-07T00:04:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.406+0000 7f74e9d9b700 1 --2- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f74d40388c0 0x7f74d403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:01.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.406+0000 7f74e9d9b700 1 --2- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f74d40388c0 0x7f74d403ad80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74e0006fd0 tx=0x7f74e0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.410+0000 7f74db7fe700 1 -- 172.21.15.5:0/1404613262 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f74dc015350 con 0x7f74ec100a00 2023-10-07T00:04:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.622+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f74ec106830 con 0x7f74ec100a00 2023-10-07T00:04:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.625+0000 7f74db7fe700 1 -- 172.21.15.5:0/1404613262 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f74dc027030 con 0x7f74ec100a00 2023-10-07T00:04:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.627+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f74d40388c0 msgr2=0x7f74d403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.627+0000 7f74f0df1700 1 --2- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f74d40388c0 0x7f74d403ad80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74e0006fd0 tx=0x7f74e0006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.627+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 msgr2=0x7f74ec197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.627+0000 7f74f0df1700 1 --2- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 0x7f74ec197c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74dc005950 tx=0x7f74dc005810 comp rx=0 tx=0).stop 2023-10-07T00:04:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.628+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 shutdown_connections 2023-10-07T00:04:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.628+0000 7f74f0df1700 1 --2- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f74d40388c0 0x7f74d403ad80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.628+0000 7f74f0df1700 1 --2- 172.21.15.5:0/1404613262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ec100a00 0x7f74ec197c40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.628+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 >> 172.21.15.5:0/1404613262 conn(0x7f74ec0fbf80 msgr2=0x7f74ec073100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.628+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 shutdown_connections 2023-10-07T00:04:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:01.628+0000 7f74f0df1700 1 -- 172.21.15.5:0/1404613262 wait complete. 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1404613262' entity='client.admin' 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:02.147 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-07T00:04:02.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-07T00:04:02.880 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:04:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.275+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/2656546385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 msgr2=0x7f7ae0073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.275+0000 7f7ae5a4d700 1 --2- 172.21.15.5:0/2656546385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 0x7f7ae0073340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009910 tx=0x7f7ad0009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.275+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/2656546385 shutdown_connections 2023-10-07T00:04:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.275+0000 7f7ae5a4d700 1 --2- 172.21.15.5:0/2656546385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 0x7f7ae0073340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.275+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/2656546385 >> 172.21.15.5:0/2656546385 conn(0x7f7ae00fbf80 msgr2=0x7f7ae00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.275+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/2656546385 shutdown_connections 2023-10-07T00:04:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.276+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/2656546385 wait complete. 2023-10-07T00:04:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.277+0000 7f7ae5a4d700 1 Processor -- start 2023-10-07T00:04:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.277+0000 7f7ae5a4d700 1 -- start start 2023-10-07T00:04:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.278+0000 7f7ae5a4d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 0x7f7ae019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.278+0000 7f7ae5a4d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae019c540 con 0x7f7ae0074ee0 2023-10-07T00:04:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.278+0000 7f7adeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 0x7f7ae019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.278+0000 7f7adeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 0x7f7ae019c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60260/0 (socket says 172.21.15.5:60260) 2023-10-07T00:04:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.278+0000 7f7adeffd700 1 -- 172.21.15.5:0/1926636048 learned_addr learned my addr 172.21.15.5:0/1926636048 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:04:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.278+0000 7f7adeffd700 1 -- 172.21.15.5:0/1926636048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00095f0 con 0x7f7ae0074ee0 2023-10-07T00:04:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.279+0000 7f7adeffd700 1 --2- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 0x7f7ae019c000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0005950 tx=0x7f7ad0005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.279+0000 7f7ae4a4b700 1 -- 172.21.15.5:0/1926636048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ad000ba90 con 0x7f7ae0074ee0 2023-10-07T00:04:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.279+0000 7f7ae4a4b700 1 -- 172.21.15.5:0/1926636048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ad000bbf0 con 0x7f7ae0074ee0 2023-10-07T00:04:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.279+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae019c740 con 0x7f7ae0074ee0 2023-10-07T00:04:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.279+0000 7f7ae4a4b700 1 -- 172.21.15.5:0/1926636048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ad0017440 con 0x7f7ae0074ee0 2023-10-07T00:04:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.279+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae019cbe0 con 0x7f7ae0074ee0 2023-10-07T00:04:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.280+0000 7f7ae4a4b700 1 -- 172.21.15.5:0/1926636048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f7ad000f460 con 0x7f7ae0074ee0 2023-10-07T00:04:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.280+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae01959d0 con 0x7f7ae0074ee0 2023-10-07T00:04:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.280+0000 7f7ae4a4b700 1 --2- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7ac8038910 0x7f7ac803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.280+0000 7f7ae4a4b700 1 -- 172.21.15.5:0/1926636048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7ad004ca90 con 0x7f7ae0074ee0 2023-10-07T00:04:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.281+0000 7f7ade7fc700 1 --2- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7ac8038910 0x7f7ac803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.281+0000 7f7ade7fc700 1 --2- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7ac8038910 0x7f7ac803add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4006fd0 tx=0x7f7ad4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.286+0000 7f7ae4a4b700 1 -- 172.21.15.5:0/1926636048 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ad002ad30 con 0x7f7ae0074ee0 2023-10-07T00:04:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.500+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae002d160 con 0x7f7ac8038910 2023-10-07T00:04:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.504+0000 7f7ae4a4b700 1 -- 172.21.15.5:0/1926636048 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7ae002d160 con 0x7f7ac8038910 2023-10-07T00:04:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7ac8038910 msgr2=0x7f7ac803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 --2- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7ac8038910 0x7f7ac803add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4006fd0 tx=0x7f7ad4006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 msgr2=0x7f7ae019c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 --2- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 0x7f7ae019c000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0005950 tx=0x7f7ad0005810 comp rx=0 tx=0).stop 2023-10-07T00:04:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 shutdown_connections 2023-10-07T00:04:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 --2- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7ac8038910 0x7f7ac803add0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 --2- 172.21.15.5:0/1926636048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0074ee0 0x7f7ae019c000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 >> 172.21.15.5:0/1926636048 conn(0x7f7ae00fbf80 msgr2=0x7f7ae00fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 shutdown_connections 2023-10-07T00:04:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:04.506+0000 7f7ae5a4d700 1 -- 172.21.15.5:0/1926636048 wait complete. 2023-10-07T00:04:04.963 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi088 2023-10-07T00:04:04.965 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:04:04.965 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/etc/ceph/ceph.conf 2023-10-07T00:04:05.014 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:04:05.014 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:05.099 INFO:tasks.cephadm:Adding host smithi088 to orchestrator... 2023-10-07T00:04:05.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi088 2023-10-07T00:04:05.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:05 smithi005 ceph-mon[129406]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:05.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:05.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:05.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:05.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:05.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:05 smithi005 ceph-mon[129406]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-07T00:04:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:04:06.729 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:06 smithi005 ceph-mon[129406]: Updating smithi005:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:06.729 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:06 smithi005 ceph-mon[129406]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:07.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.339+0000 7f51a213b700 1 -- 172.21.15.5:0/3326695351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 msgr2=0x7f519c0684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:07.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.339+0000 7f51a213b700 1 --2- 172.21.15.5:0/3326695351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 0x7f519c0684c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f518c009910 tx=0x7f518c009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:07.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.339+0000 7f51a213b700 1 -- 172.21.15.5:0/3326695351 shutdown_connections 2023-10-07T00:04:07.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.339+0000 7f51a213b700 1 --2- 172.21.15.5:0/3326695351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 0x7f519c0684c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:07.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.339+0000 7f51a213b700 1 -- 172.21.15.5:0/3326695351 >> 172.21.15.5:0/3326695351 conn(0x7f519c075370 msgr2=0x7f519c075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:07.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.339+0000 7f51a213b700 1 -- 172.21.15.5:0/3326695351 shutdown_connections 2023-10-07T00:04:07.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.340+0000 7f51a213b700 1 -- 172.21.15.5:0/3326695351 wait complete. 2023-10-07T00:04:07.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.340+0000 7f51a213b700 1 Processor -- start 2023-10-07T00:04:07.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.341+0000 7f51a213b700 1 -- start start 2023-10-07T00:04:07.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.341+0000 7f51a213b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 0x7f519c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:07.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.341+0000 7f51a213b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c1984e0 con 0x7f519c0680e0 2023-10-07T00:04:07.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.341+0000 7f519b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 0x7f519c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:07.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.341+0000 7f519b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 0x7f519c197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60292/0 (socket says 172.21.15.5:60292) 2023-10-07T00:04:07.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.341+0000 7f519b7fe700 1 -- 172.21.15.5:0/2718445659 learned_addr learned my addr 172.21.15.5:0/2718445659 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:04:07.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.342+0000 7f519b7fe700 1 -- 172.21.15.5:0/2718445659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c0095f0 con 0x7f519c0680e0 2023-10-07T00:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.342+0000 7f519b7fe700 1 --2- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 0x7f519c197fa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f518c006010 tx=0x7f518c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.342+0000 7f5198ff9700 1 -- 172.21.15.5:0/2718445659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f518c01d070 con 0x7f519c0680e0 2023-10-07T00:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.342+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c1986e0 con 0x7f519c0680e0 2023-10-07T00:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.342+0000 7f5198ff9700 1 -- 172.21.15.5:0/2718445659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f518c00bdf0 con 0x7f519c0680e0 2023-10-07T00:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.342+0000 7f5198ff9700 1 -- 172.21.15.5:0/2718445659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f518c022d80 con 0x7f519c0680e0 2023-10-07T00:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.342+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c198b00 con 0x7f519c0680e0 2023-10-07T00:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.343+0000 7f5198ff9700 1 -- 172.21.15.5:0/2718445659 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f518c00f460 con 0x7f519c0680e0 2023-10-07T00:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.343+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c0624e0 con 0x7f519c0680e0 2023-10-07T00:04:07.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.344+0000 7f5198ff9700 1 --2- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51840388c0 0x7f518403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:07.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.344+0000 7f5198ff9700 1 -- 172.21.15.5:0/2718445659 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f518c04cb00 con 0x7f519c0680e0 2023-10-07T00:04:07.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.344+0000 7f519affd700 1 --2- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51840388c0 0x7f518403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:07.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.345+0000 7f519affd700 1 --2- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51840388c0 0x7f518403ad80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5190006fd0 tx=0x7f5190006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.349+0000 7f5198ff9700 1 -- 172.21.15.5:0/2718445659 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f518c04ee60 con 0x7f519c0680e0 2023-10-07T00:04:07.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:07.565+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi088", "target": ["mon-mgr", ""]}) v1 -- 0x7f519c10cef0 con 0x7f51840388c0 2023-10-07T00:04:08.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:07 smithi005 ceph-mon[129406]: Updating smithi005:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-07T00:04:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:08 smithi005 ceph-mon[129406]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi088", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:10.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:09 smithi005 ceph-mon[129406]: Deploying cephadm binary to smithi088 2023-10-07T00:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.834+0000 7f5198ff9700 1 -- 172.21.15.5:0/2718445659 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f519c10cef0 con 0x7f51840388c0 2023-10-07T00:04:10.835 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi088' with addr '172.21.15.88' 2023-10-07T00:04:10.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.836+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51840388c0 msgr2=0x7f518403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:10.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.836+0000 7f51a213b700 1 --2- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51840388c0 0x7f518403ad80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5190006fd0 tx=0x7f5190006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:10.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.836+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 msgr2=0x7f519c197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:10.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.836+0000 7f51a213b700 1 --2- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 0x7f519c197fa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f518c006010 tx=0x7f518c004ff0 comp rx=0 tx=0).stop 2023-10-07T00:04:10.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.837+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 shutdown_connections 2023-10-07T00:04:10.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.837+0000 7f51a213b700 1 --2- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51840388c0 0x7f518403ad80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:10.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.837+0000 7f51a213b700 1 --2- 172.21.15.5:0/2718445659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c0680e0 0x7f519c197fa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.837+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 >> 172.21.15.5:0/2718445659 conn(0x7f519c075370 msgr2=0x7f519c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.837+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 shutdown_connections 2023-10-07T00:04:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:10.837+0000 7f51a213b700 1 -- 172.21.15.5:0/2718445659 wait complete. 2023-10-07T00:04:10.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:10 smithi005 ceph-mon[129406]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:11.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-07T00:04:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:04:12.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:12.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:11 smithi005 ceph-mon[129406]: Added host smithi088 2023-10-07T00:04:12.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:12.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:12.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:11 smithi005 ceph-mon[129406]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:13.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:13 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.621+0000 7f48cc97d700 1 -- 172.21.15.5:0/4243921440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 msgr2=0x7f48c8106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.621+0000 7f48cc97d700 1 --2- 172.21.15.5:0/4243921440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 0x7f48c8106d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009910 tx=0x7f48b8009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.621+0000 7f48cc97d700 1 -- 172.21.15.5:0/4243921440 shutdown_connections 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.621+0000 7f48cc97d700 1 --2- 172.21.15.5:0/4243921440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 0x7f48c8106d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.621+0000 7f48cc97d700 1 -- 172.21.15.5:0/4243921440 >> 172.21.15.5:0/4243921440 conn(0x7f48c80fc470 msgr2=0x7f48c80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.621+0000 7f48cc97d700 1 -- 172.21.15.5:0/4243921440 shutdown_connections 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.621+0000 7f48cc97d700 1 -- 172.21.15.5:0/4243921440 wait complete. 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.622+0000 7f48cc97d700 1 Processor -- start 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.622+0000 7f48cc97d700 1 -- start start 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.623+0000 7f48cc97d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 0x7f48c8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.623+0000 7f48cc97d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c81984e0 con 0x7f48c8106960 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.623+0000 7f48c659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 0x7f48c8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.623+0000 7f48c659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 0x7f48c8197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57756/0 (socket says 172.21.15.5:57756) 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.623+0000 7f48c659c700 1 -- 172.21.15.5:0/3666891775 learned_addr learned my addr 172.21.15.5:0/3666891775 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.623+0000 7f48c659c700 1 -- 172.21.15.5:0/3666891775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80095f0 con 0x7f48c8106960 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.624+0000 7f48c659c700 1 --2- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 0x7f48c8197fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48b8006010 tx=0x7f48b8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.624+0000 7f48b77fe700 1 -- 172.21.15.5:0/3666891775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48b801d070 con 0x7f48c8106960 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.624+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c8198740 con 0x7f48c8106960 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.624+0000 7f48b77fe700 1 -- 172.21.15.5:0/3666891775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48b800bdf0 con 0x7f48c8106960 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.624+0000 7f48b77fe700 1 -- 172.21.15.5:0/3666891775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48b8022d80 con 0x7f48c8106960 2023-10-07T00:04:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.624+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c8198bc0 con 0x7f48c8106960 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.625+0000 7f48b77fe700 1 -- 172.21.15.5:0/3666891775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f48b8022570 con 0x7f48c8106960 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.625+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c80624e0 con 0x7f48c8106960 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.625+0000 7f48b77fe700 1 --2- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f48b00388c0 0x7f48b003ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.626+0000 7f48b77fe700 1 -- 172.21.15.5:0/3666891775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f48b804cb50 con 0x7f48c8106960 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.626+0000 7f48c5d9b700 1 --2- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f48b00388c0 0x7f48b003ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.626+0000 7f48c5d9b700 1 --2- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f48b00388c0 0x7f48b003ad80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006fd0 tx=0x7f48bc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.631+0000 7f48b77fe700 1 -- 172.21.15.5:0/3666891775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f48b802bba0 con 0x7f48c8106960 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.845+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48c80008d0 con 0x7f48b00388c0 2023-10-07T00:04:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.846+0000 7f48b77fe700 1 -- 172.21.15.5:0/3666891775 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+158 (secure 0 0 0) 0x7f48c80008d0 con 0x7f48b00388c0 2023-10-07T00:04:13.852 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:04:13.852 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.88", "hostname": "smithi088", "labels": [], "status": ""}] 2023-10-07T00:04:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f48b00388c0 msgr2=0x7f48b003ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 --2- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f48b00388c0 0x7f48b003ad80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006fd0 tx=0x7f48bc006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 msgr2=0x7f48c8197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 --2- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 0x7f48c8197fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48b8006010 tx=0x7f48b8004ff0 comp rx=0 tx=0).stop 2023-10-07T00:04:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 shutdown_connections 2023-10-07T00:04:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 --2- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f48b00388c0 0x7f48b003ad80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 --2- 172.21.15.5:0/3666891775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c8106960 0x7f48c8197fa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 >> 172.21.15.5:0/3666891775 conn(0x7f48c80fc470 msgr2=0x7f48c8108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 shutdown_connections 2023-10-07T00:04:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:13.849+0000 7f48cc97d700 1 -- 172.21.15.5:0/3666891775 wait complete. 2023-10-07T00:04:14.288 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi112 2023-10-07T00:04:14.289 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:04:14.289 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.conf 2023-10-07T00:04:14.337 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:04:14.337 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:14.422 INFO:tasks.cephadm:Adding host smithi112 to orchestrator... 2023-10-07T00:04:14.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi112 2023-10-07T00:04:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:14 smithi005 ceph-mon[129406]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:04:15.971 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:15 smithi005 ceph-mon[129406]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:04:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.620+0000 7f1b92596700 1 -- 172.21.15.5:0/3366284238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 msgr2=0x7f1b8c106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.620+0000 7f1b92596700 1 --2- 172.21.15.5:0/3366284238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 0x7f1b8c106d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009910 tx=0x7f1b7c009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.620+0000 7f1b92596700 1 -- 172.21.15.5:0/3366284238 shutdown_connections 2023-10-07T00:04:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.620+0000 7f1b92596700 1 --2- 172.21.15.5:0/3366284238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 0x7f1b8c106d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.620+0000 7f1b92596700 1 -- 172.21.15.5:0/3366284238 >> 172.21.15.5:0/3366284238 conn(0x7f1b8c0fc4a0 msgr2=0x7f1b8c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.621+0000 7f1b92596700 1 -- 172.21.15.5:0/3366284238 shutdown_connections 2023-10-07T00:04:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.621+0000 7f1b92596700 1 -- 172.21.15.5:0/3366284238 wait complete. 2023-10-07T00:04:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.622+0000 7f1b92596700 1 Processor -- start 2023-10-07T00:04:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.622+0000 7f1b92596700 1 -- start start 2023-10-07T00:04:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.622+0000 7f1b92596700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 0x7f1b8c195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.622+0000 7f1b92596700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c1962a0 con 0x7f1b8c106970 2023-10-07T00:04:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b8bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 0x7f1b8c195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b8bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 0x7f1b8c195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57768/0 (socket says 172.21.15.5:57768) 2023-10-07T00:04:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b8bfff700 1 -- 172.21.15.5:0/1595239491 learned_addr learned my addr 172.21.15.5:0/1595239491 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:04:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b8bfff700 1 -- 172.21.15.5:0/1595239491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c0095f0 con 0x7f1b8c106970 2023-10-07T00:04:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b8bfff700 1 --2- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 0x7f1b8c195d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c006010 tx=0x7f1b7c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b897fa700 1 -- 172.21.15.5:0/1595239491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b7c01d070 con 0x7f1b8c106970 2023-10-07T00:04:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b897fa700 1 -- 172.21.15.5:0/1595239491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b7c00bdf0 con 0x7f1b8c106970 2023-10-07T00:04:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c196500 con 0x7f1b8c106970 2023-10-07T00:04:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.623+0000 7f1b897fa700 1 -- 172.21.15.5:0/1595239491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b7c022d80 con 0x7f1b8c106970 2023-10-07T00:04:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.624+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c196980 con 0x7f1b8c106970 2023-10-07T00:04:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.625+0000 7f1b897fa700 1 -- 172.21.15.5:0/1595239491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f1b7c022570 con 0x7f1b8c106970 2023-10-07T00:04:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.625+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8c0624e0 con 0x7f1b8c106970 2023-10-07T00:04:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.625+0000 7f1b897fa700 1 --2- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b74038910 0x7f1b7403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.625+0000 7f1b897fa700 1 -- 172.21.15.5:0/1595239491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1b7c04cab0 con 0x7f1b8c106970 2023-10-07T00:04:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.626+0000 7f1b8b7fe700 1 --2- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b74038910 0x7f1b7403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.626+0000 7f1b8b7fe700 1 --2- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b74038910 0x7f1b7403add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b80006fd0 tx=0x7f1b80006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.630+0000 7f1b897fa700 1 -- 172.21.15.5:0/1595239491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1b7c02bba0 con 0x7f1b8c106970 2023-10-07T00:04:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:16.847+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b8c10aca0 con 0x7f1b74038910 2023-10-07T00:04:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:16 smithi005 ceph-mon[129406]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:18.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:18.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: Updating smithi088:/etc/ceph/ceph.conf 2023-10-07T00:04:18.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:18 smithi005 ceph-mon[129406]: Deploying cephadm binary to smithi112 2023-10-07T00:04:19.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:19 smithi005 ceph-mon[129406]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.167+0000 7f1b897fa700 1 -- 172.21.15.5:0/1595239491 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1b8c10aca0 con 0x7f1b74038910 2023-10-07T00:04:20.169 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi112' with addr '172.21.15.112' 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b74038910 msgr2=0x7f1b7403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 --2- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b74038910 0x7f1b7403add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b80006fd0 tx=0x7f1b80006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 msgr2=0x7f1b8c195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 --2- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 0x7f1b8c195d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c006010 tx=0x7f1b7c004ff0 comp rx=0 tx=0).stop 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 shutdown_connections 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 --2- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b74038910 0x7f1b7403add0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 --2- 172.21.15.5:0/1595239491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c106970 0x7f1b8c195d60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 >> 172.21.15.5:0/1595239491 conn(0x7f1b8c0fc4a0 msgr2=0x7f1b8c108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.170+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 shutdown_connections 2023-10-07T00:04:20.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:20.171+0000 7f1b92596700 1 -- 172.21.15.5:0/1595239491 wait complete. 2023-10-07T00:04:20.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-07T00:04:20.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:20 smithi005 ceph-mon[129406]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:20.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:20 smithi005 ceph-mon[129406]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:20.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:20.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:20.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:20.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:21.389 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:04:21.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:21 smithi005 ceph-mon[129406]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-07T00:04:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:21 smithi005 ceph-mon[129406]: Added host smithi112 2023-10-07T00:04:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:22.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:22 smithi005 ceph-mon[129406]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:22.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:22.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.887+0000 7f2f2f407700 1 -- 172.21.15.5:0/4236802406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 msgr2=0x7f2f28101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:22.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.887+0000 7f2f2f407700 1 --2- 172.21.15.5:0/4236802406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 0x7f2f28101f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009910 tx=0x7f2f24009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:22.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.887+0000 7f2f2f407700 1 -- 172.21.15.5:0/4236802406 shutdown_connections 2023-10-07T00:04:22.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.887+0000 7f2f2f407700 1 --2- 172.21.15.5:0/4236802406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 0x7f2f28101f10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:22.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.887+0000 7f2f2f407700 1 -- 172.21.15.5:0/4236802406 >> 172.21.15.5:0/4236802406 conn(0x7f2f280fb380 msgr2=0x7f2f280fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:22.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.888+0000 7f2f2f407700 1 -- 172.21.15.5:0/4236802406 shutdown_connections 2023-10-07T00:04:22.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.888+0000 7f2f2f407700 1 -- 172.21.15.5:0/4236802406 wait complete. 2023-10-07T00:04:22.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.889+0000 7f2f2f407700 1 Processor -- start 2023-10-07T00:04:22.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.889+0000 7f2f2f407700 1 -- start start 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.889+0000 7f2f2f407700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 0x7f2f28198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.889+0000 7f2f2f407700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f281985a0 con 0x7f2f28101b30 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.889+0000 7f2f2d1a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 0x7f2f28198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.889+0000 7f2f2d1a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 0x7f2f28198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41200/0 (socket says 172.21.15.5:41200) 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.889+0000 7f2f2d1a3700 1 -- 172.21.15.5:0/2088721675 learned_addr learned my addr 172.21.15.5:0/2088721675 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.890+0000 7f2f2d1a3700 1 -- 172.21.15.5:0/2088721675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f240095f0 con 0x7f2f28101b30 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.890+0000 7f2f2d1a3700 1 --2- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 0x7f2f28198060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2f24006010 tx=0x7f2f24004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.890+0000 7f2f1e7fc700 1 -- 172.21.15.5:0/2088721675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f2401d070 con 0x7f2f28101b30 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.890+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f281987a0 con 0x7f2f28101b30 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.890+0000 7f2f1e7fc700 1 -- 172.21.15.5:0/2088721675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f2400bdf0 con 0x7f2f28101b30 2023-10-07T00:04:22.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.890+0000 7f2f1e7fc700 1 -- 172.21.15.5:0/2088721675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f24022d80 con 0x7f2f28101b30 2023-10-07T00:04:22.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.891+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f28198bc0 con 0x7f2f28101b30 2023-10-07T00:04:22.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.891+0000 7f2f1e7fc700 1 -- 172.21.15.5:0/2088721675 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f2f24022570 con 0x7f2f28101b30 2023-10-07T00:04:22.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.892+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f280624e0 con 0x7f2f28101b30 2023-10-07T00:04:22.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.892+0000 7f2f1e7fc700 1 --2- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f14038860 0x7f2f1403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:22.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.892+0000 7f2f1e7fc700 1 -- 172.21.15.5:0/2088721675 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2f2404ca90 con 0x7f2f28101b30 2023-10-07T00:04:22.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.892+0000 7f2f2c9a2700 1 --2- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f14038860 0x7f2f1403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:22.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.893+0000 7f2f2c9a2700 1 --2- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f14038860 0x7f2f1403ad20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2f18006fd0 tx=0x7f2f18006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:22.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:22.897+0000 7f2f1e7fc700 1 -- 172.21.15.5:0/2088721675 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2f2402a540 con 0x7f2f28101b30 2023-10-07T00:04:23.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.113+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f2810ac60 con 0x7f2f14038860 2023-10-07T00:04:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.114+0000 7f2f1e7fc700 1 -- 172.21.15.5:0/2088721675 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f2f2810ac60 con 0x7f2f14038860 2023-10-07T00:04:23.115 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:04:23.115 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.88", "hostname": "smithi088", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}] 2023-10-07T00:04:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.116+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f14038860 msgr2=0x7f2f1403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.116+0000 7f2f2f407700 1 --2- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f14038860 0x7f2f1403ad20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2f18006fd0 tx=0x7f2f18006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.116+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 msgr2=0x7f2f28198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.116+0000 7f2f2f407700 1 --2- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 0x7f2f28198060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2f24006010 tx=0x7f2f24004f40 comp rx=0 tx=0).stop 2023-10-07T00:04:23.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.116+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 shutdown_connections 2023-10-07T00:04:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.116+0000 7f2f2f407700 1 --2- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f14038860 0x7f2f1403ad20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.116+0000 7f2f2f407700 1 --2- 172.21.15.5:0/2088721675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f28101b30 0x7f2f28198060 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.116+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 >> 172.21.15.5:0/2088721675 conn(0x7f2f280fb380 msgr2=0x7f2f28107580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.117+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 shutdown_connections 2023-10-07T00:04:23.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:23.117+0000 7f2f2f407700 1 -- 172.21.15.5:0/2088721675 wait complete. 2023-10-07T00:04:23.567 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-07T00:04:23.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-07T00:04:24.311 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:04:24.848 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:24 smithi005 ceph-mon[129406]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:04:24.848 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:24 smithi005 ceph-mon[129406]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:24.848 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.712+0000 7fb5383a5700 1 -- 172.21.15.5:0/2579495428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 msgr2=0x7fb530106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.712+0000 7fb5383a5700 1 --2- 172.21.15.5:0/2579495428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 0x7fb530106d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009910 tx=0x7fb52c009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.712+0000 7fb5383a5700 1 -- 172.21.15.5:0/2579495428 shutdown_connections 2023-10-07T00:04:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.712+0000 7fb5383a5700 1 --2- 172.21.15.5:0/2579495428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 0x7fb530106d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.712+0000 7fb5383a5700 1 -- 172.21.15.5:0/2579495428 >> 172.21.15.5:0/2579495428 conn(0x7fb5300fc4a0 msgr2=0x7fb5300fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.712+0000 7fb5383a5700 1 -- 172.21.15.5:0/2579495428 shutdown_connections 2023-10-07T00:04:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.712+0000 7fb5383a5700 1 -- 172.21.15.5:0/2579495428 wait complete. 2023-10-07T00:04:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.714+0000 7fb5383a5700 1 Processor -- start 2023-10-07T00:04:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.714+0000 7fb5383a5700 1 -- start start 2023-10-07T00:04:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.714+0000 7fb5383a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 0x7fb530195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.714+0000 7fb5383a5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5301962a0 con 0x7fb530106970 2023-10-07T00:04:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.715+0000 7fb536141700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 0x7fb530195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.715+0000 7fb536141700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 0x7fb530195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41214/0 (socket says 172.21.15.5:41214) 2023-10-07T00:04:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.715+0000 7fb536141700 1 -- 172.21.15.5:0/3522893897 learned_addr learned my addr 172.21.15.5:0/3522893897 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:04:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.715+0000 7fb536141700 1 -- 172.21.15.5:0/3522893897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c0095f0 con 0x7fb530106970 2023-10-07T00:04:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.715+0000 7fb536141700 1 --2- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 0x7fb530195d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb52c004f40 tx=0x7fb52c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.715+0000 7fb5277fe700 1 -- 172.21.15.5:0/3522893897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb52c01d070 con 0x7fb530106970 2023-10-07T00:04:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.715+0000 7fb5383a5700 1 -- 172.21.15.5:0/3522893897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5301964a0 con 0x7fb530106970 2023-10-07T00:04:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.716+0000 7fb5277fe700 1 -- 172.21.15.5:0/3522893897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb52c0044b0 con 0x7fb530106970 2023-10-07T00:04:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.716+0000 7fb5277fe700 1 -- 172.21.15.5:0/3522893897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb52c003810 con 0x7fb530106970 2023-10-07T00:04:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.716+0000 7fb5383a5700 1 -- 172.21.15.5:0/3522893897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb530196920 con 0x7fb530106970 2023-10-07T00:04:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.717+0000 7fb5277fe700 1 -- 172.21.15.5:0/3522893897 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fb52c003a90 con 0x7fb530106970 2023-10-07T00:04:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.717+0000 7fb5257fa700 1 -- 172.21.15.5:0/3522893897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5300624e0 con 0x7fb530106970 2023-10-07T00:04:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.717+0000 7fb5277fe700 1 --2- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb51c0388b0 0x7fb51c03ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.717+0000 7fb5277fe700 1 -- 172.21.15.5:0/3522893897 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb52c04c860 con 0x7fb530106970 2023-10-07T00:04:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.717+0000 7fb535940700 1 --2- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb51c0388b0 0x7fb51c03ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.718+0000 7fb535940700 1 --2- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb51c0388b0 0x7fb51c03ad70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb520006fd0 tx=0x7fb520006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.723+0000 7fb5277fe700 1 -- 172.21.15.5:0/3522893897 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb52c02a540 con 0x7fb530106970 2023-10-07T00:04:25.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:25.939+0000 7fb5257fa700 1 -- 172.21.15.5:0/3522893897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb5301970c0 con 0x7fb530106970 2023-10-07T00:04:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.624+0000 7fb5277fe700 1 -- 172.21.15.5:0/3522893897 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb52c02a360 con 0x7fb530106970 2023-10-07T00:04:26.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 -- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb51c0388b0 msgr2=0x7fb51c03ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:26.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 --2- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb51c0388b0 0x7fb51c03ad70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb520006fd0 tx=0x7fb520006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 -- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 msgr2=0x7fb530195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 --2- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 0x7fb530195d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb52c004f40 tx=0x7fb52c005020 comp rx=0 tx=0).stop 2023-10-07T00:04:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 -- 172.21.15.5:0/3522893897 shutdown_connections 2023-10-07T00:04:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 --2- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb51c0388b0 0x7fb51c03ad70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 --2- 172.21.15.5:0/3522893897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb530106970 0x7fb530195d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 -- 172.21.15.5:0/3522893897 >> 172.21.15.5:0/3522893897 conn(0x7fb5300fc4a0 msgr2=0x7fb530108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 -- 172.21.15.5:0/3522893897 shutdown_connections 2023-10-07T00:04:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:26.629+0000 7fb5257fa700 1 -- 172.21.15.5:0/3522893897 wait complete. 2023-10-07T00:04:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2023-10-07T00:04:27.007 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:26 smithi005 ceph-mon[129406]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:27.007 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:26 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3522893897' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-07T00:04:27.090 INFO:tasks.cephadm:Adding mon.a on smithi005 2023-10-07T00:04:27.090 INFO:tasks.cephadm:Adding mon.b on smithi088 2023-10-07T00:04:27.091 INFO:tasks.cephadm:Adding mon.c on smithi112 2023-10-07T00:04:27.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c' 2023-10-07T00:04:27.831 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2023-10-07T00:04:28.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3522893897' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-07T00:04:28.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:28.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:28.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:28.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:28.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:28.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:04:28.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:28.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:28.179 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2023-10-07T00:04:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:28 smithi005 ceph-mon[129406]: Updating smithi112:/etc/ceph/ceph.conf 2023-10-07T00:04:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:28 smithi005 ceph-mon[129406]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:29.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.677+0000 7fe407508700 1 -- 172.21.15.112:0/3064097421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 msgr2=0x7fe400106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:29.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.677+0000 7fe407508700 1 --2- 172.21.15.112:0/3064097421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 0x7fe400106d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009910 tx=0x7fe3fc009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:29.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.677+0000 7fe407508700 1 -- 172.21.15.112:0/3064097421 shutdown_connections 2023-10-07T00:04:29.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.677+0000 7fe407508700 1 --2- 172.21.15.112:0/3064097421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 0x7fe400106d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:29.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.677+0000 7fe407508700 1 -- 172.21.15.112:0/3064097421 >> 172.21.15.112:0/3064097421 conn(0x7fe4000fc4a0 msgr2=0x7fe4000fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:29.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.678+0000 7fe407508700 1 -- 172.21.15.112:0/3064097421 shutdown_connections 2023-10-07T00:04:29.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.678+0000 7fe407508700 1 -- 172.21.15.112:0/3064097421 wait complete. 2023-10-07T00:04:29.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.679+0000 7fe407508700 1 Processor -- start 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.679+0000 7fe407508700 1 -- start start 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.679+0000 7fe407508700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 0x7fe400195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.679+0000 7fe407508700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4001962a0 con 0x7fe400106970 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.679+0000 7fe4052a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 0x7fe400195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.679+0000 7fe4052a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 0x7fe400195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.112:33666/0 (socket says 172.21.15.112:33666) 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.679+0000 7fe4052a4700 1 -- 172.21.15.112:0/973241440 learned_addr learned my addr 172.21.15.112:0/973241440 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.680+0000 7fe4052a4700 1 -- 172.21.15.112:0/973241440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0095f0 con 0x7fe400106970 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.680+0000 7fe4052a4700 1 --2- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 0x7fe400195d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc006010 tx=0x7fe3fc004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.680+0000 7fe3f67fc700 1 -- 172.21.15.112:0/973241440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3fc01d070 con 0x7fe400106970 2023-10-07T00:04:29.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.680+0000 7fe3f67fc700 1 -- 172.21.15.112:0/973241440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3fc00bdf0 con 0x7fe400106970 2023-10-07T00:04:29.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.680+0000 7fe3f67fc700 1 -- 172.21.15.112:0/973241440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3fc022d80 con 0x7fe400106970 2023-10-07T00:04:29.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.680+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe400196500 con 0x7fe400106970 2023-10-07T00:04:29.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.680+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe400196980 con 0x7fe400106970 2023-10-07T00:04:29.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.681+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4000624e0 con 0x7fe400106970 2023-10-07T00:04:29.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.681+0000 7fe3f67fc700 1 -- 172.21.15.112:0/973241440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fe3fc022570 con 0x7fe400106970 2023-10-07T00:04:29.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.682+0000 7fe3f67fc700 1 --2- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe3ec0388c0 0x7fe3ec03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:29.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.682+0000 7fe3f67fc700 1 -- 172.21.15.112:0/973241440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe3fc04caf0 con 0x7fe400106970 2023-10-07T00:04:29.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.682+0000 7fe404aa3700 1 --2- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe3ec0388c0 0x7fe3ec03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:29.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.683+0000 7fe404aa3700 1 --2- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe3ec0388c0 0x7fe3ec03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0006fd0 tx=0x7fe3f0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:29.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.688+0000 7fe3f67fc700 1 -- 172.21.15.112:0/973241440 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe3fc02a360 con 0x7fe400106970 2023-10-07T00:04:29.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.912+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fe40010ad50 con 0x7fe3ec0388c0 2023-10-07T00:04:29.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.919+0000 7fe3f67fc700 1 -- 172.21.15.112:0/973241440 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe40010ad50 con 0x7fe3ec0388c0 2023-10-07T00:04:29.921 INFO:teuthology.orchestra.run.smithi112.stdout:Scheduled mon update... 2023-10-07T00:04:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.921+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe3ec0388c0 msgr2=0x7fe3ec03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.921+0000 7fe407508700 1 --2- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe3ec0388c0 0x7fe3ec03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0006fd0 tx=0x7fe3f0006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.921+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 msgr2=0x7fe400195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.921+0000 7fe407508700 1 --2- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 0x7fe400195d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc006010 tx=0x7fe3fc004ff0 comp rx=0 tx=0).stop 2023-10-07T00:04:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.922+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 shutdown_connections 2023-10-07T00:04:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.922+0000 7fe407508700 1 --2- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe3ec0388c0 0x7fe3ec03ad80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.922+0000 7fe407508700 1 --2- 172.21.15.112:0/973241440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe400106970 0x7fe400195d60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.922+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 >> 172.21.15.112:0/973241440 conn(0x7fe4000fc4a0 msgr2=0x7fe400108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.922+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 shutdown_connections 2023-10-07T00:04:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:29.922+0000 7fe407508700 1 -- 172.21.15.112:0/973241440 wait complete. 2023-10-07T00:04:30.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:29 smithi005 ceph-mon[129406]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:30.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:29 smithi005 ceph-mon[129406]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:30.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:30.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:30.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:30.466 DEBUG:teuthology.orchestra.run.smithi088:mon.b> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-07T00:04:30.471 DEBUG:teuthology.orchestra.run.smithi112:mon.c> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-07T00:04:30.477 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-07T00:04:30.477 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-07T00:04:30.547 INFO:journalctl@ceph.mon.b.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:04:30.549 INFO:journalctl@ceph.mon.c.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:04:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-07T00:04:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:31.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:31.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:31.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:31.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:31.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:31.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:31.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:31.644 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:31 smithi005 ceph-mon[129406]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:31 smithi005 ceph-mon[129406]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c;count:3 2023-10-07T00:04:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:31 smithi005 ceph-mon[129406]: Deploying daemon mon.c on smithi112 2023-10-07T00:04:33.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:32 smithi005 ceph-mon[129406]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.717+0000 7f00a7207700 1 -- 172.21.15.112:0/2769397371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 msgr2=0x7f00a00736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.717+0000 7f00a7207700 1 --2- 172.21.15.112:0/2769397371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 0x7f00a00736c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0094009910 tx=0x7f0094009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.717+0000 7f00a7207700 1 -- 172.21.15.112:0/2769397371 shutdown_connections 2023-10-07T00:04:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.717+0000 7f00a7207700 1 --2- 172.21.15.112:0/2769397371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 0x7f00a00736c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.717+0000 7f00a7207700 1 -- 172.21.15.112:0/2769397371 >> 172.21.15.112:0/2769397371 conn(0x7f00a00fc410 msgr2=0x7f00a00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.717+0000 7f00a7207700 1 -- 172.21.15.112:0/2769397371 shutdown_connections 2023-10-07T00:04:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.717+0000 7f00a7207700 1 -- 172.21.15.112:0/2769397371 wait complete. 2023-10-07T00:04:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.718+0000 7f00a7207700 1 Processor -- start 2023-10-07T00:04:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.719+0000 7f00a7207700 1 -- start start 2023-10-07T00:04:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.719+0000 7f00a7207700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 0x7f00a0197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.719+0000 7f00a7207700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a0198470 con 0x7f00a00732e0 2023-10-07T00:04:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.720+0000 7f00a4fa3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 0x7f00a0197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.720+0000 7f00a4fa3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 0x7f00a0197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.112:33690/0 (socket says 172.21.15.112:33690) 2023-10-07T00:04:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.720+0000 7f00a4fa3700 1 -- 172.21.15.112:0/1049849839 learned_addr learned my addr 172.21.15.112:0/1049849839 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:04:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.720+0000 7f00a4fa3700 1 -- 172.21.15.112:0/1049849839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940095f0 con 0x7f00a00732e0 2023-10-07T00:04:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.720+0000 7f00a4fa3700 1 --2- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 0x7f00a0197f30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0094006010 tx=0x7f0094004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.721+0000 7f009dffb700 1 -- 172.21.15.112:0/1049849839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009401d070 con 0x7f00a00732e0 2023-10-07T00:04:33.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.721+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a0198670 con 0x7f00a00732e0 2023-10-07T00:04:33.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.721+0000 7f009dffb700 1 -- 172.21.15.112:0/1049849839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f009400bdf0 con 0x7f00a00732e0 2023-10-07T00:04:33.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.721+0000 7f009dffb700 1 -- 172.21.15.112:0/1049849839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0094022d80 con 0x7f00a00732e0 2023-10-07T00:04:33.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.721+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a0198a90 con 0x7f00a00732e0 2023-10-07T00:04:33.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.722+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a00624e0 con 0x7f00a00732e0 2023-10-07T00:04:33.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.722+0000 7f009dffb700 1 -- 172.21.15.112:0/1049849839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f0094022570 con 0x7f00a00732e0 2023-10-07T00:04:33.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.723+0000 7f009dffb700 1 --2- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0090038910 0x7f009003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:33.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.723+0000 7f009dffb700 1 -- 172.21.15.112:0/1049849839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f009404caa0 con 0x7f00a00732e0 2023-10-07T00:04:33.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.723+0000 7f009ffff700 1 --2- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0090038910 0x7f009003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:33.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.724+0000 7f009ffff700 1 --2- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0090038910 0x7f009003add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f008c006fd0 tx=0x7f008c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:33.728+0000 7f009dffb700 1 -- 172.21.15.112:0/1049849839 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f009402bba0 con 0x7f00a00732e0 2023-10-07T00:04:34.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.036+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f00a010ce20 con 0x7f00a00732e0 2023-10-07T00:04:34.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.037+0000 7f009dffb700 1 -- 172.21.15.112:0/1049849839 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7f0094027030 con 0x7f00a00732e0 2023-10-07T00:04:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-07T00:04:34.039 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","modified":"2023-10-07T00:02:44.952042Z","created":"2023-10-07T00:02:44.952042Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-07T00:04:34.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0090038910 msgr2=0x7f009003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:34.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 --2- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0090038910 0x7f009003add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f008c006fd0 tx=0x7f008c006e40 comp rx=0 tx=0).stop 2023-10-07T00:04:34.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 msgr2=0x7f00a0197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:34.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 --2- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 0x7f00a0197f30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0094006010 tx=0x7f0094004f40 comp rx=0 tx=0).stop 2023-10-07T00:04:34.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 shutdown_connections 2023-10-07T00:04:34.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 --2- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0090038910 0x7f009003add0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:34.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 --2- 172.21.15.112:0/1049849839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a00732e0 0x7f00a0197f30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:34.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 >> 172.21.15.112:0/1049849839 conn(0x7f00a00fc410 msgr2=0x7f00a01074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:34.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 shutdown_connections 2023-10-07T00:04:34.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:34.040+0000 7f00a7207700 1 -- 172.21.15.112:0/1049849839 wait complete. 2023-10-07T00:04:34.043 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2023-10-07T00:04:34.454 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:34 smithi112 systemd[1]: Starting Ceph mon.c for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:04:35.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:34 smithi005 ceph-mon[129406]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:34 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/1049849839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:35.123 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:34 smithi112 podman[133508]: 2023-10-07T00:04:35.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 bash[133508]: 1532319904ac4e9ff475a60b63cb63db1650196798cc653d93378b7227d2f530 2023-10-07T00:04:35.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: set uid:gid to 167:167 (ceph:ceph) 2023-10-07T00:04:35.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev), process ceph-mon, pid 7 2023-10-07T00:04:35.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pidfile_write: ignore empty --pid-file 2023-10-07T00:04:35.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: load: jerasure load: lrc 2023-10-07T00:04:35.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: RocksDB version: 7.9.2 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Git sha 0 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Compile date 2023-10-06 09:28:03 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: DB SUMMARY 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: DB Session ID: M96WUEXM6Y6T0WPJBP0U 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: CURRENT file: CURRENT 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: IDENTITY file: IDENTITY 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-07T00:04:35.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.error_if_exists: 0 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.create_if_missing: 0 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.paranoid_checks: 1 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.env: 0x564ecc366da0 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.fs: PosixFileSystem 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.info_log: 0x564ece1b15c0 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_file_opening_threads: 16 2023-10-07T00:04:35.500 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.statistics: (nil) 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.use_fsync: 0 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_log_file_size: 0 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.keep_log_file_num: 1000 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.recycle_log_file_num: 0 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.allow_fallocate: 1 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.allow_mmap_reads: 0 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.allow_mmap_writes: 0 2023-10-07T00:04:35.501 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.use_direct_reads: 0 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.create_missing_column_families: 0 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.db_log_dir: 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.wal_dir: 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-07T00:04:35.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.advise_random_on_open: 1 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.db_write_buffer_size: 0 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.write_buffer_manager: 0x564ece169360 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.rate_limiter: (nil) 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.wal_recovery_mode: 2 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.enable_thread_tracking: 0 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.enable_pipelined_write: 0 2023-10-07T00:04:35.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.unordered_write: 0 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.row_cache: None 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.wal_filter: None 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.allow_ingest_behind: 0 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.two_write_queues: 0 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.manual_wal_flush: 0 2023-10-07T00:04:35.504 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.wal_compression: 0 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.atomic_flush: 0 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.log_readahead_size: 0 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.best_efforts_recovery: 0 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.allow_data_in_errors: 0 2023-10-07T00:04:35.505 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.db_host_id: __hostname__ 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_background_jobs: 2 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_background_compactions: -1 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_subcompactions: 1 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_total_wal_size: 0 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-07T00:04:35.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_open_files: -1 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bytes_per_sync: 0 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_readahead_size: 0 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_background_flushes: -1 2023-10-07T00:04:35.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Compression algorithms supported: 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: kZSTD supported: 0 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: kXpressCompression supported: 0 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: kLZ4HCCompression supported: 1 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: kZlibCompression supported: 1 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: kSnappyCompression supported: 1 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: kLZ4Compression supported: 1 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: kBZip2Compression supported: 0 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-07T00:04:35.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.merge_operator: 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_filter: None 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_filter_factory: None 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.sst_partitioner_factory: None 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-07T00:04:35.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564ece1b16c0) 2023-10-07T00:04:35.510 INFO:journalctl@ceph.mon.c.smithi112.stdout: cache_index_and_filter_blocks: 1 2023-10-07T00:04:35.510 INFO:journalctl@ceph.mon.c.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-07T00:04:35.510 INFO:journalctl@ceph.mon.c.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-07T00:04:35.510 INFO:journalctl@ceph.mon.c.smithi112.stdout: pin_top_level_index_and_filter: 1 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: index_type: 0 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: data_block_index_type: 0 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: index_shortening: 1 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: checksum: 4 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: no_block_cache: 0 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_cache: 0x564ece2071f0 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_cache_name: BinnedLRUCache 2023-10-07T00:04:35.511 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_cache_options: 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: capacity : 536870912 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: num_shard_bits : 4 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: strict_capacity_limit : 0 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: high_pri_pool_ratio: 0.000 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_cache_compressed: (nil) 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: persistent_cache: (nil) 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_size: 4096 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_size_deviation: 10 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_restart_interval: 16 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: index_block_restart_interval: 1 2023-10-07T00:04:35.512 INFO:journalctl@ceph.mon.c.smithi112.stdout: metadata_block_size: 4096 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: partition_filters: 0 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: use_delta_encoding: 1 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: filter_policy: bloomfilter 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: whole_key_filtering: 1 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: verify_compression: 0 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: read_amp_bytes_per_bit: 0 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: format_version: 5 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: enable_index_compression: 1 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_align: 0 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: max_auto_readahead_size: 262144 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: prepopulate_block_cache: 0 2023-10-07T00:04:35.513 INFO:journalctl@ceph.mon.c.smithi112.stdout: initial_auto_readahead_size: 8192 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.write_buffer_size: 33554432 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_write_buffer_number: 2 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression: NoCompression 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression: Disabled 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.prefix_extractor: nullptr 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.num_levels: 7 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-07T00:04:35.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-07T00:04:35.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-07T00:04:35.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-07T00:04:35.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-07T00:04:35.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-07T00:04:35.515 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-07T00:04:35.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-07T00:04:35.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.level: 32767 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.strategy: 0 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-07T00:04:35.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.enabled: false 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.target_file_size_base: 67108864 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-07T00:04:35.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-07T00:04:35.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.arena_block_size: 1048576 2023-10-07T00:04:35.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-07T00:04:35.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-07T00:04:35.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.disable_auto_compactions: 0 2023-10-07T00:04:35.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-07T00:04:35.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-07T00:04:35.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-07T00:04:35.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.table_properties_collectors: 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.inplace_update_support: 0 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-07T00:04:35.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.bloom_locality: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.max_successive_merges: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.paranoid_file_checks: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.force_consistency_checks: 1 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.report_bg_io_stats: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.ttl: 2592000 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.enable_blob_files: false 2023-10-07T00:04:35.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.min_blob_size: 0 2023-10-07T00:04:35.524 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.blob_file_size: 268435456 2023-10-07T00:04:35.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-07T00:04:35.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-07T00:04:35.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-07T00:04:35.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-07T00:04:35.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-07T00:04:35.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.blob_file_starting_level: 0 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cb08c618-a93e-4608-b39e-071960c5e561 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696637075135176, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696637075136155, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696637075, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cb08c618-a93e-4608-b39e-071960c5e561", "db_session_id": "M96WUEXM6Y6T0WPJBP0U", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696637075136353, "job": 1, "event": "recovery_finished"} 2023-10-07T00:04:35.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564ece2a4000 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: DB pointer 0x564ece290000 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** DB Stats ** 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-07T00:04:35.528 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** Compaction Stats [default] ** 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-07T00:04:35.529 INFO:journalctl@ceph.mon.c.smithi112.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-07T00:04:35.530 INFO:journalctl@ceph.mon.c.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-07T00:04:35.530 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2023-10-07T00:04:35.530 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** Compaction Stats [default] ** 2023-10-07T00:04:35.530 INFO:journalctl@ceph.mon.c.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-07T00:04:35.530 INFO:journalctl@ceph.mon.c.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-07T00:04:35.530 INFO:journalctl@ceph.mon.c.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-07T00:04:35.530 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2023-10-07T00:04:35.530 INFO:journalctl@ceph.mon.c.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-07T00:04:35.531 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2023-10-07T00:04:35.531 INFO:journalctl@ceph.mon.c.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-07T00:04:35.531 INFO:journalctl@ceph.mon.c.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-07T00:04:35.531 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-07T00:04:35.531 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-07T00:04:35.531 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-07T00:04:35.531 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-07T00:04:35.531 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-07T00:04:35.532 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-07T00:04:35.532 INFO:journalctl@ceph.mon.c.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-07T00:04:35.532 INFO:journalctl@ceph.mon.c.smithi112.stdout: Block cache BinnedLRUCache@0x564ece2071f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-07T00:04:35.532 INFO:journalctl@ceph.mon.c.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-07T00:04:35.532 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2023-10-07T00:04:35.532 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: using public_addr v2:172.21.15.112:0/0 -> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: starting mon.c rank -1 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(???) e0 preinit fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 systemd[1]: Started Ceph mon.c for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).mds e1 new map 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout: e1 2023-10-07T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-07T00:04:35.534 INFO:journalctl@ceph.mon.c.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-07T00:04:35.534 INFO:journalctl@ceph.mon.c.smithi112.stdout: legacy client fscid: -1 2023-10-07T00:04:35.534 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2023-10-07T00:04:35.534 INFO:journalctl@ceph.mon.c.smithi112.stdout: No filesystems configured 2023-10-07T00:04:35.534 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-07T00:04:35.534 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-07T00:04:35.534 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-07T00:04:35.534 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-07T00:04:35.535 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-07T00:04:35.535 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-07T00:04:35.535 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-07T00:04:35.535 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:04:35.535 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:04:35.535 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:04:35.535 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.535 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.536 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:04:35.536 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.536 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:35.536 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.537 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.537 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.537 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.537 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.537 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:04:35.537 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:35.537 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Updating smithi088:/etc/ceph/ceph.conf 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Deploying cephadm binary to smithi112 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.538 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Added host smithi112 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.539 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3522893897' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3522893897' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:04:35.540 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Updating smithi112:/etc/ceph/ceph.conf 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-07T00:04:35.542 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.542 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.542 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:35.542 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c;count:3 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: Deploying daemon mon.c on smithi112 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:35.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/1049849839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta expand map: {default=false} 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta from 'false' to 'false' 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta expanded map: {default=false} 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta expand map: {default=info} 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta from 'info' to 'info' 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta expanded map: {default=info} 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta expand map: {default=daemon} 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-07T00:04:35.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta expanded map: {default=daemon} 2023-10-07T00:04:35.545 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta expand map: {default=debug} 2023-10-07T00:04:35.545 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta from 'debug' to 'debug' 2023-10-07T00:04:35.545 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:35 smithi112 ceph-mon[133548]: expand_channel_meta expanded map: {default=debug} 2023-10-07T00:04:36.170 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:04:40.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:04:40.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: mon.a calling monitor election 2023-10-07T00:04:40.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: mon.c calling monitor election 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:40.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: fsmap 2023-10-07T00:04:40.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:40.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: mgrmap e13: x(active, since 50s) 2023-10-07T00:04:40.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: overall HEALTH_OK 2023-10-07T00:04:40.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:40.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:40.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:40.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:40.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.690+0000 7f802e6a5700 1 -- 172.21.15.112:0/1108938348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 msgr2=0x7f8010005a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.690+0000 7f802e6a5700 1 --2- 172.21.15.112:0/1108938348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 0x7f8010005a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8028073180 tx=0x7f801800feb0 comp rx=0 tx=0).stop 2023-10-07T00:04:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.690+0000 7f802e6a5700 1 -- 172.21.15.112:0/1108938348 shutdown_connections 2023-10-07T00:04:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.690+0000 7f802e6a5700 1 --2- 172.21.15.112:0/1108938348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 0x7f8010005a30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.690+0000 7f802e6a5700 1 -- 172.21.15.112:0/1108938348 >> 172.21.15.112:0/1108938348 conn(0x7f80280fc540 msgr2=0x7f80280fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.690+0000 7f802e6a5700 1 -- 172.21.15.112:0/1108938348 shutdown_connections 2023-10-07T00:04:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.690+0000 7f802e6a5700 1 -- 172.21.15.112:0/1108938348 wait complete. 2023-10-07T00:04:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.692+0000 7f802e6a5700 1 Processor -- start 2023-10-07T00:04:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.692+0000 7f802e6a5700 1 -- start start 2023-10-07T00:04:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f802e6a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 0x7f80281980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f802e6a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 0x7f802819caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f802e6a5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8028198bc0 con 0x7f80100035c0 2023-10-07T00:04:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f802e6a5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8028198d30 con 0x7f8028198630 2023-10-07T00:04:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f80277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 0x7f802819caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f8027fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 0x7f80281980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f80277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 0x7f802819caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52014/0 (socket says 172.21.15.112:52014) 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f80277fe700 1 -- 172.21.15.112:0/2483550603 learned_addr learned my addr 172.21.15.112:0/2483550603 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f8027fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 0x7f80281980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.112:46784/0 (socket says 172.21.15.112:46784) 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f80277fe700 1 -- 172.21.15.112:0/2483550603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 msgr2=0x7f802819caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f80277fe700 1 -- 172.21.15.112:0/2483550603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 msgr2=0x7f802819caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f80277fe700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 0x7f802819caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.693+0000 7f80277fe700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 0x7f802819caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.694+0000 7f8027fff700 1 -- 172.21.15.112:0/2483550603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 msgr2=0x7f802819caa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.694+0000 7f8027fff700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 0x7f802819caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.694+0000 7f8027fff700 1 -- 172.21.15.112:0/2483550603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801800f900 con 0x7f80100035c0 2023-10-07T00:04:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.694+0000 7f8027fff700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 0x7f80281980f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f801800f800 tx=0x7f80180049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.694+0000 7f80257fa700 1 -- 172.21.15.112:0/2483550603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f8018013b00 con 0x7f80100035c0 2023-10-07T00:04:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.694+0000 7f80257fa700 1 -- 172.21.15.112:0/2483550603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f80180044c0 con 0x7f80100035c0 2023-10-07T00:04:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.694+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802819d040 con 0x7f80100035c0 2023-10-07T00:04:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.694+0000 7f80257fa700 1 -- 172.21.15.112:0/2483550603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f8018003bf0 con 0x7f80100035c0 2023-10-07T00:04:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.695+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802819d590 con 0x7f80100035c0 2023-10-07T00:04:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.696+0000 7f80257fa700 1 -- 172.21.15.112:0/2483550603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f8018004030 con 0x7f80100035c0 2023-10-07T00:04:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.696+0000 7f80257fa700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8014038700 0x7f801403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.696+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80280624e0 con 0x7f80100035c0 2023-10-07T00:04:40.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.696+0000 7f80257fa700 1 -- 172.21.15.112:0/2483550603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f801804dfa0 con 0x7f80100035c0 2023-10-07T00:04:40.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.697+0000 7f80277fe700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8014038700 0x7f801403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:40.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.697+0000 7f80277fe700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8014038700 0x7f801403abc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f801c009180 tx=0x7f801c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:40.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.702+0000 7f80257fa700 1 -- 172.21.15.112:0/2483550603 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8018011470 con 0x7f80100035c0 2023-10-07T00:04:40.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: mon.a calling monitor election 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: mon.c calling monitor election 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:40.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: fsmap 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: mgrmap e13: x(active, since 50s) 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: overall HEALTH_OK 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:40.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:40.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.985+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f802819d810 con 0x7f80100035c0 2023-10-07T00:04:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.985+0000 7f80257fa700 1 -- 172.21.15.112:0/2483550603 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7f8018034350 con 0x7f80100035c0 2023-10-07T00:04:40.987 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-07T00:04:40.987 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":2,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","modified":"2023-10-07T00:04:35.182280Z","created":"2023-10-07T00:02:44.952042Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-07T00:04:40.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8014038700 msgr2=0x7f801403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:40.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8014038700 0x7f801403abc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f801c009180 tx=0x7f801c008040 comp rx=0 tx=0).stop 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 msgr2=0x7f80281980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 0x7f80281980f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f801800f800 tx=0x7f80180049d0 comp rx=0 tx=0).stop 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 shutdown_connections 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8014038700 0x7f801403abc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80100035c0 0x7f80281980f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 --2- 172.21.15.112:0/2483550603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8028198630 0x7f802819caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 >> 172.21.15.112:0/2483550603 conn(0x7f80280fc540 msgr2=0x7f8028104d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 shutdown_connections 2023-10-07T00:04:40.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:40.988+0000 7f802e6a5700 1 -- 172.21.15.112:0/2483550603 wait complete. 2023-10-07T00:04:40.991 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 2 2023-10-07T00:04:41.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:41 smithi005 ceph-mon[129406]: Deploying daemon mon.b on smithi088 2023-10-07T00:04:41.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:41 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/2483550603' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:41.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:41 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:41.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:41 smithi112 ceph-mon[133548]: Deploying daemon mon.b on smithi088 2023-10-07T00:04:41.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:41 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/2483550603' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:41.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:41 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:42.455 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-07T00:04:42.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-07T00:04:42.525 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:42 smithi112 ceph-mon[133548]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:42.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:42 smithi005 ceph-mon[129406]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:43.187 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:04:44.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:43 smithi088 systemd[1]: Starting Ceph mon.b for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:04:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.675+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/688430482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 msgr2=0x7f0a48106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.675+0000 7f0a4f0ed700 1 --2- 172.21.15.112:0/688430482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 0x7f0a48106e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009910 tx=0x7f0a3c009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.675+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/688430482 shutdown_connections 2023-10-07T00:04:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.675+0000 7f0a4f0ed700 1 --2- 172.21.15.112:0/688430482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 0x7f0a48106e50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.675+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/688430482 >> 172.21.15.112:0/688430482 conn(0x7f0a480fc540 msgr2=0x7f0a480fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.675+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/688430482 shutdown_connections 2023-10-07T00:04:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.675+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/688430482 wait complete. 2023-10-07T00:04:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.676+0000 7f0a4f0ed700 1 Processor -- start 2023-10-07T00:04:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.677+0000 7f0a4f0ed700 1 -- start start 2023-10-07T00:04:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.677+0000 7f0a4f0ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 0x7f0a48198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.677+0000 7f0a4f0ed700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a481986d0 0x7f0a4819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:44.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.677+0000 7f0a4f0ed700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48198c60 con 0x7f0a48106a70 2023-10-07T00:04:44.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.677+0000 7f0a4f0ed700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48198dd0 con 0x7f0a481986d0 2023-10-07T00:04:44.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.677+0000 7f0a4ce89700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 0x7f0a48198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:44.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.678+0000 7f0a4ce89700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 0x7f0a48198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.112:46804/0 (socket says 172.21.15.112:46804) 2023-10-07T00:04:44.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.678+0000 7f0a4ce89700 1 -- 172.21.15.112:0/821338231 learned_addr learned my addr 172.21.15.112:0/821338231 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:04:44.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.678+0000 7f0a47fff700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a481986d0 0x7f0a4819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:44.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.678+0000 7f0a4ce89700 1 -- 172.21.15.112:0/821338231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a481986d0 msgr2=0x7f0a4819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:44.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.678+0000 7f0a4ce89700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a481986d0 0x7f0a4819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:44.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.678+0000 7f0a4ce89700 1 -- 172.21.15.112:0/821338231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0095f0 con 0x7f0a48106a70 2023-10-07T00:04:44.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.678+0000 7f0a4ce89700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 0x7f0a48198190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c006010 tx=0x7f0a3c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:44.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.678+0000 7f0a45ffb700 1 -- 172.21.15.112:0/821338231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f0a3c01d070 con 0x7f0a48106a70 2023-10-07T00:04:44.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.679+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4819d0e0 con 0x7f0a48106a70 2023-10-07T00:04:44.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.679+0000 7f0a45ffb700 1 -- 172.21.15.112:0/821338231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a3c005dc0 con 0x7f0a48106a70 2023-10-07T00:04:44.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.679+0000 7f0a45ffb700 1 -- 172.21.15.112:0/821338231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f0a3c022c10 con 0x7f0a48106a70 2023-10-07T00:04:44.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.679+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4819d630 con 0x7f0a48106a70 2023-10-07T00:04:44.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.680+0000 7f0a45ffb700 1 -- 172.21.15.112:0/821338231 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f0a3c022470 con 0x7f0a48106a70 2023-10-07T00:04:44.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.680+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a480624e0 con 0x7f0a48106a70 2023-10-07T00:04:44.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.680+0000 7f0a45ffb700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0a38038700 0x7f0a3803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:44.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.680+0000 7f0a45ffb700 1 -- 172.21.15.112:0/821338231 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0a3c04cdb0 con 0x7f0a48106a70 2023-10-07T00:04:44.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.681+0000 7f0a47fff700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0a38038700 0x7f0a3803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:44.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.681+0000 7f0a47fff700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0a38038700 0x7f0a3803abc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009850 tx=0x7f0a34008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:44.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.686+0000 7f0a45ffb700 1 -- 172.21.15.112:0/821338231 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0a3c051070 con 0x7f0a48106a70 2023-10-07T00:04:44.708 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 podman[103071]: 2023-10-07T00:04:44.708 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 bash[103071]: 9d76a1fc4d54ef4f15e6a606edc2b8d8f091884535b73a073c890819c1975d1c 2023-10-07T00:04:44.708 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: set uid:gid to 167:167 (ceph:ceph) 2023-10-07T00:04:44.708 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev), process ceph-mon, pid 7 2023-10-07T00:04:44.708 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pidfile_write: ignore empty --pid-file 2023-10-07T00:04:44.708 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: load: jerasure load: lrc 2023-10-07T00:04:44.708 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: RocksDB version: 7.9.2 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Git sha 0 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Compile date 2023-10-06 09:28:03 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: DB SUMMARY 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: DB Session ID: 9KAK0IUWN6WDW7KSJ93N 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: CURRENT file: CURRENT 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: IDENTITY file: IDENTITY 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.error_if_exists: 0 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.create_if_missing: 0 2023-10-07T00:04:44.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.paranoid_checks: 1 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.env: 0x564d5bbfada0 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.fs: PosixFileSystem 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.info_log: 0x564d5d26f5c0 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_file_opening_threads: 16 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.statistics: (nil) 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.use_fsync: 0 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_log_file_size: 0 2023-10-07T00:04:44.710 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-07T00:04:44.711 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-07T00:04:44.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:44 smithi112 ceph-mon[133548]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:44.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.757+0000 7f0a45ffb700 1 -- 172.21.15.112:0/821338231 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c02bd80 con 0x7f0a48106a70 2023-10-07T00:04:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:44.962+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0a48199670 con 0x7f0a48106a70 2023-10-07T00:04:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:44 smithi005 ceph-mon[129406]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.keep_log_file_num: 1000 2023-10-07T00:04:45.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.recycle_log_file_num: 0 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.allow_fallocate: 1 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.allow_mmap_reads: 0 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.allow_mmap_writes: 0 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.use_direct_reads: 0 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.create_missing_column_families: 0 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.db_log_dir: 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.wal_dir: 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-07T00:04:45.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-07T00:04:45.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-07T00:04:45.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-07T00:04:45.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-07T00:04:45.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.advise_random_on_open: 1 2023-10-07T00:04:45.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.db_write_buffer_size: 0 2023-10-07T00:04:45.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.write_buffer_manager: 0x564d5d227360 2023-10-07T00:04:45.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-07T00:04:45.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.rate_limiter: (nil) 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.wal_recovery_mode: 2 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.enable_thread_tracking: 0 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.enable_pipelined_write: 0 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.unordered_write: 0 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-07T00:04:45.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-07T00:04:45.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.row_cache: None 2023-10-07T00:04:45.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.wal_filter: None 2023-10-07T00:04:45.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-07T00:04:45.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.allow_ingest_behind: 0 2023-10-07T00:04:45.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.two_write_queues: 0 2023-10-07T00:04:45.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.manual_wal_flush: 0 2023-10-07T00:04:45.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.wal_compression: 0 2023-10-07T00:04:45.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.atomic_flush: 0 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.log_readahead_size: 0 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.best_efforts_recovery: 0 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.allow_data_in_errors: 0 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.db_host_id: __hostname__ 2023-10-07T00:04:45.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_background_jobs: 2 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_background_compactions: -1 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_subcompactions: 1 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_total_wal_size: 0 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-07T00:04:45.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_open_files: -1 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bytes_per_sync: 0 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_readahead_size: 0 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_background_flushes: -1 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Compression algorithms supported: 2023-10-07T00:04:45.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: kZSTD supported: 0 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: kXpressCompression supported: 0 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: kLZ4HCCompression supported: 1 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: kZlibCompression supported: 1 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: kSnappyCompression supported: 1 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: kLZ4Compression supported: 1 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: kBZip2Compression supported: 0 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-07T00:04:45.212 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.merge_operator: 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_filter: None 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_filter_factory: None 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.sst_partitioner_factory: None 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564d5d26f6c0) 2023-10-07T00:04:45.213 INFO:journalctl@ceph.mon.b.smithi088.stdout: cache_index_and_filter_blocks: 1 2023-10-07T00:04:45.214 INFO:journalctl@ceph.mon.b.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-07T00:04:45.214 INFO:journalctl@ceph.mon.b.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-07T00:04:45.214 INFO:journalctl@ceph.mon.b.smithi088.stdout: pin_top_level_index_and_filter: 1 2023-10-07T00:04:45.214 INFO:journalctl@ceph.mon.b.smithi088.stdout: index_type: 0 2023-10-07T00:04:45.214 INFO:journalctl@ceph.mon.b.smithi088.stdout: data_block_index_type: 0 2023-10-07T00:04:45.214 INFO:journalctl@ceph.mon.b.smithi088.stdout: index_shortening: 1 2023-10-07T00:04:45.214 INFO:journalctl@ceph.mon.b.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: checksum: 4 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: no_block_cache: 0 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: block_cache: 0x564d5d2c51f0 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: block_cache_name: BinnedLRUCache 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: block_cache_options: 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: capacity : 536870912 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: num_shard_bits : 4 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: strict_capacity_limit : 0 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: high_pri_pool_ratio: 0.000 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: block_cache_compressed: (nil) 2023-10-07T00:04:45.215 INFO:journalctl@ceph.mon.b.smithi088.stdout: persistent_cache: (nil) 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: block_size: 4096 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: block_size_deviation: 10 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: block_restart_interval: 16 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: index_block_restart_interval: 1 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: metadata_block_size: 4096 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: partition_filters: 0 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: use_delta_encoding: 1 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: filter_policy: bloomfilter 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: whole_key_filtering: 1 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: verify_compression: 0 2023-10-07T00:04:45.216 INFO:journalctl@ceph.mon.b.smithi088.stdout: read_amp_bytes_per_bit: 0 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout: format_version: 5 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout: enable_index_compression: 1 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout: block_align: 0 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout: max_auto_readahead_size: 262144 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout: prepopulate_block_cache: 0 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout: initial_auto_readahead_size: 8192 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.write_buffer_size: 33554432 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_write_buffer_number: 2 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression: NoCompression 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression: Disabled 2023-10-07T00:04:45.217 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.prefix_extractor: nullptr 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.num_levels: 7 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-07T00:04:45.218 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.level: 32767 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.strategy: 0 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-07T00:04:45.219 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.enabled: false 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.target_file_size_base: 67108864 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-07T00:04:45.220 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.arena_block_size: 1048576 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-07T00:04:45.221 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.disable_auto_compactions: 0 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-07T00:04:45.222 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.table_properties_collectors: 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.inplace_update_support: 0 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.bloom_locality: 0 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.max_successive_merges: 0 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.paranoid_file_checks: 0 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.force_consistency_checks: 1 2023-10-07T00:04:45.223 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.report_bg_io_stats: 0 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.ttl: 2592000 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.enable_blob_files: false 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.min_blob_size: 0 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.blob_file_size: 268435456 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-07T00:04:45.224 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.blob_file_starting_level: 0 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a654071a-6080-49a0-affc-83ec22c29e03 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696637084709219, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696637084710178, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696637084, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a654071a-6080-49a0-affc-83ec22c29e03", "db_session_id": "9KAK0IUWN6WDW7KSJ93N", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696637084710398, "job": 1, "event": "recovery_finished"} 2023-10-07T00:04:45.225 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564d5d362000 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: DB pointer 0x564d5d34e000 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout: ** DB Stats ** 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-07T00:04:45.226 INFO:journalctl@ceph.mon.b.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: ** Compaction Stats [default] ** 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-07T00:04:45.227 INFO:journalctl@ceph.mon.b.smithi088.stdout: 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: ** Compaction Stats [default] ** 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-07T00:04:45.228 INFO:journalctl@ceph.mon.b.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: Block cache BinnedLRUCache@0x564d5d2c51f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 7e-06 secs_since: 0 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: using public_addr v2:172.21.15.88:0/0 -> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2023-10-07T00:04:45.229 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: starting mon.b rank -1 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:04:45.230 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(???) e0 preinit fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:04:45.230 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).mds e1 new map 2023-10-07T00:04:45.230 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-07T00:04:45.230 INFO:journalctl@ceph.mon.b.smithi088.stdout: e1 2023-10-07T00:04:45.230 INFO:journalctl@ceph.mon.b.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-07T00:04:45.230 INFO:journalctl@ceph.mon.b.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-07T00:04:45.230 INFO:journalctl@ceph.mon.b.smithi088.stdout: legacy client fscid: -1 2023-10-07T00:04:45.230 INFO:journalctl@ceph.mon.b.smithi088.stdout: 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout: No filesystems configured 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:04:45.231 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-07T00:04:45.232 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.232 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.232 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:04:45.232 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.232 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:45.233 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.233 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.233 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.233 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.233 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.233 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Updating smithi088:/etc/ceph/ceph.conf 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Deploying cephadm binary to smithi112 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.234 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Added host smithi112 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.235 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3522893897' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3522893897' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Updating smithi112:/etc/ceph/ceph.conf 2023-10-07T00:04:45.236 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:45.237 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c;count:3 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Deploying daemon mon.c on smithi112 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/1049849839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:45.238 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.a calling monitor election 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.c calling monitor election 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.239 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: fsmap 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mgrmap e13: x(active, since 50s) 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: overall HEALTH_OK 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:45.240 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: Deploying daemon mon.b on smithi088 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/2483550603' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 systemd[1]: Started Ceph mon.b for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-10-07T00:04:45.241 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta expand map: {default=false} 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta from 'false' to 'false' 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta expanded map: {default=false} 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta expand map: {default=info} 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta from 'info' to 'info' 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta expanded map: {default=info} 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta expand map: {default=daemon} 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta expanded map: {default=daemon} 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta expand map: {default=debug} 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta from 'debug' to 'debug' 2023-10-07T00:04:45.242 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:44 smithi088 ceph-mon[103111]: expand_channel_meta expanded map: {default=debug} 2023-10-07T00:04:49.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.767+0000 7f0a45ffb700 1 -- 172.21.15.112:0/821338231 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1266 (secure 0 0 0) 0x7f0a3c02bba0 con 0x7f0a48106a70 2023-10-07T00:04:49.769 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-07T00:04:49.769 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":3,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","modified":"2023-10-07T00:04:44.756879Z","created":"2023-10-07T00:02:44.952042Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0a38038700 msgr2=0x7f0a3803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0a38038700 0x7f0a3803abc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009850 tx=0x7f0a34008040 comp rx=0 tx=0).stop 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 msgr2=0x7f0a48198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 0x7f0a48198190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c006010 tx=0x7f0a3c004ff0 comp rx=0 tx=0).stop 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 shutdown_connections 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0a38038700 0x7f0a3803abc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48106a70 0x7f0a48198190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 --2- 172.21.15.112:0/821338231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a481986d0 0x7f0a4819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:49.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 >> 172.21.15.112:0/821338231 conn(0x7f0a480fc540 msgr2=0x7f0a48108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:49.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 shutdown_connections 2023-10-07T00:04:49.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:49.771+0000 7f0a4f0ed700 1 -- 172.21.15.112:0/821338231 wait complete. 2023-10-07T00:04:49.774 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 3 2023-10-07T00:04:50.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:04:50.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: mon.c calling monitor election 2023-10-07T00:04:50.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: mon.a calling monitor election 2023-10-07T00:04:50.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/821338231' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:50.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: fsmap 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: mgrmap e13: x(active, since 60s) 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: mon.b (rank 2) addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] is down (out of quorum) 2023-10-07T00:04:50.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:50.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:50.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:50.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:50.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:04:50.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: mon.c calling monitor election 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: mon.a calling monitor election 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/821338231' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: fsmap 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: mgrmap e13: x(active, since 60s) 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: mon.b (rank 2) addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] is down (out of quorum) 2023-10-07T00:04:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:50.381 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-07T00:04:50.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-07T00:04:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:51.123 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:04:51.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:52.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: mon.b calling monitor election 2023-10-07T00:04:52.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: mon.b calling monitor election 2023-10-07T00:04:52.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: mon.a calling monitor election 2023-10-07T00:04:52.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: mon.c calling monitor election 2023-10-07T00:04:52.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-07T00:04:52.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:52.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: fsmap 2023-10-07T00:04:52.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:52.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: mgrmap e13: x(active, since 62s) 2023-10-07T00:04:52.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-07T00:04:52.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: Cluster is now healthy 2023-10-07T00:04:52.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:51 smithi005 ceph-mon[129406]: overall HEALTH_OK 2023-10-07T00:04:52.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:04:52.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.c calling monitor election 2023-10-07T00:04:52.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.a calling monitor election 2023-10-07T00:04:52.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:52.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:04:52.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/821338231' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-07T00:04:52.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: fsmap 2023-10-07T00:04:52.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mgrmap e13: x(active, since 60s) 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.b (rank 2) addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] is down (out of quorum) 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:52.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.b calling monitor election 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.b calling monitor election 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.a calling monitor election 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.c calling monitor election 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: fsmap 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: mgrmap e13: x(active, since 62s) 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: Cluster is now healthy 2023-10-07T00:04:52.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:51 smithi088 ceph-mon[103111]: overall HEALTH_OK 2023-10-07T00:04:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: mon.b calling monitor election 2023-10-07T00:04:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: mon.b calling monitor election 2023-10-07T00:04:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: mon.a calling monitor election 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: mon.c calling monitor election 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],c=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: fsmap 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: osdmap e4: 0 total, 0 up, 0 in 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: mgrmap e13: x(active, since 62s) 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: Cluster is now healthy 2023-10-07T00:04:52.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:51 smithi112 ceph-mon[133548]: overall HEALTH_OK 2023-10-07T00:04:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.639+0000 7faf4f59e700 1 -- 172.21.15.5:0/4028316569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 msgr2=0x7faf500736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.639+0000 7faf4f59e700 1 --2- 172.21.15.5:0/4028316569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 0x7faf500736c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf40009910 tx=0x7faf40009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.639+0000 7faf4f59e700 1 -- 172.21.15.5:0/4028316569 shutdown_connections 2023-10-07T00:04:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.639+0000 7faf4f59e700 1 --2- 172.21.15.5:0/4028316569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 0x7faf500736c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.639+0000 7faf4f59e700 1 -- 172.21.15.5:0/4028316569 >> 172.21.15.5:0/4028316569 conn(0x7faf500fc280 msgr2=0x7faf500fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.639+0000 7faf4f59e700 1 -- 172.21.15.5:0/4028316569 shutdown_connections 2023-10-07T00:04:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.639+0000 7faf4f59e700 1 -- 172.21.15.5:0/4028316569 wait complete. 2023-10-07T00:04:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.641+0000 7faf4f59e700 1 Processor -- start 2023-10-07T00:04:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.641+0000 7faf4f59e700 1 -- start start 2023-10-07T00:04:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4f59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 0x7faf50198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf50198550 0x7faf5019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4f59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf5019cf00 0x7faf5019d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4f59e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50198c40 con 0x7faf500732e0 2023-10-07T00:04:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4f59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf501a4c70 con 0x7faf5019cf00 2023-10-07T00:04:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf501a4db0 con 0x7faf50198550 2023-10-07T00:04:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 0x7faf50198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 0x7faf50198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51842/0 (socket says 172.21.15.5:51842) 2023-10-07T00:04:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.642+0000 7faf4e59c700 1 -- 172.21.15.5:0/1625063170 learned_addr learned my addr 172.21.15.5:0/1625063170 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:04:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf4e59c700 1 -- 172.21.15.5:0/1625063170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf50198550 msgr2=0x7faf5019c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf4e59c700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf50198550 0x7faf5019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf4e59c700 1 -- 172.21.15.5:0/1625063170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf5019cf00 msgr2=0x7faf5019d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf4e59c700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf5019cf00 0x7faf5019d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf4e59c700 1 -- 172.21.15.5:0/1625063170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf400095f0 con 0x7faf500732e0 2023-10-07T00:04:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf4e59c700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 0x7faf50198010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf4000bcf0 tx=0x7faf4000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf3f7fe700 1 -- 172.21.15.5:0/1625063170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4001d070 con 0x7faf500732e0 2023-10-07T00:04:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf3f7fe700 1 -- 172.21.15.5:0/1625063170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf40004e30 con 0x7faf500732e0 2023-10-07T00:04:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf501a5030 con 0x7faf500732e0 2023-10-07T00:04:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf3f7fe700 1 -- 172.21.15.5:0/1625063170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40022e20 con 0x7faf500732e0 2023-10-07T00:04:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.643+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf501a54d0 con 0x7faf500732e0 2023-10-07T00:04:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.645+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5010a5d0 con 0x7faf500732e0 2023-10-07T00:04:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.645+0000 7faf3f7fe700 1 -- 172.21.15.5:0/1625063170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7faf400049a0 con 0x7faf500732e0 2023-10-07T00:04:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.645+0000 7faf3f7fe700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf38038d40 0x7faf3803b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.645+0000 7faf3f7fe700 1 -- 172.21.15.5:0/1625063170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faf4004ca00 con 0x7faf500732e0 2023-10-07T00:04:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.646+0000 7faf4dd9b700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf38038d40 0x7faf3803b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.646+0000 7faf4dd9b700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf38038d40 0x7faf3803b200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf440098e0 tx=0x7faf44006dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.650+0000 7faf3f7fe700 1 -- 172.21.15.5:0/1625063170 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faf4000ed70 con 0x7faf500732e0 2023-10-07T00:04:52.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.881+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7faf500624e0 con 0x7faf500732e0 2023-10-07T00:04:52.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.881+0000 7faf3f7fe700 1 -- 172.21.15.5:0/1625063170 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+271 (secure 0 0 0) 0x7faf40027030 con 0x7faf500732e0 2023-10-07T00:04:52.883 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:04:52.883 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2023-10-07T00:04:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:04:52.883 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2023-10-07T00:04:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.883+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf38038d40 msgr2=0x7faf3803b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.883+0000 7faf4f59e700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf38038d40 0x7faf3803b200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf440098e0 tx=0x7faf44006dd0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.883+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 msgr2=0x7faf50198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.883+0000 7faf4f59e700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 0x7faf50198010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf4000bcf0 tx=0x7faf4000bdd0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.884+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 shutdown_connections 2023-10-07T00:04:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.884+0000 7faf4f59e700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf38038d40 0x7faf3803b200 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.884+0000 7faf4f59e700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf5019cf00 0x7faf5019d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.884+0000 7faf4f59e700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf500732e0 0x7faf50198010 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.884+0000 7faf4f59e700 1 --2- 172.21.15.5:0/1625063170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf50198550 0x7faf5019c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.884+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 >> 172.21.15.5:0/1625063170 conn(0x7faf500fc280 msgr2=0x7faf50107710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.884+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 shutdown_connections 2023-10-07T00:04:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:04:52.884+0000 7faf4f59e700 1 -- 172.21.15.5:0/1625063170 wait complete. 2023-10-07T00:04:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: Updating smithi088:/etc/ceph/ceph.conf 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: Updating smithi112:/etc/ceph/ceph.conf 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: Updating smithi005:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: Updating smithi088:/etc/ceph/ceph.conf 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: Updating smithi112:/etc/ceph/ceph.conf 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: Updating smithi005:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:53.258 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.258 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.258 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.258 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: Updating smithi088:/etc/ceph/ceph.conf 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: Updating smithi112:/etc/ceph/ceph.conf 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: Updating smithi005:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: Updating smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: Updating smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-07T00:04:53.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:04:53.308 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-07T00:04:53.308 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:04:53.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2023-10-07T00:04:53.379 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:04:53.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:53.492 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:04:53.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.conf 2023-10-07T00:04:53.564 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:04:53.564 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:53.672 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:04:53.672 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2023-10-07T00:04:53.743 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:04:53.743 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-07T00:04:53.850 INFO:tasks.cephadm:Adding mgr.x on smithi005 2023-10-07T00:04:53.851 INFO:tasks.cephadm:Adding mgr.y on smithi088 2023-10-07T00:04:53.851 INFO:tasks.cephadm:Adding mgr.z on smithi112 2023-10-07T00:04:53.851 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi005=x;smithi088=y;smithi112=z' 2023-10-07T00:04:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1625063170' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: Reconfiguring mon.a (unknown last config time)... 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:53.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:53.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: Reconfiguring daemon mon.a on smithi005 2023-10-07T00:04:53.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:53 smithi112 ceph-mon[133548]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1625063170' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.161 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: Reconfiguring mon.a (unknown last config time)... 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: Reconfiguring daemon mon.a on smithi005 2023-10-07T00:04:54.162 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:53 smithi005 ceph-mon[129406]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:54.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1625063170' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:54.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: Reconfiguring mon.a (unknown last config time)... 2023-10-07T00:04:54.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:54.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:54.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:54.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: Reconfiguring daemon mon.a on smithi005 2023-10-07T00:04:54.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:53 smithi088 ceph-mon[103111]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:54.607 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:04:55.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:55 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:55.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:55 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:55.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:55 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:55.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:55 smithi112 ceph-mon[133548]: Reconfiguring mon.b (monmap changed)... 2023-10-07T00:04:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:55 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:55 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:55 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:55 smithi112 ceph-mon[133548]: Reconfiguring daemon mon.b on smithi088 2023-10-07T00:04:55.858 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:55 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:55.858 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:55 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:55.858 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:55 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:55.859 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:55 smithi088 ceph-mon[103111]: Reconfiguring mon.b (monmap changed)... 2023-10-07T00:04:55.859 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:55 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:55.859 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:55 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:55.859 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:55 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:55.859 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:55 smithi088 ceph-mon[103111]: Reconfiguring daemon mon.b on smithi088 2023-10-07T00:04:56.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.099+0000 7f8fd7e49700 1 -- 172.21.15.112:0/2888589662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0100af0 msgr2=0x7f8fd0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:56.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.099+0000 7f8fd7e49700 1 --2- 172.21.15.112:0/2888589662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0100af0 0x7f8fd0100f10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009910 tx=0x7f8fcc009c20 comp rx=0 tx=0).stop 2023-10-07T00:04:56.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.099+0000 7f8fd7e49700 1 -- 172.21.15.112:0/2888589662 shutdown_connections 2023-10-07T00:04:56.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.099+0000 7f8fd7e49700 1 --2- 172.21.15.112:0/2888589662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0100af0 0x7f8fd0100f10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.099+0000 7f8fd7e49700 1 -- 172.21.15.112:0/2888589662 >> 172.21.15.112:0/2888589662 conn(0x7f8fd00fc0b0 msgr2=0x7f8fd00fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:56.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.099+0000 7f8fd7e49700 1 -- 172.21.15.112:0/2888589662 shutdown_connections 2023-10-07T00:04:56.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.099+0000 7f8fd7e49700 1 -- 172.21.15.112:0/2888589662 wait complete. 2023-10-07T00:04:56.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.100+0000 7f8fd7e49700 1 Processor -- start 2023-10-07T00:04:56.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.100+0000 7f8fd7e49700 1 -- start start 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.100+0000 7f8fd7e49700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fd0100af0 0x7f8fd0195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.100+0000 7f8fd7e49700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0196280 0x7f8fd019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.100+0000 7f8fd7e49700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fd0196700 0x7f8fd019d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.100+0000 7f8fd7e49700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd019e020 con 0x7f8fd0196280 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.100+0000 7f8fd7e49700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd019e190 con 0x7f8fd0100af0 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.100+0000 7f8fd7e49700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd019e350 con 0x7f8fd0196700 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd53e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0196280 0x7f8fd019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd5be5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fd0100af0 0x7f8fd0195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd53e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0196280 0x7f8fd019b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.112:48356/0 (socket says 172.21.15.112:48356) 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd53e4700 1 -- 172.21.15.112:0/4199436213 learned_addr learned my addr 172.21.15.112:0/4199436213 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:04:56.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd63e6700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fd0196700 0x7f8fd019d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:56.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd5be5700 1 -- 172.21.15.112:0/4199436213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fd0196700 msgr2=0x7f8fd019d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:56.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd5be5700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fd0196700 0x7f8fd019d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd5be5700 1 -- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0196280 msgr2=0x7f8fd019b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:56.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd5be5700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0196280 0x7f8fd019b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.101+0000 7f8fd5be5700 1 -- 172.21.15.112:0/4199436213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0095f0 con 0x7f8fd0100af0 2023-10-07T00:04:56.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.102+0000 7f8fd5be5700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fd0100af0 0x7f8fd0195d40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0098e0 tx=0x7f8fcc00bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:56.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.102+0000 7f8fc6ffd700 1 -- 172.21.15.112:0/4199436213 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc01d070 con 0x7f8fd0100af0 2023-10-07T00:04:56.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.102+0000 7f8fc6ffd700 1 -- 172.21.15.112:0/4199436213 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fcc004db0 con 0x7f8fd0100af0 2023-10-07T00:04:56.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.102+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd019e5d0 con 0x7f8fd0100af0 2023-10-07T00:04:56.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.102+0000 7f8fc6ffd700 1 -- 172.21.15.112:0/4199436213 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc022c30 con 0x7f8fd0100af0 2023-10-07T00:04:56.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.102+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd019eb10 con 0x7f8fd0100af0 2023-10-07T00:04:56.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.103+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd018f4b0 con 0x7f8fd0100af0 2023-10-07T00:04:56.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.103+0000 7f8fc6ffd700 1 -- 172.21.15.112:0/4199436213 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f8fcc004920 con 0x7f8fd0100af0 2023-10-07T00:04:56.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.103+0000 7f8fc6ffd700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8fbc038d90 0x7f8fbc03b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:04:56.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.104+0000 7f8fc6ffd700 1 -- 172.21.15.112:0/4199436213 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8fcc04ca10 con 0x7f8fd0100af0 2023-10-07T00:04:56.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.104+0000 7f8fd53e4700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8fbc038d90 0x7f8fbc03b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:04:56.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.105+0000 7f8fd53e4700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8fbc038d90 0x7f8fbc03b250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009b80 tx=0x7f8fc00092c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:04:56.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:55 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:55 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:55 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:55 smithi005 ceph-mon[129406]: Reconfiguring mon.b (monmap changed)... 2023-10-07T00:04:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:55 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:55 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:56.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:55 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:56.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:55 smithi005 ceph-mon[129406]: Reconfiguring daemon mon.b on smithi088 2023-10-07T00:04:56.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.109+0000 7f8fc6ffd700 1 -- 172.21.15.112:0/4199436213 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8fcc00e850 con 0x7f8fd0100af0 2023-10-07T00:04:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.331+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi088=y;smithi112=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fd002d0e0 con 0x7f8fbc038d90 2023-10-07T00:04:56.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.338+0000 7f8fc6ffd700 1 -- 172.21.15.112:0/4199436213 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8fd002d0e0 con 0x7f8fbc038d90 2023-10-07T00:04:56.339 INFO:teuthology.orchestra.run.smithi112.stdout:Scheduled mgr update... 2023-10-07T00:04:56.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8fbc038d90 msgr2=0x7f8fbc03b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:56.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8fbc038d90 0x7f8fbc03b250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009b80 tx=0x7f8fc00092c0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fd0100af0 msgr2=0x7f8fd0195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:04:56.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fd0100af0 0x7f8fd0195d40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0098e0 tx=0x7f8fcc00bcf0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 shutdown_connections 2023-10-07T00:04:56.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8fbc038d90 0x7f8fbc03b250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fd0196700 0x7f8fd019d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fd0100af0 0x7f8fd0195d40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 --2- 172.21.15.112:0/4199436213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd0196280 0x7f8fd019b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:04:56.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 >> 172.21.15.112:0/4199436213 conn(0x7f8fd00fc0b0 msgr2=0x7f8fd00fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:04:56.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 shutdown_connections 2023-10-07T00:04:56.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:04:56.340+0000 7f8fd7e49700 1 -- 172.21.15.112:0/4199436213 wait complete. 2023-10-07T00:04:56.780 DEBUG:teuthology.orchestra.run.smithi088:mgr.y> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-07T00:04:56.785 DEBUG:teuthology.orchestra.run.smithi112:mgr.z> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-07T00:04:56.789 INFO:tasks.cephadm:Deploying OSDs... 2023-10-07T00:04:56.790 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:04:56.790 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2023-10-07T00:04:56.839 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-07T00:04:56.840 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2023-10-07T00:04:56.857 INFO:journalctl@ceph.mgr.y.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:04:56.861 INFO:journalctl@ceph.mgr.z.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:04:56.887 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-07T00:04:56.887 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:56.887 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-07T00:04:56.887 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:56.888 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:56.888 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-07 00:03:59.350599377 +0000 2023-10-07T00:04:56.888 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-06 23:58:14.467749783 +0000 2023-10-07T00:04:56.888 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-06 23:58:14.467749783 +0000 2023-10-07T00:04:56.888 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-10-06 23:58:14.443750263 +0000 2023-10-07T00:04:56.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-07T00:04:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-07T00:04:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-07T00:04:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000194034 s, 2.6 MB/s 2023-10-07T00:04:56.960 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-07T00:04:57.006 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2023-10-07T00:04:57.090 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-07T00:04:57.091 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:57.091 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-07T00:04:57.091 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:57.091 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:57.092 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-07 00:03:59.418598016 +0000 2023-10-07T00:04:57.092 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-06 23:58:15.305733045 +0000 2023-10-07T00:04:57.092 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-06 23:58:15.305733045 +0000 2023-10-07T00:04:57.092 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-10-06 23:58:15.283733485 +0000 2023-10-07T00:04:57.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-07T00:04:57.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:56 smithi005 ceph-mon[129406]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:56 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:56 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:56 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:56 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:56 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:56 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.120 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:56 smithi112 ceph-mon[133548]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:57.120 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:56 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.120 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:56 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.120 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:56 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:57.120 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:56 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:57.120 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:56 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:57.120 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:56 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-07T00:04:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-07T00:04:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000187895 s, 2.7 MB/s 2023-10-07T00:04:57.177 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-07T00:04:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:56 smithi088 ceph-mon[103111]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:56 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:56 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:56 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-07T00:04:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:56 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-07T00:04:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:56 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:56 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:57.222 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2023-10-07T00:04:57.307 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-07T00:04:57.307 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:57.307 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-07T00:04:57.307 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:57.308 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:57.308 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-07 00:03:59.477596835 +0000 2023-10-07T00:04:57.308 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-06 23:58:16.118716807 +0000 2023-10-07T00:04:57.308 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-06 23:58:16.118716807 +0000 2023-10-07T00:04:57.308 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-10-06 23:58:16.096717246 +0000 2023-10-07T00:04:57.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-07T00:04:57.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-07T00:04:57.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-07T00:04:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000175684 s, 2.9 MB/s 2023-10-07T00:04:57.416 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-07T00:04:57.463 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2023-10-07T00:04:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-07T00:04:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:57.546 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-07T00:04:57.546 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:57.546 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:57.546 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-07 00:03:59.549595394 +0000 2023-10-07T00:04:57.546 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-06 23:58:16.941700368 +0000 2023-10-07T00:04:57.547 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-06 23:58:16.941700368 +0000 2023-10-07T00:04:57.547 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-10-06 23:58:16.920700787 +0000 2023-10-07T00:04:57.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-07T00:04:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-07T00:04:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-07T00:04:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000187881 s, 2.7 MB/s 2023-10-07T00:04:57.654 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-07T00:04:57.699 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-07T00:04:57.699 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-10-07T00:04:57.747 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-07T00:04:57.747 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-07 00:04:43.849519945 +0000 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-06 23:57:49.086073024 +0000 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-06 23:57:49.086073024 +0000 2023-10-07T00:04:57.835 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-10-06 23:57:49.055073677 +0000 2023-10-07T00:04:57.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-07T00:04:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-07T00:04:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-07T00:04:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000294047 s, 1.7 MB/s 2023-10-07T00:04:57.905 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-07T00:04:57.950 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-10-07T00:04:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-07T00:04:58.034 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-07T00:04:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-07 00:04:43.849519945 +0000 2023-10-07T00:04:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-06 23:57:49.892056040 +0000 2023-10-07T00:04:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-06 23:57:49.892056040 +0000 2023-10-07T00:04:58.035 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-10-06 23:57:49.863056651 +0000 2023-10-07T00:04:58.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-07T00:04:58.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:57 smithi005 ceph-mon[129406]: Reconfiguring mon.c (monmap changed)... 2023-10-07T00:04:58.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:57 smithi005 ceph-mon[129406]: Reconfiguring daemon mon.c on smithi112 2023-10-07T00:04:58.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:57 smithi005 ceph-mon[129406]: from='client.24101 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi088=y;smithi112=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:58.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:57 smithi005 ceph-mon[129406]: Saving service mgr spec with placement smithi005=x;smithi088=y;smithi112=z;count:3 2023-10-07T00:04:58.134 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:57 smithi088 ceph-mon[103111]: Reconfiguring mon.c (monmap changed)... 2023-10-07T00:04:58.134 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:57 smithi088 ceph-mon[103111]: Reconfiguring daemon mon.c on smithi112 2023-10-07T00:04:58.134 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:57 smithi088 ceph-mon[103111]: from='client.24101 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi088=y;smithi112=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:58.134 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:57 smithi088 ceph-mon[103111]: Saving service mgr spec with placement smithi005=x;smithi088=y;smithi112=z;count:3 2023-10-07T00:04:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-07T00:04:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-07T00:04:58.140 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000300706 s, 1.7 MB/s 2023-10-07T00:04:58.143 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-07T00:04:58.187 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-10-07T00:04:58.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:57 smithi112 ceph-mon[133548]: Reconfiguring mon.c (monmap changed)... 2023-10-07T00:04:58.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:57 smithi112 ceph-mon[133548]: Reconfiguring daemon mon.c on smithi112 2023-10-07T00:04:58.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:57 smithi112 ceph-mon[133548]: from='client.24101 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi088=y;smithi112=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:04:58.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:57 smithi112 ceph-mon[133548]: Saving service mgr spec with placement smithi005=x;smithi088=y;smithi112=z;count:3 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-07 00:04:43.849519945 +0000 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-06 23:57:50.716038677 +0000 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-06 23:57:50.716038677 +0000 2023-10-07T00:04:58.271 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-10-06 23:57:50.689039246 +0000 2023-10-07T00:04:58.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-07T00:04:58.376 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-07T00:04:58.376 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-07T00:04:58.376 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000304556 s, 1.7 MB/s 2023-10-07T00:04:58.379 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-07T00:04:58.423 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-10-07T00:04:58.507 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-07T00:04:58.507 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:58.507 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-07T00:04:58.507 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:58.507 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:58.508 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-07 00:04:43.850519924 +0000 2023-10-07T00:04:58.508 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-06 23:57:51.548021146 +0000 2023-10-07T00:04:58.508 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-06 23:57:51.548021146 +0000 2023-10-07T00:04:58.508 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-10-06 23:57:51.521021715 +0000 2023-10-07T00:04:58.508 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-07T00:04:58.611 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-07T00:04:58.612 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-07T00:04:58.612 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000321243 s, 1.6 MB/s 2023-10-07T00:04:58.614 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-07T00:04:58.659 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-07T00:04:58.659 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2023-10-07T00:04:58.709 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-07T00:04:58.710 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-07 00:04:34.246671424 +0000 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-06 23:57:50.441425952 +0000 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-06 23:57:50.441425952 +0000 2023-10-07T00:04:58.795 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2023-10-06 23:57:50.409426764 +0000 2023-10-07T00:04:58.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-07T00:04:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-07T00:04:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-07T00:04:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000267993 s, 1.9 MB/s 2023-10-07T00:04:58.911 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-07T00:04:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:04:58.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:58.961 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2023-10-07T00:04:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-07T00:04:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:59.008 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-07T00:04:59.008 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:59.008 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:59.008 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-07 00:04:34.246671424 +0000 2023-10-07T00:04:59.008 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-06 23:57:51.266405018 +0000 2023-10-07T00:04:59.008 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-06 23:57:51.266405018 +0000 2023-10-07T00:04:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2023-10-06 23:57:51.236405779 +0000 2023-10-07T00:04:59.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-07T00:04:59.107 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:04:59.108 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:04:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:04:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:04:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:04:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:04:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-07T00:04:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:04:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:04:59.114 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-07T00:04:59.114 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-07T00:04:59.114 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000297343 s, 1.7 MB/s 2023-10-07T00:04:59.117 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-07T00:04:59.163 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2023-10-07T00:04:59.251 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-07T00:04:59.251 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:59.251 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-07T00:04:59.251 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:59.251 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:59.251 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-07 00:04:34.246671424 +0000 2023-10-07T00:04:59.251 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-06 23:57:52.079384388 +0000 2023-10-07T00:04:59.251 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-06 23:57:52.079384388 +0000 2023-10-07T00:04:59.252 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2023-10-06 23:57:52.051385099 +0000 2023-10-07T00:04:59.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-07T00:04:59.317 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-07T00:04:59.318 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-07T00:04:59.318 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000298718 s, 1.7 MB/s 2023-10-07T00:04:59.320 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-07T00:04:59.366 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2023-10-07T00:04:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-07T00:04:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T00:04:59.412 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-07T00:04:59.412 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:04:59.412 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T00:04:59.412 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-07 00:04:34.246671424 +0000 2023-10-07T00:04:59.413 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-06 23:57:52.902363505 +0000 2023-10-07T00:04:59.413 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-06 23:57:52.902363505 +0000 2023-10-07T00:04:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2023-10-06 23:57:52.876364165 +0000 2023-10-07T00:04:59.413 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-07T00:04:59.517 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-07T00:04:59.517 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-07T00:04:59.517 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00031009 s, 1.7 MB/s 2023-10-07T00:04:59.519 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-07T00:04:59.566 INFO:tasks.cephadm:Deploying osd.0 on smithi005 with /dev/vg_nvme/lv_4... 2023-10-07T00:04:59.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-07T00:05:00.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:04:59 smithi005 ceph-mon[129406]: Deploying daemon mgr.z on smithi112 2023-10-07T00:05:00.189 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:04:59 smithi112 ceph-mon[133548]: Deploying daemon mgr.z on smithi112 2023-10-07T00:05:00.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:04:59 smithi088 ceph-mon[103111]: Deploying daemon mgr.z on smithi112 2023-10-07T00:05:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:05:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:00 smithi112 ceph-mon[133548]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:00.998 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:00 smithi112 systemd[1]: Starting Ceph mgr.z for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:05:00.999 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:00 smithi005 ceph-mon[129406]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:00 smithi088 ceph-mon[103111]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:01.628 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:01 smithi112 podman[135671]: 2023-10-07T00:05:01.919 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:01 smithi112 ceph-mon[133548]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:01.919 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:01 smithi112 bash[135671]: 726069db9950510b7f9de437ab4db25f4c8960ee334ea1b4e150ef0e6bd87fa1 2023-10-07T00:05:01.919 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:01 smithi112 ceph-mgr[135711]: -- 172.21.15.112:0/1070625921 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558e189d91e0 con 0x558e189ae800 2023-10-07T00:05:01.919 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:01 smithi112 systemd[1]: Started Ceph mgr.z for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:05:01.919 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:01.797+0000 7fc2ca19e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T00:05:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-07T00:05:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-07T00:05:02.073 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2023-10-07T00:05:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2023-10-07T00:05:02.074 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0313067 s, 335 MB/s 2023-10-07T00:05:02.074 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2023-10-07T00:05:02.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:01 smithi005 ceph-mon[129406]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:02.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:01 smithi088 ceph-mon[103111]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:02.247 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:01.917+0000 7fc2ca19e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T00:05:02.247 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:02.032+0000 7fc2ca19e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T00:05:02.247 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:02.150+0000 7fc2ca19e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T00:05:02.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi005:vg_nvme/lv_4 2023-10-07T00:05:02.747 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:02.368+0000 7fc2ca19e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T00:05:03.049 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.049 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.049 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.050 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:05:03.050 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-07T00:05:03.050 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:05:03.050 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:03.050 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:02 smithi088 ceph-mon[103111]: Deploying daemon mgr.y on smithi088 2023-10-07T00:05:03.101 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:02.823+0000 7fc2ca19e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T00:05:03.101 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:02.984+0000 7fc2ca19e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T00:05:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:05:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-07T00:05:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:05:03.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:03.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:02 smithi112 ceph-mon[133548]: Deploying daemon mgr.y on smithi088 2023-10-07T00:05:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:05:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-07T00:05:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:05:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:02 smithi005 ceph-mon[129406]: Deploying daemon mgr.y on smithi088 2023-10-07T00:05:03.322 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:05:03.497 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:03.099+0000 7fc2ca19e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T00:05:03.497 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:03.221+0000 7fc2ca19e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T00:05:04.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:03 smithi005 ceph-mon[129406]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:04.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:03 smithi088 ceph-mon[103111]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:04.204 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:04 smithi088 systemd[1]: Starting Ceph mgr.y for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:05:04.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:03 smithi112 ceph-mon[133548]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:04.247 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:03.764+0000 7fc2ca19e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T00:05:04.742 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:04 smithi088 podman[104562]: 2023-10-07T00:05:04.742 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:04 smithi088 ceph-mgr[104602]: -- 172.21.15.88:0/3141786904 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5638e14671e0 con 0x5638e143cc00 2023-10-07T00:05:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 -- 172.21.15.5:0/3880004596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0100dd0 msgr2=0x7f81f01011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3880004596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0100dd0 0x7f81f01011f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81e00099c0 tx=0x7f81e0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:05:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 -- 172.21.15.5:0/3880004596 shutdown_connections 2023-10-07T00:05:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3880004596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f0102970 0x7f81f0109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3880004596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0100dd0 0x7f81f01011f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3880004596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81f0101fd0 0x7f81f0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 -- 172.21.15.5:0/3880004596 >> 172.21.15.5:0/3880004596 conn(0x7f81f00fc390 msgr2=0x7f81f00fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:05:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 -- 172.21.15.5:0/3880004596 shutdown_connections 2023-10-07T00:05:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.757+0000 7f81ef59e700 1 -- 172.21.15.5:0/3880004596 wait complete. 2023-10-07T00:05:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.758+0000 7f81ef59e700 1 Processor -- start 2023-10-07T00:05:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.758+0000 7f81ef59e700 1 -- start start 2023-10-07T00:05:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.758+0000 7f81ef59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81f0100dd0 0x7f81f0198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.758+0000 7f81ef59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f0101fd0 0x7f81f0199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.758+0000 7f81ef59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0102970 0x7f81f01a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.758+0000 7f81ef59e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01a0770 con 0x7f81f0102970 2023-10-07T00:05:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.758+0000 7f81ef59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01a08b0 con 0x7f81f0101fd0 2023-10-07T00:05:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81ef59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01a0a40 con 0x7f81f0100dd0 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81eed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0102970 0x7f81f01a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81ee59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81f0100dd0 0x7f81f0198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81eed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0102970 0x7f81f01a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36562/0 (socket says 172.21.15.5:36562) 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81eed9d700 1 -- 172.21.15.5:0/3365388605 learned_addr learned my addr 172.21.15.5:0/3365388605 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81edd9b700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f0101fd0 0x7f81f0199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81ee59c700 1 -- 172.21.15.5:0/3365388605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f0101fd0 msgr2=0x7f81f0199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81ee59c700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f0101fd0 0x7f81f0199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81ee59c700 1 -- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0102970 msgr2=0x7f81f01a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81ee59c700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0102970 0x7f81f01a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.759+0000 7f81ee59c700 1 -- 172.21.15.5:0/3365388605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00095f0 con 0x7f81f0100dd0 2023-10-07T00:05:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.760+0000 7f81ee59c700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81f0100dd0 0x7f81f0198be0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f81e00098e0 tx=0x7f81e000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:05:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.760+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e001d070 con 0x7f81f0100dd0 2023-10-07T00:05:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.760+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81e000bcf0 con 0x7f81f0100dd0 2023-10-07T00:05:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.760+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00049e0 con 0x7f81f0100dd0 2023-10-07T00:05:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.760+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f01a0cc0 con 0x7f81f0100dd0 2023-10-07T00:05:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.760+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f01a10d0 con 0x7f81f0100dd0 2023-10-07T00:05:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.761+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f01932c0 con 0x7f81f0100dd0 2023-10-07T00:05:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.761+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f81e0004b40 con 0x7f81f0100dd0 2023-10-07T00:05:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.762+0000 7f81df7fe700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81d8038af0 0x7f81d803afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.762+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f81e004c0a0 con 0x7f81f0100dd0 2023-10-07T00:05:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.762+0000 7f81edd9b700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81d8038af0 0x7f81d803afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.762+0000 7f81edd9b700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81d8038af0 0x7f81d803afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009c60 tx=0x7f81e4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:05:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.767+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f81e007f100 con 0x7f81f0100dd0 2023-10-07T00:05:04.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:04.991+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f81f00008d0 con 0x7f81d8038af0 2023-10-07T00:05:04.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:04.643+0000 7fc2ca19e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T00:05:04.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:04.746+0000 7fc2ca19e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T00:05:05.006 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:04 smithi088 bash[104562]: bdb921b6a0c9065435a28762eba4504b9e8faee84151e7d3a8602b0f7a727735 2023-10-07T00:05:05.006 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:04 smithi088 systemd[1]: Started Ceph mgr.y for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:05:05.007 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:04 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:04.901+0000 7ff82bbf4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T00:05:05.452 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:05.005+0000 7ff82bbf4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T00:05:05.453 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:05.124+0000 7ff82bbf4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T00:05:05.453 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:05.243+0000 7ff82bbf4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T00:05:05.881 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:05.475+0000 7ff82bbf4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T00:05:05.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:05.741+0000 7fc2ca19e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:05:05.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:05.868+0000 7fc2ca19e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T00:05:05.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:05 smithi112 ceph-mon[133548]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:06.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:06.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:06.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:06.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:06.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:06.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:06.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:06.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:06.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:06.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:05 smithi005 ceph-mon[129406]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:06.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:05.961+0000 7ff82bbf4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T00:05:06.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:06 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:06.129+0000 7ff82bbf4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:06.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:06.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:05 smithi088 ceph-mon[103111]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:06.496 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:06.097+0000 7fc2ca19e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:05:06.497 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:06.494+0000 7fc2ca19e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T00:05:06.703 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:06 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:06.265+0000 7ff82bbf4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T00:05:06.703 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:06 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:06.394+0000 7ff82bbf4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T00:05:07.247 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:06.783+0000 7fc2ca19e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T00:05:07.247 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:06.994+0000 7fc2ca19e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T00:05:07.452 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:06 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:06.973+0000 7ff82bbf4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T00:05:07.747 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:07 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:07.361+0000 7fc2ca19e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T00:05:08.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:07 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:07.890+0000 7ff82bbf4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T00:05:08.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:07 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:07.994+0000 7ff82bbf4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T00:05:08.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: Reconfiguring mgr.x (unknown last config time)... 2023-10-07T00:05:08.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:05:08.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:05:08.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:08.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: Reconfiguring daemon mgr.x on smithi005 2023-10-07T00:05:08.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3322475933' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "304d532a-fc49-46fd-917c-11a6a7e57a15"}]: dispatch 2023-10-07T00:05:08.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3322475933' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "304d532a-fc49-46fd-917c-11a6a7e57a15"}]': finished 2023-10-07T00:05:08.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: osdmap e5: 1 total, 0 up, 1 in 2023-10-07T00:05:08.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:08 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:08.700 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:08.285+0000 7fc2ca19e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T00:05:08.700 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:08.453+0000 7fc2ca19e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T00:05:08.700 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:08.698+0000 7fc2ca19e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T00:05:08.700 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.700 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.700 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.700 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: Reconfiguring mgr.x (unknown last config time)... 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: Reconfiguring daemon mgr.x on smithi005 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3322475933' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "304d532a-fc49-46fd-917c-11a6a7e57a15"}]: dispatch 2023-10-07T00:05:08.701 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3322475933' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "304d532a-fc49-46fd-917c-11a6a7e57a15"}]': finished 2023-10-07T00:05:08.702 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: osdmap e5: 1 total, 0 up, 1 in 2023-10-07T00:05:08.702 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:08.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: Reconfiguring mgr.x (unknown last config time)... 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: Reconfiguring daemon mgr.x on smithi005 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3322475933' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "304d532a-fc49-46fd-917c-11a6a7e57a15"}]: dispatch 2023-10-07T00:05:08.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3322475933' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "304d532a-fc49-46fd-917c-11a6a7e57a15"}]': finished 2023-10-07T00:05:08.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: osdmap e5: 1 total, 0 up, 1 in 2023-10-07T00:05:08.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:08.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:08.840+0000 7fc2ca19e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T00:05:09.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:08 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:08.936+0000 7ff82bbf4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:05:09.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:09 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:09.057+0000 7ff82bbf4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T00:05:09.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:09 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3482422644' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:05:09.498 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:09.112+0000 7fc2ca19e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T00:05:09.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:09 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3482422644' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:05:09.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:09 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3482422644' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:05:09.650 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:09 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:09.284+0000 7ff82bbf4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T00:05:09.926 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:09 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:09.647+0000 7ff82bbf4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T00:05:10.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:09 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:09.924+0000 7ff82bbf4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T00:05:10.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:10.115+0000 7ff82bbf4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T00:05:10.497 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:05:10 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z[135687]: 2023-10-07T00:05:10.174+0000 7fc2ca19e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T00:05:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:10.628+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 14) v1 ==== 90790+0+0 (secure 0 0 0) 0x7f81e00053d0 con 0x7f81f0100dd0 2023-10-07T00:05:10.952 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:10.454+0000 7ff82bbf4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T00:05:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-mon[103111]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-mon[103111]: Standby manager daemon z started 2023-10-07T00:05:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-mon[103111]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-07T00:05:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-mon[103111]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-07T00:05:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-mon[103111]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-07T00:05:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:10 smithi088 ceph-mon[103111]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-07T00:05:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:10 smithi112 ceph-mon[133548]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:10 smithi112 ceph-mon[133548]: Standby manager daemon z started 2023-10-07T00:05:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:10 smithi112 ceph-mon[133548]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-07T00:05:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:10 smithi112 ceph-mon[133548]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-07T00:05:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:10 smithi112 ceph-mon[133548]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-07T00:05:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:10 smithi112 ceph-mon[133548]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-07T00:05:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:10 smithi005 ceph-mon[129406]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:10 smithi005 ceph-mon[129406]: Standby manager daemon z started 2023-10-07T00:05:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:10 smithi005 ceph-mon[129406]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-07T00:05:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:10 smithi005 ceph-mon[129406]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-07T00:05:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:10 smithi005 ceph-mon[129406]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-07T00:05:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:10 smithi005 ceph-mon[129406]: from='mgr.? 172.21.15.112:0/3122285011' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-07T00:05:11.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:11 smithi088 ceph-mon[103111]: mgrmap e14: x(active, since 81s), standbys: z 2023-10-07T00:05:11.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:11 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-07T00:05:11.703 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:11 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:11.385+0000 7ff82bbf4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T00:05:11.703 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:11 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:11.556+0000 7ff82bbf4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T00:05:11.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:11 smithi112 ceph-mon[133548]: mgrmap e14: x(active, since 81s), standbys: z 2023-10-07T00:05:11.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:11 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-07T00:05:12.068 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:11 smithi005 ceph-mon[129406]: mgrmap e14: x(active, since 81s), standbys: z 2023-10-07T00:05:12.068 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-07T00:05:12.202 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:11 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:11.806+0000 7ff82bbf4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T00:05:12.296 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:11 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:11.950+0000 7ff82bbf4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T00:05:12.634 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:12 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:12.226+0000 7ff82bbf4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T00:05:12.779 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:12 smithi005 ceph-mon[129406]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:12.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:12 smithi088 ceph-mon[103111]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:12.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:12 smithi112 ceph-mon[133548]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:13.634 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y[104578]: 2023-10-07T00:05:13.290+0000 7ff82bbf4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T00:05:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:13.646+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mon.1 v2:172.21.15.112:3300/0 8 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f81e000e3e0 con 0x7f81f0100dd0 2023-10-07T00:05:13.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:13 smithi005 ceph-mon[129406]: Standby manager daemon y started 2023-10-07T00:05:13.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:13 smithi005 ceph-mon[129406]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-07T00:05:13.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:13 smithi005 ceph-mon[129406]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-07T00:05:13.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:13 smithi005 ceph-mon[129406]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-07T00:05:13.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:13 smithi005 ceph-mon[129406]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-07T00:05:13.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:13 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:13.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:13 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:13.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:13 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:13.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-mon[103111]: Standby manager daemon y started 2023-10-07T00:05:13.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-mon[103111]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-07T00:05:13.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-mon[103111]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-07T00:05:13.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-mon[103111]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-07T00:05:13.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-mon[103111]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-07T00:05:13.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:13.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:13.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:13 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:13.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:13 smithi112 ceph-mon[133548]: Standby manager daemon y started 2023-10-07T00:05:13.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:13 smithi112 ceph-mon[133548]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-07T00:05:13.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:13 smithi112 ceph-mon[133548]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-07T00:05:13.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:13 smithi112 ceph-mon[133548]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-07T00:05:13.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:13 smithi112 ceph-mon[133548]: from='mgr.? 172.21.15.88:0/3432194186' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-07T00:05:13.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:13 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:13.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:13 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:13.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:13 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:14.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:14 smithi088 ceph-mon[103111]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:14.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:14 smithi088 ceph-mon[103111]: mgrmap e15: x(active, since 84s), standbys: y, z 2023-10-07T00:05:14.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-07T00:05:14.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:14.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:14.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:14 smithi112 ceph-mon[133548]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:14 smithi112 ceph-mon[133548]: mgrmap e15: x(active, since 84s), standbys: y, z 2023-10-07T00:05:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-07T00:05:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:14 smithi005 ceph-mon[129406]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:14 smithi005 ceph-mon[129406]: mgrmap e15: x(active, since 84s), standbys: y, z 2023-10-07T00:05:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-07T00:05:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:16.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:16 smithi088 ceph-mon[103111]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:16.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-07T00:05:16.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:16.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:16 smithi112 ceph-mon[133548]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:16.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-07T00:05:16.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:17.040 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:16 smithi005 ceph-mon[129406]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:17.040 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-07T00:05:17.040 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:17.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:17 smithi088 ceph-mon[103111]: Deploying daemon osd.0 on smithi005 2023-10-07T00:05:17.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:17 smithi112 ceph-mon[133548]: Deploying daemon osd.0 on smithi005 2023-10-07T00:05:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:17 smithi005 ceph-mon[129406]: Deploying daemon osd.0 on smithi005 2023-10-07T00:05:18.916 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:18 smithi005 ceph-mon[129406]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:18.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:18 smithi088 ceph-mon[103111]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:18.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:18 smithi112 ceph-mon[133548]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:20.847 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:20 smithi005 ceph-mon[129406]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:20.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:20 smithi088 ceph-mon[103111]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:20.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:20 smithi112 ceph-mon[133548]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:22.943 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:22 smithi005 ceph-mon[129406]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:22.944 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:22.944 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:22.944 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:22.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:22 smithi088 ceph-mon[103111]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:22.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:22.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:22.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:22 smithi112 ceph-mon[133548]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:24.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:24 smithi005 ceph-mon[129406]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:24.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:24.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:24.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:24.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:24.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:24.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:24 smithi088 ceph-mon[103111]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:24.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:24 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:24.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:24 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:24.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:24 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:24.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:24 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:24.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:24 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:24 smithi112 ceph-mon[133548]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:24 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:24 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:24 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:24.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:24 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:24.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:24 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:25.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.002+0000 7f81df7fe700 1 -- 172.21.15.5:0/3365388605 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f81f00008d0 con 0x7f81d8038af0 2023-10-07T00:05:25.004 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 0 on host 'smithi005' 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81d8038af0 msgr2=0x7f81d803afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81d8038af0 0x7f81d803afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009c60 tx=0x7f81e4009260 comp rx=0 tx=0).stop 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81f0100dd0 msgr2=0x7f81f0198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81f0100dd0 0x7f81f0198be0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f81e00098e0 tx=0x7f81e000fa00 comp rx=0 tx=0).stop 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 shutdown_connections 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81d8038af0 0x7f81d803afb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f0102970 0x7f81f01a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81f0100dd0 0x7f81f0198be0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 --2- 172.21.15.5:0/3365388605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f0101fd0 0x7f81f0199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:25.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 >> 172.21.15.5:0/3365388605 conn(0x7f81f00fc390 msgr2=0x7f81f01079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:05:25.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 shutdown_connections 2023-10-07T00:05:25.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:05:25.005+0000 7f81ef59e700 1 -- 172.21.15.5:0/3365388605 wait complete. 2023-10-07T00:05:25.451 DEBUG:teuthology.orchestra.run.smithi005:osd.0> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-07T00:05:25.456 INFO:tasks.cephadm:Deploying osd.1 on smithi088 with /dev/vg_nvme/lv_4... 2023-10-07T00:05:25.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-07T00:05:25.528 INFO:journalctl@ceph.osd.0.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:05:26.108 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:05:25 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-0[144022]: 2023-10-07T00:05:25.847+0000 7f9cd56e2640 -1 osd.0 0 log_to_monitors true 2023-10-07T00:05:26.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:25 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:26.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:25 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:26.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:25 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:26.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:25 smithi005 ceph-mon[129406]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:26.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:25 smithi005 ceph-mon[129406]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-07T00:05:26.185 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:05:26.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:25 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:26.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:25 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:26.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:25 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:26.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:25 smithi112 ceph-mon[133548]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:26.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:25 smithi112 ceph-mon[133548]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-07T00:05:26.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:25 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:26.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:25 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:25 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:25 smithi088 ceph-mon[103111]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:25 smithi088 ceph-mon[103111]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-07T00:05:27.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:26 smithi088 ceph-mon[103111]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-07T00:05:27.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:26 smithi088 ceph-mon[103111]: osdmap e6: 1 total, 0 up, 1 in 2023-10-07T00:05:27.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:26 smithi088 ceph-mon[103111]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:05:27.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:26 smithi112 ceph-mon[133548]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-07T00:05:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:26 smithi112 ceph-mon[133548]: osdmap e6: 1 total, 0 up, 1 in 2023-10-07T00:05:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:26 smithi112 ceph-mon[133548]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:05:27.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:27.359 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:05:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-0[144022]: 2023-10-07T00:05:26.981+0000 7f9ccb55a700 -1 osd.0 0 waiting for initial osdmap 2023-10-07T00:05:27.359 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:05:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-0[144022]: 2023-10-07T00:05:26.986+0000 7f9cc634d700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:05:27.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:26 smithi005 ceph-mon[129406]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-07T00:05:27.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:26 smithi005 ceph-mon[129406]: osdmap e6: 1 total, 0 up, 1 in 2023-10-07T00:05:27.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:26 smithi005 ceph-mon[129406]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:05:27.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-07T00:05:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-07T00:05:28.142 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2023-10-07T00:05:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2023-10-07T00:05:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0294089 s, 357 MB/s 2023-10-07T00:05:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2023-10-07T00:05:28.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:27 smithi112 ceph-mon[133548]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:05:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:27 smithi112 ceph-mon[133548]: osdmap e7: 1 total, 0 up, 1 in 2023-10-07T00:05:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:27 smithi112 ceph-mon[133548]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.293 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:27 smithi088 ceph-mon[103111]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:05:28.293 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:27 smithi088 ceph-mon[103111]: osdmap e7: 1 total, 0 up, 1 in 2023-10-07T00:05:28.293 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.293 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.293 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:27 smithi088 ceph-mon[103111]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:28.294 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:27 smithi005 ceph-mon[129406]: from='osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:05:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:27 smithi005 ceph-mon[129406]: osdmap e7: 1 total, 0 up, 1 in 2023-10-07T00:05:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:27 smithi005 ceph-mon[129406]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-07T00:05:28.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:28.657 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi088:vg_nvme/lv_4 2023-10-07T00:05:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:28 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:05:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:28 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:05:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:28 smithi112 ceph-mon[133548]: osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] boot 2023-10-07T00:05:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:28 smithi112 ceph-mon[133548]: osdmap e8: 1 total, 1 up, 1 in 2023-10-07T00:05:29.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:29.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:29.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:29.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:05:29.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:28 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:05:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:28 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:05:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:28 smithi005 ceph-mon[129406]: osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] boot 2023-10-07T00:05:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:28 smithi005 ceph-mon[129406]: osdmap e8: 1 total, 1 up, 1 in 2023-10-07T00:05:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:05:29.376 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:05:29.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:28 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:05:29.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:28 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:05:29.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:28 smithi088 ceph-mon[103111]: osd.0 [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] boot 2023-10-07T00:05:29.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:28 smithi088 ceph-mon[103111]: osdmap e8: 1 total, 1 up, 1 in 2023-10-07T00:05:29.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-07T00:05:29.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:29.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:29.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:05:30.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:29 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi005 2023-10-07T00:05:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:29 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi005 to 17272M 2023-10-07T00:05:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:29 smithi088 ceph-mon[103111]: osdmap e9: 1 total, 1 up, 1 in 2023-10-07T00:05:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:29 smithi088 ceph-mon[103111]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:30.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:29 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi005 2023-10-07T00:05:30.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:29 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi005 to 17272M 2023-10-07T00:05:30.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:30.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:30.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:30.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:29 smithi112 ceph-mon[133548]: osdmap e9: 1 total, 1 up, 1 in 2023-10-07T00:05:30.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:30.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:29 smithi112 ceph-mon[133548]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:30.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:29 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi005 2023-10-07T00:05:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:29 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi005 to 17272M 2023-10-07T00:05:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:29 smithi005 ceph-mon[129406]: osdmap e9: 1 total, 1 up, 1 in 2023-10-07T00:05:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:29 smithi005 ceph-mon[129406]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 -- 172.21.15.88:0/2572618037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 msgr2=0x7effc4101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 --2- 172.21.15.88:0/2572618037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 0x7effc4101390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7effb40099c0 tx=0x7effb4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:05:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 -- 172.21.15.88:0/2572618037 shutdown_connections 2023-10-07T00:05:30.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 --2- 172.21.15.88:0/2572618037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4102b10 0x7effc41093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 --2- 172.21.15.88:0/2572618037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 0x7effc4101390 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 --2- 172.21.15.88:0/2572618037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4102170 0x7effc41025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 -- 172.21.15.88:0/2572618037 >> 172.21.15.88:0/2572618037 conn(0x7effc40fc4d0 msgr2=0x7effc40fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:05:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 -- 172.21.15.88:0/2572618037 shutdown_connections 2023-10-07T00:05:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.858+0000 7effc99c6700 1 -- 172.21.15.88:0/2572618037 wait complete. 2023-10-07T00:05:30.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.859+0000 7effc99c6700 1 Processor -- start 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.859+0000 7effc99c6700 1 -- start start 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc99c6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 0x7effc4198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc99c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4102170 0x7effc41992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc99c6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4102b10 0x7effc41a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc99c6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41a0930 con 0x7effc4102170 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc99c6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41a0a70 con 0x7effc4100f70 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc99c6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41a0c00 con 0x7effc4102b10 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 0x7effc4198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 0x7effc4198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50508/0 (socket says 172.21.15.88:50508) 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc2ffd700 1 -- 172.21.15.88:0/3146757078 learned_addr learned my addr 172.21.15.88:0/3146757078 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc27fc700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4102170 0x7effc41992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc37fe700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4102b10 0x7effc41a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc2ffd700 1 -- 172.21.15.88:0/3146757078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4102b10 msgr2=0x7effc41a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc2ffd700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4102b10 0x7effc41a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc2ffd700 1 -- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4102170 msgr2=0x7effc41992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc2ffd700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4102170 0x7effc41992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.860+0000 7effc2ffd700 1 -- 172.21.15.88:0/3146757078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40095f0 con 0x7effc4100f70 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.861+0000 7effc2ffd700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 0x7effc4198da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7effb4000c00 tx=0x7effb400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:05:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.861+0000 7effc89c4700 1 -- 172.21.15.88:0/3146757078 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb401d070 con 0x7effc4100f70 2023-10-07T00:05:30.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.861+0000 7effc89c4700 1 -- 172.21.15.88:0/3146757078 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effb400fe70 con 0x7effc4100f70 2023-10-07T00:05:30.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.861+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc41a0e80 con 0x7effc4100f70 2023-10-07T00:05:30.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.861+0000 7effc89c4700 1 -- 172.21.15.88:0/3146757078 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4004b30 con 0x7effc4100f70 2023-10-07T00:05:30.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.861+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc41a11e0 con 0x7effc4100f70 2023-10-07T00:05:30.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.862+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc410c670 con 0x7effc4100f70 2023-10-07T00:05:30.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.866+0000 7effc89c4700 1 -- 172.21.15.88:0/3146757078 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7effb4004c90 con 0x7effc4100f70 2023-10-07T00:05:30.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.867+0000 7effc89c4700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effac0a1470 0x7effac0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:30.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.868+0000 7effc89c4700 1 -- 172.21.15.88:0/3146757078 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7effb40cc480 con 0x7effc4100f70 2023-10-07T00:05:30.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.868+0000 7effc27fc700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effac0a1470 0x7effac0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:30.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.868+0000 7effc27fc700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effac0a1470 0x7effac0a3930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7effb8009c60 tx=0x7effb8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:05:30.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:30.870+0000 7effc89c4700 1 -- 172.21.15.88:0/3146757078 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7effb4097540 con 0x7effc4100f70 2023-10-07T00:05:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:31.071+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7effc4108ba0 con 0x7effac0a1470 2023-10-07T00:05:31.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:31.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:31.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:31.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:31.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:31.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:31.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:31.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:31.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:32.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:32 smithi005 ceph-mon[129406]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:32.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:32 smithi005 ceph-mon[129406]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:32 smithi088 ceph-mon[103111]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:32 smithi088 ceph-mon[103111]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:32 smithi112 ceph-mon[133548]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:32 smithi112 ceph-mon[133548]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:34 smithi088 ceph-mon[103111]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:34 smithi088 ceph-mon[103111]: from='client.? 172.21.15.88:0/2022550160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]: dispatch 2023-10-07T00:05:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:34 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]: dispatch 2023-10-07T00:05:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:34 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]': finished 2023-10-07T00:05:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:34 smithi088 ceph-mon[103111]: osdmap e10: 2 total, 1 up, 2 in 2023-10-07T00:05:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:34 smithi112 ceph-mon[133548]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:34 smithi112 ceph-mon[133548]: from='client.? 172.21.15.88:0/2022550160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]: dispatch 2023-10-07T00:05:34.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:34 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]: dispatch 2023-10-07T00:05:34.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:34 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]': finished 2023-10-07T00:05:34.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:34 smithi112 ceph-mon[133548]: osdmap e10: 2 total, 1 up, 2 in 2023-10-07T00:05:34.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:34 smithi005 ceph-mon[129406]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:34 smithi005 ceph-mon[129406]: from='client.? 172.21.15.88:0/2022550160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]: dispatch 2023-10-07T00:05:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:34 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]: dispatch 2023-10-07T00:05:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:34 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b42a81d-5935-43e5-8c4f-743744701183"}]': finished 2023-10-07T00:05:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:34 smithi005 ceph-mon[129406]: osdmap e10: 2 total, 1 up, 2 in 2023-10-07T00:05:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:35.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:35 smithi088 ceph-mon[103111]: from='client.? 172.21.15.88:0/3290388263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:05:35.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:35 smithi112 ceph-mon[133548]: from='client.? 172.21.15.88:0/3290388263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:05:36.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:35 smithi005 ceph-mon[129406]: from='client.? 172.21.15.88:0/3290388263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:05:36.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:36 smithi088 ceph-mon[103111]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:36 smithi112 ceph-mon[133548]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:36 smithi005 ceph-mon[129406]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:38.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:38 smithi088 ceph-mon[103111]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:38 smithi112 ceph-mon[133548]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:38 smithi005 ceph-mon[129406]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:40.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:40 smithi088 ceph-mon[103111]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:40.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:40 smithi005 ceph-mon[129406]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:40 smithi112 ceph-mon[133548]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:41.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:41 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-07T00:05:41.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:41 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:41.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:41 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-07T00:05:41.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:41 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:41.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:41 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-07T00:05:41.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:41 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:42.639 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:42 smithi088 ceph-mon[103111]: Deploying daemon osd.1 on smithi088 2023-10-07T00:05:42.639 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:42 smithi088 ceph-mon[103111]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:42.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:42 smithi005 ceph-mon[129406]: Deploying daemon osd.1 on smithi088 2023-10-07T00:05:42.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:42 smithi005 ceph-mon[129406]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:42 smithi112 ceph-mon[133548]: Deploying daemon osd.1 on smithi088 2023-10-07T00:05:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:42 smithi112 ceph-mon[133548]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:44.834 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:44 smithi088 ceph-mon[103111]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:44 smithi112 ceph-mon[133548]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:45.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:44 smithi005 ceph-mon[129406]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:46.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:46 smithi088 ceph-mon[103111]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:46.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:46 smithi112 ceph-mon[133548]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:47.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:46 smithi005 ceph-mon[129406]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:48.811 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:48.811 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:48.812 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:48.812 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:48 smithi088 ceph-mon[103111]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:48.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:48.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:48.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:48.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:48 smithi005 ceph-mon[129406]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:48 smithi112 ceph-mon[133548]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:50.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.797+0000 7effc89c4700 1 -- 172.21.15.88:0/3146757078 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7effc4108ba0 con 0x7effac0a1470 2023-10-07T00:05:50.799 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 1 on host 'smithi088' 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.799+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effac0a1470 msgr2=0x7effac0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.799+0000 7effc99c6700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effac0a1470 0x7effac0a3930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7effb8009c60 tx=0x7effb8009260 comp rx=0 tx=0).stop 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.799+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 msgr2=0x7effc4198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.799+0000 7effc99c6700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 0x7effc4198da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7effb4000c00 tx=0x7effb400fa00 comp rx=0 tx=0).stop 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.800+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 shutdown_connections 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.800+0000 7effc99c6700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effac0a1470 0x7effac0a3930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.800+0000 7effc99c6700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4102b10 0x7effc41a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.800+0000 7effc99c6700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100f70 0x7effc4198da0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.800+0000 7effc99c6700 1 --2- 172.21.15.88:0/3146757078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4102170 0x7effc41992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.800+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 >> 172.21.15.88:0/3146757078 conn(0x7effc40fc4d0 msgr2=0x7effc40fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:05:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.800+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 shutdown_connections 2023-10-07T00:05:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:05:50.800+0000 7effc99c6700 1 -- 172.21.15.88:0/3146757078 wait complete. 2023-10-07T00:05:50.824 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:50 smithi088 ceph-mon[103111]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:50.824 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:50.824 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:50.824 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:50.824 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:50.824 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:50.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:50 smithi005 ceph-mon[129406]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:50.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:50 smithi112 ceph-mon[133548]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:50.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:51.289 DEBUG:teuthology.orchestra.run.smithi088:osd.1> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-07T00:05:51.295 INFO:tasks.cephadm:Deploying osd.2 on smithi112 with /dev/vg_nvme/lv_4... 2023-10-07T00:05:51.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-07T00:05:51.372 INFO:journalctl@ceph.osd.1.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:05:51.702 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:05:51 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-1[108219]: 2023-10-07T00:05:51.533+0000 7f920e5d7640 -1 osd.1 0 log_to_monitors true 2023-10-07T00:05:52.003 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:52.003 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:52.003 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:52.003 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:51 smithi088 ceph-mon[103111]: from='osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-07T00:05:52.003 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:51 smithi088 ceph-mon[103111]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-07T00:05:52.030 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:05:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:51 smithi005 ceph-mon[129406]: from='osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-07T00:05:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:51 smithi005 ceph-mon[129406]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-07T00:05:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:05:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:51 smithi112 ceph-mon[133548]: from='osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-07T00:05:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:51 smithi112 ceph-mon[133548]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-07T00:05:52.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:52 smithi112 ceph-mon[133548]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:52.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:52 smithi112 ceph-mon[133548]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-07T00:05:52.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:52 smithi112 ceph-mon[133548]: osdmap e11: 2 total, 1 up, 2 in 2023-10-07T00:05:52.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:52.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:52 smithi112 ceph-mon[133548]: from='osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:05:52.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:52 smithi112 ceph-mon[133548]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:05:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:52 smithi005 ceph-mon[129406]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:52 smithi005 ceph-mon[129406]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-07T00:05:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:52 smithi005 ceph-mon[129406]: osdmap e11: 2 total, 1 up, 2 in 2023-10-07T00:05:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:52 smithi005 ceph-mon[129406]: from='osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:05:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:52 smithi005 ceph-mon[129406]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:05:53.203 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:05:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-1[108219]: 2023-10-07T00:05:52.775+0000 7f9203c4e700 -1 osd.1 0 waiting for initial osdmap 2023-10-07T00:05:53.203 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:05:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-1[108219]: 2023-10-07T00:05:52.781+0000 7f91fda3f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:05:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:52 smithi088 ceph-mon[103111]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:52 smithi088 ceph-mon[103111]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-07T00:05:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:52 smithi088 ceph-mon[103111]: osdmap e11: 2 total, 1 up, 2 in 2023-10-07T00:05:53.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:53.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:52 smithi088 ceph-mon[103111]: from='osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:05:53.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:52 smithi088 ceph-mon[103111]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:05:53.988 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-07T00:05:53.989 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-07T00:05:53.989 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2023-10-07T00:05:53.989 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2023-10-07T00:05:53.989 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0297114 s, 353 MB/s 2023-10-07T00:05:53.989 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2023-10-07T00:05:54.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:53 smithi005 ceph-mon[129406]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:05:54.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:53 smithi005 ceph-mon[129406]: osdmap e12: 2 total, 1 up, 2 in 2023-10-07T00:05:54.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:54.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:54.123 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:53 smithi088 ceph-mon[103111]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:05:54.124 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:53 smithi088 ceph-mon[103111]: osdmap e12: 2 total, 1 up, 2 in 2023-10-07T00:05:54.124 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:54.124 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:54.132 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:53 smithi112 ceph-mon[133548]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:05:54.132 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:53 smithi112 ceph-mon[133548]: osdmap e12: 2 total, 1 up, 2 in 2023-10-07T00:05:54.132 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:54.132 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:54.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2023-10-07T00:05:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:05:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:05:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] boot 2023-10-07T00:05:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: osdmap e13: 2 total, 2 up, 2 in 2023-10-07T00:05:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi088 2023-10-07T00:05:54.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:54.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:54.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:05:54.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi088 to 17267M 2023-10-07T00:05:54.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:54.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:54.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:54.955 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] boot 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: osdmap e13: 2 total, 2 up, 2 in 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi088 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:55.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:05:55.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi088 to 17267M 2023-10-07T00:05:55.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:55.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:55.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:55.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:55.231 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:05:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:05:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:05:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-07T00:05:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: osd.1 [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] boot 2023-10-07T00:05:55.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: osdmap e13: 2 total, 2 up, 2 in 2023-10-07T00:05:55.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-07T00:05:55.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi088 2023-10-07T00:05:55.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:55.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:55.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:05:55.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi088 to 17267M 2023-10-07T00:05:55.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:55.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:55.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:05:55.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:05:56.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:56 smithi005 ceph-mon[129406]: osdmap e14: 2 total, 2 up, 2 in 2023-10-07T00:05:56.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:56 smithi005 ceph-mon[129406]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:05:56.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.883+0000 7f79e70da700 1 -- 172.21.15.112:0/1772859958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0100f70 msgr2=0x7f79e0101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:56.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.883+0000 7f79e70da700 1 --2- 172.21.15.112:0/1772859958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0100f70 0x7f79e0101390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009990 tx=0x7f79d4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:05:56.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.883+0000 7f79e70da700 1 -- 172.21.15.112:0/1772859958 shutdown_connections 2023-10-07T00:05:56.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.883+0000 7f79e70da700 1 --2- 172.21.15.112:0/1772859958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e0102b10 0x7f79e01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:56.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.883+0000 7f79e70da700 1 --2- 172.21.15.112:0/1772859958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0100f70 0x7f79e0101390 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:56.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.883+0000 7f79e70da700 1 --2- 172.21.15.112:0/1772859958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0102170 0x7f79e01025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:56.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.883+0000 7f79e70da700 1 -- 172.21.15.112:0/1772859958 >> 172.21.15.112:0/1772859958 conn(0x7f79e00fc4d0 msgr2=0x7f79e00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:05:56.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.883+0000 7f79e70da700 1 -- 172.21.15.112:0/1772859958 shutdown_connections 2023-10-07T00:05:56.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.884+0000 7f79e70da700 1 -- 172.21.15.112:0/1772859958 wait complete. 2023-10-07T00:05:56.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e70da700 1 Processor -- start 2023-10-07T00:05:56.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e70da700 1 -- start start 2023-10-07T00:05:56.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e70da700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0100f70 0x7f79e0196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:56.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e70da700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e0102170 0x7f79e01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:56.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e70da700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0102b10 0x7f79e019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:56.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e70da700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e019e7b0 con 0x7f79e0102170 2023-10-07T00:05:56.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e70da700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e019e8f0 con 0x7f79e0100f70 2023-10-07T00:05:56.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e70da700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e019eab0 con 0x7f79e0102b10 2023-10-07T00:05:56.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e5677700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0102b10 0x7f79e019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:56.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e4e76700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0100f70 0x7f79e0196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:56.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e5677700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0102b10 0x7f79e019e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34112/0 (socket says 172.21.15.112:34112) 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79e5677700 1 -- 172.21.15.112:0/558458356 learned_addr learned my addr 172.21.15.112:0/558458356 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.885+0000 7f79dffff700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e0102170 0x7f79e01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79e5677700 1 -- 172.21.15.112:0/558458356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0100f70 msgr2=0x7f79e0196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79e5677700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0100f70 0x7f79e0196c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79e5677700 1 -- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e0102170 msgr2=0x7f79e01971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79e5677700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e0102170 0x7f79e01971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79e5677700 1 -- 172.21.15.112:0/558458356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40095f0 con 0x7f79e0102b10 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79e5677700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0102b10 0x7f79e019e1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f79d8007ee0 tx=0x7f79d800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79ddffb700 1 -- 172.21.15.112:0/558458356 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8017070 con 0x7f79e0102b10 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79ddffb700 1 -- 172.21.15.112:0/558458356 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79d800f040 con 0x7f79e0102b10 2023-10-07T00:05:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e019ed90 con 0x7f79e0102b10 2023-10-07T00:05:56.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79ddffb700 1 -- 172.21.15.112:0/558458356 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8005710 con 0x7f79e0102b10 2023-10-07T00:05:56.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.886+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e019f200 con 0x7f79e0102b10 2023-10-07T00:05:56.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.887+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e0108640 con 0x7f79e0102b10 2023-10-07T00:05:56.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.891+0000 7f79ddffb700 1 -- 172.21.15.112:0/558458356 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f79d8005870 con 0x7f79e0102b10 2023-10-07T00:05:56.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.892+0000 7f79ddffb700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f79d00a1470 0x7f79d00a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:05:56.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.892+0000 7f79ddffb700 1 -- 172.21.15.112:0/558458356 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f79d80cb370 con 0x7f79e0102b10 2023-10-07T00:05:56.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.893+0000 7f79e4e76700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f79d00a1470 0x7f79d00a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:05:56.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.893+0000 7f79e4e76700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f79d00a1470 0x7f79d00a3930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79d400b5c0 tx=0x7f79d4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:05:56.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:56.895+0000 7f79ddffb700 1 -- 172.21.15.112:0/558458356 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f79d8096180 con 0x7f79e0102b10 2023-10-07T00:05:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:56 smithi088 ceph-mon[103111]: osdmap e14: 2 total, 2 up, 2 in 2023-10-07T00:05:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:56 smithi088 ceph-mon[103111]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:05:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:56 smithi112 ceph-mon[133548]: osdmap e14: 2 total, 2 up, 2 in 2023-10-07T00:05:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:56 smithi112 ceph-mon[133548]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:05:57.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:05:57.101+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f79e010c6f0 con 0x7f79d00a1470 2023-10-07T00:05:57.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:57 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:57.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:57 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:57.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:57 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:57.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:57 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:57.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:57 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:57.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:57 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:57 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:05:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:57 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:05:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:57 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:05:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:58 smithi112 ceph-mon[133548]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:05:58 smithi112 ceph-mon[133548]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:05:58.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:58 smithi005 ceph-mon[129406]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:58.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:05:58 smithi005 ceph-mon[129406]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:05:58.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:58 smithi088 ceph-mon[103111]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:05:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:05:58 smithi088 ceph-mon[103111]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:00.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:00 smithi005 ceph-mon[129406]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:00.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:00 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/1104100248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]: dispatch 2023-10-07T00:06:00.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:00 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]: dispatch 2023-10-07T00:06:00.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:00 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]': finished 2023-10-07T00:06:00.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:00 smithi005 ceph-mon[129406]: osdmap e15: 3 total, 2 up, 3 in 2023-10-07T00:06:00.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:00.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:00 smithi088 ceph-mon[103111]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:00 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/1104100248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]: dispatch 2023-10-07T00:06:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:00 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]: dispatch 2023-10-07T00:06:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:00 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]': finished 2023-10-07T00:06:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:00 smithi088 ceph-mon[103111]: osdmap e15: 3 total, 2 up, 3 in 2023-10-07T00:06:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:00.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:00 smithi112 ceph-mon[133548]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:00 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/1104100248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]: dispatch 2023-10-07T00:06:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:00 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]: dispatch 2023-10-07T00:06:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:00 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30a1f350-e80f-4763-8656-377a6d1df25f"}]': finished 2023-10-07T00:06:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:00 smithi112 ceph-mon[133548]: osdmap e15: 3 total, 2 up, 3 in 2023-10-07T00:06:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:01.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:01 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/1651153171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:01.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:01 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/1651153171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:01 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/1651153171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:02.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:02 smithi005 ceph-mon[129406]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:02.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:02 smithi088 ceph-mon[103111]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:02.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:02 smithi112 ceph-mon[133548]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:04.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:04 smithi088 ceph-mon[103111]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:04 smithi112 ceph-mon[133548]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:05.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:04 smithi005 ceph-mon[129406]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:06.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:06 smithi088 ceph-mon[103111]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:06.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:06 smithi112 ceph-mon[133548]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:06 smithi005 ceph-mon[129406]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:07.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-07T00:06:07.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:07.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-07T00:06:07.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:08.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-07T00:06:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:08.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:08 smithi112 ceph-mon[133548]: Deploying daemon osd.2 on smithi112 2023-10-07T00:06:08.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:08 smithi112 ceph-mon[133548]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:08.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:08 smithi088 ceph-mon[103111]: Deploying daemon osd.2 on smithi112 2023-10-07T00:06:08.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:08 smithi088 ceph-mon[103111]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:08 smithi005 ceph-mon[129406]: Deploying daemon osd.2 on smithi112 2023-10-07T00:06:09.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:08 smithi005 ceph-mon[129406]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:10.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:10 smithi005 ceph-mon[129406]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:10.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:10 smithi088 ceph-mon[103111]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:10 smithi112 ceph-mon[133548]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:12.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:12 smithi112 ceph-mon[133548]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:12.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:12 smithi088 ceph-mon[103111]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:12 smithi005 ceph-mon[129406]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:14.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:14 smithi112 ceph-mon[133548]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:14.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:14.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:14.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:14.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:14 smithi088 ceph-mon[103111]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:14.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:14.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:14.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:14 smithi005 ceph-mon[129406]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:16.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:16 smithi088 ceph-mon[103111]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:16.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:16.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:16.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:16.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:16.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:16.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:16 smithi112 ceph-mon[133548]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:16.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:16.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:16.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:16.980 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:16.980 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:16 smithi005 ceph-mon[129406]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:17.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.386+0000 7f79ddffb700 1 -- 172.21.15.112:0/558458356 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f79e010c6f0 con 0x7f79d00a1470 2023-10-07T00:06:17.386 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 2 on host 'smithi112' 2023-10-07T00:06:17.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f79d00a1470 msgr2=0x7f79d00a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:17.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f79d00a1470 0x7f79d00a3930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79d400b5c0 tx=0x7f79d4005fb0 comp rx=0 tx=0).stop 2023-10-07T00:06:17.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0102b10 msgr2=0x7f79e019e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:17.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0102b10 0x7f79e019e1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f79d8007ee0 tx=0x7f79d800d3b0 comp rx=0 tx=0).stop 2023-10-07T00:06:17.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 shutdown_connections 2023-10-07T00:06:17.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f79d00a1470 0x7f79d00a3930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:17.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79e0102b10 0x7f79e019e1e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:17.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79e0100f70 0x7f79e0196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:17.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 --2- 172.21.15.112:0/558458356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e0102170 0x7f79e01971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:17.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 >> 172.21.15.112:0/558458356 conn(0x7f79e00fc4d0 msgr2=0x7f79e0105780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:06:17.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.388+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 shutdown_connections 2023-10-07T00:06:17.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:06:17.389+0000 7f79e70da700 1 -- 172.21.15.112:0/558458356 wait complete. 2023-10-07T00:06:17.953 DEBUG:teuthology.orchestra.run.smithi112:osd.2> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-07T00:06:17.958 INFO:tasks.cephadm:Deploying osd.3 on smithi005 with /dev/vg_nvme/lv_3... 2023-10-07T00:06:17.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-07T00:06:18.031 INFO:journalctl@ceph.osd.2.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:06:18.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:18.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:18.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:18.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:18 smithi005 ceph-mon[129406]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:18.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:18 smithi005 ceph-mon[129406]: from='osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-07T00:06:18.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:18 smithi005 ceph-mon[129406]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-07T00:06:18.609 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:18.609 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:18.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:18.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:18 smithi112 ceph-mon[133548]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:18.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:18 smithi112 ceph-mon[133548]: from='osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-07T00:06:18.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:18 smithi112 ceph-mon[133548]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-07T00:06:18.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:18 smithi088 ceph-mon[103111]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:18 smithi088 ceph-mon[103111]: from='osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-07T00:06:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:18 smithi088 ceph-mon[103111]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-07T00:06:18.707 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:06:19.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:19 smithi112 ceph-mon[133548]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-07T00:06:19.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:19 smithi112 ceph-mon[133548]: osdmap e16: 3 total, 2 up, 3 in 2023-10-07T00:06:19.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:19 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:19.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:19 smithi112 ceph-mon[133548]: from='osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:06:19.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:19 smithi112 ceph-mon[133548]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:06:19.498 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:19 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-2[139370]: 2023-10-07T00:06:19.366+0000 7f738c207700 -1 osd.2 0 waiting for initial osdmap 2023-10-07T00:06:19.498 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:19 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-2[139370]: 2023-10-07T00:06:19.372+0000 7f73857f7700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:06:19.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:19 smithi005 ceph-mon[129406]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-07T00:06:19.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:19 smithi005 ceph-mon[129406]: osdmap e16: 3 total, 2 up, 3 in 2023-10-07T00:06:19.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:19 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:19.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:19 smithi005 ceph-mon[129406]: from='osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:06:19.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:19 smithi005 ceph-mon[129406]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:06:19.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:19 smithi088 ceph-mon[103111]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-07T00:06:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:19 smithi088 ceph-mon[103111]: osdmap e16: 3 total, 2 up, 3 in 2023-10-07T00:06:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:19 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:19 smithi088 ceph-mon[103111]: from='osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:06:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:19 smithi088 ceph-mon[103111]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:06:20.584 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-07T00:06:20.584 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-07T00:06:20.584 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2023-10-07T00:06:20.584 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2023-10-07T00:06:20.584 INFO:teuthology.orchestra.run.smithi005.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0304444 s, 344 MB/s 2023-10-07T00:06:20.584 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2023-10-07T00:06:20.619 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:20 smithi005 ceph-mon[129406]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:06:20.620 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:20 smithi005 ceph-mon[129406]: osdmap e17: 3 total, 2 up, 3 in 2023-10-07T00:06:20.620 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:20.620 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:20.620 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:20 smithi005 ceph-mon[129406]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:20.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:20 smithi088 ceph-mon[103111]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:06:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:20 smithi088 ceph-mon[103111]: osdmap e17: 3 total, 2 up, 3 in 2023-10-07T00:06:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:20 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:20 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:20 smithi088 ceph-mon[103111]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:20.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:20 smithi112 ceph-mon[133548]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:06:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:20 smithi112 ceph-mon[133548]: osdmap e17: 3 total, 2 up, 3 in 2023-10-07T00:06:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:20 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:20 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:20 smithi112 ceph-mon[133548]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-07T00:06:21.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi005:vg_nvme/lv_3 2023-10-07T00:06:21.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:21 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:06:21.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:21 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:06:21.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:21 smithi088 ceph-mon[103111]: osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] boot 2023-10-07T00:06:21.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:21 smithi088 ceph-mon[103111]: osdmap e18: 3 total, 3 up, 3 in 2023-10-07T00:06:21.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:21.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:21 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:06:21.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:21 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:06:21.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:21 smithi112 ceph-mon[133548]: osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] boot 2023-10-07T00:06:21.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:21 smithi112 ceph-mon[133548]: osdmap e18: 3 total, 3 up, 3 in 2023-10-07T00:06:21.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:06:21.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:21 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:06:21.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:21 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:06:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:21 smithi005 ceph-mon[129406]: osd.2 [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] boot 2023-10-07T00:06:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:21 smithi005 ceph-mon[129406]: osdmap e18: 3 total, 3 up, 3 in 2023-10-07T00:06:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-07T00:06:22.646 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi112 2023-10-07T00:06:22.646 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.646 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi112 to 17267M 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: osdmap e19: 3 total, 3 up, 3 in 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: pgmap v85: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:22.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-07T00:06:22.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi112 2023-10-07T00:06:22.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:22.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi112 to 17267M 2023-10-07T00:06:22.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:22.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:22.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: osdmap e19: 3 total, 3 up, 3 in 2023-10-07T00:06:22.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: pgmap v85: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:22.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-07T00:06:22.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi112 2023-10-07T00:06:22.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi112 to 17267M 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: osdmap e19: 3 total, 3 up, 3 in 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: pgmap v85: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:22.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-07T00:06:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.319+0000 7f8614363700 1 -- 172.21.15.5:0/3571021458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102170 msgr2=0x7f860c1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.319+0000 7f8614363700 1 --2- 172.21.15.5:0/3571021458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102170 0x7f860c1025d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0099c0 tx=0x7f85fc009cd0 comp rx=0 tx=0).stop 2023-10-07T00:06:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.319+0000 7f8614363700 1 -- 172.21.15.5:0/3571021458 shutdown_connections 2023-10-07T00:06:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.319+0000 7f8614363700 1 --2- 172.21.15.5:0/3571021458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f860c102b10 0x7f860c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.319+0000 7f8614363700 1 --2- 172.21.15.5:0/3571021458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f860c100f70 0x7f860c101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.319+0000 7f8614363700 1 --2- 172.21.15.5:0/3571021458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102170 0x7f860c1025d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.320+0000 7f8614363700 1 -- 172.21.15.5:0/3571021458 >> 172.21.15.5:0/3571021458 conn(0x7f860c0fc4d0 msgr2=0x7f860c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:06:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.320+0000 7f8614363700 1 -- 172.21.15.5:0/3571021458 shutdown_connections 2023-10-07T00:06:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.320+0000 7f8614363700 1 -- 172.21.15.5:0/3571021458 wait complete. 2023-10-07T00:06:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.321+0000 7f8614363700 1 Processor -- start 2023-10-07T00:06:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.321+0000 7f8614363700 1 -- start start 2023-10-07T00:06:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.321+0000 7f8614363700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f860c100f70 0x7f860c196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:06:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.321+0000 7f8614363700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f860c102170 0x7f860c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:06:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.321+0000 7f8614363700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102b10 0x7f860c19e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:06:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.321+0000 7f8614363700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c19e730 con 0x7f860c102b10 2023-10-07T00:06:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.321+0000 7f8614363700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c19e870 con 0x7f860c102170 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.321+0000 7f8614363700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c19ea00 con 0x7f860c100f70 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102b10 0x7f860c19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102b10 0x7f860c19e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53132/0 (socket says 172.21.15.5:53132) 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 -- 172.21.15.5:0/2824039840 learned_addr learned my addr 172.21.15.5:0/2824039840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f86120ff700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f860c100f70 0x7f860c196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f86118fe700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f860c102170 0x7f860c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 -- 172.21.15.5:0/2824039840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f860c100f70 msgr2=0x7f860c196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f860c100f70 0x7f860c196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 -- 172.21.15.5:0/2824039840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f860c102170 msgr2=0x7f860c1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f860c102170 0x7f860c1970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 -- 172.21.15.5:0/2824039840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc0095f0 con 0x7f860c102b10 2023-10-07T00:06:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f8612900700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102b10 0x7f860c19e160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f860400ef60 tx=0x7f860400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:06:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.322+0000 7f86037fe700 1 -- 172.21.15.5:0/2824039840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604018070 con 0x7f860c102b10 2023-10-07T00:06:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.323+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c19ec80 con 0x7f860c102b10 2023-10-07T00:06:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.323+0000 7f86037fe700 1 -- 172.21.15.5:0/2824039840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f860400f040 con 0x7f860c102b10 2023-10-07T00:06:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.323+0000 7f86037fe700 1 -- 172.21.15.5:0/2824039840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400cc60 con 0x7f860c102b10 2023-10-07T00:06:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.323+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c19f180 con 0x7f860c102b10 2023-10-07T00:06:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.324+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c108640 con 0x7f860c102b10 2023-10-07T00:06:23.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.326+0000 7f86037fe700 1 -- 172.21.15.5:0/2824039840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f8604004ad0 con 0x7f860c102b10 2023-10-07T00:06:23.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.328+0000 7f86037fe700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f85f80a13f0 0x7f85f80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:06:23.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.329+0000 7f86037fe700 1 -- 172.21.15.5:0/2824039840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f86040cbd30 con 0x7f860c102b10 2023-10-07T00:06:23.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.329+0000 7f86120ff700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f85f80a13f0 0x7f85f80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:06:23.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.329+0000 7f86120ff700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f85f80a13f0 0x7f85f80a38b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f860c101fd0 tx=0x7f8608009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:06:23.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.332+0000 7f86037fe700 1 -- 172.21.15.5:0/2824039840 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8604096840 con 0x7f860c102b10 2023-10-07T00:06:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:23.549+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f860c02d2b0 con 0x7f85f80a13f0 2023-10-07T00:06:23.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:23 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-07T00:06:23.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:23 smithi005 ceph-mon[129406]: osdmap e20: 3 total, 3 up, 3 in 2023-10-07T00:06:23.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:23 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-07T00:06:23.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:23 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:06:23.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:23 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:06:23.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:23 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:23.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:23 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-07T00:06:23.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:23 smithi088 ceph-mon[103111]: osdmap e20: 3 total, 3 up, 3 in 2023-10-07T00:06:23.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:23 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-07T00:06:23.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:23 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:06:23.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:23 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:06:23.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:23 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:23.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:23 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-07T00:06:23.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:23 smithi112 ceph-mon[133548]: osdmap e20: 3 total, 3 up, 3 in 2023-10-07T00:06:23.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:23 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-07T00:06:23.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:23 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:06:23.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:23 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:06:23.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:23 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:24.578 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:06:24 smithi005 sudo[150135]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-07T00:06:24.579 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:06:24 smithi005 sudo[150135]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:24.579 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:06:24 smithi005 sudo[150135]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:24.579 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:06:24 smithi005 sudo[150135]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:24.859 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:06:24 smithi005 sudo[150193]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-07T00:06:24.859 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:06:24 smithi005 sudo[150193]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:24.859 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:06:24 smithi005 sudo[150193]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:24.859 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:06:24 smithi005 sudo[150193]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:24.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:24 smithi005 ceph-mon[129406]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:06:24.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-07T00:06:24.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:24 smithi005 ceph-mon[129406]: osdmap e21: 3 total, 3 up, 3 in 2023-10-07T00:06:24.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:24 smithi005 ceph-mon[129406]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:24.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:24 smithi088 ceph-mon[103111]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:06:24.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:24 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-07T00:06:24.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:24 smithi088 ceph-mon[103111]: osdmap e21: 3 total, 3 up, 3 in 2023-10-07T00:06:24.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:24 smithi088 ceph-mon[103111]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:24 smithi112 ceph-mon[133548]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:06:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:24 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-07T00:06:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:24 smithi112 ceph-mon[133548]: osdmap e21: 3 total, 3 up, 3 in 2023-10-07T00:06:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:24 smithi112 ceph-mon[133548]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:25.580 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:06:25 smithi088 sudo[112917]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-07T00:06:25.580 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:06:25 smithi088 sudo[112917]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:25.580 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:06:25 smithi088 sudo[112917]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:25.580 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:06:25 smithi088 sudo[112917]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:25.842 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:25 smithi088 ceph-mon[103111]: osdmap e22: 3 total, 3 up, 3 in 2023-10-07T00:06:25.842 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:25 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:25.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:25 smithi005 ceph-mon[129406]: osdmap e22: 3 total, 3 up, 3 in 2023-10-07T00:06:25.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:25 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:25.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:25 smithi112 ceph-mon[133548]: osdmap e22: 3 total, 3 up, 3 in 2023-10-07T00:06:25.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:25 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:26.202 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:06:25 smithi088 sudo[112920]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-07T00:06:26.203 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:06:25 smithi088 sudo[112920]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:26.203 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:06:25 smithi088 sudo[112920]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:26.203 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:06:25 smithi088 sudo[112920]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:26.594+0000 7f86037fe700 1 -- 172.21.15.5:0/2824039840 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8604096c10 con 0x7f860c102b10 2023-10-07T00:06:26.747 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:26 smithi112 sudo[144455]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-07T00:06:26.747 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:26 smithi112 sudo[144455]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:26.747 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:26 smithi112 sudo[144455]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:26.747 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:26 smithi112 sudo[144455]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:26.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:26 smithi112 ceph-mon[133548]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:26.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:26.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:26 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/234423557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f"}]: dispatch 2023-10-07T00:06:26.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:26 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/234423557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f"}]': finished 2023-10-07T00:06:26.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:26 smithi112 ceph-mon[133548]: osdmap e23: 4 total, 3 up, 4 in 2023-10-07T00:06:26.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:26.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:26 smithi005 ceph-mon[129406]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:26.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:26.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:26 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/234423557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f"}]: dispatch 2023-10-07T00:06:26.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:26 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/234423557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f"}]': finished 2023-10-07T00:06:26.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:26 smithi005 ceph-mon[129406]: osdmap e23: 4 total, 3 up, 4 in 2023-10-07T00:06:26.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:26.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:26 smithi088 ceph-mon[103111]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:26.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:26.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:26 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/234423557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f"}]: dispatch 2023-10-07T00:06:26.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:26 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/234423557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f"}]': finished 2023-10-07T00:06:26.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:26 smithi088 ceph-mon[103111]: osdmap e23: 4 total, 3 up, 4 in 2023-10-07T00:06:26.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:27.248 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:26 smithi112 sudo[144458]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-07T00:06:27.248 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:26 smithi112 sudo[144458]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:27.248 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:26 smithi112 sudo[144458]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:27.248 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:06:26 smithi112 sudo[144458]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:27.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:27 smithi005 sudo[150353]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-07T00:06:27.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:27 smithi005 sudo[150353]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:27.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:27 smithi005 sudo[150353]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:27.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:27 smithi005 sudo[150353]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:28.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:28 smithi005 sudo[150356]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-07T00:06:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:28 smithi005 sudo[150356]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:28 smithi005 sudo[150356]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:28 smithi005 sudo[150356]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:28 smithi005 ceph-mon[129406]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-07T00:06:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:28 smithi005 ceph-mon[129406]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:28.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:28 smithi088 ceph-mon[103111]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-07T00:06:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:28 smithi088 ceph-mon[103111]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:28.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:28 smithi112 ceph-mon[133548]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-07T00:06:28.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:28.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:28 smithi112 ceph-mon[133548]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:28 smithi112 sudo[144461]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-07T00:06:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:28 smithi112 sudo[144461]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:28 smithi112 sudo[144461]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:28 smithi112 sudo[144461]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:29.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2756824728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: pgmap v92: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:29.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:29.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 sudo[144464]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-07T00:06:29.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 sudo[144464]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:29.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 sudo[144464]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 sudo[144464]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2756824728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: pgmap v92: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:29.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:29.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:29.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:29 smithi088 sudo[112923]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-07T00:06:29.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:29 smithi088 sudo[112923]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:29.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:29 smithi088 sudo[112923]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:29.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:29 smithi088 sudo[112923]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:30 smithi005 ceph-mon[129406]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:30 smithi005 ceph-mon[129406]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:30.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:30.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:30.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:30 smithi005 ceph-mon[129406]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 313 KiB/s wr, 19 op/s 2023-10-07T00:06:30.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 sudo[112926]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-07T00:06:30.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 sudo[112926]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-07T00:06:30.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 sudo[112926]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-07T00:06:30.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 sudo[112926]: pam_unix(sudo:session): session closed for user root 2023-10-07T00:06:30.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2756824728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:30.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: pgmap v92: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:30.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:30.455 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:30.455 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:30 smithi088 ceph-mon[103111]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 313 KiB/s wr, 19 op/s 2023-10-07T00:06:30.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:30 smithi112 ceph-mon[133548]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:30.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:30 smithi112 ceph-mon[133548]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:30.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:30 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-07T00:06:30.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:30 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-07T00:06:30.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:30 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-07T00:06:30.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:30 smithi112 ceph-mon[133548]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 313 KiB/s wr, 19 op/s 2023-10-07T00:06:31.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:31 smithi005 ceph-mon[129406]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:31.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:31 smithi005 ceph-mon[129406]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:31.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:31 smithi088 ceph-mon[103111]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:31.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:31 smithi088 ceph-mon[103111]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:31.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:31 smithi112 ceph-mon[133548]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-07T00:06:31.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:31 smithi112 ceph-mon[133548]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-07T00:06:32.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:32 smithi005 ceph-mon[129406]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-10-07T00:06:32.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:32 smithi088 ceph-mon[103111]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-10-07T00:06:32.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:32 smithi112 ceph-mon[133548]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-10-07T00:06:34.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:34 smithi088 ceph-mon[103111]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-10-07T00:06:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-07T00:06:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:34 smithi112 ceph-mon[133548]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-10-07T00:06:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-07T00:06:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:35.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:34 smithi005 ceph-mon[129406]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-10-07T00:06:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-07T00:06:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:35.926 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:35 smithi005 ceph-mon[129406]: Deploying daemon osd.3 on smithi005 2023-10-07T00:06:35.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:35 smithi088 ceph-mon[103111]: Deploying daemon osd.3 on smithi005 2023-10-07T00:06:35.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:35 smithi112 ceph-mon[133548]: Deploying daemon osd.3 on smithi005 2023-10-07T00:06:36.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:36 smithi005 ceph-mon[129406]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-07T00:06:36.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:36 smithi088 ceph-mon[103111]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-07T00:06:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:36 smithi112 ceph-mon[133548]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-07T00:06:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:38 smithi088 ceph-mon[103111]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-10-07T00:06:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:38 smithi112 ceph-mon[133548]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-10-07T00:06:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:38 smithi005 ceph-mon[129406]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-10-07T00:06:40.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:40 smithi005 ceph-mon[129406]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-07T00:06:40.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:40 smithi088 ceph-mon[103111]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-07T00:06:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:40 smithi112 ceph-mon[133548]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-07T00:06:41.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:41 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:41.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:41 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:41.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:41 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:41.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:41 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:41.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:41 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:41.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:41 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:41.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:41 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:41.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:41 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:41.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:41 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:42.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:42 smithi005 ceph-mon[129406]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-07T00:06:42.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:42 smithi088 ceph-mon[103111]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-07T00:06:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:42 smithi112 ceph-mon[133548]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-07T00:06:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.170+0000 7f86037fe700 1 -- 172.21.15.5:0/2824039840 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f860c02d2b0 con 0x7f85f80a13f0 2023-10-07T00:06:44.172 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 3 on host 'smithi005' 2023-10-07T00:06:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f85f80a13f0 msgr2=0x7f85f80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f85f80a13f0 0x7f85f80a38b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f860c101fd0 tx=0x7f8608009260 comp rx=0 tx=0).stop 2023-10-07T00:06:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102b10 msgr2=0x7f860c19e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102b10 0x7f860c19e160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f860400ef60 tx=0x7f860400ef90 comp rx=0 tx=0).stop 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 shutdown_connections 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f85f80a13f0 0x7f85f80a38b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c102b10 0x7f860c19e160 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f860c100f70 0x7f860c196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 --2- 172.21.15.5:0/2824039840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f860c102170 0x7f860c1970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 >> 172.21.15.5:0/2824039840 conn(0x7f860c0fc4d0 msgr2=0x7f860c105780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 shutdown_connections 2023-10-07T00:06:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:06:44.175+0000 7f8614363700 1 -- 172.21.15.5:0/2824039840 wait complete. 2023-10-07T00:06:44.767 DEBUG:teuthology.orchestra.run.smithi005:osd.3> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-07T00:06:44.772 INFO:tasks.cephadm:Deploying osd.4 on smithi088 with /dev/vg_nvme/lv_3... 2023-10-07T00:06:44.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-07T00:06:44.849 INFO:journalctl@ceph.osd.3.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:06:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:44 smithi112 ceph-mon[133548]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-07T00:06:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-07T00:06:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:45.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:44 smithi005 ceph-mon[129406]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-07T00:06:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-07T00:06:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:06:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:44 smithi088 ceph-mon[103111]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-07T00:06:45.502 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:06:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:46 smithi005 ceph-mon[129406]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-07T00:06:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:46 smithi005 ceph-mon[129406]: osdmap e24: 4 total, 3 up, 4 in 2023-10-07T00:06:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:46 smithi005 ceph-mon[129406]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:06:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:46 smithi005 ceph-mon[129406]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:46.609 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:06:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3[152539]: 2023-10-07T00:06:46.574+0000 7f21b4c3d700 -1 osd.3 0 waiting for initial osdmap 2023-10-07T00:06:46.610 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:06:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3[152539]: 2023-10-07T00:06:46.581+0000 7f21ada2c700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:06:46.827 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:46 smithi088 ceph-mon[103111]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-07T00:06:46.828 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:46 smithi088 ceph-mon[103111]: osdmap e24: 4 total, 3 up, 4 in 2023-10-07T00:06:46.828 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:46 smithi088 ceph-mon[103111]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:06:46.828 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:46.828 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:46 smithi088 ceph-mon[103111]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:46 smithi112 ceph-mon[133548]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-07T00:06:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:46 smithi112 ceph-mon[133548]: osdmap e24: 4 total, 3 up, 4 in 2023-10-07T00:06:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:46 smithi112 ceph-mon[133548]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:06:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:46 smithi112 ceph-mon[133548]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-07T00:06:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-07T00:06:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-07T00:06:47.500 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2023-10-07T00:06:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2023-10-07T00:06:47.500 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0390388 s, 269 MB/s 2023-10-07T00:06:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2023-10-07T00:06:47.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:47 smithi005 ceph-mon[129406]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:06:47.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:47 smithi005 ceph-mon[129406]: osdmap e25: 4 total, 3 up, 4 in 2023-10-07T00:06:47.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:47 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:47.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:47 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:47.941 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:47 smithi088 ceph-mon[103111]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:06:47.942 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:47 smithi088 ceph-mon[103111]: osdmap e25: 4 total, 3 up, 4 in 2023-10-07T00:06:47.942 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:47 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:47.942 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:47 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:47.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi088:vg_nvme/lv_3 2023-10-07T00:06:47.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:47 smithi112 ceph-mon[133548]: from='osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:06:47.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:47 smithi112 ceph-mon[133548]: osdmap e25: 4 total, 3 up, 4 in 2023-10-07T00:06:47.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:47 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:47.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:47 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:48.704 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:06:48.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:06:48.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:06:48.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] boot 2023-10-07T00:06:48.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: osdmap e26: 4 total, 4 up, 4 in 2023-10-07T00:06:48.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:48.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:06:48.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] boot 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: osdmap e26: 4 total, 4 up, 4 in 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:48.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:48.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: osd.3 [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] boot 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: osdmap e26: 4 total, 4 up, 4 in 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:06:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:48.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:48.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:06:48.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:06:49.857 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:49 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi005 2023-10-07T00:06:49.857 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:49 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi005 to 8636M 2023-10-07T00:06:49.857 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:49 smithi088 ceph-mon[103111]: osdmap e27: 4 total, 4 up, 4 in 2023-10-07T00:06:49.858 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:49 smithi088 ceph-mon[103111]: osdmap e28: 4 total, 4 up, 4 in 2023-10-07T00:06:49.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:49 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi005 2023-10-07T00:06:49.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:49 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi005 to 8636M 2023-10-07T00:06:49.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:49 smithi005 ceph-mon[129406]: osdmap e27: 4 total, 4 up, 4 in 2023-10-07T00:06:49.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:49 smithi005 ceph-mon[129406]: osdmap e28: 4 total, 4 up, 4 in 2023-10-07T00:06:49.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:49 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi005 2023-10-07T00:06:49.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:49 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi005 to 8636M 2023-10-07T00:06:49.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:49 smithi112 ceph-mon[133548]: osdmap e27: 4 total, 4 up, 4 in 2023-10-07T00:06:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:49 smithi112 ceph-mon[133548]: osdmap e28: 4 total, 4 up, 4 in 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 -- 172.21.15.88:0/4152647475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 msgr2=0x7fd6b4101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/4152647475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 0x7fd6b4101390 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00099c0 tx=0x7fd6b0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 -- 172.21.15.88:0/4152647475 shutdown_connections 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/4152647475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6b4102b10 0x7fd6b41093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/4152647475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 0x7fd6b4101390 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/4152647475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b4102170 0x7fd6b41025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 -- 172.21.15.88:0/4152647475 >> 172.21.15.88:0/4152647475 conn(0x7fd6b40fc4d0 msgr2=0x7fd6b40fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 -- 172.21.15.88:0/4152647475 shutdown_connections 2023-10-07T00:06:50.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.100+0000 7fd6bb58e700 1 -- 172.21.15.88:0/4152647475 wait complete. 2023-10-07T00:06:50.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.101+0000 7fd6bb58e700 1 Processor -- start 2023-10-07T00:06:50.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6bb58e700 1 -- start start 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6bb58e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 0x7fd6b4196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6bb58e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6b4102170 0x7fd6b4197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6bb58e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b4102b10 0x7fd6b419e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6bb58e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b419e790 con 0x7fd6b4102b10 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6bb58e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b419e8d0 con 0x7fd6b4100f70 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6bb58e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b419ea90 con 0x7fd6b4102170 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6b932a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 0x7fd6b4196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6b932a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 0x7fd6b4196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:32784/0 (socket says 172.21.15.88:32784) 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.102+0000 7fd6b932a700 1 -- 172.21.15.88:0/2019133179 learned_addr learned my addr 172.21.15.88:0/2019133179 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-07T00:06:50.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b9b2b700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b4102b10 0x7fd6b419e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b8b29700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6b4102170 0x7fd6b4197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b932a700 1 -- 172.21.15.88:0/2019133179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6b4102170 msgr2=0x7fd6b4197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b932a700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6b4102170 0x7fd6b4197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b932a700 1 -- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b4102b10 msgr2=0x7fd6b419e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b932a700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b4102b10 0x7fd6b419e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b932a700 1 -- 172.21.15.88:0/2019133179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b00095f0 con 0x7fd6b4100f70 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b8b29700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6b4102170 0x7fd6b4197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6b932a700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 0x7fd6b4196c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009f50 tx=0x7fd6b0003b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6aa7fc700 1 -- 172.21.15.88:0/2019133179 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b001d070 con 0x7fd6b4100f70 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6aa7fc700 1 -- 172.21.15.88:0/2019133179 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6b000bda0 con 0x7fd6b4100f70 2023-10-07T00:06:50.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b419ed10 con 0x7fd6b4100f70 2023-10-07T00:06:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6aa7fc700 1 -- 172.21.15.88:0/2019133179 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0022e40 con 0x7fd6b4100f70 2023-10-07T00:06:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.103+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b419f120 con 0x7fd6b4100f70 2023-10-07T00:06:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.104+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b4108670 con 0x7fd6b4100f70 2023-10-07T00:06:50.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.106+0000 7fd6aa7fc700 1 -- 172.21.15.88:0/2019133179 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd6b00225e0 con 0x7fd6b4100f70 2023-10-07T00:06:50.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.108+0000 7fd6aa7fc700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6a00a1480 0x7fd6a00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:06:50.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.108+0000 7fd6aa7fc700 1 -- 172.21.15.88:0/2019133179 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3698+0+0 (secure 0 0 0) 0x7fd6b00cd750 con 0x7fd6b4100f70 2023-10-07T00:06:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.108+0000 7fd6b8b29700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6a00a1480 0x7fd6a00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:06:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.109+0000 7fd6b8b29700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6a00a1480 0x7fd6a00a3940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4005d90 tx=0x7fd6a4005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:06:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.111+0000 7fd6aa7fc700 1 -- 172.21.15.88:0/2019133179 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6b0097fa0 con 0x7fd6b4100f70 2023-10-07T00:06:50.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:06:50.316+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6b402d210 con 0x7fd6a00a1480 2023-10-07T00:06:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:50 smithi005 ceph-mon[129406]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:06:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:06:50.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:50.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:50 smithi088 ceph-mon[103111]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:50.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:06:50.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:06:50.955 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:50.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:50 smithi112 ceph-mon[133548]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:06:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:06:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:06:51.690 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:51 smithi088 ceph-mon[103111]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:06:51.691 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:51 smithi088 ceph-mon[103111]: osdmap e29: 4 total, 4 up, 4 in 2023-10-07T00:06:51.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:51 smithi005 ceph-mon[129406]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:06:51.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:51 smithi005 ceph-mon[129406]: osdmap e29: 4 total, 4 up, 4 in 2023-10-07T00:06:51.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:51 smithi112 ceph-mon[133548]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:06:51.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:51 smithi112 ceph-mon[133548]: osdmap e29: 4 total, 4 up, 4 in 2023-10-07T00:06:52.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:52 smithi088 ceph-mon[103111]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:52.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:52 smithi088 ceph-mon[103111]: osdmap e30: 4 total, 4 up, 4 in 2023-10-07T00:06:52.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:52 smithi005 ceph-mon[129406]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:52.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:52 smithi005 ceph-mon[129406]: osdmap e30: 4 total, 4 up, 4 in 2023-10-07T00:06:52.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:52 smithi112 ceph-mon[133548]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:52.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:52 smithi112 ceph-mon[133548]: osdmap e30: 4 total, 4 up, 4 in 2023-10-07T00:06:53.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:53 smithi005 ceph-mon[129406]: from='client.? 172.21.15.88:0/1709991411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]: dispatch 2023-10-07T00:06:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:53 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]: dispatch 2023-10-07T00:06:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:53 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]': finished 2023-10-07T00:06:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:53 smithi005 ceph-mon[129406]: osdmap e31: 5 total, 4 up, 5 in 2023-10-07T00:06:53.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:06:53.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:53 smithi088 ceph-mon[103111]: from='client.? 172.21.15.88:0/1709991411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]: dispatch 2023-10-07T00:06:53.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:53 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]: dispatch 2023-10-07T00:06:53.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:53 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]': finished 2023-10-07T00:06:53.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:53 smithi088 ceph-mon[103111]: osdmap e31: 5 total, 4 up, 5 in 2023-10-07T00:06:53.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:06:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:53 smithi112 ceph-mon[133548]: from='client.? 172.21.15.88:0/1709991411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]: dispatch 2023-10-07T00:06:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:53 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]: dispatch 2023-10-07T00:06:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:53 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b07843b0-41cf-41ce-8b9a-18d7ed18b507"}]': finished 2023-10-07T00:06:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:53 smithi112 ceph-mon[133548]: osdmap e31: 5 total, 4 up, 5 in 2023-10-07T00:06:53.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:06:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:54 smithi088 ceph-mon[103111]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:54 smithi088 ceph-mon[103111]: from='client.? 172.21.15.88:0/3121940448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:54.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:54 smithi112 ceph-mon[133548]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:54.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:54 smithi112 ceph-mon[133548]: from='client.? 172.21.15.88:0/3121940448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:54 smithi005 ceph-mon[129406]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:06:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:54 smithi005 ceph-mon[129406]: from='client.? 172.21.15.88:0/3121940448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:06:56.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:56 smithi088 ceph-mon[103111]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:06:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:56 smithi112 ceph-mon[133548]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:06:57.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:56 smithi005 ceph-mon[129406]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:06:58.885 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:06:58 smithi088 ceph-mon[103111]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-07T00:06:58.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:06:58 smithi112 ceph-mon[133548]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-07T00:06:59.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:06:58 smithi005 ceph-mon[129406]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-07T00:07:00.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:00 smithi088 ceph-mon[103111]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:07:00.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:00 smithi005 ceph-mon[129406]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:07:00.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:00 smithi112 ceph-mon[133548]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:07:01.844 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:01 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-07T00:07:01.844 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:01 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:01.844 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:01 smithi088 ceph-mon[103111]: Deploying daemon osd.4 on smithi088 2023-10-07T00:07:01.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-07T00:07:01.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:01.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:01 smithi005 ceph-mon[129406]: Deploying daemon osd.4 on smithi088 2023-10-07T00:07:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:01 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-07T00:07:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:01 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:01 smithi112 ceph-mon[133548]: Deploying daemon osd.4 on smithi088 2023-10-07T00:07:02.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:02 smithi005 ceph-mon[129406]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-07T00:07:02.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:02 smithi088 ceph-mon[103111]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-07T00:07:02.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:02 smithi112 ceph-mon[133548]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-07T00:07:04.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:04 smithi088 ceph-mon[103111]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-07T00:07:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:04 smithi112 ceph-mon[133548]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-07T00:07:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:04 smithi005 ceph-mon[129406]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-07T00:07:06.860 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:06 smithi088 ceph-mon[103111]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-07T00:07:06.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:06 smithi112 ceph-mon[133548]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-07T00:07:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:06 smithi005 ceph-mon[129406]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-07T00:07:08.189 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:08.189 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:08.189 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:08.190 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:07 smithi088 ceph-mon[103111]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:08.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:08.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:08.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:08.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:07 smithi112 ceph-mon[133548]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:08.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:08.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:08.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:08.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:07 smithi005 ceph-mon[129406]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:10.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.241+0000 7fd6aa7fc700 1 -- 172.21.15.88:0/2019133179 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd6b402d210 con 0x7fd6a00a1480 2023-10-07T00:07:10.244 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 4 on host 'smithi088' 2023-10-07T00:07:10.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6a00a1480 msgr2=0x7fd6a00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:10.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6a00a1480 0x7fd6a00a3940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4005d90 tx=0x7fd6a4005d00 comp rx=0 tx=0).stop 2023-10-07T00:07:10.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 msgr2=0x7fd6b4196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:10.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 0x7fd6b4196c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009f50 tx=0x7fd6b0003b00 comp rx=0 tx=0).stop 2023-10-07T00:07:10.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 shutdown_connections 2023-10-07T00:07:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6a00a1480 0x7fd6a00a3940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b4102b10 0x7fd6b419e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b4100f70 0x7fd6b4196c40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 --2- 172.21.15.88:0/2019133179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6b4102170 0x7fd6b4197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 >> 172.21.15.88:0/2019133179 conn(0x7fd6b40fc4d0 msgr2=0x7fd6b41057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:07:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 shutdown_connections 2023-10-07T00:07:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:07:10.244+0000 7fd6bb58e700 1 -- 172.21.15.88:0/2019133179 wait complete. 2023-10-07T00:07:10.725 DEBUG:teuthology.orchestra.run.smithi088:osd.4> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-07T00:07:10.729 INFO:tasks.cephadm:Deploying osd.5 on smithi112 with /dev/vg_nvme/lv_3... 2023-10-07T00:07:10.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-07T00:07:10.822 INFO:journalctl@ceph.osd.4.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:07:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:10.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:11.204 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:07:10 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4[116032]: 2023-10-07T00:07:10.913+0000 7f5a47ab2640 -1 osd.4 0 log_to_monitors true 2023-10-07T00:07:11.490 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:07:11.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:11 smithi112 ceph-mon[133548]: from='osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-07T00:07:11.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:11 smithi112 ceph-mon[133548]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-07T00:07:12.057 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:11 smithi088 ceph-mon[103111]: from='osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-07T00:07:12.057 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:11 smithi088 ceph-mon[103111]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-07T00:07:12.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:11 smithi005 ceph-mon[129406]: from='osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-07T00:07:12.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:11 smithi005 ceph-mon[129406]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-07T00:07:12.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:12 smithi112 ceph-mon[133548]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:12 smithi112 ceph-mon[133548]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-07T00:07:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:12 smithi112 ceph-mon[133548]: from='osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:07:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:12 smithi112 ceph-mon[133548]: osdmap e32: 5 total, 4 up, 5 in 2023-10-07T00:07:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:12 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:12 smithi112 ceph-mon[133548]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:07:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:12 smithi005 ceph-mon[129406]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:12 smithi005 ceph-mon[129406]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-07T00:07:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:12 smithi005 ceph-mon[129406]: from='osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:07:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:12 smithi005 ceph-mon[129406]: osdmap e32: 5 total, 4 up, 5 in 2023-10-07T00:07:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:12 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:12 smithi005 ceph-mon[129406]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:07:13.203 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:07:12 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4[116032]: 2023-10-07T00:07:12.734+0000 7f5a3d129700 -1 osd.4 0 waiting for initial osdmap 2023-10-07T00:07:13.203 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:07:12 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4[116032]: 2023-10-07T00:07:12.743+0000 7f5a3771b700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:07:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:12 smithi088 ceph-mon[103111]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:12 smithi088 ceph-mon[103111]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-07T00:07:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:12 smithi088 ceph-mon[103111]: from='osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:07:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:12 smithi088 ceph-mon[103111]: osdmap e32: 5 total, 4 up, 5 in 2023-10-07T00:07:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:12 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:12 smithi088 ceph-mon[103111]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:07:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-07T00:07:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-07T00:07:13.465 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2023-10-07T00:07:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2023-10-07T00:07:13.466 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0298357 s, 351 MB/s 2023-10-07T00:07:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2023-10-07T00:07:13.864 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:13 smithi112 ceph-mon[133548]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:07:13.864 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:13 smithi112 ceph-mon[133548]: osdmap e33: 5 total, 4 up, 5 in 2023-10-07T00:07:13.864 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:13 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:13.864 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:13 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:13.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2023-10-07T00:07:13.994 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:13 smithi088 ceph-mon[103111]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:07:13.994 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:13 smithi088 ceph-mon[103111]: osdmap e33: 5 total, 4 up, 5 in 2023-10-07T00:07:13.994 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:13 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:13.994 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:13 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:14.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:13 smithi005 ceph-mon[129406]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:07:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:13 smithi005 ceph-mon[129406]: osdmap e33: 5 total, 4 up, 5 in 2023-10-07T00:07:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:13 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:13 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:14.688 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:07:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:07:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:07:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] boot 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: osdmap e34: 5 total, 5 up, 5 in 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:14.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:14.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] boot 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: osdmap e34: 5 total, 5 up, 5 in 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:07:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: osd.4 [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] boot 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: osdmap e34: 5 total, 5 up, 5 in 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:15.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:15.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:15.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:15 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi088 2023-10-07T00:07:15.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:15 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi088 to 8633M 2023-10-07T00:07:15.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:15 smithi112 ceph-mon[133548]: osdmap e35: 5 total, 5 up, 5 in 2023-10-07T00:07:16.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:15 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi088 2023-10-07T00:07:16.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:15 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi088 to 8633M 2023-10-07T00:07:16.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:15 smithi005 ceph-mon[129406]: osdmap e35: 5 total, 5 up, 5 in 2023-10-07T00:07:16.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:15 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi088 2023-10-07T00:07:16.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:15 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi088 to 8633M 2023-10-07T00:07:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:15 smithi088 ceph-mon[103111]: osdmap e35: 5 total, 5 up, 5 in 2023-10-07T00:07:16.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.297+0000 7fb6aec3d700 1 -- 172.21.15.112:0/3131815449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8100f70 msgr2=0x7fb6a8101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:16.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.297+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/3131815449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8100f70 0x7fb6a8101390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009990 tx=0x7fb69c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:07:16.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.298+0000 7fb6aec3d700 1 -- 172.21.15.112:0/3131815449 shutdown_connections 2023-10-07T00:07:16.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.298+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/3131815449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a8102b10 0x7fb6a81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:16.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.298+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/3131815449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8100f70 0x7fb6a8101390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:16.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.298+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/3131815449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a8102170 0x7fb6a81025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:16.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.298+0000 7fb6aec3d700 1 -- 172.21.15.112:0/3131815449 >> 172.21.15.112:0/3131815449 conn(0x7fb6a80fc4d0 msgr2=0x7fb6a80fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:07:16.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.298+0000 7fb6aec3d700 1 -- 172.21.15.112:0/3131815449 shutdown_connections 2023-10-07T00:07:16.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.298+0000 7fb6aec3d700 1 -- 172.21.15.112:0/3131815449 wait complete. 2023-10-07T00:07:16.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6aec3d700 1 Processor -- start 2023-10-07T00:07:16.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6aec3d700 1 -- start start 2023-10-07T00:07:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6aec3d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a8100f70 0x7fb6a8074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:07:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6aec3d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8102170 0x7fb6a80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:07:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6aec3d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a8102b10 0x7fb6a80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:07:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6aec3d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8073f60 con 0x7fb6a8102b10 2023-10-07T00:07:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6aec3d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80740d0 con 0x7fb6a8100f70 2023-10-07T00:07:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6aec3d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a81a0c30 con 0x7fb6a8102170 2023-10-07T00:07:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6a7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8102170 0x7fb6a80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:07:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6a7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8102170 0x7fb6a80732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57444/0 (socket says 172.21.15.112:57444) 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.299+0000 7fb6a7fff700 1 -- 172.21.15.112:0/1805978847 learned_addr learned my addr 172.21.15.112:0/1805978847 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6ad1da700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a8102b10 0x7fb6a80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6ac9d9700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a8100f70 0x7fb6a8074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a7fff700 1 -- 172.21.15.112:0/1805978847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a8100f70 msgr2=0x7fb6a8074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a7fff700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a8100f70 0x7fb6a8074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a7fff700 1 -- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a8102b10 msgr2=0x7fb6a80737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a7fff700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a8102b10 0x7fb6a80737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a7fff700 1 -- 172.21.15.112:0/1805978847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0095f0 con 0x7fb6a8102170 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6ad1da700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a8102b10 0x7fb6a80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:07:16.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a7fff700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8102170 0x7fb6a80732a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb69400d950 tx=0x7fb69400dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:07:16.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a5ffb700 1 -- 172.21.15.112:0/1805978847 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694009b40 con 0x7fb6a8102170 2023-10-07T00:07:16.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a5ffb700 1 -- 172.21.15.112:0/1805978847 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb694009ca0 con 0x7fb6a8102170 2023-10-07T00:07:16.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a81a0f10 con 0x7fb6a8102170 2023-10-07T00:07:16.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.300+0000 7fb6a5ffb700 1 -- 172.21.15.112:0/1805978847 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69400f620 con 0x7fb6a8102170 2023-10-07T00:07:16.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.301+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a81a1380 con 0x7fb6a8102170 2023-10-07T00:07:16.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.302+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a810c670 con 0x7fb6a8102170 2023-10-07T00:07:16.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.303+0000 7fb6a5ffb700 1 -- 172.21.15.112:0/1805978847 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb694010460 con 0x7fb6a8102170 2023-10-07T00:07:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.305+0000 7fb6a5ffb700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb6980a1480 0x7fb6980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:07:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.305+0000 7fb6a5ffb700 1 -- 172.21.15.112:0/1805978847 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fb6940cc080 con 0x7fb6a8102170 2023-10-07T00:07:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.305+0000 7fb6ac9d9700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb6980a1480 0x7fb6980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:07:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.306+0000 7fb6ac9d9700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb6980a1480 0x7fb6980a3940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00b2e0 tx=0x7fb69c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:07:16.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.309+0000 7fb6a5ffb700 1 -- 172.21.15.112:0/1805978847 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb6940ff100 con 0x7fb6a8102170 2023-10-07T00:07:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:16.512+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6a80612f0 con 0x7fb6980a1480 2023-10-07T00:07:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:16 smithi005 ceph-mon[129406]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:07:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:07:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:16 smithi088 ceph-mon[103111]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:07:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:07:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:16 smithi112 ceph-mon[133548]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:07:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:07:17.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:17.903 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:17 smithi112 ceph-mon[133548]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:07:18.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:17 smithi005 ceph-mon[129406]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:07:18.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:17 smithi088 ceph-mon[103111]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:07:18.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:18 smithi112 ceph-mon[133548]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:19.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:18 smithi005 ceph-mon[129406]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:18 smithi088 ceph-mon[103111]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:20.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:19 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/3020899229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]: dispatch 2023-10-07T00:07:20.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:19 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]: dispatch 2023-10-07T00:07:20.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:19 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]': finished 2023-10-07T00:07:20.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:19 smithi005 ceph-mon[129406]: osdmap e36: 6 total, 5 up, 6 in 2023-10-07T00:07:20.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:19 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:20.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:19 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/3020899229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]: dispatch 2023-10-07T00:07:20.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:19 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]: dispatch 2023-10-07T00:07:20.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:19 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]': finished 2023-10-07T00:07:20.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:19 smithi088 ceph-mon[103111]: osdmap e36: 6 total, 5 up, 6 in 2023-10-07T00:07:20.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:19 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:20.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:19 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/3020899229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]: dispatch 2023-10-07T00:07:20.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:19 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]: dispatch 2023-10-07T00:07:20.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:19 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f42eebd0-36c3-4da8-84ae-a22714f37531"}]': finished 2023-10-07T00:07:20.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:19 smithi112 ceph-mon[133548]: osdmap e36: 6 total, 5 up, 6 in 2023-10-07T00:07:20.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:19 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:20 smithi005 ceph-mon[129406]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:21.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:20 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/36319803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:07:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:20 smithi088 ceph-mon[103111]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:21.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:20 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/36319803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:07:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:20 smithi112 ceph-mon[133548]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:20 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/36319803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:07:23.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:22 smithi005 ceph-mon[129406]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:22 smithi088 ceph-mon[103111]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:22 smithi112 ceph-mon[133548]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:25.026 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:24 smithi112 ceph-mon[133548]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:24 smithi005 ceph-mon[129406]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:24 smithi088 ceph-mon[103111]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:27.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:26 smithi005 ceph-mon[129406]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:26 smithi088 ceph-mon[103111]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:26 smithi112 ceph-mon[133548]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:28.066 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-07T00:07:28.067 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:28.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-07T00:07:28.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:28.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-07T00:07:28.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:28.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:28 smithi112 ceph-mon[133548]: Deploying daemon osd.5 on smithi112 2023-10-07T00:07:28.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:28 smithi112 ceph-mon[133548]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:29.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:28 smithi005 ceph-mon[129406]: Deploying daemon osd.5 on smithi112 2023-10-07T00:07:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:28 smithi005 ceph-mon[129406]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:28 smithi088 ceph-mon[103111]: Deploying daemon osd.5 on smithi112 2023-10-07T00:07:29.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:28 smithi088 ceph-mon[103111]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:30.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:30 smithi112 ceph-mon[133548]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:30.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:30 smithi005 ceph-mon[129406]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:30.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:30 smithi088 ceph-mon[103111]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:32.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:32 smithi088 ceph-mon[103111]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:32.980 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:32 smithi112 ceph-mon[133548]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:33.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:32 smithi005 ceph-mon[129406]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:34.425 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:34.425 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:34.425 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:34.425 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:34 smithi112 ceph-mon[133548]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:34.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:34.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:34.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:34.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:34 smithi088 ceph-mon[103111]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:34.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:34.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:34.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:34.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:34 smithi005 ceph-mon[129406]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:36.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.690+0000 7fb6a5ffb700 1 -- 172.21.15.112:0/1805978847 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb6a80612f0 con 0x7fb6980a1480 2023-10-07T00:07:36.690 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 5 on host 'smithi112' 2023-10-07T00:07:36.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb6980a1480 msgr2=0x7fb6980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:36.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb6980a1480 0x7fb6980a3940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00b2e0 tx=0x7fb69c005fb0 comp rx=0 tx=0).stop 2023-10-07T00:07:36.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8102170 msgr2=0x7fb6a80732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:36.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8102170 0x7fb6a80732a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb69400d950 tx=0x7fb69400dd10 comp rx=0 tx=0).stop 2023-10-07T00:07:36.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 shutdown_connections 2023-10-07T00:07:36.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb6980a1480 0x7fb6980a3940 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:36.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a8102b10 0x7fb6a80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a8100f70 0x7fb6a8074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 --2- 172.21.15.112:0/1805978847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6a8102170 0x7fb6a80732a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 >> 172.21.15.112:0/1805978847 conn(0x7fb6a80fc4d0 msgr2=0x7fb6a80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 shutdown_connections 2023-10-07T00:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:07:36.692+0000 7fb6aec3d700 1 -- 172.21.15.112:0/1805978847 wait complete. 2023-10-07T00:07:36.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:36 smithi088 ceph-mon[103111]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:36.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:36 smithi112 ceph-mon[133548]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:36 smithi005 ceph-mon[129406]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:37.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:37.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:37.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:37.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:37.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:37.116 DEBUG:teuthology.orchestra.run.smithi112:osd.5> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-07T00:07:37.122 INFO:tasks.cephadm:Deploying osd.6 on smithi005 with /dev/vg_nvme/lv_2... 2023-10-07T00:07:37.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-07T00:07:37.199 INFO:journalctl@ceph.osd.5.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:07:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:07:37.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:37.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:37.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:37.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:37 smithi088 ceph-mon[103111]: from='osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-07T00:07:37.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:37 smithi088 ceph-mon[103111]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-07T00:07:37.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:37.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:37.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:37.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:37 smithi112 ceph-mon[133548]: from='osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-07T00:07:37.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:37 smithi112 ceph-mon[133548]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-07T00:07:38.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:38.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:38.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:07:38.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:37 smithi005 ceph-mon[129406]: from='osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-07T00:07:38.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:37 smithi005 ceph-mon[129406]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-07T00:07:38.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:38 smithi088 ceph-mon[103111]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:38 smithi088 ceph-mon[103111]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-07T00:07:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:38 smithi088 ceph-mon[103111]: osdmap e37: 6 total, 5 up, 6 in 2023-10-07T00:07:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:38 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:38 smithi088 ceph-mon[103111]: from='osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:07:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:38 smithi088 ceph-mon[103111]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:07:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:38 smithi112 ceph-mon[133548]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:38 smithi112 ceph-mon[133548]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-07T00:07:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:38 smithi112 ceph-mon[133548]: osdmap e37: 6 total, 5 up, 6 in 2023-10-07T00:07:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:38 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:38 smithi112 ceph-mon[133548]: from='osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:07:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:38 smithi112 ceph-mon[133548]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:07:38.998 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:07:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:07:38.691+0000 7f0ad364c700 -1 osd.5 0 waiting for initial osdmap 2023-10-07T00:07:38.998 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:07:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:07:38.700+0000 7f0acd43d700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:07:39.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:38 smithi005 ceph-mon[129406]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:39.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:38 smithi005 ceph-mon[129406]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-07T00:07:39.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:38 smithi005 ceph-mon[129406]: osdmap e37: 6 total, 5 up, 6 in 2023-10-07T00:07:39.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:38 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:38 smithi005 ceph-mon[129406]: from='osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:07:39.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:38 smithi005 ceph-mon[129406]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:07:39.755 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-07T00:07:39.755 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-07T00:07:39.755 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2023-10-07T00:07:39.755 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2023-10-07T00:07:39.756 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0317377 s, 330 MB/s 2023-10-07T00:07:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2023-10-07T00:07:39.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:39 smithi088 ceph-mon[103111]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:07:39.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:39 smithi088 ceph-mon[103111]: osdmap e38: 6 total, 5 up, 6 in 2023-10-07T00:07:39.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:39 smithi088 ceph-mon[103111]: osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] boot 2023-10-07T00:07:39.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:39 smithi088 ceph-mon[103111]: osdmap e39: 6 total, 6 up, 6 in 2023-10-07T00:07:39.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:39 smithi005 ceph-mon[129406]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:07:39.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:39 smithi005 ceph-mon[129406]: osdmap e38: 6 total, 5 up, 6 in 2023-10-07T00:07:39.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:39 smithi005 ceph-mon[129406]: osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] boot 2023-10-07T00:07:39.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:39 smithi005 ceph-mon[129406]: osdmap e39: 6 total, 6 up, 6 in 2023-10-07T00:07:39.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:39 smithi112 ceph-mon[133548]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:07:39.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:39 smithi112 ceph-mon[133548]: osdmap e38: 6 total, 5 up, 6 in 2023-10-07T00:07:39.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:39.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:39 smithi112 ceph-mon[133548]: osd.5 [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] boot 2023-10-07T00:07:39.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:39 smithi112 ceph-mon[133548]: osdmap e39: 6 total, 6 up, 6 in 2023-10-07T00:07:39.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-07T00:07:40.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi005:vg_nvme/lv_2 2023-10-07T00:07:40.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:40 smithi088 ceph-mon[103111]: osdmap e40: 6 total, 6 up, 6 in 2023-10-07T00:07:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:07:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:40.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:40 smithi112 ceph-mon[133548]: osdmap e40: 6 total, 6 up, 6 in 2023-10-07T00:07:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:07:41.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:07:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:40 smithi005 ceph-mon[129406]: osdmap e40: 6 total, 6 up, 6 in 2023-10-07T00:07:41.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:41 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi112 2023-10-07T00:07:41.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:41 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi112 to 8633M 2023-10-07T00:07:41.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:41 smithi005 ceph-mon[129406]: osdmap e41: 6 total, 6 up, 6 in 2023-10-07T00:07:41.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:41 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi112 2023-10-07T00:07:41.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:41 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi112 to 8633M 2023-10-07T00:07:41.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:41 smithi088 ceph-mon[103111]: osdmap e41: 6 total, 6 up, 6 in 2023-10-07T00:07:41.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:41 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi112 2023-10-07T00:07:41.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:41 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi112 to 8633M 2023-10-07T00:07:41.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:41 smithi112 ceph-mon[133548]: osdmap e41: 6 total, 6 up, 6 in 2023-10-07T00:07:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.433+0000 7f6a9159f700 1 -- 172.21.15.5:0/1336429403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 msgr2=0x7f6a8c101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.433+0000 7f6a9159f700 1 --2- 172.21.15.5:0/1336429403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 0x7f6a8c101390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0099c0 tx=0x7f6a7c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:07:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.433+0000 7f6a9159f700 1 -- 172.21.15.5:0/1336429403 shutdown_connections 2023-10-07T00:07:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.433+0000 7f6a9159f700 1 --2- 172.21.15.5:0/1336429403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a8c102b10 0x7f6a8c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.433+0000 7f6a9159f700 1 --2- 172.21.15.5:0/1336429403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 0x7f6a8c101390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.433+0000 7f6a9159f700 1 --2- 172.21.15.5:0/1336429403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c102170 0x7f6a8c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.433+0000 7f6a9159f700 1 -- 172.21.15.5:0/1336429403 >> 172.21.15.5:0/1336429403 conn(0x7f6a8c0fc4d0 msgr2=0x7f6a8c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:07:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.434+0000 7f6a9159f700 1 -- 172.21.15.5:0/1336429403 shutdown_connections 2023-10-07T00:07:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.434+0000 7f6a9159f700 1 -- 172.21.15.5:0/1336429403 wait complete. 2023-10-07T00:07:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a9159f700 1 Processor -- start 2023-10-07T00:07:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a9159f700 1 -- start start 2023-10-07T00:07:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a9159f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 0x7f6a8c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a9159f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a8c102170 0x7f6a8c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a9159f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c102b10 0x7f6a8c1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a9159f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1a0950 con 0x7f6a8c100f70 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a9159f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1a0a90 con 0x7f6a8c102b10 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a9159f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1a0c20 con 0x7f6a8c102170 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a8affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 0x7f6a8c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a8affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 0x7f6a8c198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33240/0 (socket says 172.21.15.5:33240) 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.435+0000 7f6a8affd700 1 -- 172.21.15.5:0/715267451 learned_addr learned my addr 172.21.15.5:0/715267451 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a8b7fe700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c102b10 0x7f6a8c1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a8a7fc700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a8c102170 0x7f6a8c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:07:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a8affd700 1 -- 172.21.15.5:0/715267451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a8c102170 msgr2=0x7f6a8c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a8affd700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a8c102170 0x7f6a8c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a8affd700 1 -- 172.21.15.5:0/715267451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c102b10 msgr2=0x7f6a8c1a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a8affd700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c102b10 0x7f6a8c1a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a8affd700 1 -- 172.21.15.5:0/715267451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0095f0 con 0x7f6a8c100f70 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a8affd700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 0x7f6a8c198dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009990 tx=0x7f6a7c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a73fff700 1 -- 172.21.15.5:0/715267451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c01d070 con 0x7f6a8c100f70 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a73fff700 1 -- 172.21.15.5:0/715267451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a7c00bda0 con 0x7f6a8c100f70 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a73fff700 1 -- 172.21.15.5:0/715267451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c022dd0 con 0x7f6a8c100f70 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.436+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c1a0ea0 con 0x7f6a8c100f70 2023-10-07T00:07:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.437+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c1a1200 con 0x7f6a8c100f70 2023-10-07T00:07:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.438+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c193460 con 0x7f6a8c100f70 2023-10-07T00:07:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.440+0000 7f6a73fff700 1 -- 172.21.15.5:0/715267451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6a7c022570 con 0x7f6a8c100f70 2023-10-07T00:07:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.441+0000 7f6a73fff700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6a740a1480 0x7f6a740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:07:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.441+0000 7f6a73fff700 1 -- 172.21.15.5:0/715267451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f6a7c0cd340 con 0x7f6a8c100f70 2023-10-07T00:07:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.441+0000 7f6a8a7fc700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6a740a1480 0x7f6a740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:07:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.442+0000 7f6a8a7fc700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6a740a1480 0x7f6a740a3940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6a80005950 tx=0x7f6a800058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:07:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.446+0000 7f6a73fff700 1 -- 172.21.15.5:0/715267451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6a7c097830 con 0x7f6a8c100f70 2023-10-07T00:07:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:07:42.668+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a8c02d2b0 con 0x7f6a740a1480 2023-10-07T00:07:42.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:42 smithi088 ceph-mon[103111]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:07:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:07:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:42 smithi112 ceph-mon[133548]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:07:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:07:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:42 smithi005 ceph-mon[129406]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:07:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:07:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:43.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:43 smithi112 ceph-mon[133548]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:07:44.175 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:43 smithi112 ceph-mon[133548]: osdmap e42: 6 total, 6 up, 6 in 2023-10-07T00:07:44.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:43 smithi005 ceph-mon[129406]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:07:44.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:43 smithi005 ceph-mon[129406]: osdmap e42: 6 total, 6 up, 6 in 2023-10-07T00:07:44.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:43 smithi088 ceph-mon[103111]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:07:44.687 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:43 smithi088 ceph-mon[103111]: osdmap e42: 6 total, 6 up, 6 in 2023-10-07T00:07:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:44 smithi112 ceph-mon[133548]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:44 smithi112 ceph-mon[133548]: osdmap e43: 6 total, 6 up, 6 in 2023-10-07T00:07:45.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:44 smithi005 ceph-mon[129406]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:44 smithi005 ceph-mon[129406]: osdmap e43: 6 total, 6 up, 6 in 2023-10-07T00:07:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:44 smithi088 ceph-mon[103111]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:44 smithi088 ceph-mon[103111]: osdmap e43: 6 total, 6 up, 6 in 2023-10-07T00:07:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:46 smithi112 ceph-mon[133548]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2023-10-07T00:07:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:46 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/136426637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e925e93d-2647-46d2-9322-bd2c7e018774"}]: dispatch 2023-10-07T00:07:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:46 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/136426637' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e925e93d-2647-46d2-9322-bd2c7e018774"}]': finished 2023-10-07T00:07:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:46 smithi112 ceph-mon[133548]: osdmap e44: 7 total, 6 up, 7 in 2023-10-07T00:07:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:07:46.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:46 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/6818053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:07:47.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:46 smithi005 ceph-mon[129406]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2023-10-07T00:07:47.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:46 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/136426637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e925e93d-2647-46d2-9322-bd2c7e018774"}]: dispatch 2023-10-07T00:07:47.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:46 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/136426637' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e925e93d-2647-46d2-9322-bd2c7e018774"}]': finished 2023-10-07T00:07:47.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:46 smithi005 ceph-mon[129406]: osdmap e44: 7 total, 6 up, 7 in 2023-10-07T00:07:47.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:07:47.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:46 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/6818053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:07:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:46 smithi088 ceph-mon[103111]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2023-10-07T00:07:47.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:46 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/136426637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e925e93d-2647-46d2-9322-bd2c7e018774"}]: dispatch 2023-10-07T00:07:47.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:46 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/136426637' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e925e93d-2647-46d2-9322-bd2c7e018774"}]': finished 2023-10-07T00:07:47.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:46 smithi088 ceph-mon[103111]: osdmap e44: 7 total, 6 up, 7 in 2023-10-07T00:07:47.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:07:47.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:46 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/6818053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:07:48.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:48 smithi112 ceph-mon[133548]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:07:49.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:48 smithi005 ceph-mon[129406]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:07:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:48 smithi088 ceph-mon[103111]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:07:50.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:50 smithi005 ceph-mon[129406]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-10-07T00:07:50.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:50 smithi088 ceph-mon[103111]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-10-07T00:07:50.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:50 smithi112 ceph-mon[133548]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-10-07T00:07:52.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:52 smithi088 ceph-mon[103111]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:07:52.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:52 smithi112 ceph-mon[133548]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:07:53.046 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:52 smithi005 ceph-mon[129406]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:07:53.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-07T00:07:53.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:53.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-07T00:07:53.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-07T00:07:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:07:54.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:54 smithi005 ceph-mon[129406]: Deploying daemon osd.6 on smithi005 2023-10-07T00:07:54.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:54 smithi005 ceph-mon[129406]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-07T00:07:54.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:54 smithi088 ceph-mon[103111]: Deploying daemon osd.6 on smithi005 2023-10-07T00:07:54.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:54 smithi088 ceph-mon[103111]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-07T00:07:54.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:54 smithi112 ceph-mon[133548]: Deploying daemon osd.6 on smithi005 2023-10-07T00:07:54.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:54 smithi112 ceph-mon[133548]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-07T00:07:56.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:56 smithi005 ceph-mon[129406]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:56.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:56 smithi088 ceph-mon[103111]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:56 smithi112 ceph-mon[133548]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:58.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:07:58 smithi088 ceph-mon[103111]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:58.955 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:07:58 smithi005 ceph-mon[129406]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:07:58.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:07:58 smithi112 ceph-mon[133548]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:00.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:00.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:00.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:00.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:00 smithi005 ceph-mon[129406]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:00.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:00.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:00.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:00.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:00 smithi088 ceph-mon[103111]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:00.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:00.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:00.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:00.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:00 smithi112 ceph-mon[133548]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.732+0000 7f6a73fff700 1 -- 172.21.15.5:0/715267451 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6a8c02d2b0 con 0x7f6a740a1480 2023-10-07T00:08:02.734 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 6 on host 'smithi005' 2023-10-07T00:08:02.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6a740a1480 msgr2=0x7f6a740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:02.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6a740a1480 0x7f6a740a3940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6a80005950 tx=0x7f6a800058e0 comp rx=0 tx=0).stop 2023-10-07T00:08:02.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 msgr2=0x7f6a8c198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:02.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 0x7f6a8c198dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009990 tx=0x7f6a7c003a50 comp rx=0 tx=0).stop 2023-10-07T00:08:02.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 shutdown_connections 2023-10-07T00:08:02.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6a740a1480 0x7f6a740a3940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c102b10 0x7f6a8c1a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a8c100f70 0x7f6a8c198dc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 --2- 172.21.15.5:0/715267451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a8c102170 0x7f6a8c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 >> 172.21.15.5:0/715267451 conn(0x7f6a8c0fc4d0 msgr2=0x7f6a8c107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:08:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 shutdown_connections 2023-10-07T00:08:02.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:08:02.735+0000 7f6a9159f700 1 -- 172.21.15.5:0/715267451 wait complete. 2023-10-07T00:08:02.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:02 smithi005 ceph-mon[129406]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:02 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:02.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:02 smithi088 ceph-mon[103111]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:02.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:02.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:02.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:02.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:02.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:02 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:02.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:02 smithi112 ceph-mon[133548]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:02.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:02.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:02.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:02.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:02.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:02 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:03.343 DEBUG:teuthology.orchestra.run.smithi005:osd.6> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-07T00:08:03.348 INFO:tasks.cephadm:Deploying osd.7 on smithi088 with /dev/vg_nvme/lv_2... 2023-10-07T00:08:03.348 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-07T00:08:03.425 INFO:journalctl@ceph.osd.6.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:08:03.949 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:03 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:03.949 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:03 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:03.949 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:03 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:03.949 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:03 smithi005 ceph-mon[129406]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-07T00:08:03.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:03 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:03.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:03 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:03.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:03 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:03.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:03 smithi088 ceph-mon[103111]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-07T00:08:03.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:03 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:03.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:03 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:03.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:03 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:03.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:03 smithi112 ceph-mon[133548]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-07T00:08:04.083 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:08:04.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:04 smithi088 ceph-mon[103111]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:04.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:04 smithi088 ceph-mon[103111]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-07T00:08:04.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:04 smithi088 ceph-mon[103111]: osdmap e45: 7 total, 6 up, 7 in 2023-10-07T00:08:04.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:04 smithi088 ceph-mon[103111]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:08:04.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:04 smithi112 ceph-mon[133548]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:04 smithi112 ceph-mon[133548]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-07T00:08:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:04 smithi112 ceph-mon[133548]: osdmap e45: 7 total, 6 up, 7 in 2023-10-07T00:08:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:04 smithi112 ceph-mon[133548]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:08:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:04 smithi005 ceph-mon[129406]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:04 smithi005 ceph-mon[129406]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-07T00:08:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:04 smithi005 ceph-mon[129406]: osdmap e45: 7 total, 6 up, 7 in 2023-10-07T00:08:05.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:04 smithi005 ceph-mon[129406]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:08:05.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:05.110 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:08:04 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:08:04.709+0000 7fed25565700 -1 osd.6 0 waiting for initial osdmap 2023-10-07T00:08:05.110 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:08:04 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:08:04.721+0000 7fed2135a700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:08:05.909 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-07T00:08:05.909 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-07T00:08:05.910 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2023-10-07T00:08:05.910 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2023-10-07T00:08:05.910 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0312146 s, 336 MB/s 2023-10-07T00:08:05.910 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2023-10-07T00:08:05.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:05 smithi112 ceph-mon[133548]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:08:05.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:05 smithi112 ceph-mon[133548]: osdmap e46: 7 total, 6 up, 7 in 2023-10-07T00:08:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:05.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:05 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:06.040 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:05 smithi088 ceph-mon[103111]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:08:06.040 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:05 smithi088 ceph-mon[103111]: osdmap e46: 7 total, 6 up, 7 in 2023-10-07T00:08:06.040 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:06.041 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:05 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:06.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:05 smithi005 ceph-mon[129406]: from='osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:08:06.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:05 smithi005 ceph-mon[129406]: osdmap e46: 7 total, 6 up, 7 in 2023-10-07T00:08:06.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:06.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:05 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:06.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi088:vg_nvme/lv_2 2023-10-07T00:08:06.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:06 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:08:06.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:06 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:08:06.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:06 smithi112 ceph-mon[133548]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:06.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:06 smithi112 ceph-mon[133548]: osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] boot 2023-10-07T00:08:06.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:06 smithi112 ceph-mon[133548]: osdmap e47: 7 total, 7 up, 7 in 2023-10-07T00:08:06.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:06 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:07.084 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:08:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:06 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:08:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:06 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:08:07.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:06 smithi005 ceph-mon[129406]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:07.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:06 smithi005 ceph-mon[129406]: osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] boot 2023-10-07T00:08:07.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:06 smithi005 ceph-mon[129406]: osdmap e47: 7 total, 7 up, 7 in 2023-10-07T00:08:07.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:06 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:06 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:08:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:06 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:08:07.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:06 smithi088 ceph-mon[103111]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-07T00:08:07.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:06 smithi088 ceph-mon[103111]: osd.6 [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] boot 2023-10-07T00:08:07.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:06 smithi088 ceph-mon[103111]: osdmap e47: 7 total, 7 up, 7 in 2023-10-07T00:08:07.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:06 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-07T00:08:07.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: osdmap e48: 7 total, 7 up, 7 in 2023-10-07T00:08:07.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi005 2023-10-07T00:08:07.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:07.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:07.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:07.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:07.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:07.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi005 to 5757M 2023-10-07T00:08:07.905 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:07.905 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:07.905 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:07.905 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:07.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: osdmap e48: 7 total, 7 up, 7 in 2023-10-07T00:08:07.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi005 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi005 to 5757M 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:08.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: osdmap e48: 7 total, 7 up, 7 in 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi005 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi005 to 5757M 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:08.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:08.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:08.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/2794451435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68108e40 msgr2=0x7f1f6810b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/2794451435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68108e40 0x7f1f6810b2d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000b0a0 tx=0x7f1f6000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:08:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/2794451435 shutdown_connections 2023-10-07T00:08:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/2794451435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68108e40 0x7f1f6810b2d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/2794451435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f68074ee0 0x7f1f68073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/2794451435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f68073910 0x7f1f68073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/2794451435 >> 172.21.15.88:0/2794451435 conn(0x7f1f680fc4d0 msgr2=0x7f1f680fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:08:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/2794451435 shutdown_connections 2023-10-07T00:08:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.591+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/2794451435 wait complete. 2023-10-07T00:08:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.592+0000 7f1f6ecf3700 1 Processor -- start 2023-10-07T00:08:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.592+0000 7f1f6ecf3700 1 -- start start 2023-10-07T00:08:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f6ecf3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f68073910 0x7f1f68198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:08:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f6ecf3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68074ee0 0x7f1f68199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:08:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f6ecf3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f68108e40 0x7f1f681a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:08:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f6ecf3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f681a0970 con 0x7f1f68073910 2023-10-07T00:08:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f6ecf3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f681a0ab0 con 0x7f1f68074ee0 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f6ecf3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f681a0c40 con 0x7f1f68108e40 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f67fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68074ee0 0x7f1f68199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f67fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68074ee0 0x7f1f68199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53812/0 (socket says 172.21.15.88:53812) 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f67fff700 1 -- 172.21.15.88:0/3462410856 learned_addr learned my addr 172.21.15.88:0/3462410856 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f6ca8f700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f68073910 0x7f1f68198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f6d290700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f68108e40 0x7f1f681a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f67fff700 1 -- 172.21.15.88:0/3462410856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f68108e40 msgr2=0x7f1f681a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f67fff700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f68108e40 0x7f1f681a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f67fff700 1 -- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f68073910 msgr2=0x7f1f68198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f67fff700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f68073910 0x7f1f68198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.593+0000 7f1f67fff700 1 -- 172.21.15.88:0/3462410856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f60009d00 con 0x7f1f68074ee0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.594+0000 7f1f67fff700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68074ee0 0x7f1f68199320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400c990 tx=0x7f1f5400cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.594+0000 7f1f65ffb700 1 -- 172.21.15.88:0/3462410856 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54007b00 con 0x7f1f68074ee0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.594+0000 7f1f65ffb700 1 -- 172.21.15.88:0/3462410856 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f54007c60 con 0x7f1f68074ee0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.594+0000 7f1f65ffb700 1 -- 172.21.15.88:0/3462410856 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54018660 con 0x7f1f68074ee0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.594+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f681a0f20 con 0x7f1f68074ee0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.594+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f681a1340 con 0x7f1f68074ee0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.595+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f681074f0 con 0x7f1f68074ee0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.597+0000 7f1f65ffb700 1 -- 172.21.15.88:0/3462410856 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1f5400f450 con 0x7f1f68074ee0 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.598+0000 7f1f65ffb700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1f580a1480 0x7f1f580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:08:08.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.598+0000 7f1f65ffb700 1 -- 172.21.15.88:0/3462410856 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f1f540cbf80 con 0x7f1f68074ee0 2023-10-07T00:08:08.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.599+0000 7f1f6ca8f700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1f580a1480 0x7f1f580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:08:08.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.599+0000 7f1f6ca8f700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1f580a1480 0x7f1f580a3940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f680752c0 tx=0x7f1f5c0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:08:08.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.603+0000 7f1f65ffb700 1 -- 172.21.15.88:0/3462410856 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1f54096250 con 0x7f1f68074ee0 2023-10-07T00:08:08.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:08.809+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f6802d350 con 0x7f1f580a1480 2023-10-07T00:08:08.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:08 smithi112 ceph-mon[133548]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:08 smithi005 ceph-mon[129406]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:08 smithi088 ceph-mon[103111]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:09.997 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:09 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:08:09.997 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:09 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:08:09.997 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:09 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:09.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:09 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:08:09.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:09 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:08:09.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:09 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:10.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:09 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:08:10.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:09 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:08:10.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:09 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:10 smithi112 ceph-mon[133548]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:08:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:10 smithi112 ceph-mon[133548]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:11.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:10 smithi005 ceph-mon[129406]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:08:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:10 smithi005 ceph-mon[129406]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:10 smithi088 ceph-mon[103111]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:08:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:10 smithi088 ceph-mon[103111]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:12.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:12 smithi112 ceph-mon[133548]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:12.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:12 smithi112 ceph-mon[133548]: from='client.? 172.21.15.88:0/2752843247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]: dispatch 2023-10-07T00:08:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:12 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]: dispatch 2023-10-07T00:08:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:12 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]': finished 2023-10-07T00:08:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:12 smithi112 ceph-mon[133548]: osdmap e49: 8 total, 7 up, 8 in 2023-10-07T00:08:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:12 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:12.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:12 smithi112 ceph-mon[133548]: from='client.? 172.21.15.88:0/1094489906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:08:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:12 smithi005 ceph-mon[129406]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:12 smithi005 ceph-mon[129406]: from='client.? 172.21.15.88:0/2752843247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]: dispatch 2023-10-07T00:08:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:12 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]: dispatch 2023-10-07T00:08:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:12 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]': finished 2023-10-07T00:08:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:12 smithi005 ceph-mon[129406]: osdmap e49: 8 total, 7 up, 8 in 2023-10-07T00:08:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:12 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:12 smithi005 ceph-mon[129406]: from='client.? 172.21.15.88:0/1094489906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:08:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:12 smithi088 ceph-mon[103111]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:12 smithi088 ceph-mon[103111]: from='client.? 172.21.15.88:0/2752843247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]: dispatch 2023-10-07T00:08:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:12 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]: dispatch 2023-10-07T00:08:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:12 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "755b1bc2-edc1-4eb5-a496-7809d5c93c12"}]': finished 2023-10-07T00:08:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:12 smithi088 ceph-mon[103111]: osdmap e49: 8 total, 7 up, 8 in 2023-10-07T00:08:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:12 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:12 smithi088 ceph-mon[103111]: from='client.? 172.21.15.88:0/1094489906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:08:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:14 smithi112 ceph-mon[133548]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:14 smithi005 ceph-mon[129406]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:14 smithi088 ceph-mon[103111]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:16.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:16 smithi112 ceph-mon[133548]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:16 smithi005 ceph-mon[129406]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:16 smithi088 ceph-mon[103111]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:18.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:18 smithi088 ceph-mon[103111]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:18.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:18 smithi112 ceph-mon[133548]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:19.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:18 smithi005 ceph-mon[129406]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:19.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:19 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-07T00:08:19.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:19 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:20.001 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:19 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-07T00:08:20.001 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:19 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:20.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:19 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-07T00:08:20.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:19 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:20.918 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:20 smithi088 ceph-mon[103111]: Deploying daemon osd.7 on smithi088 2023-10-07T00:08:20.918 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:20 smithi088 ceph-mon[103111]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:20 smithi005 ceph-mon[129406]: Deploying daemon osd.7 on smithi088 2023-10-07T00:08:21.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:20 smithi005 ceph-mon[129406]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:20 smithi112 ceph-mon[133548]: Deploying daemon osd.7 on smithi088 2023-10-07T00:08:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:20 smithi112 ceph-mon[133548]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:23.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:22 smithi005 ceph-mon[129406]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:23.173 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:22 smithi088 ceph-mon[103111]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:22 smithi112 ceph-mon[133548]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:24.909 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:24 smithi088 ceph-mon[103111]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:24 smithi005 ceph-mon[129406]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:24 smithi112 ceph-mon[133548]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:26 smithi005 ceph-mon[129406]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:26.369 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:26.369 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:26.370 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:26.370 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:26 smithi088 ceph-mon[103111]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:26 smithi112 ceph-mon[133548]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:28.482 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 7 on host 'smithi088' 2023-10-07T00:08:28.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.480+0000 7f1f65ffb700 1 -- 172.21.15.88:0/3462410856 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1f6802d350 con 0x7f1f580a1480 2023-10-07T00:08:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1f580a1480 msgr2=0x7f1f580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1f580a1480 0x7f1f580a3940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f680752c0 tx=0x7f1f5c0073d0 comp rx=0 tx=0).stop 2023-10-07T00:08:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68074ee0 msgr2=0x7f1f68199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68074ee0 0x7f1f68199320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400c990 tx=0x7f1f5400cca0 comp rx=0 tx=0).stop 2023-10-07T00:08:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 shutdown_connections 2023-10-07T00:08:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1f580a1480 0x7f1f580a3940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f68108e40 0x7f1f681a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f68073910 0x7f1f68198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 --2- 172.21.15.88:0/3462410856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f68074ee0 0x7f1f68199320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 >> 172.21.15.88:0/3462410856 conn(0x7f1f680fc4d0 msgr2=0x7f1f680fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:08:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.483+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 shutdown_connections 2023-10-07T00:08:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:08:28.484+0000 7f1f6ecf3700 1 -- 172.21.15.88:0/3462410856 wait complete. 2023-10-07T00:08:28.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:28.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:28.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:28.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:28.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:29.009 DEBUG:teuthology.orchestra.run.smithi088:osd.7> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-07T00:08:29.013 INFO:tasks.cephadm:Deploying osd.8 on smithi112 with /dev/vg_nvme/lv_2... 2023-10-07T00:08:29.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-07T00:08:29.096 INFO:journalctl@ceph.osd.7.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:29.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:29.745 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:08:29.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:29 smithi088 ceph-mon[103111]: from='osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-07T00:08:29.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:29 smithi088 ceph-mon[103111]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-07T00:08:29.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:29 smithi112 ceph-mon[133548]: from='osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-07T00:08:29.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:29 smithi112 ceph-mon[133548]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-07T00:08:30.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:29 smithi005 ceph-mon[129406]: from='osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-07T00:08:30.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:29 smithi005 ceph-mon[129406]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-07T00:08:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:30 smithi088 ceph-mon[103111]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:30 smithi088 ceph-mon[103111]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-07T00:08:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:30 smithi088 ceph-mon[103111]: from='osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:08:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:30 smithi088 ceph-mon[103111]: osdmap e50: 8 total, 7 up, 8 in 2023-10-07T00:08:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:30 smithi088 ceph-mon[103111]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:08:30.954 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:08:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:08:30.680+0000 7fc60b566700 -1 osd.7 0 waiting for initial osdmap 2023-10-07T00:08:30.954 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:08:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:08:30.691+0000 7fc603353700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:08:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:30 smithi112 ceph-mon[133548]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:30 smithi112 ceph-mon[133548]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-07T00:08:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:30 smithi112 ceph-mon[133548]: from='osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:08:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:30 smithi112 ceph-mon[133548]: osdmap e50: 8 total, 7 up, 8 in 2023-10-07T00:08:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:30 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:30 smithi112 ceph-mon[133548]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:08:31.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:30 smithi005 ceph-mon[129406]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:30 smithi005 ceph-mon[129406]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-07T00:08:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:30 smithi005 ceph-mon[129406]: from='osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:08:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:30 smithi005 ceph-mon[129406]: osdmap e50: 8 total, 7 up, 8 in 2023-10-07T00:08:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:30 smithi005 ceph-mon[129406]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:08:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-07T00:08:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-07T00:08:31.725 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2023-10-07T00:08:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2023-10-07T00:08:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.048001 s, 218 MB/s 2023-10-07T00:08:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2023-10-07T00:08:31.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:31 smithi088 ceph-mon[103111]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:08:31.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:31 smithi088 ceph-mon[103111]: osdmap e51: 8 total, 7 up, 8 in 2023-10-07T00:08:31.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:31.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:31.968 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:31 smithi112 ceph-mon[133548]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:08:31.968 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:31 smithi112 ceph-mon[133548]: osdmap e51: 8 total, 7 up, 8 in 2023-10-07T00:08:31.968 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:31.969 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:31 smithi005 ceph-mon[129406]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:08:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:31 smithi005 ceph-mon[129406]: osdmap e51: 8 total, 7 up, 8 in 2023-10-07T00:08:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:32.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2023-10-07T00:08:32.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:08:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:08:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] boot 2023-10-07T00:08:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: osdmap e52: 8 total, 8 up, 8 in 2023-10-07T00:08:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:32.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:32.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:32.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:32.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:32.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:32.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:32.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:08:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] boot 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: osdmap e52: 8 total, 8 up, 8 in 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:32.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:32.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:32.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:33.056 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:08:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:08:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:08:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-07T00:08:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: osd.7 [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] boot 2023-10-07T00:08:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: osdmap e52: 8 total, 8 up, 8 in 2023-10-07T00:08:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-07T00:08:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:33.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:33.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:33.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:33.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:33.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:33.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:33.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:33.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:33 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi088 2023-10-07T00:08:33.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:33 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi088 to 5755M 2023-10-07T00:08:33.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:33 smithi088 ceph-mon[103111]: osdmap e53: 8 total, 8 up, 8 in 2023-10-07T00:08:33.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:33 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi088 2023-10-07T00:08:33.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:33 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi088 to 5755M 2023-10-07T00:08:33.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:33 smithi112 ceph-mon[133548]: osdmap e53: 8 total, 8 up, 8 in 2023-10-07T00:08:34.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:33 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi088 2023-10-07T00:08:34.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:33 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi088 to 5755M 2023-10-07T00:08:34.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:33 smithi005 ceph-mon[129406]: osdmap e53: 8 total, 8 up, 8 in 2023-10-07T00:08:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/436988007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18102b10 msgr2=0x7f6b181093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/436988007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18102b10 0x7f6b181093c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000b0a0 tx=0x7f6b1000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:08:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/436988007 shutdown_connections 2023-10-07T00:08:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/436988007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18102b10 0x7f6b181093c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/436988007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18100f70 0x7f6b18101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/436988007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b18102170 0x7f6b181025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/436988007 >> 172.21.15.112:0/436988007 conn(0x7f6b180fc4d0 msgr2=0x7f6b180fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:08:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/436988007 shutdown_connections 2023-10-07T00:08:34.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.521+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/436988007 wait complete. 2023-10-07T00:08:34.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.522+0000 7f6b1ffc4700 1 Processor -- start 2023-10-07T00:08:34.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.522+0000 7f6b1ffc4700 1 -- start start 2023-10-07T00:08:34.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1ffc4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18100f70 0x7f6b18074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:08:34.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1ffc4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18102170 0x7f6b180732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1ffc4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b18102b10 0x7f6b180737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1ffc4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18073f60 con 0x7f6b18102b10 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1ffc4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180740d0 con 0x7f6b18102170 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1ffc4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181a0d10 con 0x7f6b18100f70 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1dd60700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18100f70 0x7f6b18074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1dd60700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18100f70 0x7f6b18074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54576/0 (socket says 172.21.15.112:54576) 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1dd60700 1 -- 172.21.15.112:0/2247500183 learned_addr learned my addr 172.21.15.112:0/2247500183 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1d55f700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18102170 0x7f6b180732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1e561700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b18102b10 0x7f6b180737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:08:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1dd60700 1 -- 172.21.15.112:0/2247500183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18102170 msgr2=0x7f6b180732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1dd60700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18102170 0x7f6b180732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1dd60700 1 -- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b18102b10 msgr2=0x7f6b180737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1dd60700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b18102b10 0x7f6b180737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.523+0000 7f6b1dd60700 1 -- 172.21.15.112:0/2247500183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10009d00 con 0x7f6b18100f70 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.524+0000 7f6b1dd60700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18100f70 0x7f6b18074c50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400d980 tx=0x7f6b1400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.524+0000 7f6b0effd700 1 -- 172.21.15.112:0/2247500183 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14004020 con 0x7f6b18100f70 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.524+0000 7f6b0effd700 1 -- 172.21.15.112:0/2247500183 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b1400f690 con 0x7f6b18100f70 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.524+0000 7f6b0effd700 1 -- 172.21.15.112:0/2247500183 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140039e0 con 0x7f6b18100f70 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.524+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b181a0ff0 con 0x7f6b18100f70 2023-10-07T00:08:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.524+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b181a1350 con 0x7f6b18100f70 2023-10-07T00:08:34.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.525+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b18108590 con 0x7f6b18100f70 2023-10-07T00:08:34.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.527+0000 7f6b0effd700 1 -- 172.21.15.112:0/2247500183 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6b1400f800 con 0x7f6b18100f70 2023-10-07T00:08:34.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.528+0000 7f6b0effd700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b040a1500 0x7f6b040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:08:34.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.529+0000 7f6b0effd700 1 -- 172.21.15.112:0/2247500183 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f6b140cc120 con 0x7f6b18100f70 2023-10-07T00:08:34.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.529+0000 7f6b1d55f700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b040a1500 0x7f6b040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:08:34.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.530+0000 7f6b1d55f700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b040a1500 0x7f6b040a39c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6b08005950 tx=0x7f6b0800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:08:34.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.531+0000 7f6b0effd700 1 -- 172.21.15.112:0/2247500183 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b140962a0 con 0x7f6b18100f70 2023-10-07T00:08:34.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:34.743+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b1802d390 con 0x7f6b040a1500 2023-10-07T00:08:34.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:34 smithi088 ceph-mon[103111]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:34.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:34 smithi088 ceph-mon[103111]: osdmap e54: 8 total, 8 up, 8 in 2023-10-07T00:08:34.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:34 smithi088 ceph-mon[103111]: osdmap e55: 8 total, 8 up, 8 in 2023-10-07T00:08:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:34 smithi112 ceph-mon[133548]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:34 smithi112 ceph-mon[133548]: osdmap e54: 8 total, 8 up, 8 in 2023-10-07T00:08:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:34 smithi112 ceph-mon[133548]: osdmap e55: 8 total, 8 up, 8 in 2023-10-07T00:08:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:34 smithi005 ceph-mon[129406]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:34 smithi005 ceph-mon[129406]: osdmap e54: 8 total, 8 up, 8 in 2023-10-07T00:08:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:34 smithi005 ceph-mon[129406]: osdmap e55: 8 total, 8 up, 8 in 2023-10-07T00:08:35.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:35 smithi088 ceph-mon[103111]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:08:35.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:35 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:08:35.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:35 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:08:35.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:35 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:35.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:35 smithi088 ceph-mon[103111]: osdmap e56: 8 total, 8 up, 8 in 2023-10-07T00:08:35.965 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:35 smithi112 ceph-mon[133548]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:08:35.966 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:08:35.966 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:08:35.966 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:35.966 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:35 smithi112 ceph-mon[133548]: osdmap e56: 8 total, 8 up, 8 in 2023-10-07T00:08:36.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:35 smithi005 ceph-mon[129406]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:08:36.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:35 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:08:36.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:35 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:08:36.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:35 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:36.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:35 smithi005 ceph-mon[129406]: osdmap e56: 8 total, 8 up, 8 in 2023-10-07T00:08:36.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:36 smithi112 ceph-mon[133548]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:36.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:36 smithi088 ceph-mon[103111]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:36 smithi005 ceph-mon[129406]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:38 smithi088 ceph-mon[103111]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:38 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/82465574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]: dispatch 2023-10-07T00:08:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:38 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]: dispatch 2023-10-07T00:08:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:38 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]': finished 2023-10-07T00:08:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:38 smithi088 ceph-mon[103111]: osdmap e57: 9 total, 8 up, 9 in 2023-10-07T00:08:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:38 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:38 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/3468277828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:08:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:38 smithi112 ceph-mon[133548]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:38 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/82465574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]: dispatch 2023-10-07T00:08:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:38 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]: dispatch 2023-10-07T00:08:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:38 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]': finished 2023-10-07T00:08:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:38 smithi112 ceph-mon[133548]: osdmap e57: 9 total, 8 up, 9 in 2023-10-07T00:08:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:38 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:38.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:38 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/3468277828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:08:39.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:38 smithi005 ceph-mon[129406]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:38 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/82465574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]: dispatch 2023-10-07T00:08:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:38 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]: dispatch 2023-10-07T00:08:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:38 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0051cf8a-fe25-4699-a03e-4dad5450fd47"}]': finished 2023-10-07T00:08:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:38 smithi005 ceph-mon[129406]: osdmap e57: 9 total, 8 up, 9 in 2023-10-07T00:08:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:38 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:38 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/3468277828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:08:40.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:40 smithi005 ceph-mon[129406]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:40.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:40 smithi088 ceph-mon[103111]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:40 smithi112 ceph-mon[133548]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:42.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:42 smithi088 ceph-mon[103111]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:42 smithi112 ceph-mon[133548]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:42 smithi005 ceph-mon[129406]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:44.923 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:44 smithi112 ceph-mon[133548]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:44.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:44 smithi088 ceph-mon[103111]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:44 smithi005 ceph-mon[129406]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:45.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:45 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-07T00:08:45.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:45 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:45.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:45 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-07T00:08:45.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:45 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:46.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:45 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-07T00:08:46.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:45 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:46.729 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:46 smithi112 ceph-mon[133548]: Deploying daemon osd.8 on smithi112 2023-10-07T00:08:46.729 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:46 smithi112 ceph-mon[133548]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:46.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:46 smithi088 ceph-mon[103111]: Deploying daemon osd.8 on smithi112 2023-10-07T00:08:46.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:46 smithi088 ceph-mon[103111]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:47.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:46 smithi005 ceph-mon[129406]: Deploying daemon osd.8 on smithi112 2023-10-07T00:08:47.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:46 smithi005 ceph-mon[129406]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:48.934 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:48 smithi112 ceph-mon[133548]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:48.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:48 smithi088 ceph-mon[103111]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:49.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:48 smithi005 ceph-mon[129406]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:50.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:50 smithi005 ceph-mon[129406]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:50.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:50 smithi088 ceph-mon[103111]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:50 smithi112 ceph-mon[133548]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:52.656 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:52.657 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:52.657 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:52.657 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:52 smithi112 ceph-mon[133548]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:52.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:52.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:52.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:52.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:52 smithi088 ceph-mon[103111]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:52.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:52.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:52.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:52.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:52 smithi005 ceph-mon[129406]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:54.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.674+0000 7f6b0effd700 1 -- 172.21.15.112:0/2247500183 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6b1802d390 con 0x7f6b040a1500 2023-10-07T00:08:54.676 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 8 on host 'smithi112' 2023-10-07T00:08:54.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b040a1500 msgr2=0x7f6b040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b040a1500 0x7f6b040a39c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6b08005950 tx=0x7f6b0800b410 comp rx=0 tx=0).stop 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18100f70 msgr2=0x7f6b18074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18100f70 0x7f6b18074c50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400d980 tx=0x7f6b1400dc90 comp rx=0 tx=0).stop 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 shutdown_connections 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b040a1500 0x7f6b040a39c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b18102b10 0x7f6b180737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b18100f70 0x7f6b18074c50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 --2- 172.21.15.112:0/2247500183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b18102170 0x7f6b180732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:08:54.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 >> 172.21.15.112:0/2247500183 conn(0x7f6b180fc4d0 msgr2=0x7f6b181056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:08:54.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 shutdown_connections 2023-10-07T00:08:54.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:08:54.678+0000 7f6b1ffc4700 1 -- 172.21.15.112:0/2247500183 wait complete. 2023-10-07T00:08:54.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:54 smithi112 ceph-mon[133548]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:54.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:54.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:54.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:54 smithi088 ceph-mon[103111]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:54 smithi005 ceph-mon[129406]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:55.174 DEBUG:teuthology.orchestra.run.smithi112:osd.8> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-07T00:08:55.178 INFO:tasks.cephadm:Deploying osd.9 on smithi005 with /dev/vg_nvme/lv_1... 2023-10-07T00:08:55.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-07T00:08:55.249 INFO:journalctl@ceph.osd.8.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:08:55.498 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:08:55 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:08:55.357+0000 7f7f4877c640 -1 osd.8 0 log_to_monitors true 2023-10-07T00:08:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:08:55.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:55 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:55.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:55 smithi088 ceph-mon[103111]: from='osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-07T00:08:55.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:55 smithi088 ceph-mon[103111]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-07T00:08:55.996 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:55 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:55.996 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:55 smithi112 ceph-mon[133548]: from='osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-07T00:08:55.996 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:55 smithi112 ceph-mon[133548]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-07T00:08:56.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:55 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:08:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:55 smithi005 ceph-mon[129406]: from='osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-07T00:08:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:55 smithi005 ceph-mon[129406]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-07T00:08:56.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:56 smithi005 ceph-mon[129406]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:56.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:56 smithi005 ceph-mon[129406]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-07T00:08:56.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:56 smithi005 ceph-mon[129406]: osdmap e58: 9 total, 8 up, 9 in 2023-10-07T00:08:56.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:56 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:56.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:56 smithi005 ceph-mon[129406]: from='osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:08:56.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:56 smithi005 ceph-mon[129406]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:08:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:56 smithi088 ceph-mon[103111]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:56 smithi088 ceph-mon[103111]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-07T00:08:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:56 smithi088 ceph-mon[103111]: osdmap e58: 9 total, 8 up, 9 in 2023-10-07T00:08:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:56 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:56 smithi088 ceph-mon[103111]: from='osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:08:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:56 smithi088 ceph-mon[103111]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:08:56.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:08:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:08:56.683+0000 7f7f3ddf3700 -1 osd.8 0 waiting for initial osdmap 2023-10-07T00:08:56.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:08:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:08:56.697+0000 7f7f393e7700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:08:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:56 smithi112 ceph-mon[133548]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:56 smithi112 ceph-mon[133548]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-07T00:08:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:56 smithi112 ceph-mon[133548]: osdmap e58: 9 total, 8 up, 9 in 2023-10-07T00:08:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:56 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:56 smithi112 ceph-mon[133548]: from='osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:08:56.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:56 smithi112 ceph-mon[133548]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:08:57.928 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-07T00:08:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-07T00:08:57.929 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2023-10-07T00:08:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2023-10-07T00:08:57.929 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0298117 s, 352 MB/s 2023-10-07T00:08:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2023-10-07T00:08:57.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:57 smithi088 ceph-mon[103111]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:08:57.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:57 smithi088 ceph-mon[103111]: osdmap e59: 9 total, 8 up, 9 in 2023-10-07T00:08:57.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:57 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:57.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:57 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:57.965 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:57 smithi005 ceph-mon[129406]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:08:57.965 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:57 smithi005 ceph-mon[129406]: osdmap e59: 9 total, 8 up, 9 in 2023-10-07T00:08:57.965 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:57 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:57.965 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:57 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:57 smithi112 ceph-mon[133548]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:08:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:57 smithi112 ceph-mon[133548]: osdmap e59: 9 total, 8 up, 9 in 2023-10-07T00:08:57.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:57 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:57.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:57 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:58.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi005:vg_nvme/lv_1 2023-10-07T00:08:58.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:08:58.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] boot 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: osdmap e60: 9 total, 9 up, 9 in 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:58.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:58.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:58.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:58.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] boot 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: osdmap e60: 9 total, 9 up, 9 in 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:58.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:58.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:58.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:58.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:58.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:59.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: osd.8 [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] boot 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: osdmap e60: 9 total, 9 up, 9 in 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:08:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:08:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:08:59.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:08:59.158 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:08:59.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:59 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi112 2023-10-07T00:08:59.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:59 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi112 to 5755M 2023-10-07T00:08:59.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:08:59 smithi088 ceph-mon[103111]: osdmap e61: 9 total, 9 up, 9 in 2023-10-07T00:08:59.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:59 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi112 2023-10-07T00:08:59.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:59 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi112 to 5755M 2023-10-07T00:08:59.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:08:59 smithi112 ceph-mon[133548]: osdmap e61: 9 total, 9 up, 9 in 2023-10-07T00:09:00.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:59 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi112 2023-10-07T00:09:00.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:59 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi112 to 5755M 2023-10-07T00:09:00.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:08:59 smithi005 ceph-mon[129406]: osdmap e61: 9 total, 9 up, 9 in 2023-10-07T00:09:00.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.565+0000 7fbd5d29f700 1 -- 172.21.15.5:0/1354289793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58100f70 msgr2=0x7fbd58101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:00.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.565+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/1354289793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58100f70 0x7fbd58101390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbd480099c0 tx=0x7fbd48009cd0 comp rx=0 tx=0).stop 2023-10-07T00:09:00.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.565+0000 7fbd5d29f700 1 -- 172.21.15.5:0/1354289793 shutdown_connections 2023-10-07T00:09:00.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.565+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/1354289793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd58102b10 0x7fbd581093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:00.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.565+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/1354289793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58100f70 0x7fbd58101390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:00.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.565+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/1354289793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd58102170 0x7fbd581025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:00.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.565+0000 7fbd5d29f700 1 -- 172.21.15.5:0/1354289793 >> 172.21.15.5:0/1354289793 conn(0x7fbd580fc4d0 msgr2=0x7fbd580fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:09:00.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.566+0000 7fbd5d29f700 1 -- 172.21.15.5:0/1354289793 shutdown_connections 2023-10-07T00:09:00.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.566+0000 7fbd5d29f700 1 -- 172.21.15.5:0/1354289793 wait complete. 2023-10-07T00:09:00.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.567+0000 7fbd5d29f700 1 Processor -- start 2023-10-07T00:09:00.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.567+0000 7fbd5d29f700 1 -- start start 2023-10-07T00:09:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.567+0000 7fbd5d29f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd58100f70 0x7fbd58074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.567+0000 7fbd5d29f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58102170 0x7fbd580732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.567+0000 7fbd5d29f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd58102b10 0x7fbd580737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.567+0000 7fbd5d29f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58073f60 con 0x7fbd58102170 2023-10-07T00:09:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.567+0000 7fbd5d29f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580740d0 con 0x7fbd58102b10 2023-10-07T00:09:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.567+0000 7fbd5d29f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd581a0c40 con 0x7fbd58100f70 2023-10-07T00:09:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58102170 0x7fbd580732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58102170 0x7fbd580732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55078/0 (socket says 172.21.15.5:55078) 2023-10-07T00:09:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 -- 172.21.15.5:0/3976233316 learned_addr learned my addr 172.21.15.5:0/3976233316 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:09:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd577fe700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd58102b10 0x7fbd580737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd56ffd700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd58100f70 0x7fbd58074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 -- 172.21.15.5:0/3976233316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd58100f70 msgr2=0x7fbd58074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd58100f70 0x7fbd58074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 -- 172.21.15.5:0/3976233316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd58102b10 msgr2=0x7fbd580737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd58102b10 0x7fbd580737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 -- 172.21.15.5:0/3976233316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480095f0 con 0x7fbd58102170 2023-10-07T00:09:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd577fe700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd58102b10 0x7fbd580737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:09:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd567fc700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58102170 0x7fbd580732a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d980 tx=0x7fbd4c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:09:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.568+0000 7fbd3ffff700 1 -- 172.21.15.5:0/3976233316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00bb60 con 0x7fbd58102170 2023-10-07T00:09:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.569+0000 7fbd3ffff700 1 -- 172.21.15.5:0/3976233316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd4c007640 con 0x7fbd58102170 2023-10-07T00:09:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.569+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd581a0f20 con 0x7fbd58102170 2023-10-07T00:09:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.569+0000 7fbd3ffff700 1 -- 172.21.15.5:0/3976233316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c004d60 con 0x7fbd58102170 2023-10-07T00:09:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.569+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd581a1390 con 0x7fbd58102170 2023-10-07T00:09:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.570+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd58108640 con 0x7fbd58102170 2023-10-07T00:09:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.572+0000 7fbd3ffff700 1 -- 172.21.15.5:0/3976233316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbd4c004020 con 0x7fbd58102170 2023-10-07T00:09:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.573+0000 7fbd3ffff700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbd400a1480 0x7fbd400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.573+0000 7fbd3ffff700 1 -- 172.21.15.5:0/3976233316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5858+0+0 (secure 0 0 0) 0x7fbd4c0cc800 con 0x7fbd58102170 2023-10-07T00:09:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.573+0000 7fbd56ffd700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbd400a1480 0x7fbd400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.574+0000 7fbd56ffd700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbd400a1480 0x7fbd400a3940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009990 tx=0x7fbd4801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:09:00.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.576+0000 7fbd3ffff700 1 -- 172.21.15.5:0/3976233316 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd4c096750 con 0x7fbd58102170 2023-10-07T00:09:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:00.800+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd5802d2b0 con 0x7fbd400a1480 2023-10-07T00:09:00.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:00 smithi088 ceph-mon[103111]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:00.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:00 smithi088 ceph-mon[103111]: osdmap e62: 9 total, 9 up, 9 in 2023-10-07T00:09:00.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:00 smithi112 ceph-mon[133548]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:00.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:00 smithi112 ceph-mon[133548]: osdmap e62: 9 total, 9 up, 9 in 2023-10-07T00:09:01.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:00 smithi005 ceph-mon[129406]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:01.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:00 smithi005 ceph-mon[129406]: osdmap e62: 9 total, 9 up, 9 in 2023-10-07T00:09:01.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:01 smithi005 ceph-mon[129406]: osdmap e63: 9 total, 9 up, 9 in 2023-10-07T00:09:01.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:01 smithi005 ceph-mon[129406]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:01.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:01.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:01.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:01 smithi112 ceph-mon[133548]: osdmap e63: 9 total, 9 up, 9 in 2023-10-07T00:09:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:01 smithi112 ceph-mon[133548]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:01.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:01 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:01.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:01 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:01.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:01 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:02.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:01 smithi088 ceph-mon[103111]: osdmap e63: 9 total, 9 up, 9 in 2023-10-07T00:09:02.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:01 smithi088 ceph-mon[103111]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:02.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:01 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:02.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:01 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:02.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:01 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:02.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:02 smithi112 ceph-mon[133548]: pgmap v209: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:02.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:02 smithi112 ceph-mon[133548]: osdmap e64: 9 total, 9 up, 9 in 2023-10-07T00:09:03.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:02 smithi005 ceph-mon[129406]: pgmap v209: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:02 smithi005 ceph-mon[129406]: osdmap e64: 9 total, 9 up, 9 in 2023-10-07T00:09:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:02 smithi088 ceph-mon[103111]: pgmap v209: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:02 smithi088 ceph-mon[103111]: osdmap e64: 9 total, 9 up, 9 in 2023-10-07T00:09:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:04 smithi112 ceph-mon[133548]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-10-07T00:09:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:04 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1451881535' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2411c33-6e83-4a69-8cd3-6f08472b288a"}]: dispatch 2023-10-07T00:09:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:04 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1451881535' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2411c33-6e83-4a69-8cd3-6f08472b288a"}]': finished 2023-10-07T00:09:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:04 smithi112 ceph-mon[133548]: osdmap e65: 10 total, 9 up, 10 in 2023-10-07T00:09:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:04 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1931050125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:05.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:04 smithi005 ceph-mon[129406]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-10-07T00:09:05.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:04 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1451881535' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2411c33-6e83-4a69-8cd3-6f08472b288a"}]: dispatch 2023-10-07T00:09:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:04 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1451881535' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2411c33-6e83-4a69-8cd3-6f08472b288a"}]': finished 2023-10-07T00:09:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:04 smithi005 ceph-mon[129406]: osdmap e65: 10 total, 9 up, 10 in 2023-10-07T00:09:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:04 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1931050125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:04 smithi088 ceph-mon[103111]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-10-07T00:09:05.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:04 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1451881535' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2411c33-6e83-4a69-8cd3-6f08472b288a"}]: dispatch 2023-10-07T00:09:05.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:04 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1451881535' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2411c33-6e83-4a69-8cd3-6f08472b288a"}]': finished 2023-10-07T00:09:05.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:04 smithi088 ceph-mon[103111]: osdmap e65: 10 total, 9 up, 10 in 2023-10-07T00:09:05.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:05.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:04 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1931050125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:06.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:06 smithi112 ceph-mon[133548]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-10-07T00:09:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:06 smithi005 ceph-mon[129406]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-10-07T00:09:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:06 smithi088 ceph-mon[103111]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-10-07T00:09:08.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:08 smithi112 ceph-mon[133548]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-07T00:09:09.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:08 smithi005 ceph-mon[129406]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-07T00:09:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:08 smithi088 ceph-mon[103111]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-07T00:09:10.865 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:10 smithi005 ceph-mon[129406]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:09:10.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:10 smithi088 ceph-mon[103111]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:09:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:10 smithi112 ceph-mon[133548]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-07T00:09:11.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-07T00:09:11.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:11.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:11 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-07T00:09:11.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:11 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:11.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:11 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-07T00:09:11.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:11 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:12.708 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:12 smithi005 ceph-mon[129406]: Deploying daemon osd.9 on smithi005 2023-10-07T00:09:12.708 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:12 smithi005 ceph-mon[129406]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:12.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:12 smithi088 ceph-mon[103111]: Deploying daemon osd.9 on smithi005 2023-10-07T00:09:12.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:12 smithi088 ceph-mon[103111]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:12.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:12 smithi112 ceph-mon[133548]: Deploying daemon osd.9 on smithi005 2023-10-07T00:09:12.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:12 smithi112 ceph-mon[133548]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:14.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:14 smithi088 ceph-mon[103111]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:14.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:14 smithi005 ceph-mon[129406]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:14.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:14 smithi112 ceph-mon[133548]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:16.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:16 smithi088 ceph-mon[103111]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:16.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:16 smithi112 ceph-mon[133548]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:16 smithi005 ceph-mon[129406]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:18.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:18.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:18.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:18.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:18 smithi005 ceph-mon[129406]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:18.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:18.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:18.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:18.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:18 smithi088 ceph-mon[103111]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:18.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:18.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:18.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:18.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:18 smithi112 ceph-mon[133548]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:20.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:20 smithi088 ceph-mon[103111]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:20.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:20 smithi112 ceph-mon[133548]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:21.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:20 smithi005 ceph-mon[129406]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:21.163 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 9 on host 'smithi005' 2023-10-07T00:09:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.161+0000 7fbd3ffff700 1 -- 172.21.15.5:0/3976233316 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbd5802d2b0 con 0x7fbd400a1480 2023-10-07T00:09:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbd400a1480 msgr2=0x7fbd400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbd400a1480 0x7fbd400a3940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009990 tx=0x7fbd4801a040 comp rx=0 tx=0).stop 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58102170 msgr2=0x7fbd580732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58102170 0x7fbd580732a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d980 tx=0x7fbd4c00dd40 comp rx=0 tx=0).stop 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 shutdown_connections 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbd400a1480 0x7fbd400a3940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd58102b10 0x7fbd580737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd58100f70 0x7fbd58074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 --2- 172.21.15.5:0/3976233316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd58102170 0x7fbd580732a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 >> 172.21.15.5:0/3976233316 conn(0x7fbd580fc4d0 msgr2=0x7fbd58105780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 shutdown_connections 2023-10-07T00:09:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:09:21.164+0000 7fbd5d29f700 1 -- 172.21.15.5:0/3976233316 wait complete. 2023-10-07T00:09:21.689 DEBUG:teuthology.orchestra.run.smithi005:osd.9> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-07T00:09:21.693 INFO:tasks.cephadm:Deploying osd.10 on smithi088 with /dev/vg_nvme/lv_1... 2023-10-07T00:09:21.693 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-07T00:09:21.773 INFO:journalctl@ceph.osd.9.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:09:22.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:21 smithi005 ceph-mon[129406]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-07T00:09:22.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:22.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:22.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:22.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:21 smithi088 ceph-mon[103111]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-07T00:09:22.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:22.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:22.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:22.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:22.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:21 smithi112 ceph-mon[133548]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-07T00:09:22.428 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:09:22.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:22 smithi005 ceph-mon[129406]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:22.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:22 smithi005 ceph-mon[129406]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-07T00:09:22.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:22 smithi005 ceph-mon[129406]: osdmap e66: 10 total, 9 up, 10 in 2023-10-07T00:09:22.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:22 smithi005 ceph-mon[129406]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:09:22.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:22 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:23.006 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:22 smithi088 ceph-mon[103111]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:23.006 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:22 smithi088 ceph-mon[103111]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-07T00:09:23.006 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:22 smithi088 ceph-mon[103111]: osdmap e66: 10 total, 9 up, 10 in 2023-10-07T00:09:23.006 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:22 smithi088 ceph-mon[103111]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:09:23.006 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:22 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:22 smithi112 ceph-mon[133548]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:22 smithi112 ceph-mon[133548]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-07T00:09:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:22 smithi112 ceph-mon[133548]: osdmap e66: 10 total, 9 up, 10 in 2023-10-07T00:09:23.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:22 smithi112 ceph-mon[133548]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-07T00:09:23.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:22 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:23.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:09:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:09:23.132+0000 7fc3d9e28700 -1 osd.9 0 waiting for initial osdmap 2023-10-07T00:09:23.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:09:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:09:23.149+0000 7fc3d2c17700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:09:24.367 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-07T00:09:24.367 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-07T00:09:24.367 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2023-10-07T00:09:24.368 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2023-10-07T00:09:24.368 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0303753 s, 345 MB/s 2023-10-07T00:09:24.368 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2023-10-07T00:09:24.403 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:24 smithi088 ceph-mon[103111]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:09:24.403 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:24 smithi088 ceph-mon[103111]: osdmap e67: 10 total, 9 up, 10 in 2023-10-07T00:09:24.403 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:24 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:24.403 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:24 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:24.403 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:24 smithi088 ceph-mon[103111]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:24.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:24 smithi112 ceph-mon[133548]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:09:24.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:24 smithi112 ceph-mon[133548]: osdmap e67: 10 total, 9 up, 10 in 2023-10-07T00:09:24.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:24 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:24.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:24 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:24.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:24 smithi112 ceph-mon[133548]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:24.605 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:24 smithi005 ceph-mon[129406]: from='osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-07T00:09:24.605 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:24 smithi005 ceph-mon[129406]: osdmap e67: 10 total, 9 up, 10 in 2023-10-07T00:09:24.606 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:24.606 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:24 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:24.606 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:24 smithi005 ceph-mon[129406]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-07T00:09:24.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi088:vg_nvme/lv_1 2023-10-07T00:09:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:25 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:09:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:25 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:09:25.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:25 smithi088 ceph-mon[103111]: osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] boot 2023-10-07T00:09:25.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:25 smithi088 ceph-mon[103111]: osdmap e68: 10 total, 10 up, 10 in 2023-10-07T00:09:25.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:25 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:25.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:25 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:09:25.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:25 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:09:25.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:25 smithi112 ceph-mon[133548]: osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] boot 2023-10-07T00:09:25.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:25 smithi112 ceph-mon[133548]: osdmap e68: 10 total, 10 up, 10 in 2023-10-07T00:09:25.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:25 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:25.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:25 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:09:25.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:25 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:09:25.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:25 smithi005 ceph-mon[129406]: osd.9 [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] boot 2023-10-07T00:09:25.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:25 smithi005 ceph-mon[129406]: osdmap e68: 10 total, 10 up, 10 in 2023-10-07T00:09:25.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:25 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-07T00:09:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: osdmap e69: 10 total, 10 up, 10 in 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi005 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi005 to 4318M 2023-10-07T00:09:26.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:26.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:26.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:26 smithi088 ceph-mon[103111]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: osdmap e69: 10 total, 10 up, 10 in 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi005 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi005 to 4318M 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:26.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:26.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:26 smithi112 ceph-mon[133548]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:26.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: osdmap e69: 10 total, 10 up, 10 in 2023-10-07T00:09:26.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi005 2023-10-07T00:09:26.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:26.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi005 to 4318M 2023-10-07T00:09:26.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:26.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:26.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:26.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:26 smithi005 ceph-mon[129406]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:27.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 -- 172.21.15.88:0/1721900604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 msgr2=0x7f1548073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:27.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 --2- 172.21.15.88:0/1721900604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 0x7f1548073d90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1530009990 tx=0x7f1530009ca0 comp rx=0 tx=0).stop 2023-10-07T00:09:27.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 -- 172.21.15.88:0/1721900604 shutdown_connections 2023-10-07T00:09:27.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 --2- 172.21.15.88:0/1721900604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f154810d550 0x7f154810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:27.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 --2- 172.21.15.88:0/1721900604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1548074ee0 0x7f1548073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:27.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 --2- 172.21.15.88:0/1721900604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 0x7f1548073d90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:27.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 -- 172.21.15.88:0/1721900604 >> 172.21.15.88:0/1721900604 conn(0x7f15480fc4d0 msgr2=0x7f15480fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:09:27.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 -- 172.21.15.88:0/1721900604 shutdown_connections 2023-10-07T00:09:27.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.123+0000 7f154d12a700 1 -- 172.21.15.88:0/1721900604 wait complete. 2023-10-07T00:09:27.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.124+0000 7f154d12a700 1 Processor -- start 2023-10-07T00:09:27.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.124+0000 7f154d12a700 1 -- start start 2023-10-07T00:09:27.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154d12a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 0x7f154819d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:27.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154d12a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1548074ee0 0x7f154819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:27.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154d12a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f154810d550 0x7f15481a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:27.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154d12a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15481a4da0 con 0x7f1548074ee0 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154d12a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15481a4ee0 con 0x7f1548073910 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154d12a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15481a5070 con 0x7f154810d550 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f1546d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 0x7f154819d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f1546d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 0x7f154819d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39876/0 (socket says 172.21.15.88:39876) 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f1546d9d700 1 -- 172.21.15.88:0/1826162395 learned_addr learned my addr 172.21.15.88:0/1826162395 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154759e700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f154810d550 0x7f15481a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f1546d9d700 1 -- 172.21.15.88:0/1826162395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f154810d550 msgr2=0x7f15481a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f1546d9d700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f154810d550 0x7f15481a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154659c700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1548074ee0 0x7f154819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f1546d9d700 1 -- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1548074ee0 msgr2=0x7f154819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f1546d9d700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1548074ee0 0x7f154819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f1546d9d700 1 -- 172.21.15.88:0/1826162395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300095f0 con 0x7f1548073910 2023-10-07T00:09:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.125+0000 7f154659c700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1548074ee0 0x7f154819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:09:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.126+0000 7f1546d9d700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 0x7f154819d210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f153800d980 tx=0x7f153800dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:09:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.126+0000 7f153ffff700 1 -- 172.21.15.88:0/1826162395 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538009b40 con 0x7f1548073910 2023-10-07T00:09:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.126+0000 7f153ffff700 1 -- 172.21.15.88:0/1826162395 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f153800de60 con 0x7f1548073910 2023-10-07T00:09:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.126+0000 7f153ffff700 1 -- 172.21.15.88:0/1826162395 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800f620 con 0x7f1548073910 2023-10-07T00:09:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.126+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15481a5350 con 0x7f1548073910 2023-10-07T00:09:27.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.126+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15481a5800 con 0x7f1548073910 2023-10-07T00:09:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.127+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15481030a0 con 0x7f1548073910 2023-10-07T00:09:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.129+0000 7f153ffff700 1 -- 172.21.15.88:0/1826162395 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1538010460 con 0x7f1548073910 2023-10-07T00:09:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.130+0000 7f153ffff700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f15340a1500 0x7f15340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.131+0000 7f153ffff700 1 -- 172.21.15.88:0/1826162395 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f15380cc0e0 con 0x7f1548073910 2023-10-07T00:09:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.131+0000 7f154659c700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f15340a1500 0x7f15340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:27.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.132+0000 7f154659c700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f15340a1500 0x7f15340a39c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1530005f50 tx=0x7f1530005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:09:27.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.133+0000 7f153ffff700 1 -- 172.21.15.88:0/1826162395 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1538095f20 con 0x7f1548073910 2023-10-07T00:09:27.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:27.338+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f154802d280 con 0x7f15340a1500 2023-10-07T00:09:27.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:27.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:27.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:27.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:27.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:27.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:27.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:27.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:27.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:28.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:28 smithi088 ceph-mon[103111]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:28.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:28 smithi088 ceph-mon[103111]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:28.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:28 smithi112 ceph-mon[133548]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:28.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:28 smithi112 ceph-mon[133548]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:28.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:28 smithi005 ceph-mon[129406]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:28.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:28 smithi005 ceph-mon[129406]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:30.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:30 smithi088 ceph-mon[103111]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:30 smithi088 ceph-mon[103111]: from='client.? 172.21.15.88:0/687094831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]: dispatch 2023-10-07T00:09:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:30 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]: dispatch 2023-10-07T00:09:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:30 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]': finished 2023-10-07T00:09:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:30 smithi088 ceph-mon[103111]: osdmap e70: 11 total, 10 up, 11 in 2023-10-07T00:09:30.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:30 smithi112 ceph-mon[133548]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:30 smithi112 ceph-mon[133548]: from='client.? 172.21.15.88:0/687094831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]: dispatch 2023-10-07T00:09:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:30 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]: dispatch 2023-10-07T00:09:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:30 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]': finished 2023-10-07T00:09:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:30 smithi112 ceph-mon[133548]: osdmap e70: 11 total, 10 up, 11 in 2023-10-07T00:09:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:30 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:31.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:30 smithi005 ceph-mon[129406]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:30 smithi005 ceph-mon[129406]: from='client.? 172.21.15.88:0/687094831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]: dispatch 2023-10-07T00:09:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:30 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]: dispatch 2023-10-07T00:09:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:30 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23623dd7-34f4-471f-8c60-c99314accd66"}]': finished 2023-10-07T00:09:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:30 smithi005 ceph-mon[129406]: osdmap e70: 11 total, 10 up, 11 in 2023-10-07T00:09:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:31.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:31 smithi088 ceph-mon[103111]: from='client.? 172.21.15.88:0/2448559574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:31.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:31 smithi112 ceph-mon[133548]: from='client.? 172.21.15.88:0/2448559574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:31 smithi005 ceph-mon[129406]: from='client.? 172.21.15.88:0/2448559574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:32.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:32 smithi088 ceph-mon[103111]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:32 smithi112 ceph-mon[133548]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:33.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:32 smithi005 ceph-mon[129406]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:34.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:34 smithi088 ceph-mon[103111]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:34 smithi112 ceph-mon[133548]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:35.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:34 smithi005 ceph-mon[129406]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:36 smithi088 ceph-mon[103111]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:36 smithi112 ceph-mon[133548]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:36 smithi005 ceph-mon[129406]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:38.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:38 smithi088 ceph-mon[103111]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:38.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:38 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-07T00:09:38.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:38 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:38.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:38 smithi088 ceph-mon[103111]: Deploying daemon osd.10 on smithi088 2023-10-07T00:09:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:38 smithi112 ceph-mon[133548]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:38 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-07T00:09:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:38 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:38 smithi112 ceph-mon[133548]: Deploying daemon osd.10 on smithi088 2023-10-07T00:09:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:38 smithi005 ceph-mon[129406]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:38 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-07T00:09:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:38 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:38 smithi005 ceph-mon[129406]: Deploying daemon osd.10 on smithi088 2023-10-07T00:09:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:40 smithi088 ceph-mon[103111]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:40 smithi112 ceph-mon[133548]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:41.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:40 smithi005 ceph-mon[129406]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:42 smithi088 ceph-mon[103111]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:42 smithi112 ceph-mon[133548]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:43.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:42 smithi005 ceph-mon[129406]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:44.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:44 smithi088 ceph-mon[103111]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:44.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:44.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:44.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:44 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:44 smithi112 ceph-mon[133548]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:44.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:44 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:44 smithi005 ceph-mon[129406]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:44 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:46.948 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:46 smithi088 ceph-mon[103111]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:46.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:46 smithi112 ceph-mon[133548]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:47.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:46 smithi005 ceph-mon[129406]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:47.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.314+0000 7f153ffff700 1 -- 172.21.15.88:0/1826162395 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f154802d280 con 0x7f15340a1500 2023-10-07T00:09:47.315 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 10 on host 'smithi088' 2023-10-07T00:09:47.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.317+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f15340a1500 msgr2=0x7f15340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:47.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.317+0000 7f154d12a700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f15340a1500 0x7f15340a39c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1530005f50 tx=0x7f1530005e80 comp rx=0 tx=0).stop 2023-10-07T00:09:47.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.317+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 msgr2=0x7f154819d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:47.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.317+0000 7f154d12a700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 0x7f154819d210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f153800d980 tx=0x7f153800dd40 comp rx=0 tx=0).stop 2023-10-07T00:09:47.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.318+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 shutdown_connections 2023-10-07T00:09:47.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.318+0000 7f154d12a700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f15340a1500 0x7f15340a39c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:47.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.318+0000 7f154d12a700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f154810d550 0x7f15481a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:47.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.318+0000 7f154d12a700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1548073910 0x7f154819d210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:47.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.318+0000 7f154d12a700 1 --2- 172.21.15.88:0/1826162395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1548074ee0 0x7f154819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:47.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.318+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 >> 172.21.15.88:0/1826162395 conn(0x7f15480fc4d0 msgr2=0x7f15480fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:09:47.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.318+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 shutdown_connections 2023-10-07T00:09:47.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-07T00:09:47.318+0000 7f154d12a700 1 -- 172.21.15.88:0/1826162395 wait complete. 2023-10-07T00:09:47.844 DEBUG:teuthology.orchestra.run.smithi088:osd.10> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-07T00:09:47.849 INFO:tasks.cephadm:Deploying osd.11 on smithi112 with /dev/vg_nvme/lv_1... 2023-10-07T00:09:47.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-07T00:09:47.933 INFO:journalctl@ceph.osd.10.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:09:48.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:09:47 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:09:47.937+0000 7fbd5aadf640 -1 osd.10 0 log_to_monitors true 2023-10-07T00:09:48.564 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.564 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.565 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.565 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.565 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:48 smithi088 ceph-mon[103111]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:48.565 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:48 smithi088 ceph-mon[103111]: from='osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-07T00:09:48.565 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:48 smithi088 ceph-mon[103111]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-07T00:09:48.588 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:09:48.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:48 smithi005 ceph-mon[129406]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:48.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:48 smithi005 ceph-mon[129406]: from='osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-07T00:09:48.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:48 smithi005 ceph-mon[129406]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-07T00:09:48.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:48.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:48 smithi112 ceph-mon[133548]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:48.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:48 smithi112 ceph-mon[133548]: from='osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-07T00:09:48.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:48 smithi112 ceph-mon[133548]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-07T00:09:49.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:49 smithi112 ceph-mon[133548]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-07T00:09:49.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:49 smithi112 ceph-mon[133548]: osdmap e71: 11 total, 10 up, 11 in 2023-10-07T00:09:49.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:49.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:49 smithi112 ceph-mon[133548]: from='osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:09:49.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:49 smithi112 ceph-mon[133548]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:09:49.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:49 smithi005 ceph-mon[129406]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-07T00:09:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:49 smithi005 ceph-mon[129406]: osdmap e71: 11 total, 10 up, 11 in 2023-10-07T00:09:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:49 smithi005 ceph-mon[129406]: from='osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:09:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:49 smithi005 ceph-mon[129406]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:09:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:49 smithi088 ceph-mon[103111]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-07T00:09:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:49 smithi088 ceph-mon[103111]: osdmap e71: 11 total, 10 up, 11 in 2023-10-07T00:09:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:49 smithi088 ceph-mon[103111]: from='osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:09:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:49 smithi088 ceph-mon[103111]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2023-10-07T00:09:49.704 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:09:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:09:49.355+0000 7fbd50957700 -1 osd.10 0 waiting for initial osdmap 2023-10-07T00:09:49.705 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:09:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:09:49.369+0000 7fbd4a748700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:09:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-07T00:09:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-07T00:09:50.441 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2023-10-07T00:09:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2023-10-07T00:09:50.441 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0312198 s, 336 MB/s 2023-10-07T00:09:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2023-10-07T00:09:50.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:50 smithi005 ceph-mon[129406]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:09:50.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:50 smithi005 ceph-mon[129406]: osdmap e72: 11 total, 10 up, 11 in 2023-10-07T00:09:50.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:50 smithi005 ceph-mon[129406]: osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] boot 2023-10-07T00:09:50.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:50 smithi005 ceph-mon[129406]: osdmap e73: 11 total, 11 up, 11 in 2023-10-07T00:09:50.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:50 smithi005 ceph-mon[129406]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:50.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:50 smithi112 ceph-mon[133548]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:09:50.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:50 smithi112 ceph-mon[133548]: osdmap e72: 11 total, 10 up, 11 in 2023-10-07T00:09:50.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:50 smithi112 ceph-mon[133548]: osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] boot 2023-10-07T00:09:50.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:50 smithi112 ceph-mon[133548]: osdmap e73: 11 total, 11 up, 11 in 2023-10-07T00:09:50.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.610 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:50 smithi112 ceph-mon[133548]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:50.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:50 smithi088 ceph-mon[103111]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2023-10-07T00:09:50.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:50 smithi088 ceph-mon[103111]: osdmap e72: 11 total, 10 up, 11 in 2023-10-07T00:09:50.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:50 smithi088 ceph-mon[103111]: osd.10 [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] boot 2023-10-07T00:09:50.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:50 smithi088 ceph-mon[103111]: osdmap e73: 11 total, 11 up, 11 in 2023-10-07T00:09:50.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-07T00:09:50.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:50 smithi088 ceph-mon[103111]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-07T00:09:50.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi112:vg_nvme/lv_1 2023-10-07T00:09:51.693 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: osdmap e74: 11 total, 11 up, 11 in 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:51.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:51.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:51.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:51.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:51.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:51.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:51 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:09:51.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:09:51.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: osdmap e74: 11 total, 11 up, 11 in 2023-10-07T00:09:51.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:51.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:51 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:52.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: osdmap e74: 11 total, 11 up, 11 in 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:09:52.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:52.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:52.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:52.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:52.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:09:52.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:52.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:09:52.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:51 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:09:52.923 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:52 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi088 2023-10-07T00:09:52.923 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:52 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi088 to 4316M 2023-10-07T00:09:52.923 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:52 smithi112 ceph-mon[133548]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:09:52.923 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:52 smithi112 ceph-mon[133548]: osdmap e75: 11 total, 11 up, 11 in 2023-10-07T00:09:52.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:52 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi088 2023-10-07T00:09:52.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:52 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi088 to 4316M 2023-10-07T00:09:52.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:52 smithi088 ceph-mon[103111]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:09:52.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:52 smithi088 ceph-mon[103111]: osdmap e75: 11 total, 11 up, 11 in 2023-10-07T00:09:53.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:52 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi088 2023-10-07T00:09:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:52 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi088 to 4316M 2023-10-07T00:09:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:52 smithi005 ceph-mon[129406]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:09:53.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:52 smithi005 ceph-mon[129406]: osdmap e75: 11 total, 11 up, 11 in 2023-10-07T00:09:53.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 -- 172.21.15.112:0/1060175925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102170 msgr2=0x7f31541025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:53.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 --2- 172.21.15.112:0/1060175925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102170 0x7f31541025d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3148009990 tx=0x7f3148009ca0 comp rx=0 tx=0).stop 2023-10-07T00:09:53.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 -- 172.21.15.112:0/1060175925 shutdown_connections 2023-10-07T00:09:53.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 --2- 172.21.15.112:0/1060175925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3154102b10 0x7f31541093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:53.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 --2- 172.21.15.112:0/1060175925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3154100f70 0x7f3154101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:53.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 --2- 172.21.15.112:0/1060175925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102170 0x7f31541025d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:53.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 -- 172.21.15.112:0/1060175925 >> 172.21.15.112:0/1060175925 conn(0x7f31540fc4d0 msgr2=0x7f31540fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:09:53.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 -- 172.21.15.112:0/1060175925 shutdown_connections 2023-10-07T00:09:53.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.168+0000 7f31595dd700 1 -- 172.21.15.112:0/1060175925 wait complete. 2023-10-07T00:09:53.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.169+0000 7f31595dd700 1 Processor -- start 2023-10-07T00:09:53.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.169+0000 7f31595dd700 1 -- start start 2023-10-07T00:09:53.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.169+0000 7f31595dd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3154100f70 0x7f3154198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:53.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.169+0000 7f31595dd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3154102170 0x7f3154199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:53.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.169+0000 7f31595dd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102b10 0x7f31541a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:53.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.169+0000 7f31595dd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31541a08e0 con 0x7f3154102170 2023-10-07T00:09:53.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.169+0000 7f31595dd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31541a0a20 con 0x7f3154100f70 2023-10-07T00:09:53.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.169+0000 7f31595dd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31541a0bb0 con 0x7f3154102b10 2023-10-07T00:09:53.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102b10 0x7f31541a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:53.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102b10 0x7f31541a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37754/0 (socket says 172.21.15.112:37754) 2023-10-07T00:09:53.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 -- 172.21.15.112:0/1749271190 learned_addr learned my addr 172.21.15.112:0/1749271190 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:09:53.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31527fc700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3154102170 0x7f3154199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:53.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f3152ffd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3154100f70 0x7f3154198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:53.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 -- 172.21.15.112:0/1749271190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3154100f70 msgr2=0x7f3154198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3154100f70 0x7f3154198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 -- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3154102170 msgr2=0x7f3154199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:09:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3154102170 0x7f3154199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:09:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 -- 172.21.15.112:0/1749271190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31480095f0 con 0x7f3154102b10 2023-10-07T00:09:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.170+0000 7f31537fe700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102b10 0x7f31541a0310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f314c007f10 tx=0x7f314c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:09:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.171+0000 7f313bfff700 1 -- 172.21.15.112:0/1749271190 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c017070 con 0x7f3154102b10 2023-10-07T00:09:53.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.171+0000 7f313bfff700 1 -- 172.21.15.112:0/1749271190 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f314c00f040 con 0x7f3154102b10 2023-10-07T00:09:53.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.171+0000 7f313bfff700 1 -- 172.21.15.112:0/1749271190 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c005710 con 0x7f3154102b10 2023-10-07T00:09:53.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.171+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31541a0e90 con 0x7f3154102b10 2023-10-07T00:09:53.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.171+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31541a12b0 con 0x7f3154102b10 2023-10-07T00:09:53.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.172+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3154193410 con 0x7f3154102b10 2023-10-07T00:09:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.175+0000 7f313bfff700 1 -- 172.21.15.112:0/1749271190 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f314c004ad0 con 0x7f3154102b10 2023-10-07T00:09:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.176+0000 7f313bfff700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f313c0a1500 0x7f313c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:09:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.177+0000 7f313bfff700 1 -- 172.21.15.112:0/1749271190 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f314c0cc4b0 con 0x7f3154102b10 2023-10-07T00:09:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.177+0000 7f3152ffd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f313c0a1500 0x7f313c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:09:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.178+0000 7f3152ffd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f313c0a1500 0x7f313c0a39c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3154101fd0 tx=0x7f3144009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:09:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.179+0000 7f313bfff700 1 -- 172.21.15.112:0/1749271190 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f314c0960c0 con 0x7f3154102b10 2023-10-07T00:09:53.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:09:53.386+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f315402d350 con 0x7f313c0a1500 2023-10-07T00:09:53.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:53 smithi088 ceph-mon[103111]: osdmap e76: 11 total, 11 up, 11 in 2023-10-07T00:09:53.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:53.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:53.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:53 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:53 smithi112 ceph-mon[133548]: osdmap e76: 11 total, 11 up, 11 in 2023-10-07T00:09:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:53.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:53 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:54.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:53 smithi005 ceph-mon[129406]: osdmap e76: 11 total, 11 up, 11 in 2023-10-07T00:09:54.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-07T00:09:54.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-07T00:09:54.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:53 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:09:54.935 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:54 smithi112 ceph-mon[133548]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:54.935 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:54 smithi112 ceph-mon[133548]: pgmap v248: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-07T00:09:54.935 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:54 smithi112 ceph-mon[133548]: osdmap e77: 11 total, 11 up, 11 in 2023-10-07T00:09:54.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:54 smithi088 ceph-mon[103111]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:54.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:54 smithi088 ceph-mon[103111]: pgmap v248: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-07T00:09:54.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:54 smithi088 ceph-mon[103111]: osdmap e77: 11 total, 11 up, 11 in 2023-10-07T00:09:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:54 smithi005 ceph-mon[129406]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:09:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:54 smithi005 ceph-mon[129406]: pgmap v248: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-07T00:09:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:54 smithi005 ceph-mon[129406]: osdmap e77: 11 total, 11 up, 11 in 2023-10-07T00:09:56.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:56 smithi088 ceph-mon[103111]: pgmap v250: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 115 KiB/s, 0 objects/s recovering 2023-10-07T00:09:56.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:56 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/2396814899' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]: dispatch 2023-10-07T00:09:56.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:56 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]: dispatch 2023-10-07T00:09:56.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:56 smithi088 ceph-mon[103111]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]': finished 2023-10-07T00:09:56.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:56 smithi088 ceph-mon[103111]: osdmap e78: 12 total, 11 up, 12 in 2023-10-07T00:09:56.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:56 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:09:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:56 smithi112 ceph-mon[133548]: pgmap v250: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 115 KiB/s, 0 objects/s recovering 2023-10-07T00:09:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:56 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/2396814899' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]: dispatch 2023-10-07T00:09:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:56 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]: dispatch 2023-10-07T00:09:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:56 smithi112 ceph-mon[133548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]': finished 2023-10-07T00:09:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:56 smithi112 ceph-mon[133548]: osdmap e78: 12 total, 11 up, 12 in 2023-10-07T00:09:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:56 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:09:57.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:56 smithi005 ceph-mon[129406]: pgmap v250: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 115 KiB/s, 0 objects/s recovering 2023-10-07T00:09:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:56 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/2396814899' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]: dispatch 2023-10-07T00:09:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:56 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]: dispatch 2023-10-07T00:09:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:56 smithi005 ceph-mon[129406]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44ce1587-7ab8-4271-b6b1-443ae111ab2c"}]': finished 2023-10-07T00:09:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:56 smithi005 ceph-mon[129406]: osdmap e78: 12 total, 11 up, 12 in 2023-10-07T00:09:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:56 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:09:57.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:57 smithi088 ceph-mon[103111]: from='client.? 172.21.15.112:0/3653292311' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:57 smithi112 ceph-mon[133548]: from='client.? 172.21.15.112:0/3653292311' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:58.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:57 smithi005 ceph-mon[129406]: from='client.? 172.21.15.112:0/3653292311' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-07T00:09:58.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:09:58 smithi088 ceph-mon[103111]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:09:58.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:09:58 smithi112 ceph-mon[133548]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:09:59.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:09:58 smithi005 ceph-mon[129406]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-07T00:10:00.673 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:00 smithi112 ceph-mon[133548]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:00.673 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:00 smithi112 ceph-mon[133548]: overall HEALTH_OK 2023-10-07T00:10:00.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:00 smithi088 ceph-mon[103111]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:00 smithi088 ceph-mon[103111]: overall HEALTH_OK 2023-10-07T00:10:01.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:00 smithi005 ceph-mon[129406]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:01.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:00 smithi005 ceph-mon[129406]: overall HEALTH_OK 2023-10-07T00:10:02.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:02 smithi088 ceph-mon[103111]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:02.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:02 smithi112 ceph-mon[133548]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:03.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:02 smithi005 ceph-mon[129406]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:04.910 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:04 smithi112 ceph-mon[133548]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:04.911 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-07T00:10:04.911 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:04.911 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:04 smithi112 ceph-mon[133548]: Deploying daemon osd.11 on smithi112 2023-10-07T00:10:04.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:04 smithi088 ceph-mon[103111]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:04.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-07T00:10:04.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:04.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:04 smithi088 ceph-mon[103111]: Deploying daemon osd.11 on smithi112 2023-10-07T00:10:05.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:04 smithi005 ceph-mon[129406]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-07T00:10:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:04 smithi005 ceph-mon[129406]: Deploying daemon osd.11 on smithi112 2023-10-07T00:10:06.864 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:06 smithi112 ceph-mon[133548]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:06.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:06 smithi088 ceph-mon[103111]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:06 smithi005 ceph-mon[129406]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:08.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:08 smithi088 ceph-mon[103111]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:08.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:08 smithi112 ceph-mon[133548]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:08 smithi005 ceph-mon[129406]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:10.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:10 smithi088 ceph-mon[103111]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:10.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:10 smithi112 ceph-mon[133548]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:10.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:10 smithi005 ceph-mon[129406]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:12.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:12 smithi088 ceph-mon[103111]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:12.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:12 smithi112 ceph-mon[133548]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:12 smithi005 ceph-mon[129406]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:13.172 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 11 on host 'smithi112' 2023-10-07T00:10:13.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.171+0000 7f313bfff700 1 -- 172.21.15.112:0/1749271190 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f315402d350 con 0x7f313c0a1500 2023-10-07T00:10:13.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.174+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f313c0a1500 msgr2=0x7f313c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:13.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.174+0000 7f31595dd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f313c0a1500 0x7f313c0a39c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3154101fd0 tx=0x7f3144009260 comp rx=0 tx=0).stop 2023-10-07T00:10:13.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.174+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102b10 msgr2=0x7f31541a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:13.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.174+0000 7f31595dd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102b10 0x7f31541a0310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f314c007f10 tx=0x7f314c00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:10:13.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.175+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 shutdown_connections 2023-10-07T00:10:13.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.175+0000 7f31595dd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f313c0a1500 0x7f313c0a39c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:13.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.175+0000 7f31595dd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3154102b10 0x7f31541a0310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:13.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.175+0000 7f31595dd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3154100f70 0x7f3154198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:13.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.175+0000 7f31595dd700 1 --2- 172.21.15.112:0/1749271190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3154102170 0x7f3154199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:13.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.175+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 >> 172.21.15.112:0/1749271190 conn(0x7f31540fc4d0 msgr2=0x7f3154107b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:13.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.175+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 shutdown_connections 2023-10-07T00:10:13.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:13.175+0000 7f31595dd700 1 -- 172.21.15.112:0/1749271190 wait complete. 2023-10-07T00:10:13.614 DEBUG:teuthology.orchestra.run.smithi112:osd.11> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-07T00:10:13.618 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-07T00:10:13.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-07T00:10:13.689 INFO:journalctl@ceph.osd.11.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:10:14.145 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:10:13 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:10:13.859+0000 7f9afd3ec640 -1 osd.11 0 log_to_monitors true 2023-10-07T00:10:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:10:14.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:14 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:14 smithi088 ceph-mon[103111]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:14.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:14 smithi088 ceph-mon[103111]: from='osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-07T00:10:14.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:14 smithi088 ceph-mon[103111]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-07T00:10:14.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:14 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:14 smithi112 ceph-mon[133548]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:14.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:14 smithi112 ceph-mon[133548]: from='osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-07T00:10:14.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:14 smithi112 ceph-mon[133548]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-07T00:10:14.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:14 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:14.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:14 smithi005 ceph-mon[129406]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:14.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:14 smithi005 ceph-mon[129406]: from='osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-07T00:10:14.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:14 smithi005 ceph-mon[129406]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-07T00:10:15.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:10:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:10:15.201+0000 7f9af2a63700 -1 osd.11 0 waiting for initial osdmap 2023-10-07T00:10:15.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:10:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:10:15.218+0000 7f9aee057700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T00:10:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:15 smithi112 ceph-mon[133548]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-07T00:10:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:15 smithi112 ceph-mon[133548]: osdmap e79: 12 total, 11 up, 12 in 2023-10-07T00:10:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:15 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:15 smithi112 ceph-mon[133548]: from='osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:10:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:15 smithi112 ceph-mon[133548]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:10:15.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:15 smithi088 ceph-mon[103111]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-07T00:10:15.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:15 smithi088 ceph-mon[103111]: osdmap e79: 12 total, 11 up, 12 in 2023-10-07T00:10:15.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:15 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:15.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:15 smithi088 ceph-mon[103111]: from='osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:10:15.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:15 smithi088 ceph-mon[103111]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:10:15.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:15 smithi005 ceph-mon[129406]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-07T00:10:15.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:15 smithi005 ceph-mon[129406]: osdmap e79: 12 total, 11 up, 12 in 2023-10-07T00:10:15.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:15 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:15.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:15 smithi005 ceph-mon[129406]: from='osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:10:15.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:15 smithi005 ceph-mon[129406]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2023-10-07T00:10:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 -- 172.21.15.5:0/2318983925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 msgr2=0x7fb0341025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 --2- 172.21.15.5:0/2318983925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 0x7fb0341025d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0280099c0 tx=0x7fb028009cd0 comp rx=0 tx=0).stop 2023-10-07T00:10:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 -- 172.21.15.5:0/2318983925 shutdown_connections 2023-10-07T00:10:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 --2- 172.21.15.5:0/2318983925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb034102b10 0x7fb0341093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 --2- 172.21.15.5:0/2318983925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb034100f70 0x7fb034101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 --2- 172.21.15.5:0/2318983925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 0x7fb0341025d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 -- 172.21.15.5:0/2318983925 >> 172.21.15.5:0/2318983925 conn(0x7fb0340fc4d0 msgr2=0x7fb0340fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 -- 172.21.15.5:0/2318983925 shutdown_connections 2023-10-07T00:10:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.885+0000 7fb038d58700 1 -- 172.21.15.5:0/2318983925 wait complete. 2023-10-07T00:10:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.887+0000 7fb038d58700 1 Processor -- start 2023-10-07T00:10:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.887+0000 7fb038d58700 1 -- start start 2023-10-07T00:10:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.887+0000 7fb038d58700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb034100f70 0x7fb034196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.887+0000 7fb038d58700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 0x7fb034197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.887+0000 7fb038d58700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb034102b10 0x7fb03419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.887+0000 7fb038d58700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03419e6b0 con 0x7fb034102170 2023-10-07T00:10:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.887+0000 7fb038d58700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03419e7f0 con 0x7fb034100f70 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.887+0000 7fb038d58700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03419e980 con 0x7fb034102b10 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb031d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 0x7fb034197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb03259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb034100f70 0x7fb034196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb031d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 0x7fb034197060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33744/0 (socket says 172.21.15.5:33744) 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb03259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb034100f70 0x7fb034196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:47312/0 (socket says 172.21.15.5:47312) 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb031d9b700 1 -- 172.21.15.5:0/2142773473 learned_addr learned my addr 172.21.15.5:0/2142773473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb032d9d700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb034102b10 0x7fb03419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb03259c700 1 -- 172.21.15.5:0/2142773473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb034102b10 msgr2=0x7fb03419e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb03259c700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb034102b10 0x7fb03419e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb03259c700 1 -- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 msgr2=0x7fb034197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb03259c700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 0x7fb034197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb03259c700 1 -- 172.21.15.5:0/2142773473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280095f0 con 0x7fb034100f70 2023-10-07T00:10:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb031d9b700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 0x7fb034197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:10:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.888+0000 7fb03259c700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb034100f70 0x7fb034196b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb02400e9c0 tx=0x7fb02400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.889+0000 7fb0237fe700 1 -- 172.21.15.5:0/2142773473 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024004220 con 0x7fb034100f70 2023-10-07T00:10:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.889+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03419ec60 con 0x7fb034100f70 2023-10-07T00:10:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.889+0000 7fb0237fe700 1 -- 172.21.15.5:0/2142773473 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb024004380 con 0x7fb034100f70 2023-10-07T00:10:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.889+0000 7fb0237fe700 1 -- 172.21.15.5:0/2142773473 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024003b40 con 0x7fb034100f70 2023-10-07T00:10:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.889+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03419f160 con 0x7fb034100f70 2023-10-07T00:10:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.890+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb034108610 con 0x7fb034100f70 2023-10-07T00:10:15.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.892+0000 7fb0237fe700 1 -- 172.21.15.5:0/2142773473 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb024003ca0 con 0x7fb034100f70 2023-10-07T00:10:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.894+0000 7fb0237fe700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb01c0a1480 0x7fb01c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.894+0000 7fb0237fe700 1 -- 172.21.15.5:0/2142773473 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fb024014070 con 0x7fb034100f70 2023-10-07T00:10:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.894+0000 7fb031d9b700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb01c0a1480 0x7fb01c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.894+0000 7fb031d9b700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb01c0a1480 0x7fb01c0a3940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb028000c00 tx=0x7fb028005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:15.896+0000 7fb0237fe700 1 -- 172.21.15.5:0/2142773473 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb024096760 con 0x7fb034100f70 2023-10-07T00:10:16.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.106+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fb03410c620 con 0x7fb034100f70 2023-10-07T00:10:16.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.107+0000 7fb0237fe700 1 -- 172.21.15.5:0/2142773473 <== mon.2 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7fb024099d80 con 0x7fb034100f70 2023-10-07T00:10:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb01c0a1480 msgr2=0x7fb01c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb01c0a1480 0x7fb01c0a3940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb028000c00 tx=0x7fb028005fb0 comp rx=0 tx=0).stop 2023-10-07T00:10:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb034100f70 msgr2=0x7fb034196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb034100f70 0x7fb034196b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb02400e9c0 tx=0x7fb02400ecd0 comp rx=0 tx=0).stop 2023-10-07T00:10:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 shutdown_connections 2023-10-07T00:10:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb01c0a1480 0x7fb01c0a3940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb034102b10 0x7fb03419e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb034100f70 0x7fb034196b20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 --2- 172.21.15.5:0/2142773473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034102170 0x7fb034197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 >> 172.21.15.5:0/2142773473 conn(0x7fb0340fc4d0 msgr2=0x7fb034105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 shutdown_connections 2023-10-07T00:10:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:16.110+0000 7fb038d58700 1 -- 172.21.15.5:0/2142773473 wait complete. 2023-10-07T00:10:16.472 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:16 smithi112 ceph-mon[133548]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:10:16.472 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:16 smithi112 ceph-mon[133548]: osdmap e80: 12 total, 11 up, 12 in 2023-10-07T00:10:16.472 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:16.472 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:16.472 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:16 smithi112 ceph-mon[133548]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:16.472 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:16 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2142773473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-07T00:10:16.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:16 smithi005 ceph-mon[129406]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:10:16.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:16 smithi005 ceph-mon[129406]: osdmap e80: 12 total, 11 up, 12 in 2023-10-07T00:10:16.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:16.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:16.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:16 smithi005 ceph-mon[129406]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:16.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:16 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2142773473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-07T00:10:16.550 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1696637389,"num_in_osds":12,"osd_in_since":1696637396,"num_remapped_pgs":0} 2023-10-07T00:10:16.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:16 smithi088 ceph-mon[103111]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2023-10-07T00:10:16.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:16 smithi088 ceph-mon[103111]: osdmap e80: 12 total, 11 up, 12 in 2023-10-07T00:10:16.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:16.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:16.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:16 smithi088 ceph-mon[103111]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-07T00:10:16.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:16 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2142773473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-07T00:10:17.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: purged_snaps scrub starts 2023-10-07T00:10:17.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: purged_snaps scrub ok 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] boot 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: osdmap e81: 12 total, 12 up, 12 in 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:17.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:17.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:17 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-07T00:10:17.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: purged_snaps scrub starts 2023-10-07T00:10:17.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: purged_snaps scrub ok 2023-10-07T00:10:17.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] boot 2023-10-07T00:10:17.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: osdmap e81: 12 total, 12 up, 12 in 2023-10-07T00:10:17.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:17.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:17.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:17.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:17 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: purged_snaps scrub starts 2023-10-07T00:10:17.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: purged_snaps scrub ok 2023-10-07T00:10:17.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: osd.11 [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] boot 2023-10-07T00:10:17.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: osdmap e81: 12 total, 12 up, 12 in 2023-10-07T00:10:17.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-07T00:10:17.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:10:17.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:17.705 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:17.705 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:17.705 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:17 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:18.291 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:10:18.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:18 smithi112 ceph-mon[133548]: Detected new or changed devices on smithi112 2023-10-07T00:10:18.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:18 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi112 to 4316M 2023-10-07T00:10:18.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:18 smithi112 ceph-mon[133548]: osdmap e82: 12 total, 12 up, 12 in 2023-10-07T00:10:18.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:18.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:18.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:18.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:18 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:18.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:18 smithi112 ceph-mon[133548]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:18.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:18 smithi005 ceph-mon[129406]: Detected new or changed devices on smithi112 2023-10-07T00:10:18.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:18 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi112 to 4316M 2023-10-07T00:10:18.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:18 smithi005 ceph-mon[129406]: osdmap e82: 12 total, 12 up, 12 in 2023-10-07T00:10:18.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:18.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:18.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:18.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:18 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:18.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:18 smithi005 ceph-mon[129406]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:18.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:18 smithi088 ceph-mon[103111]: Detected new or changed devices on smithi112 2023-10-07T00:10:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:18 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi112 to 4316M 2023-10-07T00:10:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:18 smithi088 ceph-mon[103111]: osdmap e82: 12 total, 12 up, 12 in 2023-10-07T00:10:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:18 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:18.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:18 smithi088 ceph-mon[103111]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 -- 172.21.15.5:0/1484527909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 msgr2=0x7f0824073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 --2- 172.21.15.5:0/1484527909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 0x7f0824073340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0818009990 tx=0x7f0818009ca0 comp rx=0 tx=0).stop 2023-10-07T00:10:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 -- 172.21.15.5:0/1484527909 shutdown_connections 2023-10-07T00:10:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 --2- 172.21.15.5:0/1484527909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0824108e40 0x7f082410b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 --2- 172.21.15.5:0/1484527909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 0x7f0824073340 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 --2- 172.21.15.5:0/1484527909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0824073910 0x7f0824073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 -- 172.21.15.5:0/1484527909 >> 172.21.15.5:0/1484527909 conn(0x7f08240fc4d0 msgr2=0x7f08240fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 -- 172.21.15.5:0/1484527909 shutdown_connections 2023-10-07T00:10:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.783+0000 7f082b08b700 1 -- 172.21.15.5:0/1484527909 wait complete. 2023-10-07T00:10:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f082b08b700 1 Processor -- start 2023-10-07T00:10:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f082b08b700 1 -- start start 2023-10-07T00:10:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f082b08b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0824073910 0x7f0824198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f082b08b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 0x7f0824199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f082b08b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0824108e40 0x7f08241a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f082b08b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08241a09e0 con 0x7f0824074ee0 2023-10-07T00:10:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f082b08b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08241a0b20 con 0x7f0824108e40 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f082b08b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08241a0cb0 con 0x7f0824073910 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f0823fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 0x7f0824199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f0823fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 0x7f0824199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33770/0 (socket says 172.21.15.5:33770) 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.785+0000 7f0823fff700 1 -- 172.21.15.5:0/878298170 learned_addr learned my addr 172.21.15.5:0/878298170 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0828e27700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0824073910 0x7f0824198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0829628700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0824108e40 0x7f08241a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0823fff700 1 -- 172.21.15.5:0/878298170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0824073910 msgr2=0x7f0824198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0823fff700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0824073910 0x7f0824198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0823fff700 1 -- 172.21.15.5:0/878298170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0824108e40 msgr2=0x7f08241a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0823fff700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0824108e40 0x7f08241a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0823fff700 1 -- 172.21.15.5:0/878298170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08180095f0 con 0x7f0824074ee0 2023-10-07T00:10:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0829628700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0824108e40 0x7f08241a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:10:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0823fff700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 0x7f0824199390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f081000e9a0 tx=0x7f081000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0821ffb700 1 -- 172.21.15.5:0/878298170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810009790 con 0x7f0824074ee0 2023-10-07T00:10:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0821ffb700 1 -- 172.21.15.5:0/878298170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08100044b0 con 0x7f0824074ee0 2023-10-07T00:10:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f0821ffb700 1 -- 172.21.15.5:0/878298170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810003c60 con 0x7f0824074ee0 2023-10-07T00:10:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.786+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08241a0f90 con 0x7f0824074ee0 2023-10-07T00:10:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.787+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08241a13b0 con 0x7f0824074ee0 2023-10-07T00:10:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.788+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08241074f0 con 0x7f0824074ee0 2023-10-07T00:10:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.790+0000 7f0821ffb700 1 -- 172.21.15.5:0/878298170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0810003dc0 con 0x7f0824074ee0 2023-10-07T00:10:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.791+0000 7f0821ffb700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08140a1480 0x7f08140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.792+0000 7f0821ffb700 1 -- 172.21.15.5:0/878298170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0810014070 con 0x7f0824074ee0 2023-10-07T00:10:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.792+0000 7f0828e27700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08140a1480 0x7f08140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.792+0000 7f0828e27700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08140a1480 0x7f08140a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f08180098e0 tx=0x7f081800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:19.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:19.795+0000 7f0821ffb700 1 -- 172.21.15.5:0/878298170 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0810096630 con 0x7f0824074ee0 2023-10-07T00:10:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.004+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f082410e8c0 con 0x7f0824074ee0 2023-10-07T00:10:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.005+0000 7f0821ffb700 1 -- 172.21.15.5:0/878298170 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7f0810099c50 con 0x7f0824074ee0 2023-10-07T00:10:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08140a1480 msgr2=0x7f08140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08140a1480 0x7f08140a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f08180098e0 tx=0x7f081800b260 comp rx=0 tx=0).stop 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 msgr2=0x7f0824199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 0x7f0824199390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f081000e9a0 tx=0x7f081000ecb0 comp rx=0 tx=0).stop 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 shutdown_connections 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08140a1480 0x7f08140a3940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0824108e40 0x7f08241a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0824073910 0x7f0824198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 --2- 172.21.15.5:0/878298170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0824074ee0 0x7f0824199390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 >> 172.21.15.5:0/878298170 conn(0x7f08240fc4d0 msgr2=0x7f08240fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 shutdown_connections 2023-10-07T00:10:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:20.007+0000 7f082b08b700 1 -- 172.21.15.5:0/878298170 wait complete. 2023-10-07T00:10:20.469 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1696637416,"num_in_osds":12,"osd_in_since":1696637396,"num_remapped_pgs":0} 2023-10-07T00:10:20.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-07T00:10:20.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:20 smithi005 ceph-mon[129406]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:20.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:20 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/878298170' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-07T00:10:20.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:20 smithi088 ceph-mon[103111]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:20.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:20 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/878298170' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-07T00:10:20.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:20 smithi112 ceph-mon[133548]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:20.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:20 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/878298170' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-07T00:10:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:10:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 -- 172.21.15.5:0/2105193335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30101940 msgr2=0x7fdd3010ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 --2- 172.21.15.5:0/2105193335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30101940 0x7fdd3010ddb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800b0d0 tx=0x7fdd2800b3e0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 -- 172.21.15.5:0/2105193335 shutdown_connections 2023-10-07T00:10:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 --2- 172.21.15.5:0/2105193335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30101940 0x7fdd3010ddb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 --2- 172.21.15.5:0/2105193335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd30106f90 0x7fdd30107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 --2- 172.21.15.5:0/2105193335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd30100f80 0x7fdd30101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 -- 172.21.15.5:0/2105193335 >> 172.21.15.5:0/2105193335 conn(0x7fdd300780a0 msgr2=0x7fdd300784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 -- 172.21.15.5:0/2105193335 shutdown_connections 2023-10-07T00:10:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.702+0000 7fdd3643a700 1 -- 172.21.15.5:0/2105193335 wait complete. 2023-10-07T00:10:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.703+0000 7fdd3643a700 1 Processor -- start 2023-10-07T00:10:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd3643a700 1 -- start start 2023-10-07T00:10:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd3643a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30100f80 0x7fdd301991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd3643a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd30101940 0x7fdd30199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd3643a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd30106f90 0x7fdd3019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd3643a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3019e1a0 con 0x7fdd30100f80 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd3643a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3019e310 con 0x7fdd30106f90 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd3643a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3019e4d0 con 0x7fdd30101940 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30100f80 0x7fdd301991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30100f80 0x7fdd301991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55552/0 (socket says 172.21.15.5:55552) 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd2ffff700 1 -- 172.21.15.5:0/4098892492 learned_addr learned my addr 172.21.15.5:0/4098892492 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd2f7fe700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd30101940 0x7fdd30199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.704+0000 7fdd349d7700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd30106f90 0x7fdd3019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2ffff700 1 -- 172.21.15.5:0/4098892492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd30101940 msgr2=0x7fdd30199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2ffff700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd30101940 0x7fdd30199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2ffff700 1 -- 172.21.15.5:0/4098892492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd30106f90 msgr2=0x7fdd3019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2ffff700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd30106f90 0x7fdd3019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2ffff700 1 -- 172.21.15.5:0/4098892492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd28009d00 con 0x7fdd30100f80 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2ffff700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30100f80 0x7fdd301991e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000d950 tx=0x7fdd2000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2d7fa700 1 -- 172.21.15.5:0/4098892492 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000f890 con 0x7fdd30100f80 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3019e7b0 con 0x7fdd30100f80 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2d7fa700 1 -- 172.21.15.5:0/4098892492 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd2000fe80 con 0x7fdd30100f80 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.705+0000 7fdd2d7fa700 1 -- 172.21.15.5:0/4098892492 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000e3b0 con 0x7fdd30100f80 2023-10-07T00:10:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.706+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd301a6010 con 0x7fdd30100f80 2023-10-07T00:10:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.707+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3004ebb0 con 0x7fdd30100f80 2023-10-07T00:10:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.708+0000 7fdd2d7fa700 1 -- 172.21.15.5:0/4098892492 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdd20010460 con 0x7fdd30100f80 2023-10-07T00:10:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.710+0000 7fdd2d7fa700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdd180a1480 0x7fdd180a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.710+0000 7fdd2d7fa700 1 -- 172.21.15.5:0/4098892492 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdd200cc690 con 0x7fdd30100f80 2023-10-07T00:10:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.710+0000 7fdd2f7fe700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdd180a1480 0x7fdd180a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.711+0000 7fdd2f7fe700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdd180a1480 0x7fdd180a3940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdd3019a800 tx=0x7fdd2400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.714+0000 7fdd2d7fa700 1 -- 172.21.15.5:0/4098892492 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdd200960f0 con 0x7fdd30100f80 2023-10-07T00:10:22.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:22 smithi005 ceph-mon[129406]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.924+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd3019e9a0 con 0x7fdd30100f80 2023-10-07T00:10:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.925+0000 7fdd2d7fa700 1 -- 172.21.15.5:0/4098892492 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18303 (secure 0 0 0) 0x7fdd20099710 con 0x7fdd30100f80 2023-10-07T00:10:22.927 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:22.927 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:10:17.205387+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:10:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.927+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdd180a1480 msgr2=0x7fdd180a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.927+0000 7fdd3643a700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdd180a1480 0x7fdd180a3940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdd3019a800 tx=0x7fdd2400b410 comp rx=0 tx=0).stop 2023-10-07T00:10:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.927+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30100f80 msgr2=0x7fdd301991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.927+0000 7fdd3643a700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30100f80 0x7fdd301991e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000d950 tx=0x7fdd2000dc60 comp rx=0 tx=0).stop 2023-10-07T00:10:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.928+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 shutdown_connections 2023-10-07T00:10:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.928+0000 7fdd3643a700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdd180a1480 0x7fdd180a3940 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.928+0000 7fdd3643a700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd30106f90 0x7fdd3019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.928+0000 7fdd3643a700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd30100f80 0x7fdd301991e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.928+0000 7fdd3643a700 1 --2- 172.21.15.5:0/4098892492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd30101940 0x7fdd30199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.928+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 >> 172.21.15.5:0/4098892492 conn(0x7fdd300780a0 msgr2=0x7fdd3010c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.928+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 shutdown_connections 2023-10-07T00:10:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:22.928+0000 7fdd3643a700 1 -- 172.21.15.5:0/4098892492 wait complete. 2023-10-07T00:10:22.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:22 smithi088 ceph-mon[103111]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:22 smithi112 ceph-mon[133548]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:23.299 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:10:23.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-07T00:10:23.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:23 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4098892492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:10:23.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:23 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4098892492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:10:24.041 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:10:24.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:23 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4098892492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:10:24.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:24 smithi088 ceph-mon[103111]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:24.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:24 smithi112 ceph-mon[133548]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:24 smithi005 ceph-mon[129406]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 -- 172.21.15.5:0/1122832088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878101940 msgr2=0x7f787810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 --2- 172.21.15.5:0/1122832088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878101940 0x7f787810ddb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f787000b0d0 tx=0x7f787000b3e0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 -- 172.21.15.5:0/1122832088 shutdown_connections 2023-10-07T00:10:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 --2- 172.21.15.5:0/1122832088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878101940 0x7f787810ddb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 --2- 172.21.15.5:0/1122832088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7878106f90 0x7f7878107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 --2- 172.21.15.5:0/1122832088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7878100f80 0x7f7878101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 -- 172.21.15.5:0/1122832088 >> 172.21.15.5:0/1122832088 conn(0x7f78780780a0 msgr2=0x7f78780784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 -- 172.21.15.5:0/1122832088 shutdown_connections 2023-10-07T00:10:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.665+0000 7f787fbda700 1 -- 172.21.15.5:0/1122832088 wait complete. 2023-10-07T00:10:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.667+0000 7f787fbda700 1 Processor -- start 2023-10-07T00:10:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.667+0000 7f787fbda700 1 -- start start 2023-10-07T00:10:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787fbda700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878100f80 0x7f7878197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787fbda700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7878101940 0x7f7878197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787fbda700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7878106f90 0x7f787819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787fbda700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787819bfe0 con 0x7f7878100f80 2023-10-07T00:10:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787fbda700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787819c150 con 0x7f7878106f90 2023-10-07T00:10:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787fbda700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787819c310 con 0x7f7878101940 2023-10-07T00:10:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d976700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878100f80 0x7f7878197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d976700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878100f80 0x7f7878197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55570/0 (socket says 172.21.15.5:55570) 2023-10-07T00:10:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d976700 1 -- 172.21.15.5:0/1732144312 learned_addr learned my addr 172.21.15.5:0/1732144312 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d175700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7878101940 0x7f7878197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787e177700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7878106f90 0x7f787819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d976700 1 -- 172.21.15.5:0/1732144312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7878101940 msgr2=0x7f7878197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d976700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7878101940 0x7f7878197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d976700 1 -- 172.21.15.5:0/1732144312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7878106f90 msgr2=0x7f787819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d976700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7878106f90 0x7f787819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.668+0000 7f787d976700 1 -- 172.21.15.5:0/1732144312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870009d00 con 0x7f7878100f80 2023-10-07T00:10:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.669+0000 7f787d976700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878100f80 0x7f7878197020 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f787400e9a0 tx=0x7f787400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.669+0000 7f786effd700 1 -- 172.21.15.5:0/1732144312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874009790 con 0x7f7878100f80 2023-10-07T00:10:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.669+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787819c5f0 con 0x7f7878100f80 2023-10-07T00:10:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.669+0000 7f786effd700 1 -- 172.21.15.5:0/1732144312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7874010430 con 0x7f7878100f80 2023-10-07T00:10:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.669+0000 7f786effd700 1 -- 172.21.15.5:0/1732144312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400cea0 con 0x7f7878100f80 2023-10-07T00:10:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.669+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78781a3e50 con 0x7f7878100f80 2023-10-07T00:10:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.670+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787804ebb0 con 0x7f7878100f80 2023-10-07T00:10:25.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.672+0000 7f786effd700 1 -- 172.21.15.5:0/1732144312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f78740105a0 con 0x7f7878100f80 2023-10-07T00:10:25.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.673+0000 7f786effd700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f78640a1500 0x7f78640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:25.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.673+0000 7f786effd700 1 -- 172.21.15.5:0/1732144312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7874014070 con 0x7f7878100f80 2023-10-07T00:10:25.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.674+0000 7f787d175700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f78640a1500 0x7f78640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:25.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.674+0000 7f787d175700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f78640a1500 0x7f78640a39c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7878198640 tx=0x7f786800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:25.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.677+0000 7f786effd700 1 -- 172.21.15.5:0/1732144312 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7874096400 con 0x7f7878100f80 2023-10-07T00:10:25.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.890+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7878110f20 con 0x7f7878100f80 2023-10-07T00:10:25.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.890+0000 7f786effd700 1 -- 172.21.15.5:0/1732144312 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7874099a20 con 0x7f7878100f80 2023-10-07T00:10:25.892 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:10:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f78640a1500 msgr2=0x7f78640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f78640a1500 0x7f78640a39c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7878198640 tx=0x7f786800b410 comp rx=0 tx=0).stop 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878100f80 msgr2=0x7f7878197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878100f80 0x7f7878197020 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f787400e9a0 tx=0x7f787400ecb0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 shutdown_connections 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f78640a1500 0x7f78640a39c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7878106f90 0x7f787819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7878100f80 0x7f7878197020 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 --2- 172.21.15.5:0/1732144312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7878101940 0x7f7878197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 >> 172.21.15.5:0/1732144312 conn(0x7f78780780a0 msgr2=0x7f78780ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 shutdown_connections 2023-10-07T00:10:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:25.893+0000 7f787fbda700 1 -- 172.21.15.5:0/1732144312 wait complete. 2023-10-07T00:10:26.319 INFO:tasks.cephadm:Adding mds.a on smithi005 2023-10-07T00:10:26.319 INFO:tasks.cephadm:Adding mds.d on smithi005 2023-10-07T00:10:26.319 INFO:tasks.cephadm:Adding mds.g on smithi005 2023-10-07T00:10:26.319 INFO:tasks.cephadm:Adding mds.j on smithi005 2023-10-07T00:10:26.320 INFO:tasks.cephadm:Adding mds.b on smithi088 2023-10-07T00:10:26.320 INFO:tasks.cephadm:Adding mds.e on smithi088 2023-10-07T00:10:26.320 INFO:tasks.cephadm:Adding mds.h on smithi088 2023-10-07T00:10:26.320 INFO:tasks.cephadm:Adding mds.k on smithi088 2023-10-07T00:10:26.320 INFO:tasks.cephadm:Adding mds.c on smithi112 2023-10-07T00:10:26.320 INFO:tasks.cephadm:Adding mds.f on smithi112 2023-10-07T00:10:26.320 INFO:tasks.cephadm:Adding mds.i on smithi112 2023-10-07T00:10:26.320 INFO:tasks.cephadm:Adding mds.l on smithi112 2023-10-07T00:10:26.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l' 2023-10-07T00:10:26.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:26 smithi088 ceph-mon[103111]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:26.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:26 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1732144312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:10:26.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:26 smithi112 ceph-mon[133548]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:26.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:26 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1732144312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:10:27.057 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:10:27.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:26 smithi005 ceph-mon[129406]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:27.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:26 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1732144312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:10:28.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1626019266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0102b10 msgr2=0x7fdfa01093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:28.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1626019266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0102b10 0x7fdfa01093c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800b0a0 tx=0x7fdf9800b3b0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1626019266 shutdown_connections 2023-10-07T00:10:28.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1626019266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0102b10 0x7fdfa01093c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1626019266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa0100f70 0x7fdfa0101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1626019266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfa0102170 0x7fdfa01025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1626019266 >> 172.21.15.112:0/1626019266 conn(0x7fdfa00fc4d0 msgr2=0x7fdfa00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:28.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1626019266 shutdown_connections 2023-10-07T00:10:28.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.495+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1626019266 wait complete. 2023-10-07T00:10:28.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.496+0000 7fdfa85d8700 1 Processor -- start 2023-10-07T00:10:28.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa85d8700 1 -- start start 2023-10-07T00:10:28.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa85d8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0100f70 0x7fdfa0196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:28.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa85d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa0102170 0x7fdfa0197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:28.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa85d8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfa0102b10 0x7fdfa019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:28.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa85d8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa019e7c0 con 0x7fdfa0102170 2023-10-07T00:10:28.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa85d8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa019e900 con 0x7fdfa0102b10 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa85d8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa019eac0 con 0x7fdfa0100f70 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa6374700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0100f70 0x7fdfa0196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa6374700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0100f70 0x7fdfa0196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59434/0 (socket says 172.21.15.112:59434) 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa6374700 1 -- 172.21.15.112:0/1868419856 learned_addr learned my addr 172.21.15.112:0/1868419856 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.497+0000 7fdfa5b73700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa0102170 0x7fdfa0197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa6b75700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfa0102b10 0x7fdfa019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa6374700 1 -- 172.21.15.112:0/1868419856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfa0102b10 msgr2=0x7fdfa019e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa6374700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfa0102b10 0x7fdfa019e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa6374700 1 -- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa0102170 msgr2=0x7fdfa0197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:28.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa6374700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa0102170 0x7fdfa0197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa6374700 1 -- 172.21.15.112:0/1868419856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98009d00 con 0x7fdfa0100f70 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa6b75700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfa0102b10 0x7fdfa019e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa5b73700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa0102170 0x7fdfa0197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa6374700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0100f70 0x7fdfa0196cc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00e970 tx=0x7fdf9c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdf977fe700 1 -- 172.21.15.112:0/1868419856 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c009790 con 0x7fdfa0100f70 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa019eda0 con 0x7fdfa0100f70 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdf977fe700 1 -- 172.21.15.112:0/1868419856 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf9c0044b0 con 0x7fdfa0100f70 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdf977fe700 1 -- 172.21.15.112:0/1868419856 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c003dd0 con 0x7fdfa0100f70 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.498+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa019f200 con 0x7fdfa0100f70 2023-10-07T00:10:28.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.499+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa0108600 con 0x7fdfa0100f70 2023-10-07T00:10:28.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.501+0000 7fdf977fe700 1 -- 172.21.15.112:0/1868419856 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdf9c003f30 con 0x7fdfa0100f70 2023-10-07T00:10:28.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.502+0000 7fdf977fe700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf8c0a1480 0x7fdf8c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:28.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.503+0000 7fdf977fe700 1 -- 172.21.15.112:0/1868419856 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdf9c014070 con 0x7fdfa0100f70 2023-10-07T00:10:28.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.503+0000 7fdfa5b73700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf8c0a1480 0x7fdf8c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:28.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.504+0000 7fdfa5b73700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf8c0a1480 0x7fdf8c0a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdf90005950 tx=0x7fdf900058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:28.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.507+0000 7fdf977fe700 1 -- 172.21.15.112:0/1868419856 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf9c096650 con 0x7fdfa0100f70 2023-10-07T00:10:28.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.715+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfa00008d0 con 0x7fdf8c0a1480 2023-10-07T00:10:28.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.723+0000 7fdf977fe700 1 -- 172.21.15.112:0/1868419856 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fdfa00008d0 con 0x7fdf8c0a1480 2023-10-07T00:10:28.724 INFO:teuthology.orchestra.run.smithi112.stdout:Scheduled mds.all update... 2023-10-07T00:10:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf8c0a1480 msgr2=0x7fdf8c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf8c0a1480 0x7fdf8c0a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdf90005950 tx=0x7fdf900058e0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0100f70 msgr2=0x7fdfa0196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0100f70 0x7fdfa0196cc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00e970 tx=0x7fdf9c00ed30 comp rx=0 tx=0).stop 2023-10-07T00:10:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 shutdown_connections 2023-10-07T00:10:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf8c0a1480 0x7fdf8c0a3940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfa0102b10 0x7fdfa019e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa0100f70 0x7fdfa0196cc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 --2- 172.21.15.112:0/1868419856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfa0102170 0x7fdfa0197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:28.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.725+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 >> 172.21.15.112:0/1868419856 conn(0x7fdfa00fc4d0 msgr2=0x7fdfa0105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:28.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.726+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 shutdown_connections 2023-10-07T00:10:28.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-07T00:10:28.726+0000 7fdfa85d8700 1 -- 172.21.15.112:0/1868419856 wait complete. 2023-10-07T00:10:28.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:28 smithi088 ceph-mon[103111]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:28 smithi112 ceph-mon[133548]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:29.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:28 smithi005 ceph-mon[129406]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:29.227 DEBUG:teuthology.orchestra.run.smithi005:mds.a> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-07T00:10:29.233 DEBUG:teuthology.orchestra.run.smithi005:mds.d> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-07T00:10:29.279 DEBUG:teuthology.orchestra.run.smithi005:mds.g> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-07T00:10:29.315 INFO:journalctl@ceph.mds.a.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:10:29.318 DEBUG:teuthology.orchestra.run.smithi005:mds.j> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-07T00:10:29.353 INFO:journalctl@ceph.mds.d.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:10:29.356 DEBUG:teuthology.orchestra.run.smithi088:mds.b> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-07T00:10:29.362 DEBUG:teuthology.orchestra.run.smithi088:mds.e> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-07T00:10:29.392 INFO:journalctl@ceph.mds.g.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:10:29.408 DEBUG:teuthology.orchestra.run.smithi088:mds.h> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-07T00:10:29.427 INFO:journalctl@ceph.mds.j.smithi005.stdout:-- Logs begin at Fri 2023-10-06 23:43:22 UTC. -- 2023-10-07T00:10:29.441 INFO:journalctl@ceph.mds.b.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:10:29.445 DEBUG:teuthology.orchestra.run.smithi088:mds.k> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-07T00:10:29.479 INFO:journalctl@ceph.mds.e.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:10:29.482 DEBUG:teuthology.orchestra.run.smithi112:mds.c> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-07T00:10:29.487 DEBUG:teuthology.orchestra.run.smithi112:mds.f> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-07T00:10:29.514 INFO:journalctl@ceph.mds.h.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:10:29.532 DEBUG:teuthology.orchestra.run.smithi112:mds.i> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-07T00:10:29.554 INFO:journalctl@ceph.mds.k.smithi088.stdout:-- Logs begin at Fri 2023-10-06 23:44:45 UTC. -- 2023-10-07T00:10:29.559 INFO:journalctl@ceph.mds.c.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:10:29.562 DEBUG:teuthology.orchestra.run.smithi112:mds.l> sudo journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-07T00:10:29.602 INFO:journalctl@ceph.mds.f.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:10:29.605 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-07T00:10:29.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:10:29.631 INFO:journalctl@ceph.mds.i.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:10:29.675 INFO:journalctl@ceph.mds.l.smithi112.stdout:-- Logs begin at Fri 2023-10-06 23:43:36 UTC. -- 2023-10-07T00:10:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.819+0000 7f05f3fff700 1 -- 172.21.15.5:0/1361370387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 msgr2=0x7f05ec102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.819+0000 7f05f3fff700 1 --2- 172.21.15.5:0/1361370387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 0x7f05ec102610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0099c0 tx=0x7f05dc009cd0 comp rx=0 tx=0).stop 2023-10-07T00:10:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.819+0000 7f05f3fff700 1 -- 172.21.15.5:0/1361370387 shutdown_connections 2023-10-07T00:10:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.819+0000 7f05f3fff700 1 --2- 172.21.15.5:0/1361370387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05ec102b50 0x7f05ec109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.819+0000 7f05f3fff700 1 --2- 172.21.15.5:0/1361370387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec100fc0 0x7f05ec1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.819+0000 7f05f3fff700 1 --2- 172.21.15.5:0/1361370387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 0x7f05ec102610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.819+0000 7f05f3fff700 1 -- 172.21.15.5:0/1361370387 >> 172.21.15.5:0/1361370387 conn(0x7f05ec0fc530 msgr2=0x7f05ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.820+0000 7f05f3fff700 1 -- 172.21.15.5:0/1361370387 shutdown_connections 2023-10-07T00:10:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.820+0000 7f05f3fff700 1 -- 172.21.15.5:0/1361370387 wait complete. 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f3fff700 1 Processor -- start 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f3fff700 1 -- start start 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05ec100fc0 0x7f05ec198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 0x7f05ec199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec102b50 0x7f05ec1a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f3fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec1a0960 con 0x7f05ec1021b0 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f3fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec1a0aa0 con 0x7f05ec102b50 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f3fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec1a0c30 con 0x7f05ec100fc0 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 0x7f05ec199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05ec100fc0 0x7f05ec198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05ec100fc0 0x7f05ec198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:50398/0 (socket says 172.21.15.5:50398) 2023-10-07T00:10:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f1d9b700 1 -- 172.21.15.5:0/205007759 learned_addr learned my addr 172.21.15.5:0/205007759 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.821+0000 7f05f159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 0x7f05ec199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55586/0 (socket says 172.21.15.5:55586) 2023-10-07T00:10:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f259c700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec102b50 0x7f05ec1a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f159a700 1 -- 172.21.15.5:0/205007759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05ec100fc0 msgr2=0x7f05ec198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f159a700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05ec100fc0 0x7f05ec198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f159a700 1 -- 172.21.15.5:0/205007759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec102b50 msgr2=0x7f05ec1a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f159a700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec102b50 0x7f05ec1a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f159a700 1 -- 172.21.15.5:0/205007759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8009520 con 0x7f05ec1021b0 2023-10-07T00:10:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f259c700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec102b50 0x7f05ec1a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:10:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f159a700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 0x7f05ec199320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009fd0 tx=0x7f05dc00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05e2ffd700 1 -- 172.21.15.5:0/205007759 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc01d070 con 0x7f05ec1021b0 2023-10-07T00:10:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05e2ffd700 1 -- 172.21.15.5:0/205007759 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05dc00fe70 con 0x7f05ec1021b0 2023-10-07T00:10:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc0095f0 con 0x7f05ec1021b0 2023-10-07T00:10:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05e2ffd700 1 -- 172.21.15.5:0/205007759 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc004b30 con 0x7f05ec1021b0 2023-10-07T00:10:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.822+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec1a1140 con 0x7f05ec1021b0 2023-10-07T00:10:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.824+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec10c6e0 con 0x7f05ec1021b0 2023-10-07T00:10:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.825+0000 7f05e2ffd700 1 -- 172.21.15.5:0/205007759 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f05dc004c90 con 0x7f05ec1021b0 2023-10-07T00:10:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.828+0000 7f05e2ffd700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f05d80a1480 0x7f05d80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.828+0000 7f05e2ffd700 1 -- 172.21.15.5:0/205007759 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f05dc0cd580 con 0x7f05ec1021b0 2023-10-07T00:10:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.828+0000 7f05f1d9b700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f05d80a1480 0x7f05d80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.829+0000 7f05f1d9b700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f05d80a1480 0x7f05d80a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05e8005950 tx=0x7f05e8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:29.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:29.832+0000 7f05e2ffd700 1 -- 172.21.15.5:0/205007759 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f05dc097110 con 0x7f05ec1021b0 2023-10-07T00:10:29.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:10:29.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l;count:12 2023-10-07T00:10:29.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:29.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:29.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:29.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:29.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:29.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:29.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:29.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:30.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.047+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05ec1a12d0 con 0x7f05ec1021b0 2023-10-07T00:10:30.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.048+0000 7f05e2ffd700 1 -- 172.21.15.5:0/205007759 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f05dc09a730 con 0x7f05ec1021b0 2023-10-07T00:10:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:30.050 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:10:17.205387+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:10:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f05d80a1480 msgr2=0x7f05d80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f05d80a1480 0x7f05d80a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05e8005950 tx=0x7f05e8009260 comp rx=0 tx=0).stop 2023-10-07T00:10:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 msgr2=0x7f05ec199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 0x7f05ec199320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009fd0 tx=0x7f05dc00fa00 comp rx=0 tx=0).stop 2023-10-07T00:10:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 shutdown_connections 2023-10-07T00:10:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f05d80a1480 0x7f05d80a3940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec102b50 0x7f05ec1a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05ec100fc0 0x7f05ec198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 --2- 172.21.15.5:0/205007759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05ec1021b0 0x7f05ec199320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.050+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 >> 172.21.15.5:0/205007759 conn(0x7f05ec0fc530 msgr2=0x7f05ec0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.051+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 shutdown_connections 2023-10-07T00:10:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.051+0000 7f05f3fff700 1 -- 172.21.15.5:0/205007759 wait complete. 2023-10-07T00:10:30.069 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:10:30.069 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l;count:12 2023-10-07T00:10:30.069 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:30.069 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:30.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:30.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:30.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:30.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:30.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:30.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:30.072 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:10:30.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:10:30.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l;count:12 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:30.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.278+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/2035760968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b4102b50 msgr2=0x7fc6b4109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.278+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/2035760968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b4102b50 0x7fc6b4109400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00b0d0 tx=0x7fc6ac00b3e0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.278+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/2035760968 shutdown_connections 2023-10-07T00:10:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.278+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/2035760968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b4102b50 0x7fc6b4109400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.279+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/2035760968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6b4100fc0 0x7fc6b41013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.279+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/2035760968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b41021b0 0x7fc6b4102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.279+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/2035760968 >> 172.21.15.5:0/2035760968 conn(0x7fc6b40fc530 msgr2=0x7fc6b40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.279+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/2035760968 shutdown_connections 2023-10-07T00:10:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.279+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/2035760968 wait complete. 2023-10-07T00:10:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6ba5ff700 1 Processor -- start 2023-10-07T00:10:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6ba5ff700 1 -- start start 2023-10-07T00:10:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6ba5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6b4100fc0 0x7fc6b4198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6ba5ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b41021b0 0x7fc6b41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6ba5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b4102b50 0x7fc6b41a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6ba5ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b41a0a00 con 0x7fc6b41021b0 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6ba5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b41a0b40 con 0x7fc6b4100fc0 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6ba5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b41a0cd0 con 0x7fc6b4102b50 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6b37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b41021b0 0x7fc6b41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6b37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b41021b0 0x7fc6b41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55602/0 (socket says 172.21.15.5:55602) 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6b37fe700 1 -- 172.21.15.5:0/4017720215 learned_addr learned my addr 172.21.15.5:0/4017720215 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6b8b9c700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b4102b50 0x7fc6b41a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.280+0000 7fc6b3fff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6b4100fc0 0x7fc6b4198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b37fe700 1 -- 172.21.15.5:0/4017720215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b4102b50 msgr2=0x7fc6b41a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b37fe700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b4102b50 0x7fc6b41a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b37fe700 1 -- 172.21.15.5:0/4017720215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6b4100fc0 msgr2=0x7fc6b4198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b37fe700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6b4100fc0 0x7fc6b4198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b37fe700 1 -- 172.21.15.5:0/4017720215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac009d00 con 0x7fc6b41021b0 2023-10-07T00:10:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b37fe700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b41021b0 0x7fc6b41993c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800e9a0 tx=0x7fc6a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b17fa700 1 -- 172.21.15.5:0/4017720215 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8009790 con 0x7fc6b41021b0 2023-10-07T00:10:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b17fa700 1 -- 172.21.15.5:0/4017720215 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc6a8010430 con 0x7fc6b41021b0 2023-10-07T00:10:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b41a0fb0 con 0x7fc6b41021b0 2023-10-07T00:10:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6b17fa700 1 -- 172.21.15.5:0/4017720215 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800cea0 con 0x7fc6b41021b0 2023-10-07T00:10:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.281+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b41a1430 con 0x7fc6b41021b0 2023-10-07T00:10:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.283+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b410c630 con 0x7fc6b41021b0 2023-10-07T00:10:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.284+0000 7fc6b17fa700 1 -- 172.21.15.5:0/4017720215 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc6a80105a0 con 0x7fc6b41021b0 2023-10-07T00:10:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.286+0000 7fc6b17fa700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc69c0a1480 0x7fc69c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.286+0000 7fc6b17fa700 1 -- 172.21.15.5:0/4017720215 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc6a8014070 con 0x7fc6b41021b0 2023-10-07T00:10:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.286+0000 7fc6b3fff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc69c0a1480 0x7fc69c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:30.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.287+0000 7fc6b3fff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc69c0a1480 0x7fc69c0a3940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4102010 tx=0x7fc6a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.290+0000 7fc6b17fa700 1 -- 172.21.15.5:0/4017720215 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc6a8052100 con 0x7fc6b41021b0 2023-10-07T00:10:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.502+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6b41a1620 con 0x7fc6b41021b0 2023-10-07T00:10:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.502+0000 7fc6b17fa700 1 -- 172.21.15.5:0/4017720215 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6a80964f0 con 0x7fc6b41021b0 2023-10-07T00:10:30.504 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:10:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.504+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc69c0a1480 msgr2=0x7fc69c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.504+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc69c0a1480 0x7fc69c0a3940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4102010 tx=0x7fc6a4009260 comp rx=0 tx=0).stop 2023-10-07T00:10:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.504+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b41021b0 msgr2=0x7fc6b41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.504+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b41021b0 0x7fc6b41993c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800e9a0 tx=0x7fc6a800ecb0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.505+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 shutdown_connections 2023-10-07T00:10:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.505+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc69c0a1480 0x7fc69c0a3940 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.505+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b4102b50 0x7fc6b41a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.505+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6b4100fc0 0x7fc6b4198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.505+0000 7fc6ba5ff700 1 --2- 172.21.15.5:0/4017720215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6b41021b0 0x7fc6b41993c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.505+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 >> 172.21.15.5:0/4017720215 conn(0x7fc6b40fc530 msgr2=0x7fc6b40fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.505+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 shutdown_connections 2023-10-07T00:10:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.505+0000 7fc6ba5ff700 1 -- 172.21.15.5:0/4017720215 wait complete. 2023-10-07T00:10:30.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.729+0000 7f1322fff700 1 -- 172.21.15.5:0/4022538071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c104340 msgr2=0x7f131c106730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.729+0000 7f1322fff700 1 --2- 172.21.15.5:0/4022538071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c104340 0x7f131c106730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1308009990 tx=0x7f1308009ca0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.730+0000 7f1322fff700 1 -- 172.21.15.5:0/4022538071 shutdown_connections 2023-10-07T00:10:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.730+0000 7f1322fff700 1 --2- 172.21.15.5:0/4022538071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131c106c70 0x7f131c1090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.730+0000 7f1322fff700 1 --2- 172.21.15.5:0/4022538071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f131c101a10 0x7f131c103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.730+0000 7f1322fff700 1 --2- 172.21.15.5:0/4022538071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c104340 0x7f131c106730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.730+0000 7f1322fff700 1 -- 172.21.15.5:0/4022538071 >> 172.21.15.5:0/4022538071 conn(0x7f131c0fb420 msgr2=0x7f131c0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.730+0000 7f1322fff700 1 -- 172.21.15.5:0/4022538071 shutdown_connections 2023-10-07T00:10:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.730+0000 7f1322fff700 1 -- 172.21.15.5:0/4022538071 wait complete. 2023-10-07T00:10:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1322fff700 1 Processor -- start 2023-10-07T00:10:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1322fff700 1 -- start start 2023-10-07T00:10:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1322fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f131c101a10 0x7f131c196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1322fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131c104340 0x7f131c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1322fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c106c70 0x7f131c19e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1322fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c19e720 con 0x7f131c106c70 2023-10-07T00:10:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1322fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c19e860 con 0x7f131c104340 2023-10-07T00:10:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1322fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c19e9f0 con 0x7f131c101a10 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f132159c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c106c70 0x7f131c19e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f132159c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c106c70 0x7f131c19e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55610/0 (socket says 172.21.15.5:55610) 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f132159c700 1 -- 172.21.15.5:0/2340880211 learned_addr learned my addr 172.21.15.5:0/2340880211 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f1320d9b700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f131c101a10 0x7f131c196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.731+0000 7f131bfff700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131c104340 0x7f131c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f132159c700 1 -- 172.21.15.5:0/2340880211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f131c101a10 msgr2=0x7f131c196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f132159c700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f131c101a10 0x7f131c196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f132159c700 1 -- 172.21.15.5:0/2340880211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131c104340 msgr2=0x7f131c1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f132159c700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131c104340 0x7f131c1970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f132159c700 1 -- 172.21.15.5:0/2340880211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080095f0 con 0x7f131c106c70 2023-10-07T00:10:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f132159c700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c106c70 0x7f131c19e150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1314007ee0 tx=0x7f131400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f1319ffb700 1 -- 172.21.15.5:0/2340880211 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131400dd20 con 0x7f131c106c70 2023-10-07T00:10:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131c19ecd0 con 0x7f131c106c70 2023-10-07T00:10:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f1319ffb700 1 -- 172.21.15.5:0/2340880211 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f131400f040 con 0x7f131c106c70 2023-10-07T00:10:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f1319ffb700 1 -- 172.21.15.5:0/2340880211 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314004750 con 0x7f131c106c70 2023-10-07T00:10:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.732+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c19f190 con 0x7f131c106c70 2023-10-07T00:10:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.734+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131c0fcfa0 con 0x7f131c106c70 2023-10-07T00:10:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.736+0000 7f1319ffb700 1 -- 172.21.15.5:0/2340880211 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1314003a00 con 0x7f131c106c70 2023-10-07T00:10:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.737+0000 7f1319ffb700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f130c0a1480 0x7f130c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.737+0000 7f1319ffb700 1 -- 172.21.15.5:0/2340880211 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f13140cc1c0 con 0x7f131c106c70 2023-10-07T00:10:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.737+0000 7f1320d9b700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f130c0a1480 0x7f130c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.738+0000 7f1320d9b700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f130c0a1480 0x7f130c0a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1310005950 tx=0x7f131000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.741+0000 7f1319ffb700 1 -- 172.21.15.5:0/2340880211 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f131404f100 con 0x7f131c106c70 2023-10-07T00:10:30.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:30 smithi005 ceph-mon[129406]: Deploying daemon mds.l on smithi112 2023-10-07T00:10:30.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:30 smithi005 ceph-mon[129406]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:30.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:30 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/205007759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:10:30.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:30 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4017720215' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:10:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:30 smithi112 ceph-mon[133548]: Deploying daemon mds.l on smithi112 2023-10-07T00:10:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:30 smithi112 ceph-mon[133548]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:30 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/205007759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:10:30.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:30 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4017720215' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:10:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.998+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f131c10c680 con 0x7f131c106c70 2023-10-07T00:10:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:30.998+0000 7f1319ffb700 1 -- 172.21.15.5:0/2340880211 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f1314095c20 con 0x7f131c106c70 2023-10-07T00:10:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:31.000 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f130c0a1480 msgr2=0x7f130c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f130c0a1480 0x7f130c0a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1310005950 tx=0x7f131000b410 comp rx=0 tx=0).stop 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c106c70 msgr2=0x7f131c19e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c106c70 0x7f131c19e150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1314007ee0 tx=0x7f131400d3b0 comp rx=0 tx=0).stop 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 shutdown_connections 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f130c0a1480 0x7f130c0a3940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f131c106c70 0x7f131c19e150 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f131c101a10 0x7f131c196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 --2- 172.21.15.5:0/2340880211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131c104340 0x7f131c1970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 >> 172.21.15.5:0/2340880211 conn(0x7f131c0fb420 msgr2=0x7f131c102680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 shutdown_connections 2023-10-07T00:10:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:31.001+0000 7f1322fff700 1 -- 172.21.15.5:0/2340880211 wait complete. 2023-10-07T00:10:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 1 2023-10-07T00:10:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:30 smithi088 ceph-mon[103111]: Deploying daemon mds.l on smithi112 2023-10-07T00:10:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:30 smithi088 ceph-mon[103111]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:30 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/205007759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:10:31.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:30 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4017720215' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:10:31.694 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:10:31 smithi112 systemd[1]: Starting Ceph mds.l for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:31.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:31 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2340880211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:31 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2340880211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:32.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:31 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2340880211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:32.454 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:10:32 smithi112 podman[169593]: 2023-10-07T00:10:32.454 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mds[169633]: -- 172.21.15.112:0/1853248073 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d3212c11e0 con 0x55d321296c00 2023-10-07T00:10:32.454 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-l[169609]: starting mds.l at 2023-10-07T00:10:32.454 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:10:32 smithi112 bash[169593]: e47b9a5a427d7c7d57780cff7db29bed62222c8998eedccde5f20602afe531fb 2023-10-07T00:10:32.733 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:10:32 smithi112 systemd[1]: Started Ceph mds.l for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.112:6832/2184532481,v1:172.21.15.112:6833/2184532481] up:boot 2023-10-07T00:10:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: fsmap 1 up:standby 2023-10-07T00:10:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-07T00:10:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:32.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:32 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:33.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:33.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:33.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.112:6832/2184532481,v1:172.21.15.112:6833/2184532481] up:boot 2023-10-07T00:10:33.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: fsmap 1 up:standby 2023-10-07T00:10:33.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-07T00:10:33.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:33.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:33.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:33.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:33.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:33.094 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:32 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.112:6832/2184532481,v1:172.21.15.112:6833/2184532481] up:boot 2023-10-07T00:10:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: fsmap 1 up:standby 2023-10-07T00:10:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-07T00:10:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:32 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 -- 172.21.15.5:0/742596800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf68104370 msgr2=0x7faf68106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 --2- 172.21.15.5:0/742596800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf68104370 0x7faf68106760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faf58009990 tx=0x7faf58009ca0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 -- 172.21.15.5:0/742596800 shutdown_connections 2023-10-07T00:10:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 --2- 172.21.15.5:0/742596800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68106ca0 0x7faf68109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 --2- 172.21.15.5:0/742596800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf68101a40 0x7faf68103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 --2- 172.21.15.5:0/742596800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf68104370 0x7faf68106760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 -- 172.21.15.5:0/742596800 >> 172.21.15.5:0/742596800 conn(0x7faf680fb410 msgr2=0x7faf680fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 -- 172.21.15.5:0/742596800 shutdown_connections 2023-10-07T00:10:33.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.239+0000 7faf6ffff700 1 -- 172.21.15.5:0/742596800 wait complete. 2023-10-07T00:10:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.240+0000 7faf6ffff700 1 Processor -- start 2023-10-07T00:10:33.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.240+0000 7faf6ffff700 1 -- start start 2023-10-07T00:10:33.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68101a40 0x7faf68196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:33.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf68104370 0x7faf681970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:33.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf68106ca0 0x7faf6819e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:33.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6ffff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6819e720 con 0x7faf68101a40 2023-10-07T00:10:33.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6819e860 con 0x7faf68106ca0 2023-10-07T00:10:33.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6ffff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6819e9f0 con 0x7faf68104370 2023-10-07T00:10:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68101a40 0x7faf68196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68101a40 0x7faf68196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54228/0 (socket says 172.21.15.5:54228) 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 -- 172.21.15.5:0/686002430 learned_addr learned my addr 172.21.15.5:0/686002430 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6e59c700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf68106ca0 0x7faf6819e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6d59a700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf68104370 0x7faf681970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 -- 172.21.15.5:0/686002430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf68104370 msgr2=0x7faf681970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf68104370 0x7faf681970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 -- 172.21.15.5:0/686002430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf68106ca0 msgr2=0x7faf6819e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf68106ca0 0x7faf6819e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 -- 172.21.15.5:0/686002430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580095f0 con 0x7faf68101a40 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6d59a700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf68104370 0x7faf681970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.241+0000 7faf6dd9b700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68101a40 0x7faf68196ba0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf6400d980 tx=0x7faf6400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.242+0000 7faf5effd700 1 -- 172.21.15.5:0/686002430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64004220 con 0x7faf68101a40 2023-10-07T00:10:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.242+0000 7faf5effd700 1 -- 172.21.15.5:0/686002430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf64007640 con 0x7faf68101a40 2023-10-07T00:10:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.242+0000 7faf5effd700 1 -- 172.21.15.5:0/686002430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf640055e0 con 0x7faf68101a40 2023-10-07T00:10:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.242+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6819ecd0 con 0x7faf68101a40 2023-10-07T00:10:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.242+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6819f190 con 0x7faf68101a40 2023-10-07T00:10:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.243+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf680fcf90 con 0x7faf68101a40 2023-10-07T00:10:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.245+0000 7faf5effd700 1 -- 172.21.15.5:0/686002430 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7faf64004750 con 0x7faf68101a40 2023-10-07T00:10:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.246+0000 7faf5effd700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf540a1480 0x7faf540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.247+0000 7faf5effd700 1 -- 172.21.15.5:0/686002430 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faf640cc6d0 con 0x7faf68101a40 2023-10-07T00:10:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.247+0000 7faf6d59a700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf540a1480 0x7faf540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.247+0000 7faf6d59a700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf540a1480 0x7faf540a3940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf580098e0 tx=0x7faf58005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:33.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.250+0000 7faf5effd700 1 -- 172.21.15.5:0/686002430 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faf640961d0 con 0x7faf68101a40 2023-10-07T00:10:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.510+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf6810c6b0 con 0x7faf68101a40 2023-10-07T00:10:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.510+0000 7faf5effd700 1 -- 172.21.15.5:0/686002430 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7faf64005740 con 0x7faf68101a40 2023-10-07T00:10:33.512 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:33.512 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-07T00:10:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf540a1480 msgr2=0x7faf540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf540a1480 0x7faf540a3940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf580098e0 tx=0x7faf58005fb0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68101a40 msgr2=0x7faf68196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68101a40 0x7faf68196ba0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf6400d980 tx=0x7faf6400dc90 comp rx=0 tx=0).stop 2023-10-07T00:10:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 shutdown_connections 2023-10-07T00:10:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7faf540a1480 0x7faf540a3940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf68106ca0 0x7faf6819e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68101a40 0x7faf68196ba0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 --2- 172.21.15.5:0/686002430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf68104370 0x7faf681970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 >> 172.21.15.5:0/686002430 conn(0x7faf680fb410 msgr2=0x7faf681026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 shutdown_connections 2023-10-07T00:10:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:33.513+0000 7faf6ffff700 1 -- 172.21.15.5:0/686002430 wait complete. 2023-10-07T00:10:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2023-10-07T00:10:33.815 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:33 smithi088 ceph-mon[103111]: Deploying daemon mds.k on smithi088 2023-10-07T00:10:33.815 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:33 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/686002430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:33.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:33 smithi005 ceph-mon[129406]: Deploying daemon mds.k on smithi088 2023-10-07T00:10:33.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:33 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/686002430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:33.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:33 smithi112 ceph-mon[133548]: Deploying daemon mds.k on smithi088 2023-10-07T00:10:33.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:33 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/686002430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:34.808 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:34 smithi088 ceph-mon[103111]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:34.809 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:10:34 smithi088 systemd[1]: Starting Ceph mds.k for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:34 smithi112 ceph-mon[133548]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:35.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:34 smithi005 ceph-mon[129406]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:35.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:35.560 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:10:35 smithi088 podman[138130]: 2023-10-07T00:10:35.561 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:10:35 smithi088 bash[138130]: 33e1d80cd515b9c7d798007b3c941dee96cd71e1d860ec75045612236282389d 2023-10-07T00:10:35.561 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:10:35 smithi088 ceph-mds[138170]: -- 172.21.15.88:0/3337529495 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55936ea571e0 con 0x55936ea2c800 2023-10-07T00:10:35.561 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:10:35 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-k[138146]: starting mds.k at 2023-10-07T00:10:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.756+0000 7fa0699ff700 1 -- 172.21.15.5:0/2038256398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640ffe90 msgr2=0x7fa0641002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.756+0000 7fa0699ff700 1 --2- 172.21.15.5:0/2038256398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640ffe90 0x7fa0641002b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa054009990 tx=0x7fa054009ca0 comp rx=0 tx=0).stop 2023-10-07T00:10:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.757+0000 7fa0699ff700 1 -- 172.21.15.5:0/2038256398 shutdown_connections 2023-10-07T00:10:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.757+0000 7fa0699ff700 1 --2- 172.21.15.5:0/2038256398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0641019a0 0x7fa0641082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.757+0000 7fa0699ff700 1 --2- 172.21.15.5:0/2038256398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640ffe90 0x7fa0641002b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.757+0000 7fa0699ff700 1 --2- 172.21.15.5:0/2038256398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa064100fe0 0x7fa064101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.757+0000 7fa0699ff700 1 -- 172.21.15.5:0/2038256398 >> 172.21.15.5:0/2038256398 conn(0x7fa0640fb420 msgr2=0x7fa0640fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.757+0000 7fa0699ff700 1 -- 172.21.15.5:0/2038256398 shutdown_connections 2023-10-07T00:10:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.757+0000 7fa0699ff700 1 -- 172.21.15.5:0/2038256398 wait complete. 2023-10-07T00:10:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.758+0000 7fa0699ff700 1 Processor -- start 2023-10-07T00:10:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.758+0000 7fa0699ff700 1 -- start start 2023-10-07T00:10:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0699ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0640ffe90 0x7fa06410a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0699ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa064100fe0 0x7fa064108db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0699ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0641019a0 0x7fa0641092f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0699ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa064109a90 con 0x7fa064100fe0 2023-10-07T00:10:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0699ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa064109c00 con 0x7fa0640ffe90 2023-10-07T00:10:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0699ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0641a0bc0 con 0x7fa0641019a0 2023-10-07T00:10:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0627fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa064100fe0 0x7fa064108db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0627fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa064100fe0 0x7fa064108db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54244/0 (socket says 172.21.15.5:54244) 2023-10-07T00:10:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa0627fc700 1 -- 172.21.15.5:0/3899115697 learned_addr learned my addr 172.21.15.5:0/3899115697 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.759+0000 7fa062ffd700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0640ffe90 0x7fa06410a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0627fc700 1 -- 172.21.15.5:0/3899115697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0641019a0 msgr2=0x7fa0641092f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0627fc700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0641019a0 0x7fa0641092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0627fc700 1 -- 172.21.15.5:0/3899115697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0640ffe90 msgr2=0x7fa06410a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0627fc700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0640ffe90 0x7fa06410a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0627fc700 1 -- 172.21.15.5:0/3899115697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540095f0 con 0x7fa064100fe0 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0627fc700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa064100fe0 0x7fa064108db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa05800e9a0 tx=0x7fa05800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0689fd700 1 -- 172.21.15.5:0/3899115697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058009790 con 0x7fa064100fe0 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0689fd700 1 -- 172.21.15.5:0/3899115697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa05800cbd0 con 0x7fa064100fe0 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0641a0ea0 con 0x7fa064100fe0 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0689fd700 1 -- 172.21.15.5:0/3899115697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058018680 con 0x7fa064100fe0 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.760+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0641a1380 con 0x7fa064100fe0 2023-10-07T00:10:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.761+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa064106e00 con 0x7fa064100fe0 2023-10-07T00:10:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.764+0000 7fa0689fd700 1 -- 172.21.15.5:0/3899115697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa05800cd40 con 0x7fa064100fe0 2023-10-07T00:10:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.765+0000 7fa0689fd700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa04c0a1480 0x7fa04c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.765+0000 7fa0689fd700 1 -- 172.21.15.5:0/3899115697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa058014070 con 0x7fa064100fe0 2023-10-07T00:10:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.765+0000 7fa062ffd700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa04c0a1480 0x7fa04c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.766+0000 7fa062ffd700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa04c0a1480 0x7fa04c0a3940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa054006010 tx=0x7fa05400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:35.768+0000 7fa0689fd700 1 -- 172.21.15.5:0/3899115697 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa058096980 con 0x7fa064100fe0 2023-10-07T00:10:35.952 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:10:35 smithi088 systemd[1]: Started Ceph mds.k for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.034+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa06410c920 con 0x7fa064100fe0 2023-10-07T00:10:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.034+0000 7fa0689fd700 1 -- 172.21.15.5:0/3899115697 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7fa058099fa0 con 0x7fa064100fe0 2023-10-07T00:10:36.036 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:36.036 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-07T00:10:36.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa04c0a1480 msgr2=0x7fa04c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:36.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa04c0a1480 0x7fa04c0a3940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa054006010 tx=0x7fa05400b260 comp rx=0 tx=0).stop 2023-10-07T00:10:36.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa064100fe0 msgr2=0x7fa064108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:36.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa064100fe0 0x7fa064108db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa05800e9a0 tx=0x7fa05800ecb0 comp rx=0 tx=0).stop 2023-10-07T00:10:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 shutdown_connections 2023-10-07T00:10:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa04c0a1480 0x7fa04c0a3940 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0641019a0 0x7fa0641092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0640ffe90 0x7fa06410a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 --2- 172.21.15.5:0/3899115697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa064100fe0 0x7fa064108db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 >> 172.21.15.5:0/3899115697 conn(0x7fa0640fb420 msgr2=0x7fa0640fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 shutdown_connections 2023-10-07T00:10:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:36.037+0000 7fa0699ff700 1 -- 172.21.15.5:0/3899115697 wait complete. 2023-10-07T00:10:36.040 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2023-10-07T00:10:36.885 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.885 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:36.885 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.885 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:36.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:36.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:36.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: Deploying daemon mds.j on smithi005 2023-10-07T00:10:36.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.88:6832/1806621495,v1:172.21.15.88:6833/1806621495] up:boot 2023-10-07T00:10:36.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: fsmap 2 up:standby 2023-10-07T00:10:36.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-07T00:10:36.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:36 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3899115697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:36.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:36.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:36.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: Deploying daemon mds.j on smithi005 2023-10-07T00:10:36.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.88:6832/1806621495,v1:172.21.15.88:6833/1806621495] up:boot 2023-10-07T00:10:36.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: fsmap 2 up:standby 2023-10-07T00:10:36.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-07T00:10:36.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:36 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3899115697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: Deploying daemon mds.j on smithi005 2023-10-07T00:10:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.88:6832/1806621495,v1:172.21.15.88:6833/1806621495] up:boot 2023-10-07T00:10:36.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: fsmap 2 up:standby 2023-10-07T00:10:36.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-07T00:10:36.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:36 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3899115697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:37.990 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:10:37 smithi005 systemd[1]: Starting Ceph mds.j for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:38.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 -- 172.21.15.5:0/2900612273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c104340 msgr2=0x7f679c106730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 --2- 172.21.15.5:0/2900612273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c104340 0x7f679c106730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6788009990 tx=0x7f6788009ca0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 -- 172.21.15.5:0/2900612273 shutdown_connections 2023-10-07T00:10:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 --2- 172.21.15.5:0/2900612273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c106c70 0x7f679c1090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 --2- 172.21.15.5:0/2900612273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f679c101a10 0x7f679c103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 --2- 172.21.15.5:0/2900612273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c104340 0x7f679c106730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 -- 172.21.15.5:0/2900612273 >> 172.21.15.5:0/2900612273 conn(0x7f679c0fb420 msgr2=0x7f679c0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 -- 172.21.15.5:0/2900612273 shutdown_connections 2023-10-07T00:10:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.291+0000 7f67a31ff700 1 -- 172.21.15.5:0/2900612273 wait complete. 2023-10-07T00:10:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.292+0000 7f67a31ff700 1 Processor -- start 2023-10-07T00:10:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a31ff700 1 -- start start 2023-10-07T00:10:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a31ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c101a10 0x7f679c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a31ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c104340 0x7f679c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a31ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f679c106c70 0x7f679c1a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a31ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1a08f0 con 0x7f679c101a10 2023-10-07T00:10:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a31ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1a0a30 con 0x7f679c106c70 2023-10-07T00:10:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a31ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1a0bc0 con 0x7f679c104340 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a0f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c101a10 0x7f679c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a0f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c101a10 0x7f679c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54260/0 (socket says 172.21.15.5:54260) 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a0f9b700 1 -- 172.21.15.5:0/1174629440 learned_addr learned my addr 172.21.15.5:0/1174629440 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.293+0000 7f67a179c700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f679c106c70 0x7f679c1a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f679bfff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c104340 0x7f679c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f67a0f9b700 1 -- 172.21.15.5:0/1174629440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c104340 msgr2=0x7f679c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f67a0f9b700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c104340 0x7f679c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f67a0f9b700 1 -- 172.21.15.5:0/1174629440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f679c106c70 msgr2=0x7f679c1a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f67a0f9b700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f679c106c70 0x7f679c1a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f67a0f9b700 1 -- 172.21.15.5:0/1174629440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880095f0 con 0x7f679c101a10 2023-10-07T00:10:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f67a0f9b700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c101a10 0x7f679c198d70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f679000d980 tx=0x7f679000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f6799ffb700 1 -- 172.21.15.5:0/1174629440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790004220 con 0x7f679c101a10 2023-10-07T00:10:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679c1a0ea0 con 0x7f679c101a10 2023-10-07T00:10:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f6799ffb700 1 -- 172.21.15.5:0/1174629440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6790007640 con 0x7f679c101a10 2023-10-07T00:10:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.294+0000 7f6799ffb700 1 -- 172.21.15.5:0/1174629440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67900055e0 con 0x7f679c101a10 2023-10-07T00:10:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.295+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c1a12c0 con 0x7f679c101a10 2023-10-07T00:10:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.296+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679c108840 con 0x7f679c101a10 2023-10-07T00:10:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.298+0000 7f6799ffb700 1 -- 172.21.15.5:0/1174629440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6790004750 con 0x7f679c101a10 2023-10-07T00:10:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.299+0000 7f6799ffb700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f678c0a1480 0x7f678c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.299+0000 7f6799ffb700 1 -- 172.21.15.5:0/1174629440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f67900cc760 con 0x7f679c101a10 2023-10-07T00:10:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.299+0000 7f679bfff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f678c0a1480 0x7f678c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.300+0000 7f679bfff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f678c0a1480 0x7f678c0a3940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6788006010 tx=0x7f678800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:38.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.303+0000 7f6799ffb700 1 -- 172.21.15.5:0/1174629440 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f67900961c0 con 0x7f679c101a10 2023-10-07T00:10:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.594+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f679c10c630 con 0x7f679c101a10 2023-10-07T00:10:38.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.595+0000 7f6799ffb700 1 -- 172.21.15.5:0/1174629440 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7f6790016860 con 0x7f679c101a10 2023-10-07T00:10:38.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:38.596 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-07T00:10:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f678c0a1480 msgr2=0x7f678c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f678c0a1480 0x7f678c0a3940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6788006010 tx=0x7f678800b260 comp rx=0 tx=0).stop 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c101a10 msgr2=0x7f679c198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c101a10 0x7f679c198d70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f679000d980 tx=0x7f679000dc90 comp rx=0 tx=0).stop 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 shutdown_connections 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f678c0a1480 0x7f678c0a3940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f679c106c70 0x7f679c1a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f679c101a10 0x7f679c198d70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 --2- 172.21.15.5:0/1174629440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c104340 0x7f679c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 >> 172.21.15.5:0/1174629440 conn(0x7f679c0fb420 msgr2=0x7f679c102680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.597+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 shutdown_connections 2023-10-07T00:10:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:38.598+0000 7f67a31ff700 1 -- 172.21.15.5:0/1174629440 wait complete. 2023-10-07T00:10:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2023-10-07T00:10:38.789 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:38 smithi005 ceph-mon[129406]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:38.789 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:38 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1174629440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:38.790 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:10:38 smithi005 podman[176876]: 2023-10-07T00:10:38.790 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:10:38 smithi005 bash[176876]: 51a4ef8ee1f1869d07b78af1b6d2aa041703a9e1469ce44557d0b0e7733722e2 2023-10-07T00:10:38.790 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:10:38 smithi005 ceph-mds[176918]: -- 172.21.15.5:0/1341497086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5610172251e0 con 0x5610171fb000 2023-10-07T00:10:38.790 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:10:38 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-j[176892]: starting mds.j at 2023-10-07T00:10:38.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:38 smithi088 ceph-mon[103111]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:38.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:38 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1174629440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:38 smithi112 ceph-mon[133548]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:38 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1174629440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:39.108 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:10:38 smithi005 systemd[1]: Started Ceph mds.j for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: Deploying daemon mds.d on smithi005 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.5:6834/661622030,v1:172.21.15.5:6835/661622030] up:boot 2023-10-07T00:10:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: fsmap 3 up:standby 2023-10-07T00:10:40.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:39 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-07T00:10:40.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: Deploying daemon mds.d on smithi005 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.5:6834/661622030,v1:172.21.15.5:6835/661622030] up:boot 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: fsmap 3 up:standby 2023-10-07T00:10:40.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:39 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-07T00:10:40.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: Deploying daemon mds.d on smithi005 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.5:6834/661622030,v1:172.21.15.5:6835/661622030] up:boot 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: fsmap 3 up:standby 2023-10-07T00:10:40.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:39 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-07T00:10:40.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 -- 172.21.15.5:0/2169168011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204077470 msgr2=0x7f0204077cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 --2- 172.21.15.5:0/2169168011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204077470 0x7f0204077cf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00b0a0 tx=0x7f01fc00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:10:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 -- 172.21.15.5:0/2169168011 shutdown_connections 2023-10-07T00:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 --2- 172.21.15.5:0/2169168011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204077470 0x7f0204077cf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 --2- 172.21.15.5:0/2169168011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0204075870 0x7f0204075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 --2- 172.21.15.5:0/2169168011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0204076ab0 0x7f0204076f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 -- 172.21.15.5:0/2169168011 >> 172.21.15.5:0/2169168011 conn(0x7f02040fe770 msgr2=0x7f0204100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 -- 172.21.15.5:0/2169168011 shutdown_connections 2023-10-07T00:10:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.975+0000 7f02091ff700 1 -- 172.21.15.5:0/2169168011 wait complete. 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.976+0000 7f02091ff700 1 Processor -- start 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.976+0000 7f02091ff700 1 -- start start 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.976+0000 7f02091ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204075870 0x7f020419d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.976+0000 7f02091ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0204076ab0 0x7f020419d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.976+0000 7f02091ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0204077470 0x7f02041a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.976+0000 7f02091ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02041a4e30 con 0x7f0204075870 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.976+0000 7f02091ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02041a4f70 con 0x7f0204076ab0 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.976+0000 7f02091ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02041a5100 con 0x7f0204077470 2023-10-07T00:10:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204075870 0x7f020419d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204075870 0x7f020419d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54276/0 (socket says 172.21.15.5:54276) 2023-10-07T00:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 -- 172.21.15.5:0/3393020756 learned_addr learned my addr 172.21.15.5:0/3393020756 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f020359e700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0204077470 0x7f02041a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f020259c700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0204076ab0 0x7f020419d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 -- 172.21.15.5:0/3393020756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0204077470 msgr2=0x7f02041a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0204077470 0x7f02041a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 -- 172.21.15.5:0/3393020756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0204076ab0 msgr2=0x7f020419d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0204076ab0 0x7f020419d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 -- 172.21.15.5:0/3393020756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc009d00 con 0x7f0204075870 2023-10-07T00:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.977+0000 7f0202d9d700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204075870 0x7f020419d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f01f400d950 tx=0x7f01f400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.978+0000 7f01ebfff700 1 -- 172.21.15.5:0/3393020756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f400f890 con 0x7f0204075870 2023-10-07T00:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.978+0000 7f01ebfff700 1 -- 172.21.15.5:0/3393020756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01f400fe80 con 0x7f0204075870 2023-10-07T00:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.978+0000 7f01ebfff700 1 -- 172.21.15.5:0/3393020756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f400e3b0 con 0x7f0204075870 2023-10-07T00:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.978+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02041a53e0 con 0x7f0204075870 2023-10-07T00:10:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.978+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02041a58a0 con 0x7f0204075870 2023-10-07T00:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.979+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020410fbc0 con 0x7f0204075870 2023-10-07T00:10:40.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.981+0000 7f01ebfff700 1 -- 172.21.15.5:0/3393020756 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f01f4010460 con 0x7f0204075870 2023-10-07T00:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.982+0000 7f01ebfff700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01ec0a1480 0x7f01ec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.982+0000 7f01ebfff700 1 -- 172.21.15.5:0/3393020756 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f01f40cc660 con 0x7f0204075870 2023-10-07T00:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.982+0000 7f020259c700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01ec0a1480 0x7f01ec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.983+0000 7f020259c700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01ec0a1480 0x7f01ec0a3940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f01f8005950 tx=0x7f01f800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:40.989+0000 7f01ebfff700 1 -- 172.21.15.5:0/3393020756 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f01f40960c0 con 0x7f0204075870 2023-10-07T00:10:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.264+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0204112e60 con 0x7f0204075870 2023-10-07T00:10:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.265+0000 7f01ebfff700 1 -- 172.21.15.5:0/3393020756 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2904 (secure 0 0 0) 0x7f01f4016b70 con 0x7f0204075870 2023-10-07T00:10:41.267 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:41.267 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-07T00:10:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01ec0a1480 msgr2=0x7f01ec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01ec0a1480 0x7f01ec0a3940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f01f8005950 tx=0x7f01f800b410 comp rx=0 tx=0).stop 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204075870 msgr2=0x7f020419d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204075870 0x7f020419d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f01f400d950 tx=0x7f01f400dc60 comp rx=0 tx=0).stop 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 shutdown_connections 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01ec0a1480 0x7f01ec0a3940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0204077470 0x7f02041a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204075870 0x7f020419d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 --2- 172.21.15.5:0/3393020756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0204076ab0 0x7f020419d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 >> 172.21.15.5:0/3393020756 conn(0x7f02040fe770 msgr2=0x7f0204100460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 shutdown_connections 2023-10-07T00:10:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:41.269+0000 7f02091ff700 1 -- 172.21.15.5:0/3393020756 wait complete. 2023-10-07T00:10:41.272 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 4 2023-10-07T00:10:41.609 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:10:41 smithi005 systemd[1]: Starting Ceph mds.d for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:41.898 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:41 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3393020756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:41.898 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:10:41 smithi005 podman[177263]: 2023-10-07T00:10:41.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:41 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3393020756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:41.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:41 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3393020756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:42.358 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:10:41 smithi005 bash[177263]: ac7b129c637071fb2c0066b3953276db3ba10c0405b4bc3b6adb076017704ac2 2023-10-07T00:10:42.358 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:10:41 smithi005 ceph-mds[177303]: -- 172.21.15.5:0/3456169130 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5603701ed1e0 con 0x5603701c2800 2023-10-07T00:10:42.359 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:10:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-d[177279]: starting mds.d at 2023-10-07T00:10:42.359 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:10:41 smithi005 systemd[1]: Started Ceph mds.d for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:42.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:42 smithi088 ceph-mon[103111]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:42 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:42 smithi112 ceph-mon[133548]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:42.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:42.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:42.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:42.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:42.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:42.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:42 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:42 smithi005 ceph-mon[129406]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:42 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:43.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:43.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 -- 172.21.15.5:0/2335390892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41441021a0 msgr2=0x7f4144102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 --2- 172.21.15.5:0/2335390892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41441021a0 0x7f4144102600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f412c0099c0 tx=0x7f412c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 -- 172.21.15.5:0/2335390892 shutdown_connections 2023-10-07T00:10:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 --2- 172.21.15.5:0/2335390892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4144102b40 0x7f41441093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 --2- 172.21.15.5:0/2335390892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4144100fb0 0x7f41441013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 --2- 172.21.15.5:0/2335390892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41441021a0 0x7f4144102600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 -- 172.21.15.5:0/2335390892 >> 172.21.15.5:0/2335390892 conn(0x7f41440fc520 msgr2=0x7f41440fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 -- 172.21.15.5:0/2335390892 shutdown_connections 2023-10-07T00:10:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.516+0000 7f41495ff700 1 -- 172.21.15.5:0/2335390892 wait complete. 2023-10-07T00:10:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.517+0000 7f41495ff700 1 Processor -- start 2023-10-07T00:10:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.518+0000 7f41495ff700 1 -- start start 2023-10-07T00:10:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.518+0000 7f41495ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4144100fb0 0x7f4144074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.518+0000 7f41495ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41441021a0 0x7f41440732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.518+0000 7f41495ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4144102b40 0x7f41440737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.518+0000 7f41495ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144073f80 con 0x7f4144102b40 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.518+0000 7f41495ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440740f0 con 0x7f41441021a0 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.518+0000 7f41495ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41441a0c30 con 0x7f4144100fb0 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.518+0000 7f41437fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4144102b40 0x7f41440737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41441021a0 0x7f41440732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41441021a0 0x7f41440732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56294/0 (socket says 172.21.15.5:56294) 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f41437fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4144102b40 0x7f41440737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38080/0 (socket says 172.21.15.5:38080) 2023-10-07T00:10:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 -- 172.21.15.5:0/240021656 learned_addr learned my addr 172.21.15.5:0/240021656 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f4142ffd700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4144100fb0 0x7f4144074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 -- 172.21.15.5:0/240021656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4144100fb0 msgr2=0x7f4144074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4144100fb0 0x7f4144074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 -- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4144102b40 msgr2=0x7f41440737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4144102b40 0x7f41440737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 -- 172.21.15.5:0/240021656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0095f0 con 0x7f41441021a0 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f4142ffd700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4144100fb0 0x7f4144074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f41437fe700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4144102b40 0x7f41440737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:10:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f413bfff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41441021a0 0x7f41440732a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f412c000c00 tx=0x7f412c00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.519+0000 7f4140ff9700 1 -- 172.21.15.5:0/240021656 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c01d070 con 0x7f41441021a0 2023-10-07T00:10:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.520+0000 7f4140ff9700 1 -- 172.21.15.5:0/240021656 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f412c00fe70 con 0x7f41441021a0 2023-10-07T00:10:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.520+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41441a0eb0 con 0x7f41441021a0 2023-10-07T00:10:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.520+0000 7f4140ff9700 1 -- 172.21.15.5:0/240021656 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c004bd0 con 0x7f41441021a0 2023-10-07T00:10:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.520+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41441a1270 con 0x7f41441021a0 2023-10-07T00:10:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.521+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4144107ff0 con 0x7f41441021a0 2023-10-07T00:10:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.523+0000 7f4140ff9700 1 -- 172.21.15.5:0/240021656 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f412c004d30 con 0x7f41441021a0 2023-10-07T00:10:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.524+0000 7f4140ff9700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41300a1480 0x7f41300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.524+0000 7f4140ff9700 1 -- 172.21.15.5:0/240021656 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f412c0cdb80 con 0x7f41441021a0 2023-10-07T00:10:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.525+0000 7f4142ffd700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41300a1480 0x7f41300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.525+0000 7f4142ffd700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41300a1480 0x7f41300a3940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4144102000 tx=0x7f4134009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.526+0000 7f4140ff9700 1 -- 172.21.15.5:0/240021656 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f412c097670 con 0x7f41441021a0 2023-10-07T00:10:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.785+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f414402d1c0 con 0x7f41441021a0 2023-10-07T00:10:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.786+0000 7f4140ff9700 1 -- 172.21.15.5:0/240021656 <== mon.2 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3692 (secure 0 0 0) 0x7f412c026e80 con 0x7f41441021a0 2023-10-07T00:10:43.787 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:43.787 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-07T00:10:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41300a1480 msgr2=0x7f41300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41300a1480 0x7f41300a3940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4144102000 tx=0x7f4134009260 comp rx=0 tx=0).stop 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41441021a0 msgr2=0x7f41440732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41441021a0 0x7f41440732a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f412c000c00 tx=0x7f412c00fa00 comp rx=0 tx=0).stop 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 shutdown_connections 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41300a1480 0x7f41300a3940 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4144102b40 0x7f41440737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4144100fb0 0x7f4144074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 --2- 172.21.15.5:0/240021656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41441021a0 0x7f41440732a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 >> 172.21.15.5:0/240021656 conn(0x7f41440fc520 msgr2=0x7f41440fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 shutdown_connections 2023-10-07T00:10:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:43.788+0000 7f41495ff700 1 -- 172.21.15.5:0/240021656 wait complete. 2023-10-07T00:10:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 5 2023-10-07T00:10:43.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:43 smithi088 ceph-mon[103111]: Deploying daemon mds.e on smithi088 2023-10-07T00:10:43.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:43 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.5:6836/3650932338,v1:172.21.15.5:6837/3650932338] up:boot 2023-10-07T00:10:43.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:43 smithi088 ceph-mon[103111]: fsmap 4 up:standby 2023-10-07T00:10:43.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:43 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-07T00:10:43.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:43 smithi112 ceph-mon[133548]: Deploying daemon mds.e on smithi088 2023-10-07T00:10:43.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:43 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.5:6836/3650932338,v1:172.21.15.5:6837/3650932338] up:boot 2023-10-07T00:10:43.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:43 smithi112 ceph-mon[133548]: fsmap 4 up:standby 2023-10-07T00:10:43.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:43 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-07T00:10:44.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:43 smithi005 ceph-mon[129406]: Deploying daemon mds.e on smithi088 2023-10-07T00:10:44.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:43 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.5:6836/3650932338,v1:172.21.15.5:6837/3650932338] up:boot 2023-10-07T00:10:44.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:43 smithi005 ceph-mon[129406]: fsmap 4 up:standby 2023-10-07T00:10:44.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:43 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-07T00:10:44.247 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:10:44 smithi088 systemd[1]: Starting Ceph mds.e for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:44.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:44 smithi088 ceph-mon[103111]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:44.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:44 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/240021656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:44.953 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:10:44 smithi088 podman[138471]: 2023-10-07T00:10:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:44 smithi112 ceph-mon[133548]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:44 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/240021656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:45.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:44 smithi005 ceph-mon[129406]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:44 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/240021656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:45.452 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:10:44 smithi088 ceph-mds[138511]: -- 172.21.15.88:0/3061877584 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556c434231e0 con 0x556c433f8c00 2023-10-07T00:10:45.452 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:10:44 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-e[138487]: starting mds.e at 2023-10-07T00:10:45.452 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:10:45 smithi088 bash[138471]: d4c62ca4c39a0aef3277da09e2cef16236e3b0f05f8ac349b1bc56543f528cfd 2023-10-07T00:10:45.453 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:10:45 smithi088 systemd[1]: Started Ceph mds.e for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:45.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:46.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.023+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/431302873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc881021a0 msgr2=0x7fcc88102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:46.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.023+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/431302873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc881021a0 0x7fcc88102600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc780099c0 tx=0x7fcc78009cd0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.024+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/431302873 shutdown_connections 2023-10-07T00:10:46.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.024+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/431302873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc88102b40 0x7fcc881093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.024+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/431302873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc88100fb0 0x7fcc881013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.024+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/431302873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc881021a0 0x7fcc88102600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.024+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/431302873 >> 172.21.15.5:0/431302873 conn(0x7fcc880fc520 msgr2=0x7fcc880fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:46.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.024+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/431302873 shutdown_connections 2023-10-07T00:10:46.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.024+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/431302873 wait complete. 2023-10-07T00:10:46.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8f9ff700 1 Processor -- start 2023-10-07T00:10:46.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8f9ff700 1 -- start start 2023-10-07T00:10:46.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8f9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88100fb0 0x7fcc88198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:46.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8f9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc881021a0 0x7fcc88199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:46.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8f9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc88102b40 0x7fcc881a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8f9ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc881a0980 con 0x7fcc88100fb0 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8f9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc881a0ac0 con 0x7fcc881021a0 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8f9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc881a0c50 con 0x7fcc88102b40 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8d79b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88100fb0 0x7fcc88198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8d79b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88100fb0 0x7fcc88198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38086/0 (socket says 172.21.15.5:38086) 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8d79b700 1 -- 172.21.15.5:0/3256359590 learned_addr learned my addr 172.21.15.5:0/3256359590 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.025+0000 7fcc8df9c700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc88102b40 0x7fcc881a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc8cf9a700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc881021a0 0x7fcc88199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc8d79b700 1 -- 172.21.15.5:0/3256359590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc88102b40 msgr2=0x7fcc881a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc8d79b700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc88102b40 0x7fcc881a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc8d79b700 1 -- 172.21.15.5:0/3256359590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc881021a0 msgr2=0x7fcc88199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:46.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc8d79b700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc881021a0 0x7fcc88199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc8d79b700 1 -- 172.21.15.5:0/3256359590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780095f0 con 0x7fcc88100fb0 2023-10-07T00:10:46.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc8d79b700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88100fb0 0x7fcc88198e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400e970 tx=0x7fcc8400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:46.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc7e7fc700 1 -- 172.21.15.5:0/3256359590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84009790 con 0x7fcc88100fb0 2023-10-07T00:10:46.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc7e7fc700 1 -- 172.21.15.5:0/3256359590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc8400c7e0 con 0x7fcc88100fb0 2023-10-07T00:10:46.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc881a0f30 con 0x7fcc88100fb0 2023-10-07T00:10:46.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.026+0000 7fcc7e7fc700 1 -- 172.21.15.5:0/3256359590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84003bd0 con 0x7fcc88100fb0 2023-10-07T00:10:46.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.027+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc881a1350 con 0x7fcc88100fb0 2023-10-07T00:10:46.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.027+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8810c6c0 con 0x7fcc88100fb0 2023-10-07T00:10:46.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.030+0000 7fcc7e7fc700 1 -- 172.21.15.5:0/3256359590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fcc8400c950 con 0x7fcc88100fb0 2023-10-07T00:10:46.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.031+0000 7fcc7e7fc700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc740a1480 0x7fcc740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:46.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.031+0000 7fcc7e7fc700 1 -- 172.21.15.5:0/3256359590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcc84014070 con 0x7fcc88100fb0 2023-10-07T00:10:46.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.031+0000 7fcc8cf9a700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc740a1480 0x7fcc740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:46.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.032+0000 7fcc8cf9a700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc740a1480 0x7fcc740a3940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcc78006010 tx=0x7fcc780058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:46.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.035+0000 7fcc7e7fc700 1 -- 172.21.15.5:0/3256359590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcc84096540 con 0x7fcc88100fb0 2023-10-07T00:10:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.294+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc8810c900 con 0x7fcc88100fb0 2023-10-07T00:10:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.295+0000 7fcc7e7fc700 1 -- 172.21.15.5:0/3256359590 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4480 (secure 0 0 0) 0x7fcc84099b60 con 0x7fcc88100fb0 2023-10-07T00:10:46.297 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:46.297 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-07T00:10:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc740a1480 msgr2=0x7fcc740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc740a1480 0x7fcc740a3940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcc78006010 tx=0x7fcc780058e0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88100fb0 msgr2=0x7fcc88198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88100fb0 0x7fcc88198e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400e970 tx=0x7fcc8400ec80 comp rx=0 tx=0).stop 2023-10-07T00:10:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 shutdown_connections 2023-10-07T00:10:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc740a1480 0x7fcc740a3940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc88102b40 0x7fcc881a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88100fb0 0x7fcc88198e00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 --2- 172.21.15.5:0/3256359590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc881021a0 0x7fcc88199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.297+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 >> 172.21.15.5:0/3256359590 conn(0x7fcc880fc520 msgr2=0x7fcc880fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.298+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 shutdown_connections 2023-10-07T00:10:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:46.298+0000 7fcc8f9ff700 1 -- 172.21.15.5:0/3256359590 wait complete. 2023-10-07T00:10:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2023-10-07T00:10:46.376 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.376 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.376 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.377 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:46.377 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:46.377 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:46.377 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: Deploying daemon mds.f on smithi112 2023-10-07T00:10:46.377 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:46.377 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.88:6834/987389810,v1:172.21.15.88:6835/987389810] up:boot 2023-10-07T00:10:46.377 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: fsmap 5 up:standby 2023-10-07T00:10:46.377 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:46 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-07T00:10:46.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:46.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:46.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:46.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: Deploying daemon mds.f on smithi112 2023-10-07T00:10:46.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:46.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.88:6834/987389810,v1:172.21.15.88:6835/987389810] up:boot 2023-10-07T00:10:46.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: fsmap 5 up:standby 2023-10-07T00:10:46.454 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:46 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: Deploying daemon mds.f on smithi112 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.88:6834/987389810,v1:172.21.15.88:6835/987389810] up:boot 2023-10-07T00:10:46.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: fsmap 5 up:standby 2023-10-07T00:10:46.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:46 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-07T00:10:47.359 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:47 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3256359590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:47.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:47 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3256359590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:47.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:47 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3256359590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:47.747 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:10:47 smithi112 systemd[1]: Starting Ceph mds.f for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:48.119 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:10:47 smithi112 podman[169939]: 2023-10-07T00:10:48.119 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:10:48 smithi112 bash[169939]: a5e84e130fed456510a9cb8ae54d44d0821e5ebcf0ff369a3958515980e7bd5c 2023-10-07T00:10:48.119 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:10:48 smithi112 ceph-mds[169979]: -- 172.21.15.112:0/3443998576 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5652f9ced1e0 con 0x5652f9cc2800 2023-10-07T00:10:48.119 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:10:48 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-f[169955]: starting mds.f at 2023-10-07T00:10:48.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:48.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:48 smithi112 ceph-mon[133548]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:48.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:48.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:48 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:48.498 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:10:48 smithi112 systemd[1]: Started Ceph mds.f for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:48.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.526+0000 7feece9ff700 1 -- 172.21.15.5:0/2428651365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8108e70 msgr2=0x7feec810b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:48.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.526+0000 7feece9ff700 1 --2- 172.21.15.5:0/2428651365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8108e70 0x7feec810b300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feec000b0a0 tx=0x7feec000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.526+0000 7feece9ff700 1 -- 172.21.15.5:0/2428651365 shutdown_connections 2023-10-07T00:10:48.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.526+0000 7feece9ff700 1 --2- 172.21.15.5:0/2428651365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8108e70 0x7feec810b300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.527+0000 7feece9ff700 1 --2- 172.21.15.5:0/2428651365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feec8074ef0 0x7feec8073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.527+0000 7feece9ff700 1 --2- 172.21.15.5:0/2428651365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec8073910 0x7feec8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.527+0000 7feece9ff700 1 -- 172.21.15.5:0/2428651365 >> 172.21.15.5:0/2428651365 conn(0x7feec80fc520 msgr2=0x7feec80fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:48.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.527+0000 7feece9ff700 1 -- 172.21.15.5:0/2428651365 shutdown_connections 2023-10-07T00:10:48.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.527+0000 7feece9ff700 1 -- 172.21.15.5:0/2428651365 wait complete. 2023-10-07T00:10:48.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feece9ff700 1 Processor -- start 2023-10-07T00:10:48.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feece9ff700 1 -- start start 2023-10-07T00:10:48.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feece9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8073910 0x7feec8198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:48.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feece9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feec8074ef0 0x7feec8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:48.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feece9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec8108e70 0x7feec81a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:48.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feece9ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81a0a70 con 0x7feec8073910 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feece9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81a0bb0 con 0x7feec8074ef0 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feece9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81a0d40 con 0x7feec8108e70 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feec7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8073910 0x7feec8198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feec7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8073910 0x7feec8198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38110/0 (socket says 172.21.15.5:38110) 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feec7fff700 1 -- 172.21.15.5:0/650278180 learned_addr learned my addr 172.21.15.5:0/650278180 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feeccf9c700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec8108e70 0x7feec81a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.528+0000 7feec77fe700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feec8074ef0 0x7feec8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec7fff700 1 -- 172.21.15.5:0/650278180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec8108e70 msgr2=0x7feec81a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec7fff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec8108e70 0x7feec81a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec7fff700 1 -- 172.21.15.5:0/650278180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feec8074ef0 msgr2=0x7feec8199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec7fff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feec8074ef0 0x7feec8199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec7fff700 1 -- 172.21.15.5:0/650278180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009d00 con 0x7feec8073910 2023-10-07T00:10:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec7fff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8073910 0x7feec8198ef0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feeb800d950 tx=0x7feeb800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec57fa700 1 -- 172.21.15.5:0/650278180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800f890 con 0x7feec8073910 2023-10-07T00:10:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec81a0fc0 con 0x7feec8073910 2023-10-07T00:10:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec57fa700 1 -- 172.21.15.5:0/650278180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feeb800fe80 con 0x7feec8073910 2023-10-07T00:10:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feec57fa700 1 -- 172.21.15.5:0/650278180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800e3b0 con 0x7feec8073910 2023-10-07T00:10:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.529+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec81a1490 con 0x7feec8073910 2023-10-07T00:10:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.530+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec8107520 con 0x7feec8073910 2023-10-07T00:10:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.533+0000 7feec57fa700 1 -- 172.21.15.5:0/650278180 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7feeb8010460 con 0x7feec8073910 2023-10-07T00:10:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.534+0000 7feec57fa700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7feeb00a1500 0x7feeb00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.534+0000 7feec57fa700 1 -- 172.21.15.5:0/650278180 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7feeb80cc640 con 0x7feec8073910 2023-10-07T00:10:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.534+0000 7feec77fe700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7feeb00a1500 0x7feeb00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:48.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.535+0000 7feec77fe700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7feeb00a1500 0x7feeb00a39c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feec8074c10 tx=0x7feebc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:48.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.538+0000 7feec57fa700 1 -- 172.21.15.5:0/650278180 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feeb80960a0 con 0x7feec8073910 2023-10-07T00:10:48.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:48 smithi005 ceph-mon[129406]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:48.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:48.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:48 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:48.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:48 smithi088 ceph-mon[103111]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:48.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:48.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:48 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.795+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feec802d020 con 0x7feec8073910 2023-10-07T00:10:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.796+0000 7feec57fa700 1 -- 172.21.15.5:0/650278180 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5274 (secure 0 0 0) 0x7feeb80996c0 con 0x7feec8073910 2023-10-07T00:10:48.797 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:48.798 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-07T00:10:48.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.798+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7feeb00a1500 msgr2=0x7feeb00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:48.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.798+0000 7feece9ff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7feeb00a1500 0x7feeb00a39c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feec8074c10 tx=0x7feebc009260 comp rx=0 tx=0).stop 2023-10-07T00:10:48.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.798+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8073910 msgr2=0x7feec8198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:48.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.798+0000 7feece9ff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8073910 0x7feec8198ef0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feeb800d950 tx=0x7feeb800dc60 comp rx=0 tx=0).stop 2023-10-07T00:10:48.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.799+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 shutdown_connections 2023-10-07T00:10:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.799+0000 7feece9ff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7feeb00a1500 0x7feeb00a39c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.799+0000 7feece9ff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec8108e70 0x7feec81a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.799+0000 7feece9ff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec8073910 0x7feec8198ef0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.799+0000 7feece9ff700 1 --2- 172.21.15.5:0/650278180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feec8074ef0 0x7feec8199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.799+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 >> 172.21.15.5:0/650278180 conn(0x7feec80fc520 msgr2=0x7feec80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.799+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 shutdown_connections 2023-10-07T00:10:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:48.799+0000 7feece9ff700 1 -- 172.21.15.5:0/650278180 wait complete. 2023-10-07T00:10:48.802 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-10-07T00:10:49.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.112:6834/1364284217,v1:172.21.15.112:6835/1364284217] up:boot 2023-10-07T00:10:49.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: fsmap 6 up:standby 2023-10-07T00:10:49.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-07T00:10:49.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:49.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:49.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:49.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:49.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: Deploying daemon mds.c on smithi112 2023-10-07T00:10:49.443 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:49 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/650278180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.112:6834/1364284217,v1:172.21.15.112:6835/1364284217] up:boot 2023-10-07T00:10:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: fsmap 6 up:standby 2023-10-07T00:10:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-07T00:10:49.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:49.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:49.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:49.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:49.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: Deploying daemon mds.c on smithi112 2023-10-07T00:10:49.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:49 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/650278180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:49.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.112:6834/1364284217,v1:172.21.15.112:6835/1364284217] up:boot 2023-10-07T00:10:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: fsmap 6 up:standby 2023-10-07T00:10:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-07T00:10:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: Deploying daemon mds.c on smithi112 2023-10-07T00:10:49.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:49 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/650278180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:50.468 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:10:50 smithi112 systemd[1]: Starting Ceph mds.c for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:50.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:50.902 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:50 smithi112 ceph-mon[133548]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:50.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:50 smithi088 ceph-mon[103111]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.033+0000 7f8eed7ff700 1 -- 172.21.15.5:0/1724856667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8073910 msgr2=0x7f8ee8073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.033+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/1724856667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8073910 0x7f8ee8073d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009990 tx=0x7f8edc009ca0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.034+0000 7f8eed7ff700 1 -- 172.21.15.5:0/1724856667 shutdown_connections 2023-10-07T00:10:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.034+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/1724856667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee8108e80 0x7f8ee810b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.034+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/1724856667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee8074ef0 0x7f8ee8073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.034+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/1724856667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8073910 0x7f8ee8073d90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.034+0000 7f8eed7ff700 1 -- 172.21.15.5:0/1724856667 >> 172.21.15.5:0/1724856667 conn(0x7f8ee80fc530 msgr2=0x7f8ee80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.034+0000 7f8eed7ff700 1 -- 172.21.15.5:0/1724856667 shutdown_connections 2023-10-07T00:10:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.034+0000 7f8eed7ff700 1 -- 172.21.15.5:0/1724856667 wait complete. 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8eed7ff700 1 Processor -- start 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8eed7ff700 1 -- start start 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8eed7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee8073910 0x7f8ee8198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8eed7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8074ef0 0x7f8ee8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8eed7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee8108e80 0x7f8ee81a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8eed7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81a0990 con 0x7f8ee8074ef0 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8eed7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81a0ad0 con 0x7f8ee8073910 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8eed7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81a0c60 con 0x7f8ee8108e80 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8ee67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8074ef0 0x7f8ee8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8ee67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8074ef0 0x7f8ee8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38136/0 (socket says 172.21.15.5:38136) 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8ee67fc700 1 -- 172.21.15.5:0/734375356 learned_addr learned my addr 172.21.15.5:0/734375356 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8ee77fe700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee8108e80 0x7f8ee81a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.035+0000 7f8ee6ffd700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee8073910 0x7f8ee8198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ee67fc700 1 -- 172.21.15.5:0/734375356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee8108e80 msgr2=0x7f8ee81a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ee67fc700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee8108e80 0x7f8ee81a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ee67fc700 1 -- 172.21.15.5:0/734375356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee8073910 msgr2=0x7f8ee8198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ee67fc700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee8073910 0x7f8ee8198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ee67fc700 1 -- 172.21.15.5:0/734375356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0095f0 con 0x7f8ee8074ef0 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ee67fc700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8074ef0 0x7f8ee8199350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8edc005910 tx=0x7f8edc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ecffff700 1 -- 172.21.15.5:0/734375356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc01d070 con 0x7f8ee8074ef0 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee81a0ee0 con 0x7f8ee8074ef0 2023-10-07T00:10:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ecffff700 1 -- 172.21.15.5:0/734375356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8edc00bdb0 con 0x7f8ee8074ef0 2023-10-07T00:10:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.036+0000 7f8ecffff700 1 -- 172.21.15.5:0/734375356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc022d40 con 0x7f8ee8074ef0 2023-10-07T00:10:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.037+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee81a1250 con 0x7f8ee8074ef0 2023-10-07T00:10:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.037+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8107530 con 0x7f8ee8074ef0 2023-10-07T00:10:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.039+0000 7f8ecffff700 1 -- 172.21.15.5:0/734375356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8edc022470 con 0x7f8ee8074ef0 2023-10-07T00:10:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.041+0000 7f8ecffff700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ed00a1480 0x7f8ed00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.041+0000 7f8ecffff700 1 -- 172.21.15.5:0/734375356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8edc0ce5b0 con 0x7f8ee8074ef0 2023-10-07T00:10:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.041+0000 7f8ee6ffd700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ed00a1480 0x7f8ed00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:51.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.042+0000 7f8ee6ffd700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ed00a1480 0x7f8ed00a3940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009c60 tx=0x7f8ed8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.043+0000 7f8ecffff700 1 -- 172.21.15.5:0/734375356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8edc0980a0 con 0x7f8ee8074ef0 2023-10-07T00:10:51.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:50 smithi005 ceph-mon[129406]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:51.189 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:10:50 smithi112 podman[170280]: 2023-10-07T00:10:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.308+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ee810eb00 con 0x7f8ee8074ef0 2023-10-07T00:10:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.309+0000 7f8ecffff700 1 -- 172.21.15.5:0/734375356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5274 (secure 0 0 0) 0x7f8edc09b6c0 con 0x7f8ee8074ef0 2023-10-07T00:10:51.310 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:51.310 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-07T00:10:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ed00a1480 msgr2=0x7f8ed00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ed00a1480 0x7f8ed00a3940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009c60 tx=0x7f8ed8009260 comp rx=0 tx=0).stop 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8074ef0 msgr2=0x7f8ee8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8074ef0 0x7f8ee8199350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8edc005910 tx=0x7f8edc005740 comp rx=0 tx=0).stop 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 shutdown_connections 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ed00a1480 0x7f8ed00a3940 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee8108e80 0x7f8ee81a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee8073910 0x7f8ee8198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 --2- 172.21.15.5:0/734375356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee8074ef0 0x7f8ee8199350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 >> 172.21.15.5:0/734375356 conn(0x7f8ee80fc530 msgr2=0x7f8ee80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 shutdown_connections 2023-10-07T00:10:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:51.311+0000 7f8eed7ff700 1 -- 172.21.15.5:0/734375356 wait complete. 2023-10-07T00:10:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-10-07T00:10:51.497 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:10:51 smithi112 bash[170280]: bf4fe1fa75b2bd828f700913d20d425c84b93f0cb06fc166c7d7f4467b3a5854 2023-10-07T00:10:51.497 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:10:51 smithi112 ceph-mds[170320]: -- 172.21.15.112:0/1957792183 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56455caef1e0 con 0x56455cac4800 2023-10-07T00:10:51.497 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:10:51 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-c[170296]: starting mds.c at 2023-10-07T00:10:51.497 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:10:51 smithi112 systemd[1]: Started Ceph mds.c for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:52.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/734375356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:52.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:52.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:52.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:52.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: Deploying daemon mds.h on smithi088 2023-10-07T00:10:52.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:52.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.112:6836/963373716,v1:172.21.15.112:6837/963373716] up:boot 2023-10-07T00:10:52.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: fsmap 7 up:standby 2023-10-07T00:10:52.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:52 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-07T00:10:52.619 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.619 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.619 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/734375356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:52.619 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.619 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:52.619 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:52.619 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:52.620 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: Deploying daemon mds.h on smithi088 2023-10-07T00:10:52.620 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:52.620 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.112:6836/963373716,v1:172.21.15.112:6837/963373716] up:boot 2023-10-07T00:10:52.620 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: fsmap 7 up:standby 2023-10-07T00:10:52.620 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:52 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-07T00:10:52.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/734375356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:52.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:52.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:52.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:52.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:52.749 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: Deploying daemon mds.h on smithi088 2023-10-07T00:10:52.750 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:52.750 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.112:6836/963373716,v1:172.21.15.112:6837/963373716] up:boot 2023-10-07T00:10:52.750 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: fsmap 7 up:standby 2023-10-07T00:10:52.750 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:52 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-07T00:10:53.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.547+0000 7f57c31ff700 1 -- 172.21.15.5:0/2084991397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc102b50 msgr2=0x7f57bc109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.547+0000 7f57c31ff700 1 --2- 172.21.15.5:0/2084991397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc102b50 0x7f57bc109400 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009fc0 tx=0x7f57b400b330 comp rx=0 tx=0).stop 2023-10-07T00:10:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.548+0000 7f57c31ff700 1 -- 172.21.15.5:0/2084991397 shutdown_connections 2023-10-07T00:10:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.548+0000 7f57c31ff700 1 --2- 172.21.15.5:0/2084991397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc102b50 0x7f57bc109400 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.548+0000 7f57c31ff700 1 --2- 172.21.15.5:0/2084991397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57bc100fc0 0x7f57bc1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.548+0000 7f57c31ff700 1 --2- 172.21.15.5:0/2084991397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57bc1021b0 0x7f57bc102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.548+0000 7f57c31ff700 1 -- 172.21.15.5:0/2084991397 >> 172.21.15.5:0/2084991397 conn(0x7f57bc0fc530 msgr2=0x7f57bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.548+0000 7f57c31ff700 1 -- 172.21.15.5:0/2084991397 shutdown_connections 2023-10-07T00:10:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.548+0000 7f57c31ff700 1 -- 172.21.15.5:0/2084991397 wait complete. 2023-10-07T00:10:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57c31ff700 1 Processor -- start 2023-10-07T00:10:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57c31ff700 1 -- start start 2023-10-07T00:10:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57c31ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57bc100fc0 0x7f57bc196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57c31ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc1021b0 0x7f57bc1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57c31ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57bc102b50 0x7f57bc19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57c31ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc19e810 con 0x7f57bc1021b0 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57c31ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc19e980 con 0x7f57bc102b50 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57c31ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc19eb40 con 0x7f57bc100fc0 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57bbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc1021b0 0x7f57bc1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57bbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc1021b0 0x7f57bc1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51324/0 (socket says 172.21.15.5:51324) 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.549+0000 7f57bbfff700 1 -- 172.21.15.5:0/3801959823 learned_addr learned my addr 172.21.15.5:0/3801959823 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57c179c700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57bc102b50 0x7f57bc19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57c0f9b700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57bc100fc0 0x7f57bc196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57bbfff700 1 -- 172.21.15.5:0/3801959823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57bc100fc0 msgr2=0x7f57bc196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57bbfff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57bc100fc0 0x7f57bc196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57bbfff700 1 -- 172.21.15.5:0/3801959823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57bc102b50 msgr2=0x7f57bc19e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57bbfff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57bc102b50 0x7f57bc19e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57bbfff700 1 -- 172.21.15.5:0/3801959823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4009c40 con 0x7f57bc1021b0 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57c0f9b700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57bc100fc0 0x7f57bc196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57bbfff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc1021b0 0x7f57bc1971e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f57a800e9c0 tx=0x7f57a800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57b9ffb700 1 -- 172.21.15.5:0/3801959823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a800cbd0 con 0x7f57bc1021b0 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57b9ffb700 1 -- 172.21.15.5:0/3801959823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57a800eeb0 con 0x7f57bc1021b0 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57b9ffb700 1 -- 172.21.15.5:0/3801959823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8005410 con 0x7f57bc1021b0 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.550+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57bc19ee20 con 0x7f57bc1021b0 2023-10-07T00:10:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.551+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc19f250 con 0x7f57bc1021b0 2023-10-07T00:10:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.552+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc108500 con 0x7f57bc1021b0 2023-10-07T00:10:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.554+0000 7f57b9ffb700 1 -- 172.21.15.5:0/3801959823 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f57a8005570 con 0x7f57bc1021b0 2023-10-07T00:10:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.555+0000 7f57b9ffb700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f57ac0a1480 0x7f57ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.555+0000 7f57b9ffb700 1 -- 172.21.15.5:0/3801959823 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f57a8014070 con 0x7f57bc1021b0 2023-10-07T00:10:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.556+0000 7f57c0f9b700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f57ac0a1480 0x7f57ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.556+0000 7f57c0f9b700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f57ac0a1480 0x7f57ac0a3940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f57bc197b70 tx=0x7f57b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.558+0000 7f57b9ffb700 1 -- 172.21.15.5:0/3801959823 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f57a8096790 con 0x7f57bc1021b0 2023-10-07T00:10:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.817+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57bc10c6d0 con 0x7f57bc1021b0 2023-10-07T00:10:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.817+0000 7f57b9ffb700 1 -- 172.21.15.5:0/3801959823 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6065 (secure 0 0 0) 0x7f57a8099db0 con 0x7f57bc1021b0 2023-10-07T00:10:53.819 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:53.819 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-07T00:10:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f57ac0a1480 msgr2=0x7f57ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f57ac0a1480 0x7f57ac0a3940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f57bc197b70 tx=0x7f57b0009260 comp rx=0 tx=0).stop 2023-10-07T00:10:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc1021b0 msgr2=0x7f57bc1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc1021b0 0x7f57bc1971e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f57a800e9c0 tx=0x7f57a800ecd0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 shutdown_connections 2023-10-07T00:10:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f57ac0a1480 0x7f57ac0a3940 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57bc102b50 0x7f57bc19e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57bc100fc0 0x7f57bc196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 --2- 172.21.15.5:0/3801959823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57bc1021b0 0x7f57bc1971e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 >> 172.21.15.5:0/3801959823 conn(0x7f57bc0fc530 msgr2=0x7f57bc105640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 shutdown_connections 2023-10-07T00:10:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:53.820+0000 7f57c31ff700 1 -- 172.21.15.5:0/3801959823 wait complete. 2023-10-07T00:10:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-07T00:10:53.953 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:10:53 smithi088 systemd[1]: Starting Ceph mds.h for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:54.250 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:10:53 smithi088 podman[138811]: 2023-10-07T00:10:54.698 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:10:54 smithi088 bash[138811]: 1c78d4b7670d62951a36f0cddce15b6118af1ebef76d29b25923649da1b388e7 2023-10-07T00:10:54.698 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mds[138851]: -- 172.21.15.88:0/882396413 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cbeed0d1e0 con 0x55cbeece2c00 2023-10-07T00:10:54.698 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-h[138827]: starting mds.h at 2023-10-07T00:10:54.698 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:10:54 smithi088 systemd[1]: Started Ceph mds.h for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:54.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mon[103111]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:54.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3801959823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:54.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:54 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:54.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:54 smithi112 ceph-mon[133548]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:54.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:54 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3801959823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:54.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:54.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:54.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:54.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:54.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:54.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:54 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:54 smithi005 ceph-mon[129406]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:54 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3801959823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:54 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:55.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:55.928 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:55 smithi112 ceph-mon[133548]: Deploying daemon mds.i on smithi112 2023-10-07T00:10:55.928 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:55 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] up:boot 2023-10-07T00:10:55.928 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:55 smithi112 ceph-mon[133548]: fsmap 8 up:standby 2023-10-07T00:10:55.929 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:55 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-07T00:10:56.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 -- 172.21.15.5:0/74557344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71341021b0 msgr2=0x7f7134102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 --2- 172.21.15.5:0/74557344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71341021b0 0x7f7134102610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71240099c0 tx=0x7f7124009cd0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 -- 172.21.15.5:0/74557344 shutdown_connections 2023-10-07T00:10:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 --2- 172.21.15.5:0/74557344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7134102b50 0x7f7134109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 --2- 172.21.15.5:0/74557344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7134100fc0 0x7f71341013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 --2- 172.21.15.5:0/74557344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71341021b0 0x7f7134102610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 -- 172.21.15.5:0/74557344 >> 172.21.15.5:0/74557344 conn(0x7f71340fc530 msgr2=0x7f71340fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 -- 172.21.15.5:0/74557344 shutdown_connections 2023-10-07T00:10:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.055+0000 7f713b7ff700 1 -- 172.21.15.5:0/74557344 wait complete. 2023-10-07T00:10:56.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.056+0000 7f713b7ff700 1 Processor -- start 2023-10-07T00:10:56.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.056+0000 7f713b7ff700 1 -- start start 2023-10-07T00:10:56.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f713b7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7134100fc0 0x7f7134196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:56.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f713b7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71341021b0 0x7f71341970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f713b7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7134102b50 0x7f713419e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f713b7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713419e6f0 con 0x7f7134102b50 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f713b7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713419e830 con 0x7f7134100fc0 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f713b7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713419e9c0 con 0x7f71341021b0 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7138d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71341021b0 0x7f71341970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7139d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7134102b50 0x7f713419e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7138d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71341021b0 0x7f71341970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49912/0 (socket says 172.21.15.5:49912) 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7138d9a700 1 -- 172.21.15.5:0/910351148 learned_addr learned my addr 172.21.15.5:0/910351148 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f713959b700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7134100fc0 0x7f7134196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7139d9c700 1 -- 172.21.15.5:0/910351148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71341021b0 msgr2=0x7f71341970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7139d9c700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71341021b0 0x7f71341970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7139d9c700 1 -- 172.21.15.5:0/910351148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7134100fc0 msgr2=0x7f7134196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7139d9c700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7134100fc0 0x7f7134196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.057+0000 7f7139d9c700 1 -- 172.21.15.5:0/910351148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240095f0 con 0x7f7134102b50 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.058+0000 7f7139d9c700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7134102b50 0x7f713419e120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f712c007f10 tx=0x7f712c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.058+0000 7f712a7fc700 1 -- 172.21.15.5:0/910351148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c00ddd0 con 0x7f7134102b50 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.058+0000 7f712a7fc700 1 -- 172.21.15.5:0/910351148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f712c00f040 con 0x7f7134102b50 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.058+0000 7f712a7fc700 1 -- 172.21.15.5:0/910351148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0059c0 con 0x7f7134102b50 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.058+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713419eca0 con 0x7f7134102b50 2023-10-07T00:10:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.058+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713419f160 con 0x7f7134102b50 2023-10-07T00:10:56.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.059+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7134107f40 con 0x7f7134102b50 2023-10-07T00:10:56.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.061+0000 7f712a7fc700 1 -- 172.21.15.5:0/910351148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f712c005020 con 0x7f7134102b50 2023-10-07T00:10:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.063+0000 7f712a7fc700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71200a1480 0x7f71200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.063+0000 7f712a7fc700 1 -- 172.21.15.5:0/910351148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f712c0cc1b0 con 0x7f7134102b50 2023-10-07T00:10:56.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.063+0000 7f713959b700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71200a1480 0x7f71200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:56.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.064+0000 7f713959b700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71200a1480 0x7f71200a3940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7130005fd0 tx=0x7f7130005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.067+0000 7f712a7fc700 1 -- 172.21.15.5:0/910351148 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f712c04f100 con 0x7f7134102b50 2023-10-07T00:10:56.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:55 smithi005 ceph-mon[129406]: Deploying daemon mds.i on smithi112 2023-10-07T00:10:56.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:55 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] up:boot 2023-10-07T00:10:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:55 smithi005 ceph-mon[129406]: fsmap 8 up:standby 2023-10-07T00:10:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:55 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-07T00:10:56.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:55 smithi088 ceph-mon[103111]: Deploying daemon mds.i on smithi112 2023-10-07T00:10:56.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:55 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] up:boot 2023-10-07T00:10:56.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:55 smithi088 ceph-mon[103111]: fsmap 8 up:standby 2023-10-07T00:10:56.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:55 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-07T00:10:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.325+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f713410c6e0 con 0x7f7134102b50 2023-10-07T00:10:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.325+0000 7f712a7fc700 1 -- 172.21.15.5:0/910351148 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6856 (secure 0 0 0) 0x7f712c095c10 con 0x7f7134102b50 2023-10-07T00:10:56.327 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-07T00:10:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71200a1480 msgr2=0x7f71200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71200a1480 0x7f71200a3940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7130005fd0 tx=0x7f7130005e50 comp rx=0 tx=0).stop 2023-10-07T00:10:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7134102b50 msgr2=0x7f713419e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7134102b50 0x7f713419e120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f712c007f10 tx=0x7f712c00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 shutdown_connections 2023-10-07T00:10:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71200a1480 0x7f71200a3940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7134102b50 0x7f713419e120 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7134100fc0 0x7f7134196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 --2- 172.21.15.5:0/910351148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71341021b0 0x7f71341970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 >> 172.21.15.5:0/910351148 conn(0x7f71340fc530 msgr2=0x7f71340fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 shutdown_connections 2023-10-07T00:10:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:56.328+0000 7f713b7ff700 1 -- 172.21.15.5:0/910351148 wait complete. 2023-10-07T00:10:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-10-07T00:10:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:56 smithi112 ceph-mon[133548]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:56.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:56 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/910351148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:56.998 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:10:56 smithi112 systemd[1]: Starting Ceph mds.i for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:10:57.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:56 smithi005 ceph-mon[129406]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:57.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:56 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/910351148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:56 smithi088 ceph-mon[103111]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:56 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/910351148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:57.385 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:10:57 smithi112 podman[170621]: 2023-10-07T00:10:57.385 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:10:57 smithi112 bash[170621]: 0f70f847a6dae385622bbf29e7df364f1814ccf98b3fe6f2e58f020dcec91d24 2023-10-07T00:10:57.385 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:10:57 smithi112 ceph-mds[170661]: -- 172.21.15.112:0/1104310561 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55751c9d11e0 con 0x55751c9a6c00 2023-10-07T00:10:57.385 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:10:57 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-i[170637]: starting mds.i at 2023-10-07T00:10:57.747 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:10:57 smithi112 systemd[1]: Started Ceph mds.i for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:10:58.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:10:58.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 -- 172.21.15.5:0/1289589046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0100fb0 msgr2=0x7efea01013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:58.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 --2- 172.21.15.5:0/1289589046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0100fb0 0x7efea01013d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efe900099c0 tx=0x7efe90009cd0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 -- 172.21.15.5:0/1289589046 shutdown_connections 2023-10-07T00:10:58.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 --2- 172.21.15.5:0/1289589046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b40 0x7efea01093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 --2- 172.21.15.5:0/1289589046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0100fb0 0x7efea01013d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 --2- 172.21.15.5:0/1289589046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea01021a0 0x7efea0102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 -- 172.21.15.5:0/1289589046 >> 172.21.15.5:0/1289589046 conn(0x7efea00fc520 msgr2=0x7efea00fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:58.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 -- 172.21.15.5:0/1289589046 shutdown_connections 2023-10-07T00:10:58.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.584+0000 7efea4dff700 1 -- 172.21.15.5:0/1289589046 wait complete. 2023-10-07T00:10:58.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.585+0000 7efea4dff700 1 Processor -- start 2023-10-07T00:10:58.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.585+0000 7efea4dff700 1 -- start start 2023-10-07T00:10:58.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efea4dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0100fb0 0x7efea0194a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:58.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efea4dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea01021a0 0x7efea0194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:58.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efea4dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0102b40 0x7efea019bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:58.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efea4dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea019c5a0 con 0x7efea0102b40 2023-10-07T00:10:58.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efea4dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea019c6e0 con 0x7efea0100fb0 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efea4dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea019c870 con 0x7efea01021a0 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0102b40 0x7efea019bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0102b40 0x7efea019bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51368/0 (socket says 172.21.15.5:51368) 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9ed9d700 1 -- 172.21.15.5:0/2095242867 learned_addr learned my addr 172.21.15.5:0/2095242867 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9dd9b700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea01021a0 0x7efea0194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9e59c700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0100fb0 0x7efea0194a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9ed9d700 1 -- 172.21.15.5:0/2095242867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea01021a0 msgr2=0x7efea0194f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9ed9d700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea01021a0 0x7efea0194f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9ed9d700 1 -- 172.21.15.5:0/2095242867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0100fb0 msgr2=0x7efea0194a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9ed9d700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0100fb0 0x7efea0194a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.586+0000 7efe9ed9d700 1 -- 172.21.15.5:0/2095242867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe98009c40 con 0x7efea0102b40 2023-10-07T00:10:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.587+0000 7efe9ed9d700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0102b40 0x7efea019bfd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c370 tx=0x7efe9800c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.587+0000 7efe8f7fe700 1 -- 172.21.15.5:0/2095242867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98017070 con 0x7efea0102b40 2023-10-07T00:10:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.587+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe900095f0 con 0x7efea0102b40 2023-10-07T00:10:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.587+0000 7efe8f7fe700 1 -- 172.21.15.5:0/2095242867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe9800f040 con 0x7efea0102b40 2023-10-07T00:10:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.587+0000 7efe8f7fe700 1 -- 172.21.15.5:0/2095242867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800e050 con 0x7efea0102b40 2023-10-07T00:10:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.587+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea019ce20 con 0x7efea0102b40 2023-10-07T00:10:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.588+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea010a5c0 con 0x7efea0102b40 2023-10-07T00:10:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.590+0000 7efe8f7fe700 1 -- 172.21.15.5:0/2095242867 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7efe98003a00 con 0x7efea0102b40 2023-10-07T00:10:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.592+0000 7efe8f7fe700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efe880a58e0 0x7efe880a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:10:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.592+0000 7efe8f7fe700 1 -- 172.21.15.5:0/2095242867 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efe980cc2a0 con 0x7efea0102b40 2023-10-07T00:10:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.592+0000 7efe9e59c700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efe880a58e0 0x7efe880a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:10:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.592+0000 7efe9e59c700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efe880a58e0 0x7efe880a7da0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe9000bf10 tx=0x7efe9000b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:10:58.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.596+0000 7efe8f7fe700 1 -- 172.21.15.5:0/2095242867 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efe98095d00 con 0x7efea0102b40 2023-10-07T00:10:58.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: Deploying daemon mds.g on smithi005 2023-10-07T00:10:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] up:boot 2023-10-07T00:10:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: fsmap 9 up:standby 2023-10-07T00:10:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:58 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-07T00:10:58.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: Deploying daemon mds.g on smithi005 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] up:boot 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: fsmap 9 up:standby 2023-10-07T00:10:58.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:58 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-07T00:10:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.876+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efea0107f50 con 0x7efea0102b40 2023-10-07T00:10:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.876+0000 7efe8f7fe700 1 -- 172.21.15.5:0/2095242867 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7652 (secure 0 0 0) 0x7efe98099320 con 0x7efea0102b40 2023-10-07T00:10:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:10:58.878 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-07T00:10:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efe880a58e0 msgr2=0x7efe880a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efe880a58e0 0x7efe880a7da0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe9000bf10 tx=0x7efe9000b540 comp rx=0 tx=0).stop 2023-10-07T00:10:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0102b40 msgr2=0x7efea019bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:10:58.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0102b40 0x7efea019bfd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c370 tx=0x7efe9800c680 comp rx=0 tx=0).stop 2023-10-07T00:10:58.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 shutdown_connections 2023-10-07T00:10:58.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efe880a58e0 0x7efe880a7da0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea0102b40 0x7efea019bfd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0100fb0 0x7efea0194a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 --2- 172.21.15.5:0/2095242867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea01021a0 0x7efea0194f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:10:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 >> 172.21.15.5:0/2095242867 conn(0x7efea00fc520 msgr2=0x7efea00fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:10:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 shutdown_connections 2023-10-07T00:10:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:10:58.879+0000 7efea4dff700 1 -- 172.21.15.5:0/2095242867 wait complete. 2023-10-07T00:10:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 10 2023-10-07T00:10:58.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: Deploying daemon mds.g on smithi005 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] up:boot 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: fsmap 9 up:standby 2023-10-07T00:10:58.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:58 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-07T00:10:59.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:10:59 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2095242867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:59.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:10:59 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2095242867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:10:59.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:10:59 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2095242867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:00.079 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:10:59 smithi005 systemd[1]: Starting Ceph mds.g for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:11:00.338 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:11:00 smithi005 podman[177917]: 2023-10-07T00:11:00.608 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:11:00 smithi005 bash[177917]: 70cfa902b18a36b41f83da2124b775aabeef08834d7a4826abb924579b58e26d 2023-10-07T00:11:00.609 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-mds[177957]: -- 172.21.15.5:0/1339076397 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d1c6fe31e0 con 0x55d1c6fb8c00 2023-10-07T00:11:00.609 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-g[177933]: starting mds.g at 2023-10-07T00:11:00.609 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:11:00 smithi005 systemd[1]: Started Ceph mds.g for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:11:00.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:11:00.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:00 smithi088 ceph-mon[103111]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:00.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:11:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:11:00.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:00 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:00.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-mon[129406]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:00.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:11:00.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:11:00.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:00 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:00.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:00 smithi112 ceph-mon[133548]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:00.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:11:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:11:00.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:00 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:01.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 -- 172.21.15.5:0/4285941868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370073890 msgr2=0x7fa370073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:01.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 --2- 172.21.15.5:0/4285941868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370073890 0x7fa370073d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa360009990 tx=0x7fa360009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 -- 172.21.15.5:0/4285941868 shutdown_connections 2023-10-07T00:11:01.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 --2- 172.21.15.5:0/4285941868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa370108eb0 0x7fa37010b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 --2- 172.21.15.5:0/4285941868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370074e70 0x7fa3700732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 --2- 172.21.15.5:0/4285941868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370073890 0x7fa370073d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 -- 172.21.15.5:0/4285941868 >> 172.21.15.5:0/4285941868 conn(0x7fa3700fc530 msgr2=0x7fa3700fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:01.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 -- 172.21.15.5:0/4285941868 shutdown_connections 2023-10-07T00:11:01.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.119+0000 7fa3787ff700 1 -- 172.21.15.5:0/4285941868 wait complete. 2023-10-07T00:11:01.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.120+0000 7fa3787ff700 1 Processor -- start 2023-10-07T00:11:01.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.120+0000 7fa3787ff700 1 -- start start 2023-10-07T00:11:01.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.121+0000 7fa3787ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa370073890 0x7fa370104360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:01.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.121+0000 7fa3787ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370074e70 0x7fa3701048a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:01.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.121+0000 7fa3787ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370108eb0 0x7fa370100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:01.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.121+0000 7fa3787ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370101690 con 0x7fa370074e70 2023-10-07T00:11:01.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.121+0000 7fa3787ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370101800 con 0x7fa370073890 2023-10-07T00:11:01.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.121+0000 7fa3787ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3701019c0 con 0x7fa370108eb0 2023-10-07T00:11:01.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.122+0000 7fa375d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370074e70 0x7fa3701048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.122+0000 7fa375d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370074e70 0x7fa3701048a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51396/0 (socket says 172.21.15.5:51396) 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.122+0000 7fa375d9a700 1 -- 172.21.15.5:0/122194572 learned_addr learned my addr 172.21.15.5:0/122194572 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa376d9c700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370108eb0 0x7fa370100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa37659b700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa370073890 0x7fa370104360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa375d9a700 1 -- 172.21.15.5:0/122194572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370108eb0 msgr2=0x7fa370100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa375d9a700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370108eb0 0x7fa370100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa375d9a700 1 -- 172.21.15.5:0/122194572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa370073890 msgr2=0x7fa370104360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa375d9a700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa370073890 0x7fa370104360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa375d9a700 1 -- 172.21.15.5:0/122194572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600095f0 con 0x7fa370074e70 2023-10-07T00:11:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa375d9a700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370074e70 0x7fa3701048a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa3600098e0 tx=0x7fa360009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:01.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa3677fe700 1 -- 172.21.15.5:0/122194572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36001d070 con 0x7fa370074e70 2023-10-07T00:11:01.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa3677fe700 1 -- 172.21.15.5:0/122194572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa360022470 con 0x7fa370074e70 2023-10-07T00:11:01.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa370198ab0 con 0x7fa370074e70 2023-10-07T00:11:01.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.123+0000 7fa3677fe700 1 -- 172.21.15.5:0/122194572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000f6c0 con 0x7fa370074e70 2023-10-07T00:11:01.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.124+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa370198fb0 con 0x7fa370074e70 2023-10-07T00:11:01.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.125+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3701075b0 con 0x7fa370074e70 2023-10-07T00:11:01.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.127+0000 7fa3677fe700 1 -- 172.21.15.5:0/122194572 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa36000baa0 con 0x7fa370074e70 2023-10-07T00:11:01.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.128+0000 7fa3677fe700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa35c0a1500 0x7fa35c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:01.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.129+0000 7fa3677fe700 1 -- 172.21.15.5:0/122194572 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa3600cdfa0 con 0x7fa370074e70 2023-10-07T00:11:01.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.129+0000 7fa37659b700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa35c0a1500 0x7fa35c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:01.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.129+0000 7fa37659b700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa35c0a1500 0x7fa35c0a39c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009bf0 tx=0x7fa36c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.131+0000 7fa3677fe700 1 -- 172.21.15.5:0/122194572 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa360097a90 con 0x7fa370074e70 2023-10-07T00:11:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.420+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa37010e8b0 con 0x7fa370074e70 2023-10-07T00:11:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.421+0000 7fa3677fe700 1 -- 172.21.15.5:0/122194572 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8441 (secure 0 0 0) 0x7fa36009b0b0 con 0x7fa370074e70 2023-10-07T00:11:01.423 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:01.423 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-07T00:11:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.423+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa35c0a1500 msgr2=0x7fa35c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.423+0000 7fa3787ff700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa35c0a1500 0x7fa35c0a39c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009bf0 tx=0x7fa36c009260 comp rx=0 tx=0).stop 2023-10-07T00:11:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.423+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370074e70 msgr2=0x7fa3701048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.423+0000 7fa3787ff700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370074e70 0x7fa3701048a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa3600098e0 tx=0x7fa360009570 comp rx=0 tx=0).stop 2023-10-07T00:11:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.424+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 shutdown_connections 2023-10-07T00:11:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.424+0000 7fa3787ff700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa35c0a1500 0x7fa35c0a39c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.424+0000 7fa3787ff700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370108eb0 0x7fa370100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.424+0000 7fa3787ff700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa370073890 0x7fa370104360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.424+0000 7fa3787ff700 1 --2- 172.21.15.5:0/122194572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370074e70 0x7fa3701048a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.424+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 >> 172.21.15.5:0/122194572 conn(0x7fa3700fc530 msgr2=0x7fa3700fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.424+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 shutdown_connections 2023-10-07T00:11:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:01.424+0000 7fa3787ff700 1 -- 172.21.15.5:0/122194572 wait complete. 2023-10-07T00:11:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 11 2023-10-07T00:11:01.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:01 smithi005 ceph-mon[129406]: Deploying daemon mds.a on smithi005 2023-10-07T00:11:01.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:01 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] up:boot 2023-10-07T00:11:01.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:01 smithi005 ceph-mon[129406]: fsmap 10 up:standby 2023-10-07T00:11:01.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:01 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-07T00:11:01.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:01 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/122194572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:01.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:01 smithi088 ceph-mon[103111]: Deploying daemon mds.a on smithi005 2023-10-07T00:11:01.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:01 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] up:boot 2023-10-07T00:11:01.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:01 smithi088 ceph-mon[103111]: fsmap 10 up:standby 2023-10-07T00:11:01.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:01 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-07T00:11:01.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:01 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/122194572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:01 smithi112 ceph-mon[133548]: Deploying daemon mds.a on smithi005 2023-10-07T00:11:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:01 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] up:boot 2023-10-07T00:11:01.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:01 smithi112 ceph-mon[133548]: fsmap 10 up:standby 2023-10-07T00:11:01.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:01 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-07T00:11:01.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:01 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/122194572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:02.745 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:02 smithi005 ceph-mon[129406]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:02.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:02 smithi088 ceph-mon[103111]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:02.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:02 smithi112 ceph-mon[133548]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:03.109 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:11:02 smithi005 systemd[1]: Starting Ceph mds.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:11:03.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:11:03.481 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:11:03 smithi005 podman[178302]: 2023-10-07T00:11:03.481 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:11:03 smithi005 bash[178302]: 0e22a82879af80e91d217dcf1da47899b3c4161106187c7a8a9e8c7d57551cd4 2023-10-07T00:11:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.671+0000 7f95e0fff700 1 -- 172.21.15.5:0/2310354262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 msgr2=0x7f95dc1013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.671+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2310354262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 0x7f95dc1013d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0099c0 tx=0x7f95cc009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.671+0000 7f95e0fff700 1 -- 172.21.15.5:0/2310354262 shutdown_connections 2023-10-07T00:11:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.671+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2310354262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95dc102b40 0x7f95dc1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.671+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2310354262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 0x7f95dc1013d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.671+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2310354262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95dc1021a0 0x7f95dc102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.671+0000 7f95e0fff700 1 -- 172.21.15.5:0/2310354262 >> 172.21.15.5:0/2310354262 conn(0x7f95dc0fc520 msgr2=0x7f95dc0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.672+0000 7f95e0fff700 1 -- 172.21.15.5:0/2310354262 shutdown_connections 2023-10-07T00:11:03.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.672+0000 7f95e0fff700 1 -- 172.21.15.5:0/2310354262 wait complete. 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95e0fff700 1 Processor -- start 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95e0fff700 1 -- start start 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95e0fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 0x7f95dc198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95e0fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95dc1021a0 0x7f95dc1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95e0fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95dc102b40 0x7f95dc1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95e0fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc1a0a30 con 0x7f95dc100fb0 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95e0fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc1a0b70 con 0x7f95dc1021a0 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95e0fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc1a0d00 con 0x7f95dc102b40 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 0x7f95dc198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 0x7f95dc198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49790/0 (socket says 172.21.15.5:49790) 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.673+0000 7f95da59c700 1 -- 172.21.15.5:0/2698017378 learned_addr learned my addr 172.21.15.5:0/2698017378 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95d9d9b700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95dc1021a0 0x7f95dc1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95dad9d700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95dc102b40 0x7f95dc1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95da59c700 1 -- 172.21.15.5:0/2698017378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95dc102b40 msgr2=0x7f95dc1a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95da59c700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95dc102b40 0x7f95dc1a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95da59c700 1 -- 172.21.15.5:0/2698017378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95dc1021a0 msgr2=0x7f95dc1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95da59c700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95dc1021a0 0x7f95dc1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95da59c700 1 -- 172.21.15.5:0/2698017378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0095f0 con 0x7f95dc100fb0 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95dad9d700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95dc102b40 0x7f95dc1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95da59c700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 0x7f95dc198eb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95cb7fe700 1 -- 172.21.15.5:0/2698017378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc01d070 con 0x7f95dc100fb0 2023-10-07T00:11:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95cb7fe700 1 -- 172.21.15.5:0/2698017378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95cc004080 con 0x7f95dc100fb0 2023-10-07T00:11:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95cb7fe700 1 -- 172.21.15.5:0/2698017378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc022c30 con 0x7f95dc100fb0 2023-10-07T00:11:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.674+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc1a0f80 con 0x7f95dc100fb0 2023-10-07T00:11:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.675+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc1a12f0 con 0x7f95dc100fb0 2023-10-07T00:11:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.675+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95dc193530 con 0x7f95dc100fb0 2023-10-07T00:11:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.677+0000 7f95cb7fe700 1 -- 172.21.15.5:0/2698017378 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f95cc022470 con 0x7f95dc100fb0 2023-10-07T00:11:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.679+0000 7f95cb7fe700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f95c40a1500 0x7f95c40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.679+0000 7f95cb7fe700 1 -- 172.21.15.5:0/2698017378 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f95cc0ce630 con 0x7f95dc100fb0 2023-10-07T00:11:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.679+0000 7f95d9d9b700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f95c40a1500 0x7f95c40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.680+0000 7f95d9d9b700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f95c40a1500 0x7f95c40a39c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009a10 tx=0x7f95d0009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.681+0000 7f95cb7fe700 1 -- 172.21.15.5:0/2698017378 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f95cc098120 con 0x7f95dc100fb0 2023-10-07T00:11:03.858 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:11:03 smithi005 ceph-mds[178342]: -- 172.21.15.5:0/1214935613 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cc7b4b11e0 con 0x55cc7b486c00 2023-10-07T00:11:03.859 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:11:03 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: starting mds.a at 2023-10-07T00:11:03.859 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:11:03 smithi005 systemd[1]: Started Ceph mds.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:11:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.939+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95dc10c990 con 0x7f95dc100fb0 2023-10-07T00:11:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.940+0000 7f95cb7fe700 1 -- 172.21.15.5:0/2698017378 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9230 (secure 0 0 0) 0x7f95cc0041f0 con 0x7f95dc100fb0 2023-10-07T00:11:03.941 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:03.942 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[]} 2023-10-07T00:11:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.942+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f95c40a1500 msgr2=0x7f95c40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.942+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f95c40a1500 0x7f95c40a39c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009a10 tx=0x7f95d0009190 comp rx=0 tx=0).stop 2023-10-07T00:11:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.942+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 msgr2=0x7f95dc198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.942+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 0x7f95dc198eb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc005740 comp rx=0 tx=0).stop 2023-10-07T00:11:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.943+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 shutdown_connections 2023-10-07T00:11:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.943+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f95c40a1500 0x7f95c40a39c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.943+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95dc102b40 0x7f95dc1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.943+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95dc100fb0 0x7f95dc198eb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.943+0000 7f95e0fff700 1 --2- 172.21.15.5:0/2698017378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95dc1021a0 0x7f95dc1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:03.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.943+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 >> 172.21.15.5:0/2698017378 conn(0x7f95dc0fc520 msgr2=0x7f95dc107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:03.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.943+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 shutdown_connections 2023-10-07T00:11:03.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:03.943+0000 7f95e0fff700 1 -- 172.21.15.5:0/2698017378 wait complete. 2023-10-07T00:11:03.945 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 12 2023-10-07T00:11:04.850 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.850 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.850 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:04.850 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.850 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:11:04.850 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:boot 2023-10-07T00:11:04.851 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: fsmap 11 up:standby 2023-10-07T00:11:04.851 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-07T00:11:04.851 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:11:04.851 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:04.851 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: Deploying daemon mds.b on smithi088 2023-10-07T00:11:04.851 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:04 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2698017378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:04.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:boot 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: fsmap 11 up:standby 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:04.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: Deploying daemon mds.b on smithi088 2023-10-07T00:11:04.860 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:04 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2698017378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:04.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-07T00:11:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:boot 2023-10-07T00:11:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: fsmap 11 up:standby 2023-10-07T00:11:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-07T00:11:04.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-07T00:11:04.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:04.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: Deploying daemon mds.b on smithi088 2023-10-07T00:11:04.999 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:04 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2698017378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:05.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:11:06.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/3425618876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 msgr2=0x7f7c18109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:06.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/3425618876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 0x7f7c18109400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000b0d0 tx=0x7f7c1000b3e0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/3425618876 shutdown_connections 2023-10-07T00:11:06.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/3425618876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 0x7f7c18109400 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/3425618876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18100fc0 0x7f7c181013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/3425618876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c181021b0 0x7f7c18102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/3425618876 >> 172.21.15.5:0/3425618876 conn(0x7f7c180fc530 msgr2=0x7f7c180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:06.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/3425618876 shutdown_connections 2023-10-07T00:11:06.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.178+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/3425618876 wait complete. 2023-10-07T00:11:06.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.179+0000 7f7c1d7ff700 1 Processor -- start 2023-10-07T00:11:06.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.180+0000 7f7c1d7ff700 1 -- start start 2023-10-07T00:11:06.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.180+0000 7f7c1d7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18100fc0 0x7f7c18196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:06.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.180+0000 7f7c1d7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c181021b0 0x7f7c181971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:06.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.180+0000 7f7c1d7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 0x7f7c1819e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:06.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.180+0000 7f7c1d7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1819e800 con 0x7f7c18102b50 2023-10-07T00:11:06.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.180+0000 7f7c1d7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1819e970 con 0x7f7c181021b0 2023-10-07T00:11:06.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.180+0000 7f7c1d7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1819eb30 con 0x7f7c18100fc0 2023-10-07T00:11:06.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c181021b0 0x7f7c181971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:06.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 0x7f7c1819e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:06.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c181021b0 0x7f7c181971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:51486/0 (socket says 172.21.15.5:51486) 2023-10-07T00:11:06.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 -- 172.21.15.5:0/848682451 learned_addr learned my addr 172.21.15.5:0/848682451 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:06.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c16ffd700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18100fc0 0x7f7c18196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:06.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 -- 172.21.15.5:0/848682451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18100fc0 msgr2=0x7f7c18196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:06.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18100fc0 0x7f7c18196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 -- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 msgr2=0x7f7c1819e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:06.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 0x7f7c1819e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 -- 172.21.15.5:0/848682451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10009d00 con 0x7f7c181021b0 2023-10-07T00:11:06.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c177fe700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 0x7f7c1819e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:11:06.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7c167fc700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c181021b0 0x7f7c181971d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00e9a0 tx=0x7f7c0c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:06.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.181+0000 7f7bfffff700 1 -- 172.21.15.5:0/848682451 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c009790 con 0x7f7c181021b0 2023-10-07T00:11:06.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.182+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1819ee10 con 0x7f7c181021b0 2023-10-07T00:11:06.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.182+0000 7f7bfffff700 1 -- 172.21.15.5:0/848682451 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c0c010430 con 0x7f7c181021b0 2023-10-07T00:11:06.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.182+0000 7f7bfffff700 1 -- 172.21.15.5:0/848682451 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00cea0 con 0x7f7c181021b0 2023-10-07T00:11:06.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.182+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1819f290 con 0x7f7c181021b0 2023-10-07T00:11:06.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.183+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1810c680 con 0x7f7c181021b0 2023-10-07T00:11:06.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.185+0000 7f7bfffff700 1 -- 172.21.15.5:0/848682451 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7c0c0105a0 con 0x7f7c181021b0 2023-10-07T00:11:06.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.186+0000 7f7bfffff700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7c000a1480 0x7f7c000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:06.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.186+0000 7f7bfffff700 1 -- 172.21.15.5:0/848682451 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7c0c014070 con 0x7f7c181021b0 2023-10-07T00:11:06.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.186+0000 7f7c16ffd700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7c000a1480 0x7f7c000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:06.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.187+0000 7f7c16ffd700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7c000a1480 0x7f7c000a3940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7c18197b60 tx=0x7f7c08009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:06.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.191+0000 7f7bfffff700 1 -- 172.21.15.5:0/848682451 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7c0c052100 con 0x7f7c181021b0 2023-10-07T00:11:06.203 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:05 smithi088 systemd[1]: Starting Ceph mds.b for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:11:06.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.450+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c18107ef0 con 0x7f7c181021b0 2023-10-07T00:11:06.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.451+0000 7f7bfffff700 1 -- 172.21.15.5:0/848682451 <== mon.2 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9230 (secure 0 0 0) 0x7f7c0c0964f0 con 0x7f7c181021b0 2023-10-07T00:11:06.453 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:06.453 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[]} 2023-10-07T00:11:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7c000a1480 msgr2=0x7f7c000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7c000a1480 0x7f7c000a3940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7c18197b60 tx=0x7f7c08009260 comp rx=0 tx=0).stop 2023-10-07T00:11:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c181021b0 msgr2=0x7f7c181971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c181021b0 0x7f7c181971d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00e9a0 tx=0x7f7c0c00ecb0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 shutdown_connections 2023-10-07T00:11:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7c000a1480 0x7f7c000a3940 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c18102b50 0x7f7c1819e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18100fc0 0x7f7c18196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 --2- 172.21.15.5:0/848682451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c181021b0 0x7f7c181971d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 >> 172.21.15.5:0/848682451 conn(0x7f7c180fc530 msgr2=0x7f7c180fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 shutdown_connections 2023-10-07T00:11:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:06.454+0000 7f7c1d7ff700 1 -- 172.21.15.5:0/848682451 wait complete. 2023-10-07T00:11:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 12 2023-10-07T00:11:06.638 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:06 smithi088 podman[139159]: 2023-10-07T00:11:06.638 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:06 smithi088 ceph-mds[139199]: -- 172.21.15.88:0/2720251601 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5638e3e711e0 con 0x5638e3e46800 2023-10-07T00:11:06.638 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:06 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-b[139175]: starting mds.b at 2023-10-07T00:11:06.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:06 smithi005 ceph-mon[129406]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:06.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:06 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/848682451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:06.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:06 smithi088 ceph-mon[103111]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:06.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:06 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/848682451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:06.953 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:06 smithi088 bash[139159]: f0e13dfd4af29ae7cb3b4ada8742514971fd25e19681325dd68fef1dc4f0db75 2023-10-07T00:11:06.953 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:06 smithi088 systemd[1]: Started Ceph mds.b for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:11:06.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:06 smithi112 ceph-mon[133548]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:06.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:06 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/848682451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:07.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] up:boot 2023-10-07T00:11:07.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: fsmap 12 up:standby 2023-10-07T00:11:07.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-07T00:11:07.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:07.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:07 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:11:08.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] up:boot 2023-10-07T00:11:08.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: fsmap 12 up:standby 2023-10-07T00:11:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-07T00:11:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:07 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:11:08.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] up:boot 2023-10-07T00:11:08.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: fsmap 12 up:standby 2023-10-07T00:11:08.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-07T00:11:08.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:08.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:07 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:11:08.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:11:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 -- 172.21.15.5:0/2500011407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 msgr2=0x7fc57c101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2500011407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 0x7fc57c101c30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc570009990 tx=0x7fc570009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 -- 172.21.15.5:0/2500011407 shutdown_connections 2023-10-07T00:11:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2500011407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc57c104b40 0x7fc57c104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2500011407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 0x7fc57c101c30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2500011407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c102170 0x7fc57c104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 -- 172.21.15.5:0/2500011407 >> 172.21.15.5:0/2500011407 conn(0x7fc57c0fb420 msgr2=0x7fc57c0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 -- 172.21.15.5:0/2500011407 shutdown_connections 2023-10-07T00:11:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.695+0000 7fc5831ff700 1 -- 172.21.15.5:0/2500011407 wait complete. 2023-10-07T00:11:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.696+0000 7fc5831ff700 1 Processor -- start 2023-10-07T00:11:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.696+0000 7fc5831ff700 1 -- start start 2023-10-07T00:11:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc5831ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 0x7fc57c19d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc5831ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c102170 0x7fc57c19d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc5831ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc57c104b40 0x7fc57c1a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc5831ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1a4d60 con 0x7fc57c0ff800 2023-10-07T00:11:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc5831ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1a4ea0 con 0x7fc57c102170 2023-10-07T00:11:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc5831ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1a5030 con 0x7fc57c104b40 2023-10-07T00:11:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc580f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 0x7fc57c19d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c102170 0x7fc57c19d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc580f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 0x7fc57c19d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49828/0 (socket says 172.21.15.5:49828) 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc580f9b700 1 -- 172.21.15.5:0/2408274344 learned_addr learned my addr 172.21.15.5:0/2408274344 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c102170 0x7fc57c19d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:51516/0 (socket says 172.21.15.5:51516) 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc58179c700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc57c104b40 0x7fc57c1a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc580f9b700 1 -- 172.21.15.5:0/2408274344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc57c104b40 msgr2=0x7fc57c1a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc580f9b700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc57c104b40 0x7fc57c1a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc580f9b700 1 -- 172.21.15.5:0/2408274344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c102170 msgr2=0x7fc57c19d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc580f9b700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c102170 0x7fc57c19d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc580f9b700 1 -- 172.21.15.5:0/2408274344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700095f0 con 0x7fc57c0ff800 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.697+0000 7fc57bfff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c102170 0x7fc57c19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:11:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.698+0000 7fc580f9b700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 0x7fc57c19d1e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc570005910 tx=0x7fc570005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.698+0000 7fc579ffb700 1 -- 172.21.15.5:0/2408274344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57001d070 con 0x7fc57c0ff800 2023-10-07T00:11:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.698+0000 7fc579ffb700 1 -- 172.21.15.5:0/2408274344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc570022470 con 0x7fc57c0ff800 2023-10-07T00:11:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.698+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c1a52b0 con 0x7fc57c0ff800 2023-10-07T00:11:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.698+0000 7fc579ffb700 1 -- 172.21.15.5:0/2408274344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570022ea0 con 0x7fc57c0ff800 2023-10-07T00:11:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.698+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c1a5730 con 0x7fc57c0ff800 2023-10-07T00:11:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.699+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0fcfa0 con 0x7fc57c0ff800 2023-10-07T00:11:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.701+0000 7fc579ffb700 1 -- 172.21.15.5:0/2408274344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc57000ba60 con 0x7fc57c0ff800 2023-10-07T00:11:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.704+0000 7fc579ffb700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc56c0a1500 0x7fc56c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.704+0000 7fc579ffb700 1 -- 172.21.15.5:0/2408274344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc5700cdc10 con 0x7fc57c0ff800 2023-10-07T00:11:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.704+0000 7fc57bfff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc56c0a1500 0x7fc56c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.705+0000 7fc57bfff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc56c0a1500 0x7fc56c0a39c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc568011490 tx=0x7fc568009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:08.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.708+0000 7fc579ffb700 1 -- 172.21.15.5:0/2408274344 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc57005d100 con 0x7fc57c0ff800 2023-10-07T00:11:08.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:08 smithi005 ceph-mon[129406]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.982+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc57c112c80 con 0x7fc57c0ff800 2023-10-07T00:11:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.983+0000 7fc579ffb700 1 -- 172.21.15.5:0/2408274344 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10022 (secure 0 0 0) 0x7fc570097700 con 0x7fc57c0ff800 2023-10-07T00:11:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:08.985 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14607,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24502,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-07T00:11:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc56c0a1500 msgr2=0x7fc56c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc56c0a1500 0x7fc56c0a39c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc568011490 tx=0x7fc568009260 comp rx=0 tx=0).stop 2023-10-07T00:11:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 msgr2=0x7fc57c19d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 0x7fc57c19d1e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc570005910 tx=0x7fc570005720 comp rx=0 tx=0).stop 2023-10-07T00:11:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 shutdown_connections 2023-10-07T00:11:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc56c0a1500 0x7fc56c0a39c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc57c104b40 0x7fc57c1a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc57c0ff800 0x7fc57c19d1e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 --2- 172.21.15.5:0/2408274344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c102170 0x7fc57c19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 >> 172.21.15.5:0/2408274344 conn(0x7fc57c0fb420 msgr2=0x7fc57c102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 shutdown_connections 2023-10-07T00:11:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:08.986+0000 7fc5831ff700 1 -- 172.21.15.5:0/2408274344 wait complete. 2023-10-07T00:11:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 13 2023-10-07T00:11:09.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:11:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:08 smithi088 ceph-mon[103111]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 -- 172.21.15.5:0/4275062450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc100f20 msgr2=0x7f71fc101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 --2- 172.21.15.5:0/4275062450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc100f20 0x7f71fc101360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009990 tx=0x7f71f8009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 -- 172.21.15.5:0/4275062450 shutdown_connections 2023-10-07T00:11:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 --2- 172.21.15.5:0/4275062450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71fc102ab0 0x7f71fc1093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 --2- 172.21.15.5:0/4275062450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc100f20 0x7f71fc101360 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 --2- 172.21.15.5:0/4275062450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71fc1020f0 0x7f71fc102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 -- 172.21.15.5:0/4275062450 >> 172.21.15.5:0/4275062450 conn(0x7f71fc0fc4e0 msgr2=0x7f71fc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 -- 172.21.15.5:0/4275062450 shutdown_connections 2023-10-07T00:11:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.221+0000 7f72045ff700 1 -- 172.21.15.5:0/4275062450 wait complete. 2023-10-07T00:11:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.223+0000 7f72045ff700 1 Processor -- start 2023-10-07T00:11:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.223+0000 7f72045ff700 1 -- start start 2023-10-07T00:11:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.223+0000 7f72045ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71fc100f20 0x7f71fc196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.223+0000 7f72045ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc1020f0 0x7f71fc197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.223+0000 7f72045ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71fc102ab0 0x7f71fc19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.223+0000 7f72045ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc19e790 con 0x7f71fc1020f0 2023-10-07T00:11:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.223+0000 7f72045ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc19e900 con 0x7f71fc100f20 2023-10-07T00:11:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.223+0000 7f72045ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc19eac0 con 0x7f71fc102ab0 2023-10-07T00:11:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc1020f0 0x7f71fc197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f720239b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71fc100f20 0x7f71fc196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc1020f0 0x7f71fc197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49856/0 (socket says 172.21.15.5:49856) 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f720239b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71fc100f20 0x7f71fc196c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:51534/0 (socket says 172.21.15.5:51534) 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 -- 172.21.15.5:0/4061526277 learned_addr learned my addr 172.21.15.5:0/4061526277 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7202b9c700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71fc102ab0 0x7f71fc19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 -- 172.21.15.5:0/4061526277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71fc102ab0 msgr2=0x7f71fc19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71fc102ab0 0x7f71fc19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 -- 172.21.15.5:0/4061526277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71fc100f20 msgr2=0x7f71fc196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71fc100f20 0x7f71fc196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 -- 172.21.15.5:0/4061526277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80095f0 con 0x7f71fc1020f0 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f7201b9a700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc1020f0 0x7f71fc197190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00e9a0 tx=0x7f71ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f71f37fe700 1 -- 172.21.15.5:0/4061526277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec009790 con 0x7f71fc1020f0 2023-10-07T00:11:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc19eda0 con 0x7f71fc1020f0 2023-10-07T00:11:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.224+0000 7f71f37fe700 1 -- 172.21.15.5:0/4061526277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71ec010430 con 0x7f71fc1020f0 2023-10-07T00:11:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.225+0000 7f71f37fe700 1 -- 172.21.15.5:0/4061526277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00cea0 con 0x7f71fc1020f0 2023-10-07T00:11:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.225+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc19f1d0 con 0x7f71fc1020f0 2023-10-07T00:11:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.226+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71fc10c680 con 0x7f71fc1020f0 2023-10-07T00:11:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.229+0000 7f71f37fe700 1 -- 172.21.15.5:0/4061526277 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f71ec0105a0 con 0x7f71fc1020f0 2023-10-07T00:11:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.231+0000 7f71f37fe700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71e80a1480 0x7f71e80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:09.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.231+0000 7f71f37fe700 1 -- 172.21.15.5:0/4061526277 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f71ec014070 con 0x7f71fc1020f0 2023-10-07T00:11:09.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.231+0000 7f720239b700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71e80a1480 0x7f71e80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:09.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.233+0000 7f720239b700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71e80a1480 0x7f71e80a3940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f71f8005910 tx=0x7f71f800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.235+0000 7f71f37fe700 1 -- 172.21.15.5:0/4061526277 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f71ec052100 con 0x7f71fc1020f0 2023-10-07T00:11:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:08 smithi112 ceph-mon[133548]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:09.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.465+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71fc19f3f0 con 0x7f71fc1020f0 2023-10-07T00:11:09.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.466+0000 7f71f37fe700 1 -- 172.21.15.5:0/4061526277 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f71ec096520 con 0x7f71fc1020f0 2023-10-07T00:11:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:09.468 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:10:17.205387+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:11:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.468+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71e80a1480 msgr2=0x7f71e80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.468+0000 7f72045ff700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71e80a1480 0x7f71e80a3940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f71f8005910 tx=0x7f71f800b260 comp rx=0 tx=0).stop 2023-10-07T00:11:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc1020f0 msgr2=0x7f71fc197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc1020f0 0x7f71fc197190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00e9a0 tx=0x7f71ec00ecb0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 shutdown_connections 2023-10-07T00:11:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f71e80a1480 0x7f71e80a3940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71fc102ab0 0x7f71fc19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71fc100f20 0x7f71fc196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 --2- 172.21.15.5:0/4061526277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71fc1020f0 0x7f71fc197190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 >> 172.21.15.5:0/4061526277 conn(0x7f71fc0fc4e0 msgr2=0x7f71fc0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 shutdown_connections 2023-10-07T00:11:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.469+0000 7f72045ff700 1 -- 172.21.15.5:0/4061526277 wait complete. 2023-10-07T00:11:09.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:11:09.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:11:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.707+0000 7f61f77ff700 1 -- 172.21.15.5:0/800072138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 msgr2=0x7f61f0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.707+0000 7f61f77ff700 1 --2- 172.21.15.5:0/800072138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 0x7f61f0102610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f61e00099c0 tx=0x7f61e0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.707+0000 7f61f77ff700 1 -- 172.21.15.5:0/800072138 shutdown_connections 2023-10-07T00:11:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.707+0000 7f61f77ff700 1 --2- 172.21.15.5:0/800072138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61f0102b50 0x7f61f0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.707+0000 7f61f77ff700 1 --2- 172.21.15.5:0/800072138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61f0100fc0 0x7f61f01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.707+0000 7f61f77ff700 1 --2- 172.21.15.5:0/800072138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 0x7f61f0102610 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.707+0000 7f61f77ff700 1 -- 172.21.15.5:0/800072138 >> 172.21.15.5:0/800072138 conn(0x7f61f00fc530 msgr2=0x7f61f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:09.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.707+0000 7f61f77ff700 1 -- 172.21.15.5:0/800072138 shutdown_connections 2023-10-07T00:11:09.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.708+0000 7f61f77ff700 1 -- 172.21.15.5:0/800072138 wait complete. 2023-10-07T00:11:09.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.708+0000 7f61f77ff700 1 Processor -- start 2023-10-07T00:11:09.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f77ff700 1 -- start start 2023-10-07T00:11:09.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f77ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61f0100fc0 0x7f61f0074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:09.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f77ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 0x7f61f00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:09.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f77ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61f0102b50 0x7f61f00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:09.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f77ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0073f80 con 0x7f61f01021b0 2023-10-07T00:11:09.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f77ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00740f0 con 0x7f61f0100fc0 2023-10-07T00:11:09.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f77ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f01a0c60 con 0x7f61f0102b50 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f4d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 0x7f61f00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f4d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 0x7f61f00732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49872/0 (socket says 172.21.15.5:49872) 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f4d9a700 1 -- 172.21.15.5:0/2842241493 learned_addr learned my addr 172.21.15.5:0/2842241493 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f5d9c700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61f0102b50 0x7f61f00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.709+0000 7f61f559b700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61f0100fc0 0x7f61f0074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f4d9a700 1 -- 172.21.15.5:0/2842241493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61f0102b50 msgr2=0x7f61f00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f4d9a700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61f0102b50 0x7f61f00737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f4d9a700 1 -- 172.21.15.5:0/2842241493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61f0100fc0 msgr2=0x7f61f0074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f4d9a700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61f0100fc0 0x7f61f0074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f4d9a700 1 -- 172.21.15.5:0/2842241493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec009520 con 0x7f61f01021b0 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f559b700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61f0100fc0 0x7f61f0074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:11:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f4d9a700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 0x7f61f00732a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000c00 tx=0x7f61e000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:09.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61e67fc700 1 -- 172.21.15.5:0/2842241493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e001d070 con 0x7f61f01021b0 2023-10-07T00:11:09.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61e67fc700 1 -- 172.21.15.5:0/2842241493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61e000fe70 con 0x7f61f01021b0 2023-10-07T00:11:09.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e00095f0 con 0x7f61f01021b0 2023-10-07T00:11:09.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61e67fc700 1 -- 172.21.15.5:0/2842241493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e00173f0 con 0x7f61f01021b0 2023-10-07T00:11:09.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.710+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f01a11d0 con 0x7f61f01021b0 2023-10-07T00:11:09.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.711+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f010c6e0 con 0x7f61f01021b0 2023-10-07T00:11:09.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.713+0000 7f61e67fc700 1 -- 172.21.15.5:0/2842241493 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f61e0022470 con 0x7f61f01021b0 2023-10-07T00:11:09.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.715+0000 7f61e67fc700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61dc0a1500 0x7f61dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:09.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.715+0000 7f61e67fc700 1 -- 172.21.15.5:0/2842241493 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f61e00cdb80 con 0x7f61f01021b0 2023-10-07T00:11:09.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.715+0000 7f61f559b700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61dc0a1500 0x7f61dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:09.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.716+0000 7f61f559b700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61dc0a1500 0x7f61dc0a39c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61f0102010 tx=0x7f61ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:09.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.721+0000 7f61e67fc700 1 -- 172.21.15.5:0/2842241493 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f61e0097670 con 0x7f61f01021b0 2023-10-07T00:11:09.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.940+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61f0107fa0 con 0x7f61f01021b0 2023-10-07T00:11:09.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.940+0000 7f61e67fc700 1 -- 172.21.15.5:0/2842241493 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61e009ac90 con 0x7f61f01021b0 2023-10-07T00:11:09.942 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:11:09.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61dc0a1500 msgr2=0x7f61dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61dc0a1500 0x7f61dc0a39c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61f0102010 tx=0x7f61ec009260 comp rx=0 tx=0).stop 2023-10-07T00:11:09.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 msgr2=0x7f61f00732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:09.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 0x7f61f00732a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000c00 tx=0x7f61e000fa00 comp rx=0 tx=0).stop 2023-10-07T00:11:09.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 shutdown_connections 2023-10-07T00:11:09.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61dc0a1500 0x7f61dc0a39c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61f0102b50 0x7f61f00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61f0100fc0 0x7f61f0074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 --2- 172.21.15.5:0/2842241493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f01021b0 0x7f61f00732a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:09.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 >> 172.21.15.5:0/2842241493 conn(0x7f61f00fc530 msgr2=0x7f61f00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:09.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 shutdown_connections 2023-10-07T00:11:09.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:09.943+0000 7f61f77ff700 1 -- 172.21.15.5:0/2842241493 wait complete. 2023-10-07T00:11:09.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T00:11:10.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:09 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2408274344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:10.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:09 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4061526277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:10.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:09 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 -- 172.21.15.5:0/2043502172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c102b40 msgr2=0x7f5b9c1093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/2043502172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c102b40 0x7f5b9c1093f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009fc0 tx=0x7f5b9400b330 comp rx=0 tx=0).stop 2023-10-07T00:11:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 -- 172.21.15.5:0/2043502172 shutdown_connections 2023-10-07T00:11:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/2043502172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c102b40 0x7f5b9c1093f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/2043502172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b9c100fb0 0x7f5b9c1013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/2043502172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b9c1021a0 0x7f5b9c102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 -- 172.21.15.5:0/2043502172 >> 172.21.15.5:0/2043502172 conn(0x7f5b9c0fc520 msgr2=0x7f5b9c0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 -- 172.21.15.5:0/2043502172 shutdown_connections 2023-10-07T00:11:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.172+0000 7f5ba29ff700 1 -- 172.21.15.5:0/2043502172 wait complete. 2023-10-07T00:11:10.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.173+0000 7f5ba29ff700 1 Processor -- start 2023-10-07T00:11:10.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.173+0000 7f5ba29ff700 1 -- start start 2023-10-07T00:11:10.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5ba29ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b9c100fb0 0x7f5b9c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:10.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5ba29ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c1021a0 0x7f5b9c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:10.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5ba29ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b9c102b40 0x7f5b9c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:10.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5ba29ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c1a09e0 con 0x7f5b9c1021a0 2023-10-07T00:11:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5ba29ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c1a0b20 con 0x7f5b9c100fb0 2023-10-07T00:11:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5ba29ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c1a0cb0 con 0x7f5b9c102b40 2023-10-07T00:11:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c1021a0 0x7f5b9c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c1021a0 0x7f5b9c1993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49884/0 (socket says 172.21.15.5:49884) 2023-10-07T00:11:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 -- 172.21.15.5:0/3798150530 learned_addr learned my addr 172.21.15.5:0/3798150530 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9bfff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b9c100fb0 0x7f5b9c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5ba0f9c700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b9c102b40 0x7f5b9c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 -- 172.21.15.5:0/3798150530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b9c102b40 msgr2=0x7f5b9c1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b9c102b40 0x7f5b9c1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 -- 172.21.15.5:0/3798150530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b9c100fb0 msgr2=0x7f5b9c198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b9c100fb0 0x7f5b9c198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 -- 172.21.15.5:0/3798150530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009520 con 0x7f5b9c1021a0 2023-10-07T00:11:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.174+0000 7f5b9b7fe700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c1021a0 0x7f5b9c1993a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000eb30 tx=0x7f5b9000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.175+0000 7f5b997fa700 1 -- 172.21.15.5:0/3798150530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90009880 con 0x7f5b9c1021a0 2023-10-07T00:11:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.175+0000 7f5b997fa700 1 -- 172.21.15.5:0/3798150530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b900044b0 con 0x7f5b9c1021a0 2023-10-07T00:11:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.175+0000 7f5b997fa700 1 -- 172.21.15.5:0/3798150530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90003ce0 con 0x7f5b9c1021a0 2023-10-07T00:11:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.175+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b94009c40 con 0x7f5b9c1021a0 2023-10-07T00:11:10.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.175+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c1a1230 con 0x7f5b9c1021a0 2023-10-07T00:11:10.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.176+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c1934c0 con 0x7f5b9c1021a0 2023-10-07T00:11:10.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.178+0000 7f5b997fa700 1 -- 172.21.15.5:0/3798150530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5b90003e40 con 0x7f5b9c1021a0 2023-10-07T00:11:10.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.179+0000 7f5b997fa700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b840a1500 0x7f5b840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:10.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.179+0000 7f5b997fa700 1 -- 172.21.15.5:0/3798150530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5b90014070 con 0x7f5b9c1021a0 2023-10-07T00:11:10.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.180+0000 7f5b9bfff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b840a1500 0x7f5b840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:10.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.180+0000 7f5b9bfff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b840a1500 0x7f5b840a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c102000 tx=0x7f5b8c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.183+0000 7f5b997fa700 1 -- 172.21.15.5:0/3798150530 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b90096640 con 0x7f5b9c1021a0 2023-10-07T00:11:10.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:09 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2408274344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:10.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:09 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4061526277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:10.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:09 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:10.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:09 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2408274344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:10.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:09 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4061526277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:10.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:09 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.407+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b9c10c6d0 con 0x7f5b9c1021a0 2023-10-07T00:11:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.407+0000 7f5b997fa700 1 -- 172.21.15.5:0/3798150530 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5b90099c60 con 0x7f5b9c1021a0 2023-10-07T00:11:10.410 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:10.410 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-07T00:11:10.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:11:10.410 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-07T00:11:10.410 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-07T00:11:10.410 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:11:10.410 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-07T00:11:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b840a1500 msgr2=0x7f5b840a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b840a1500 0x7f5b840a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c102000 tx=0x7f5b8c009310 comp rx=0 tx=0).stop 2023-10-07T00:11:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c1021a0 msgr2=0x7f5b9c1993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c1021a0 0x7f5b9c1993a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000eb30 tx=0x7f5b9000ee40 comp rx=0 tx=0).stop 2023-10-07T00:11:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 shutdown_connections 2023-10-07T00:11:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b840a1500 0x7f5b840a39c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b9c102b40 0x7f5b9c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b9c100fb0 0x7f5b9c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 --2- 172.21.15.5:0/3798150530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b9c1021a0 0x7f5b9c1993a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 >> 172.21.15.5:0/3798150530 conn(0x7f5b9c0fc520 msgr2=0x7f5b9c107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 shutdown_connections 2023-10-07T00:11:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.410+0000 7f5ba29ff700 1 -- 172.21.15.5:0/3798150530 wait complete. 2023-10-07T00:11:10.430 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T00:11:10.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T00:11:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 -- 172.21.15.5:0/3047871951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 msgr2=0x7f2f34104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3047871951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 0x7f2f34104810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f280099c0 tx=0x7f2f28009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 -- 172.21.15.5:0/3047871951 shutdown_connections 2023-10-07T00:11:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3047871951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f34104d50 0x7f2f3410b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3047871951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f341031c0 0x7f2f341035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3047871951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 0x7f2f34104810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 -- 172.21.15.5:0/3047871951 >> 172.21.15.5:0/3047871951 conn(0x7f2f340fe730 msgr2=0x7f2f34100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 -- 172.21.15.5:0/3047871951 shutdown_connections 2023-10-07T00:11:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.664+0000 7f2f389ff700 1 -- 172.21.15.5:0/3047871951 wait complete. 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.665+0000 7f2f389ff700 1 Processor -- start 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f389ff700 1 -- start start 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f389ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f341031c0 0x7f2f34198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f389ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 0x7f2f341992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f389ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f34104d50 0x7f2f341a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f389ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341a08f0 con 0x7f2f341043b0 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f389ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341a0a30 con 0x7f2f34104d50 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f389ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341a0bc0 con 0x7f2f341031c0 2023-10-07T00:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f31d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 0x7f2f341992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f31d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 0x7f2f341992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49900/0 (socket says 172.21.15.5:49900) 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f31d9b700 1 -- 172.21.15.5:0/3625384667 learned_addr learned my addr 172.21.15.5:0/3625384667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.666+0000 7f2f32d9d700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f34104d50 0x7f2f341a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f3259c700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f341031c0 0x7f2f34198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f31d9b700 1 -- 172.21.15.5:0/3625384667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f341031c0 msgr2=0x7f2f34198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f31d9b700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f341031c0 0x7f2f34198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f31d9b700 1 -- 172.21.15.5:0/3625384667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f34104d50 msgr2=0x7f2f341a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f31d9b700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f34104d50 0x7f2f341a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f31d9b700 1 -- 172.21.15.5:0/3625384667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280095f0 con 0x7f2f341043b0 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f31d9b700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 0x7f2f341992b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005910 tx=0x7f2f2800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f237fe700 1 -- 172.21.15.5:0/3625384667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2801d070 con 0x7f2f341043b0 2023-10-07T00:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f341a0e40 con 0x7f2f341043b0 2023-10-07T00:11:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f237fe700 1 -- 172.21.15.5:0/3625384667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f2800bd10 con 0x7f2f341043b0 2023-10-07T00:11:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f237fe700 1 -- 172.21.15.5:0/3625384667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28004ba0 con 0x7f2f341043b0 2023-10-07T00:11:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.667+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f341a1210 con 0x7f2f341043b0 2023-10-07T00:11:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.669+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3410e890 con 0x7f2f341043b0 2023-10-07T00:11:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.670+0000 7f2f237fe700 1 -- 172.21.15.5:0/3625384667 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2f28005050 con 0x7f2f341043b0 2023-10-07T00:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.672+0000 7f2f237fe700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f1c0a1480 0x7f2f1c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.672+0000 7f2f237fe700 1 -- 172.21.15.5:0/3625384667 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2f280cd7f0 con 0x7f2f341043b0 2023-10-07T00:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.672+0000 7f2f3259c700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f1c0a1480 0x7f2f1c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.673+0000 7f2f3259c700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f1c0a1480 0x7f2f1c0a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2f34104210 tx=0x7f2f24009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.676+0000 7f2f237fe700 1 -- 172.21.15.5:0/3625384667 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2f280972e0 con 0x7f2f341043b0 2023-10-07T00:11:10.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:10.894+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f3410a160 con 0x7f2f341043b0 2023-10-07T00:11:11.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2842241493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:11:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3798150530' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-07T00:11:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:10 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2842241493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3798150530' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:10 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2842241493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:11:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3798150530' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-07T00:11:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:10 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:11.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.802+0000 7f2f237fe700 1 -- 172.21.15.5:0/3625384667 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f2809a900 con 0x7f2f341043b0 2023-10-07T00:11:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.804+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f1c0a1480 msgr2=0x7f2f1c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.804+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f1c0a1480 0x7f2f1c0a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2f34104210 tx=0x7f2f24009260 comp rx=0 tx=0).stop 2023-10-07T00:11:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.804+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 msgr2=0x7f2f341992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.804+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 0x7f2f341992b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005910 tx=0x7f2f2800fa00 comp rx=0 tx=0).stop 2023-10-07T00:11:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.805+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 shutdown_connections 2023-10-07T00:11:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.805+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2f1c0a1480 0x7f2f1c0a3940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.805+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f34104d50 0x7f2f341a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.805+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f341031c0 0x7f2f34198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.805+0000 7f2f389ff700 1 --2- 172.21.15.5:0/3625384667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f341043b0 0x7f2f341992b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.805+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 >> 172.21.15.5:0/3625384667 conn(0x7f2f340fe730 msgr2=0x7f2f34100a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.805+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 shutdown_connections 2023-10-07T00:11:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:11.805+0000 7f2f389ff700 1 -- 172.21.15.5:0/3625384667 wait complete. 2023-10-07T00:11:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-07T00:11:11.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T00:11:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.055+0000 7f1b51fff700 1 -- 172.21.15.5:0/2239809479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4c074ef0 msgr2=0x7f1b4c073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.055+0000 7f1b51fff700 1 --2- 172.21.15.5:0/2239809479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4c074ef0 0x7f1b4c073340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009990 tx=0x7f1b3c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.055+0000 7f1b51fff700 1 -- 172.21.15.5:0/2239809479 shutdown_connections 2023-10-07T00:11:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.055+0000 7f1b51fff700 1 --2- 172.21.15.5:0/2239809479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4c108e80 0x7f1b4c10b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.055+0000 7f1b51fff700 1 --2- 172.21.15.5:0/2239809479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4c074ef0 0x7f1b4c073340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.055+0000 7f1b51fff700 1 --2- 172.21.15.5:0/2239809479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b4c073910 0x7f1b4c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.055+0000 7f1b51fff700 1 -- 172.21.15.5:0/2239809479 >> 172.21.15.5:0/2239809479 conn(0x7f1b4c0fc530 msgr2=0x7f1b4c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.056+0000 7f1b51fff700 1 -- 172.21.15.5:0/2239809479 shutdown_connections 2023-10-07T00:11:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.056+0000 7f1b51fff700 1 -- 172.21.15.5:0/2239809479 wait complete. 2023-10-07T00:11:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.057+0000 7f1b51fff700 1 Processor -- start 2023-10-07T00:11:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.057+0000 7f1b51fff700 1 -- start start 2023-10-07T00:11:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.057+0000 7f1b51fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4c073910 0x7f1b4c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b51fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4c074ef0 0x7f1b4c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b51fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b4c108e80 0x7f1b4c1a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b51fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1a0960 con 0x7f1b4c074ef0 2023-10-07T00:11:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b51fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1a0aa0 con 0x7f1b4c073910 2023-10-07T00:11:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b51fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1a0c30 con 0x7f1b4c108e80 2023-10-07T00:11:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b4c108e80 0x7f1b4c1a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4c073910 0x7f1b4c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b4c108e80 0x7f1b4c1a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:42722/0 (socket says 172.21.15.5:42722) 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4bfff700 1 -- 172.21.15.5:0/1553974940 learned_addr learned my addr 172.21.15.5:0/1553974940 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4affd700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4c074ef0 0x7f1b4c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4bfff700 1 -- 172.21.15.5:0/1553974940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4c073910 msgr2=0x7f1b4c198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4bfff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4c073910 0x7f1b4c198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4bfff700 1 -- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4c074ef0 msgr2=0x7f1b4c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4bfff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4c074ef0 0x7f1b4c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.058+0000 7f1b4bfff700 1 -- 172.21.15.5:0/1553974940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b44009c40 con 0x7f1b4c108e80 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.059+0000 7f1b4bfff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b4c108e80 0x7f1b4c1a0390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c370 tx=0x7f1b4400c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.059+0000 7f1b48ff9700 1 -- 172.21.15.5:0/1553974940 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44017070 con 0x7f1b4c108e80 2023-10-07T00:11:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.059+0000 7f1b48ff9700 1 -- 172.21.15.5:0/1553974940 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b4400f040 con 0x7f1b4c108e80 2023-10-07T00:11:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.059+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c0095f0 con 0x7f1b4c108e80 2023-10-07T00:11:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.059+0000 7f1b48ff9700 1 -- 172.21.15.5:0/1553974940 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400e050 con 0x7f1b4c108e80 2023-10-07T00:11:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.059+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c1a11d0 con 0x7f1b4c108e80 2023-10-07T00:11:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.060+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c107530 con 0x7f1b4c108e80 2023-10-07T00:11:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.063+0000 7f1b48ff9700 1 -- 172.21.15.5:0/1553974940 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1b44004bd0 con 0x7f1b4c108e80 2023-10-07T00:11:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.065+0000 7f1b48ff9700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b340a1500 0x7f1b340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.065+0000 7f1b48ff9700 1 -- 172.21.15.5:0/1553974940 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f1b440cc290 con 0x7f1b4c108e80 2023-10-07T00:11:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.065+0000 7f1b4b7fe700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b340a1500 0x7f1b340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.066+0000 7f1b4b7fe700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b340a1500 0x7f1b340a39c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c006010 tx=0x7f1b3c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.066+0000 7f1b48ff9700 1 -- 172.21.15.5:0/1553974940 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1b44095c20 con 0x7f1b4c108e80 2023-10-07T00:11:12.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:11 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3625384667' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-07T00:11:12.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:12.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:11:12.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:11 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:12.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:11 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3625384667' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-07T00:11:12.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:11 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:12.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:11 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:11:12.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:11 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:12.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:11 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3625384667' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-07T00:11:12.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:11 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:12.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:11 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:11:12.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:11 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.281+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1b4c10e8b0 con 0x7f1b4c108e80 2023-10-07T00:11:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.822+0000 7f1b48ff9700 1 -- 172.21.15.5:0/1553974940 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1b44099240 con 0x7f1b4c108e80 2023-10-07T00:11:12.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.837+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b340a1500 msgr2=0x7f1b340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:12.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.837+0000 7f1b51fff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b340a1500 0x7f1b340a39c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c006010 tx=0x7f1b3c00b260 comp rx=0 tx=0).stop 2023-10-07T00:11:12.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.837+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b4c108e80 msgr2=0x7f1b4c1a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:12.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.837+0000 7f1b51fff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b4c108e80 0x7f1b4c1a0390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c370 tx=0x7f1b4400c680 comp rx=0 tx=0).stop 2023-10-07T00:11:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.840+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 shutdown_connections 2023-10-07T00:11:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.840+0000 7f1b51fff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1b340a1500 0x7f1b340a39c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.840+0000 7f1b51fff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b4c108e80 0x7f1b4c1a0390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.840+0000 7f1b51fff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4c073910 0x7f1b4c198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.840+0000 7f1b51fff700 1 --2- 172.21.15.5:0/1553974940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4c074ef0 0x7f1b4c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.840+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 >> 172.21.15.5:0/1553974940 conn(0x7f1b4c0fc530 msgr2=0x7f1b4c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.842+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 shutdown_connections 2023-10-07T00:11:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:12.842+0000 7f1b51fff700 1 -- 172.21.15.5:0/1553974940 wait complete. 2023-10-07T00:11:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-07T00:11:12.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T00:11:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.081+0000 7fd9db7ff700 1 -- 172.21.15.5:0/3494396516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d4073910 msgr2=0x7fd9d4073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.081+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/3494396516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d4073910 0x7fd9d4073d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009990 tx=0x7fd9c4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.082+0000 7fd9db7ff700 1 -- 172.21.15.5:0/3494396516 shutdown_connections 2023-10-07T00:11:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.082+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/3494396516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d410d590 0x7fd9d410f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.082+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/3494396516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d4074ef0 0x7fd9d4073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.082+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/3494396516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d4073910 0x7fd9d4073d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.082+0000 7fd9db7ff700 1 -- 172.21.15.5:0/3494396516 >> 172.21.15.5:0/3494396516 conn(0x7fd9d40fc530 msgr2=0x7fd9d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.082+0000 7fd9db7ff700 1 -- 172.21.15.5:0/3494396516 shutdown_connections 2023-10-07T00:11:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.082+0000 7fd9db7ff700 1 -- 172.21.15.5:0/3494396516 wait complete. 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9db7ff700 1 Processor -- start 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9db7ff700 1 -- start start 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9db7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d4073910 0x7fd9d419d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9db7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d4074ef0 0x7fd9d419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9db7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d410d590 0x7fd9d41a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9db7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d41a4d80 con 0x7fd9d410d590 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9db7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d41a4ec0 con 0x7fd9d4074ef0 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9db7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d41a5050 con 0x7fd9d4073910 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9d959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d4073910 0x7fd9d419d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9d9d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d410d590 0x7fd9d41a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9d959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d4073910 0x7fd9d419d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:42750/0 (socket says 172.21.15.5:42750) 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9d8d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d4074ef0 0x7fd9d419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.083+0000 7fd9d959b700 1 -- 172.21.15.5:0/2324791958 learned_addr learned my addr 172.21.15.5:0/2324791958 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9d959b700 1 -- 172.21.15.5:0/2324791958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d4074ef0 msgr2=0x7fd9d419d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9d959b700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d4074ef0 0x7fd9d419d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9d959b700 1 -- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d410d590 msgr2=0x7fd9d41a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9d959b700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d410d590 0x7fd9d41a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9d959b700 1 -- 172.21.15.5:0/2324791958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c40095f0 con 0x7fd9d4073910 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9d9d9c700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d410d590 0x7fd9d41a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9d959b700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d4073910 0x7fd9d419d200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000e9a0 tx=0x7fd9d000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9ca7fc700 1 -- 172.21.15.5:0/2324791958 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0009790 con 0x7fd9d4073910 2023-10-07T00:11:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d41a5330 con 0x7fd9d4073910 2023-10-07T00:11:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9ca7fc700 1 -- 172.21.15.5:0/2324791958 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9d0010430 con 0x7fd9d4073910 2023-10-07T00:11:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.084+0000 7fd9ca7fc700 1 -- 172.21.15.5:0/2324791958 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000cea0 con 0x7fd9d4073910 2023-10-07T00:11:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.085+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d41a5890 con 0x7fd9d4073910 2023-10-07T00:11:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.085+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d41030e0 con 0x7fd9d4073910 2023-10-07T00:11:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.088+0000 7fd9ca7fc700 1 -- 172.21.15.5:0/2324791958 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd9d00105a0 con 0x7fd9d4073910 2023-10-07T00:11:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.089+0000 7fd9ca7fc700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd9c00a1480 0x7fd9c00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.089+0000 7fd9ca7fc700 1 -- 172.21.15.5:0/2324791958 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fd9d0014070 con 0x7fd9d4073910 2023-10-07T00:11:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.089+0000 7fd9d8d9a700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd9c00a1480 0x7fd9c00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:13.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.090+0000 7fd9d8d9a700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd9c00a1480 0x7fd9c00a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005910 tx=0x7fd9c400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:13.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.091+0000 7fd9ca7fc700 1 -- 172.21.15.5:0/2324791958 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd9d0096700 con 0x7fd9d4073910 2023-10-07T00:11:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:12 smithi005 ceph-mon[129406]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:12 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3625384667' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-07T00:11:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:12 smithi005 ceph-mon[129406]: osdmap e83: 12 total, 12 up, 12 in 2023-10-07T00:11:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:12 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:11:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:12 smithi088 ceph-mon[103111]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:12 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3625384667' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-07T00:11:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:12 smithi088 ceph-mon[103111]: osdmap e83: 12 total, 12 up, 12 in 2023-10-07T00:11:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:12 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:11:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:12 smithi112 ceph-mon[133548]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:12 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3625384667' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-07T00:11:13.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:12 smithi112 ceph-mon[133548]: osdmap e83: 12 total, 12 up, 12 in 2023-10-07T00:11:13.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:12 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:11:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.362+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd9d4112cc0 con 0x7fd9d4073910 2023-10-07T00:11:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.847+0000 7fd9ca7fc700 1 -- 172.21.15.5:0/2324791958 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd9d0099d20 con 0x7fd9d4073910 2023-10-07T00:11:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.851+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd9c00a1480 msgr2=0x7fd9c00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.851+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd9c00a1480 0x7fd9c00a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005910 tx=0x7fd9c400b260 comp rx=0 tx=0).stop 2023-10-07T00:11:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.851+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d4073910 msgr2=0x7fd9d419d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.851+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d4073910 0x7fd9d419d200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000e9a0 tx=0x7fd9d000ecb0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.852+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 shutdown_connections 2023-10-07T00:11:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.852+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd9c00a1480 0x7fd9c00a3940 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005910 tx=0x7fd9c400b260 comp rx=0 tx=0).stop 2023-10-07T00:11:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.852+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d410d590 0x7fd9d41a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.852+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d4073910 0x7fd9d419d200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.852+0000 7fd9db7ff700 1 --2- 172.21.15.5:0/2324791958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d4074ef0 0x7fd9d419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.852+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 >> 172.21.15.5:0/2324791958 conn(0x7fd9d40fc530 msgr2=0x7fd9d40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:13.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.853+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 shutdown_connections 2023-10-07T00:11:13.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:13.853+0000 7fd9db7ff700 1 -- 172.21.15.5:0/2324791958 wait complete. 2023-10-07T00:11:13.857 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2023-10-07T00:11:13.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:11:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.092+0000 7fe1c65ff700 1 -- 172.21.15.5:0/3138698068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 msgr2=0x7fe1c0073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.092+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/3138698068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 0x7fe1c0073340 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009990 tx=0x7fe1b0009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.092+0000 7fe1c65ff700 1 -- 172.21.15.5:0/3138698068 shutdown_connections 2023-10-07T00:11:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.092+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/3138698068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c0108e80 0x7fe1c010b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.092+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/3138698068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 0x7fe1c0073340 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.092+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/3138698068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0073910 0x7fe1c0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.092+0000 7fe1c65ff700 1 -- 172.21.15.5:0/3138698068 >> 172.21.15.5:0/3138698068 conn(0x7fe1c00fc530 msgr2=0x7fe1c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.092+0000 7fe1c65ff700 1 -- 172.21.15.5:0/3138698068 shutdown_connections 2023-10-07T00:11:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.093+0000 7fe1c65ff700 1 -- 172.21.15.5:0/3138698068 wait complete. 2023-10-07T00:11:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.094+0000 7fe1c65ff700 1 Processor -- start 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.094+0000 7fe1c65ff700 1 -- start start 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1c65ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0073910 0x7fe1c0198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1c65ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 0x7fe1c0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1c65ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c0108e80 0x7fe1c01a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1c65ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01a0990 con 0x7fe1c0074ef0 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1c65ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01a0ad0 con 0x7fe1c0108e80 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1c65ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01a0c60 con 0x7fe1c0073910 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0073910 0x7fe1c0198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0073910 0x7fe1c0198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:42782/0 (socket says 172.21.15.5:42782) 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bffff700 1 -- 172.21.15.5:0/64214478 learned_addr learned my addr 172.21.15.5:0/64214478 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bf7fe700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 0x7fe1c0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1c4b9c700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c0108e80 0x7fe1c01a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bf7fe700 1 -- 172.21.15.5:0/64214478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0073910 msgr2=0x7fe1c0198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bf7fe700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0073910 0x7fe1c0198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bf7fe700 1 -- 172.21.15.5:0/64214478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c0108e80 msgr2=0x7fe1c01a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bf7fe700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c0108e80 0x7fe1c01a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bf7fe700 1 -- 172.21.15.5:0/64214478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00095f0 con 0x7fe1c0074ef0 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.095+0000 7fe1bffff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0073910 0x7fe1c0198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.096+0000 7fe1bf7fe700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 0x7fe1c0199350 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400d740 tx=0x7fe1b400da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.096+0000 7fe1bd7fa700 1 -- 172.21.15.5:0/64214478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4004220 con 0x7fe1c0074ef0 2023-10-07T00:11:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.096+0000 7fe1bd7fa700 1 -- 172.21.15.5:0/64214478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1b4004380 con 0x7fe1c0074ef0 2023-10-07T00:11:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.096+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c01a0f40 con 0x7fe1c0074ef0 2023-10-07T00:11:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.096+0000 7fe1bd7fa700 1 -- 172.21.15.5:0/64214478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4003bc0 con 0x7fe1c0074ef0 2023-10-07T00:11:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.096+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c01a13c0 con 0x7fe1c0074ef0 2023-10-07T00:11:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.097+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0107530 con 0x7fe1c0074ef0 2023-10-07T00:11:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.099+0000 7fe1bd7fa700 1 -- 172.21.15.5:0/64214478 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe1b4003d20 con 0x7fe1c0074ef0 2023-10-07T00:11:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.101+0000 7fe1bd7fa700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe1a80a1480 0x7fe1a80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.101+0000 7fe1bd7fa700 1 -- 172.21.15.5:0/64214478 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe1b40cc9f0 con 0x7fe1c0074ef0 2023-10-07T00:11:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.101+0000 7fe1bffff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe1a80a1480 0x7fe1a80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.102+0000 7fe1bffff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe1a80a1480 0x7fe1a80a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0006010 tx=0x7fe1b000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:14.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:13 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1553974940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-07T00:11:14.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:13 smithi005 ceph-mon[129406]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-07T00:11:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:13 smithi005 ceph-mon[129406]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-07T00:11:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:13 smithi005 ceph-mon[129406]: osdmap e84: 12 total, 12 up, 12 in 2023-10-07T00:11:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:13 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2324791958' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-07T00:11:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:13 smithi005 ceph-mon[129406]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-07T00:11:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:13 smithi005 ceph-mon[129406]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-07T00:11:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.108+0000 7fe1bd7fa700 1 -- 172.21.15.5:0/64214478 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1b4096100 con 0x7fe1c0074ef0 2023-10-07T00:11:14.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:13 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1553974940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-07T00:11:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:13 smithi088 ceph-mon[103111]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-07T00:11:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:13 smithi088 ceph-mon[103111]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-07T00:11:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:13 smithi088 ceph-mon[103111]: osdmap e84: 12 total, 12 up, 12 in 2023-10-07T00:11:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:13 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2324791958' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-07T00:11:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:13 smithi088 ceph-mon[103111]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-07T00:11:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:13 smithi088 ceph-mon[103111]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-07T00:11:14.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:13 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1553974940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-07T00:11:14.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:13 smithi112 ceph-mon[133548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-07T00:11:14.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:13 smithi112 ceph-mon[133548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-07T00:11:14.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:13 smithi112 ceph-mon[133548]: osdmap e84: 12 total, 12 up, 12 in 2023-10-07T00:11:14.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:13 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2324791958' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-07T00:11:14.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:13 smithi112 ceph-mon[133548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-07T00:11:14.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:13 smithi112 ceph-mon[133548]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-07T00:11:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.340+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1c010ea80 con 0x7fe1c0074ef0 2023-10-07T00:11:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.343+0000 7fe1bd7fa700 1 -- 172.21.15.5:0/64214478 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22013 (secure 0 0 0) 0x7fe1b401f090 con 0x7fe1c0074ef0 2023-10-07T00:11:14.344 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:14.344 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:13.364505+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:11:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.345+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe1a80a1480 msgr2=0x7fe1a80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.345+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe1a80a1480 0x7fe1a80a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0006010 tx=0x7fe1b000b260 comp rx=0 tx=0).stop 2023-10-07T00:11:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.345+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 msgr2=0x7fe1c0199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.345+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 0x7fe1c0199350 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400d740 tx=0x7fe1b400da50 comp rx=0 tx=0).stop 2023-10-07T00:11:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.346+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 shutdown_connections 2023-10-07T00:11:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.346+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe1a80a1480 0x7fe1a80a3940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.346+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c0108e80 0x7fe1c01a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.346+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0073910 0x7fe1c0198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.346+0000 7fe1c65ff700 1 --2- 172.21.15.5:0/64214478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0074ef0 0x7fe1c0199350 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.346+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 >> 172.21.15.5:0/64214478 conn(0x7fe1c00fc530 msgr2=0x7fe1c00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:14.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.346+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 shutdown_connections 2023-10-07T00:11:14.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.346+0000 7fe1c65ff700 1 -- 172.21.15.5:0/64214478 wait complete. 2023-10-07T00:11:14.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:11:14.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.582+0000 7f70e9bff700 1 -- 172.21.15.5:0/2098810057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e41021a0 msgr2=0x7f70e4102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.582+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2098810057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e41021a0 0x7f70e4102600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f70d80099c0 tx=0x7f70d8009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.582+0000 7f70e9bff700 1 -- 172.21.15.5:0/2098810057 shutdown_connections 2023-10-07T00:11:14.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.582+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2098810057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e4102b40 0x7f70e41093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.582+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2098810057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e4100fb0 0x7f70e41013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.582+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2098810057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e41021a0 0x7f70e4102600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.582+0000 7f70e9bff700 1 -- 172.21.15.5:0/2098810057 >> 172.21.15.5:0/2098810057 conn(0x7f70e40fc520 msgr2=0x7f70e40fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.583+0000 7f70e9bff700 1 -- 172.21.15.5:0/2098810057 shutdown_connections 2023-10-07T00:11:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.583+0000 7f70e9bff700 1 -- 172.21.15.5:0/2098810057 wait complete. 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e9bff700 1 Processor -- start 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e9bff700 1 -- start start 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e9bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e4100fb0 0x7f70e4198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e9bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e41021a0 0x7f70e4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e9bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4102b40 0x7f70e41a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e9bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41a0990 con 0x7f70e4102b40 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e9bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41a0ad0 con 0x7f70e4100fb0 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e9bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41a0c60 con 0x7f70e41021a0 2023-10-07T00:11:14.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4102b40 0x7f70e41a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4102b40 0x7f70e41a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43880/0 (socket says 172.21.15.5:43880) 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e3fff700 1 -- 172.21.15.5:0/2172354142 learned_addr learned my addr 172.21.15.5:0/2172354142 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e2ffd700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e41021a0 0x7f70e4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.584+0000 7f70e37fe700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e4100fb0 0x7f70e4198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e3fff700 1 -- 172.21.15.5:0/2172354142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e41021a0 msgr2=0x7f70e4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e3fff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e41021a0 0x7f70e4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e3fff700 1 -- 172.21.15.5:0/2172354142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e4100fb0 msgr2=0x7f70e4198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e3fff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e4100fb0 0x7f70e4198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e3fff700 1 -- 172.21.15.5:0/2172354142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80095f0 con 0x7f70e4102b40 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e3fff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4102b40 0x7f70e41a03c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70dc007ee0 tx=0x7f70dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e0ff9700 1 -- 172.21.15.5:0/2172354142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00dd20 con 0x7f70e4102b40 2023-10-07T00:11:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e0ff9700 1 -- 172.21.15.5:0/2172354142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70dc00f040 con 0x7f70e4102b40 2023-10-07T00:11:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e41a0f40 con 0x7f70e4102b40 2023-10-07T00:11:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e0ff9700 1 -- 172.21.15.5:0/2172354142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc004750 con 0x7f70e4102b40 2023-10-07T00:11:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.585+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e41a1370 con 0x7f70e4102b40 2023-10-07T00:11:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.586+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e410c6c0 con 0x7f70e4102b40 2023-10-07T00:11:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.588+0000 7f70e0ff9700 1 -- 172.21.15.5:0/2172354142 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f70dc003a00 con 0x7f70e4102b40 2023-10-07T00:11:14.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.590+0000 7f70e0ff9700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70cc0a1480 0x7f70cc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:14.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.590+0000 7f70e0ff9700 1 -- 172.21.15.5:0/2172354142 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f70dc0ccc70 con 0x7f70e4102b40 2023-10-07T00:11:14.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.590+0000 7f70e37fe700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70cc0a1480 0x7f70cc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:14.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.590+0000 7f70e37fe700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70cc0a1480 0x7f70cc0a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f70e4102000 tx=0x7f70d4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.592+0000 7f70e0ff9700 1 -- 172.21.15.5:0/2172354142 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f70dc096380 con 0x7f70e4102b40 2023-10-07T00:11:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.820+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70e41a1560 con 0x7f70e4102b40 2023-10-07T00:11:14.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.822+0000 7f70e0ff9700 1 -- 172.21.15.5:0/2172354142 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22000 (secure 0 0 0) 0x7f70dc023090 con 0x7f70e4102b40 2023-10-07T00:11:14.823 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:14.824 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:14.815312+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:11:14.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70cc0a1480 msgr2=0x7f70cc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70cc0a1480 0x7f70cc0a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f70e4102000 tx=0x7f70d4009260 comp rx=0 tx=0).stop 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4102b40 msgr2=0x7f70e41a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4102b40 0x7f70e41a03c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70dc007ee0 tx=0x7f70dc00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 shutdown_connections 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70cc0a1480 0x7f70cc0a3940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4102b40 0x7f70e41a03c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e4100fb0 0x7f70e4198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 --2- 172.21.15.5:0/2172354142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e41021a0 0x7f70e4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 >> 172.21.15.5:0/2172354142 conn(0x7f70e40fc520 msgr2=0x7f70e40fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 shutdown_connections 2023-10-07T00:11:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:14.824+0000 7f70e9bff700 1 -- 172.21.15.5:0/2172354142 wait complete. 2023-10-07T00:11:14.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T00:11:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 -- 172.21.15.5:0/1251105000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 msgr2=0x7fbf601025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1251105000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 0x7fbf601025d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbf500099c0 tx=0x7fbf50009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 -- 172.21.15.5:0/1251105000 shutdown_connections 2023-10-07T00:11:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1251105000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf60102b10 0x7fbf601093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1251105000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf60100f80 0x7fbf601013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1251105000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 0x7fbf601025d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 -- 172.21.15.5:0/1251105000 >> 172.21.15.5:0/1251105000 conn(0x7fbf600fc510 msgr2=0x7fbf600fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 -- 172.21.15.5:0/1251105000 shutdown_connections 2023-10-07T00:11:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.062+0000 7fbf673ff700 1 -- 172.21.15.5:0/1251105000 wait complete. 2023-10-07T00:11:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.063+0000 7fbf673ff700 1 Processor -- start 2023-10-07T00:11:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.063+0000 7fbf673ff700 1 -- start start 2023-10-07T00:11:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.063+0000 7fbf673ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf60100f80 0x7fbf60196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.063+0000 7fbf673ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 0x7fbf601970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf673ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf60102b10 0x7fbf6019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf673ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6019e730 con 0x7fbf60102170 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf673ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6019e870 con 0x7fbf60102b10 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf673ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6019ea00 con 0x7fbf60100f80 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6519b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf60100f80 0x7fbf60196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6519b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf60100f80 0x7fbf60196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:42832/0 (socket says 172.21.15.5:42832) 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 0x7fbf601970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6519b700 1 -- 172.21.15.5:0/1866617972 learned_addr learned my addr 172.21.15.5:0/1866617972 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6599c700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf60102b10 0x7fbf6019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6519b700 1 -- 172.21.15.5:0/1866617972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf60102b10 msgr2=0x7fbf6019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6519b700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf60102b10 0x7fbf6019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6519b700 1 -- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 msgr2=0x7fbf601970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6519b700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 0x7fbf601970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6519b700 1 -- 172.21.15.5:0/1866617972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500095f0 con 0x7fbf60100f80 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.064+0000 7fbf6499a700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 0x7fbf601970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.065+0000 7fbf6519b700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf60100f80 0x7fbf60196bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00d980 tx=0x7fbf5c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.065+0000 7fbf567fc700 1 -- 172.21.15.5:0/1866617972 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c004020 con 0x7fbf60100f80 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.065+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6019ece0 con 0x7fbf60100f80 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.065+0000 7fbf567fc700 1 -- 172.21.15.5:0/1866617972 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf5c00f690 con 0x7fbf60100f80 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.065+0000 7fbf567fc700 1 -- 172.21.15.5:0/1866617972 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0039e0 con 0x7fbf60100f80 2023-10-07T00:11:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.065+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6019f190 con 0x7fbf60100f80 2023-10-07T00:11:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.066+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf60107f60 con 0x7fbf60100f80 2023-10-07T00:11:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.068+0000 7fbf567fc700 1 -- 172.21.15.5:0/1866617972 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbf5c00f800 con 0x7fbf60100f80 2023-10-07T00:11:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.069+0000 7fbf567fc700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbf4c0a1500 0x7fbf4c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.069+0000 7fbf567fc700 1 -- 172.21.15.5:0/1866617972 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbf5c0cc740 con 0x7fbf60100f80 2023-10-07T00:11:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.070+0000 7fbf6499a700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbf4c0a1500 0x7fbf4c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.070+0000 7fbf6499a700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbf4c0a1500 0x7fbf4c0a39c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000b580 tx=0x7fbf50005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:15.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.071+0000 7fbf567fc700 1 -- 172.21.15.5:0/1866617972 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbf5c095ed0 con 0x7fbf60100f80 2023-10-07T00:11:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: pgmap v296: 97 pgs: 2 creating+peering, 1 active+clean, 94 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-07T00:11:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: osdmap e85: 12 total, 12 up, 12 in 2023-10-07T00:11:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-07T00:11:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-07T00:11:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-07T00:11:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/64214478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] up:active 2023-10-07T00:11:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: osdmap e86: 12 total, 12 up, 12 in 2023-10-07T00:11:15.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:14 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2172354142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: pgmap v296: 97 pgs: 2 creating+peering, 1 active+clean, 94 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-07T00:11:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: osdmap e85: 12 total, 12 up, 12 in 2023-10-07T00:11:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-07T00:11:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-07T00:11:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-07T00:11:15.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/64214478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:15.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] up:active 2023-10-07T00:11:15.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:15.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: osdmap e86: 12 total, 12 up, 12 in 2023-10-07T00:11:15.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:14 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2172354142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: pgmap v296: 97 pgs: 2 creating+peering, 1 active+clean, 94 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-07T00:11:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-07T00:11:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: osdmap e85: 12 total, 12 up, 12 in 2023-10-07T00:11:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-07T00:11:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-07T00:11:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-07T00:11:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/64214478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] up:active 2023-10-07T00:11:15.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:15.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: osdmap e86: 12 total, 12 up, 12 in 2023-10-07T00:11:15.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:14 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2172354142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:15.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.344+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbf600008d0 con 0x7fbf60100f80 2023-10-07T00:11:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.838+0000 7fbf567fc700 1 -- 172.21.15.5:0/1866617972 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbf5c0170b0 con 0x7fbf60100f80 2023-10-07T00:11:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbf4c0a1500 msgr2=0x7fbf4c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbf4c0a1500 0x7fbf4c0a39c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000b580 tx=0x7fbf50005ec0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf60100f80 msgr2=0x7fbf60196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf60100f80 0x7fbf60196bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00d980 tx=0x7fbf5c00dc90 comp rx=0 tx=0).stop 2023-10-07T00:11:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 shutdown_connections 2023-10-07T00:11:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbf4c0a1500 0x7fbf4c0a39c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf60102b10 0x7fbf6019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf60100f80 0x7fbf60196bb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 --2- 172.21.15.5:0/1866617972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf60102170 0x7fbf601970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 >> 172.21.15.5:0/1866617972 conn(0x7fbf600fc510 msgr2=0x7fbf600fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 shutdown_connections 2023-10-07T00:11:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:15.841+0000 7fbf673ff700 1 -- 172.21.15.5:0/1866617972 wait complete. 2023-10-07T00:11:15.862 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-07T00:11:15.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-07T00:11:16.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 -- 172.21.15.5:0/1063966200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a81021b0 msgr2=0x7fa6a8102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 --2- 172.21.15.5:0/1063966200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a81021b0 0x7fa6a8102610 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa6900099c0 tx=0x7fa690009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 -- 172.21.15.5:0/1063966200 shutdown_connections 2023-10-07T00:11:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 --2- 172.21.15.5:0/1063966200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a8102b50 0x7fa6a8109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 --2- 172.21.15.5:0/1063966200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a8100fc0 0x7fa6a81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 --2- 172.21.15.5:0/1063966200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a81021b0 0x7fa6a8102610 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 -- 172.21.15.5:0/1063966200 >> 172.21.15.5:0/1063966200 conn(0x7fa6a80fc530 msgr2=0x7fa6a80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 -- 172.21.15.5:0/1063966200 shutdown_connections 2023-10-07T00:11:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.068+0000 7fa6acfff700 1 -- 172.21.15.5:0/1063966200 wait complete. 2023-10-07T00:11:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.069+0000 7fa6acfff700 1 Processor -- start 2023-10-07T00:11:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.069+0000 7fa6acfff700 1 -- start start 2023-10-07T00:11:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6acfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a8100fc0 0x7fa6a8198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6acfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a81021b0 0x7fa6a8199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6acfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a8102b50 0x7fa6a81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6acfff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81a09d0 con 0x7fa6a8100fc0 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6acfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81a0b10 con 0x7fa6a81021b0 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6acfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81a0ca0 con 0x7fa6a8102b50 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a8100fc0 0x7fa6a8198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a8100fc0 0x7fa6a8198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43908/0 (socket says 172.21.15.5:43908) 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a659c700 1 -- 172.21.15.5:0/57325810 learned_addr learned my addr 172.21.15.5:0/57325810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa69ffff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a81021b0 0x7fa6a8199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a6d9d700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a8102b50 0x7fa6a81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a659c700 1 -- 172.21.15.5:0/57325810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a8102b50 msgr2=0x7fa6a81a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a659c700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a8102b50 0x7fa6a81a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a659c700 1 -- 172.21.15.5:0/57325810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a81021b0 msgr2=0x7fa6a8199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a659c700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a81021b0 0x7fa6a8199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.070+0000 7fa6a659c700 1 -- 172.21.15.5:0/57325810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6900095f0 con 0x7fa6a8100fc0 2023-10-07T00:11:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.071+0000 7fa6a659c700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a8100fc0 0x7fa6a8198e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa69800e970 tx=0x7fa69800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.071+0000 7fa69f7fe700 1 -- 172.21.15.5:0/57325810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698009790 con 0x7fa6a8100fc0 2023-10-07T00:11:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.071+0000 7fa69f7fe700 1 -- 172.21.15.5:0/57325810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa69800eec0 con 0x7fa6a8100fc0 2023-10-07T00:11:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.071+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a81a0f80 con 0x7fa6a8100fc0 2023-10-07T00:11:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.071+0000 7fa69f7fe700 1 -- 172.21.15.5:0/57325810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698003c10 con 0x7fa6a8100fc0 2023-10-07T00:11:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.071+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a81a13a0 con 0x7fa6a8100fc0 2023-10-07T00:11:16.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.072+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a81934d0 con 0x7fa6a8100fc0 2023-10-07T00:11:16.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.074+0000 7fa69f7fe700 1 -- 172.21.15.5:0/57325810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa698004870 con 0x7fa6a8100fc0 2023-10-07T00:11:16.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.075+0000 7fa69f7fe700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa6940a1480 0x7fa6940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:16.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.076+0000 7fa69f7fe700 1 -- 172.21.15.5:0/57325810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa698014070 con 0x7fa6a8100fc0 2023-10-07T00:11:16.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.076+0000 7fa69ffff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa6940a1480 0x7fa6940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:16.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.076+0000 7fa69ffff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa6940a1480 0x7fa6940a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa690006010 tx=0x7fa69000bfd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:16.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.078+0000 7fa69f7fe700 1 -- 172.21.15.5:0/57325810 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa698096950 con 0x7fa6a8100fc0 2023-10-07T00:11:16.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1866617972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-07T00:11:16.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-07T00:11:16.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:15 smithi005 ceph-mon[129406]: pgmap v299: 97 pgs: 12 creating+peering, 50 active+clean, 35 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-07T00:11:16.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1866617972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-07T00:11:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-07T00:11:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:15 smithi088 ceph-mon[103111]: pgmap v299: 97 pgs: 12 creating+peering, 50 active+clean, 35 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-07T00:11:16.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1866617972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-07T00:11:16.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-07T00:11:16.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:16.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:15 smithi112 ceph-mon[133548]: pgmap v299: 97 pgs: 12 creating+peering, 50 active+clean, 35 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-07T00:11:16.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:16.341+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fa6a810c870 con 0x7fa6a8100fc0 2023-10-07T00:11:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:16 smithi005 ceph-mon[129406]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-07T00:11:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:16 smithi005 ceph-mon[129406]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:11:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:16 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/57325810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-07T00:11:17.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:16 smithi005 ceph-mon[129406]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-07T00:11:17.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:16 smithi005 ceph-mon[129406]: Cluster is now healthy 2023-10-07T00:11:17.202 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-b[139175]: 2023-10-07T00:11:16.708+0000 7f8319a34700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T00:11:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-mon[103111]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-07T00:11:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-mon[103111]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:11:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/57325810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-07T00:11:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-mon[103111]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-07T00:11:17.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:16 smithi088 ceph-mon[103111]: Cluster is now healthy 2023-10-07T00:11:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:16 smithi112 ceph-mon[133548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-07T00:11:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:16 smithi112 ceph-mon[133548]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:11:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:11:17.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:11:17.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:16 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/57325810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-07T00:11:17.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:16 smithi112 ceph-mon[133548]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-07T00:11:17.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:16 smithi112 ceph-mon[133548]: Cluster is now healthy 2023-10-07T00:11:17.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.307+0000 7fa69f7fe700 1 -- 172.21.15.5:0/57325810 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7fa698099f70 con 0x7fa6a8100fc0 2023-10-07T00:11:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa6940a1480 msgr2=0x7fa6940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa6940a1480 0x7fa6940a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa690006010 tx=0x7fa69000bfd0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a8100fc0 msgr2=0x7fa6a8198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a8100fc0 0x7fa6a8198e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa69800e970 tx=0x7fa69800ec80 comp rx=0 tx=0).stop 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 shutdown_connections 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa6940a1480 0x7fa6940a3940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a8102b50 0x7fa6a81a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a8100fc0 0x7fa6a8198e50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 --2- 172.21.15.5:0/57325810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a81021b0 0x7fa6a8199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 >> 172.21.15.5:0/57325810 conn(0x7fa6a80fc530 msgr2=0x7fa6a8107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 shutdown_connections 2023-10-07T00:11:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.311+0000 7fa6acfff700 1 -- 172.21.15.5:0/57325810 wait complete. 2023-10-07T00:11:17.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-07T00:11:17.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 -- 172.21.15.5:0/238354051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c102b50 msgr2=0x7f188c109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 --2- 172.21.15.5:0/238354051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c102b50 0x7f188c109400 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f188400b0d0 tx=0x7f188400b3e0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 -- 172.21.15.5:0/238354051 shutdown_connections 2023-10-07T00:11:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 --2- 172.21.15.5:0/238354051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c102b50 0x7f188c109400 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 --2- 172.21.15.5:0/238354051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c100fc0 0x7f188c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 --2- 172.21.15.5:0/238354051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188c1021b0 0x7f188c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 -- 172.21.15.5:0/238354051 >> 172.21.15.5:0/238354051 conn(0x7f188c0fc530 msgr2=0x7f188c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 -- 172.21.15.5:0/238354051 shutdown_connections 2023-10-07T00:11:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.549+0000 7f18933ff700 1 -- 172.21.15.5:0/238354051 wait complete. 2023-10-07T00:11:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.550+0000 7f18933ff700 1 Processor -- start 2023-10-07T00:11:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.550+0000 7f18933ff700 1 -- start start 2023-10-07T00:11:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f18933ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c100fc0 0x7f188c196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f18933ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1021b0 0x7f188c1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f18933ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188c102b50 0x7f188c19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f18933ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c19e7b0 con 0x7f188c1021b0 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f18933ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c19e920 con 0x7f188c102b50 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f18933ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c19eae0 con 0x7f188c100fc0 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1021b0 0x7f188c1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1021b0 0x7f188c1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43938/0 (socket says 172.21.15.5:43938) 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 -- 172.21.15.5:0/2128447798 learned_addr learned my addr 172.21.15.5:0/2128447798 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189119b700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c100fc0 0x7f188c196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 -- 172.21.15.5:0/2128447798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c100fc0 msgr2=0x7f188c196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c100fc0 0x7f188c196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 -- 172.21.15.5:0/2128447798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188c102b50 msgr2=0x7f188c19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188c102b50 0x7f188c19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 -- 172.21.15.5:0/2128447798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009d00 con 0x7f188c1021b0 2023-10-07T00:11:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.551+0000 7f189099a700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1021b0 0x7f188c1971b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f187c00e9a0 tx=0x7f187c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.552+0000 7f18827fc700 1 -- 172.21.15.5:0/2128447798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c009790 con 0x7f188c1021b0 2023-10-07T00:11:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.552+0000 7f18827fc700 1 -- 172.21.15.5:0/2128447798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f187c00cbd0 con 0x7f188c1021b0 2023-10-07T00:11:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.552+0000 7f18827fc700 1 -- 172.21.15.5:0/2128447798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c018680 con 0x7f188c1021b0 2023-10-07T00:11:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.552+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c19edc0 con 0x7f188c1021b0 2023-10-07T00:11:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.552+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c19f210 con 0x7f188c1021b0 2023-10-07T00:11:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.553+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c107ea0 con 0x7f188c1021b0 2023-10-07T00:11:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.555+0000 7f18827fc700 1 -- 172.21.15.5:0/2128447798 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f187c00cd40 con 0x7f188c1021b0 2023-10-07T00:11:17.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.556+0000 7f18827fc700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18780a1500 0x7f18780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:17.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.556+0000 7f18827fc700 1 -- 172.21.15.5:0/2128447798 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f187c014070 con 0x7f188c1021b0 2023-10-07T00:11:17.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.556+0000 7f189119b700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18780a1500 0x7f18780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.557+0000 7f189119b700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18780a1500 0x7f18780a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f188c198140 tx=0x7f188800b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.560+0000 7f18827fc700 1 -- 172.21.15.5:0/2128447798 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f187c052100 con 0x7f188c1021b0 2023-10-07T00:11:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:17.819+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f188c02cf70 con 0x7f188c1021b0 2023-10-07T00:11:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:17 smithi005 ceph-mon[129406]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-07T00:11:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:17 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/57325810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-07T00:11:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:17 smithi005 ceph-mon[129406]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-07T00:11:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:17 smithi005 ceph-mon[129406]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:17 smithi005 ceph-mon[129406]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2023-10-07T00:11:18.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:17 smithi005 ceph-mon[129406]: daemon mds.a is now active in filesystem cephfs as rank 1 2023-10-07T00:11:18.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:17 smithi005 ceph-mon[129406]: pgmap v300: 97 pgs: 10 creating+peering, 87 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 4 op/s 2023-10-07T00:11:18.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:17 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2128447798' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-07T00:11:18.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:17 smithi088 ceph-mon[103111]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-07T00:11:18.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:17 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/57325810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-07T00:11:18.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:17 smithi088 ceph-mon[103111]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-07T00:11:18.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:17 smithi088 ceph-mon[103111]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:18.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:17 smithi088 ceph-mon[103111]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2023-10-07T00:11:18.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:17 smithi088 ceph-mon[103111]: daemon mds.a is now active in filesystem cephfs as rank 1 2023-10-07T00:11:18.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:17 smithi088 ceph-mon[103111]: pgmap v300: 97 pgs: 10 creating+peering, 87 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 4 op/s 2023-10-07T00:11:18.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:17 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2128447798' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-07T00:11:18.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:17 smithi112 ceph-mon[133548]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-07T00:11:18.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:17 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/57325810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-07T00:11:18.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:17 smithi112 ceph-mon[133548]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-07T00:11:18.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:17 smithi112 ceph-mon[133548]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-07T00:11:18.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:17 smithi112 ceph-mon[133548]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2023-10-07T00:11:18.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:17 smithi112 ceph-mon[133548]: daemon mds.a is now active in filesystem cephfs as rank 1 2023-10-07T00:11:18.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:17 smithi112 ceph-mon[133548]: pgmap v300: 97 pgs: 10 creating+peering, 87 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 4 op/s 2023-10-07T00:11:18.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:17 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2128447798' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-07T00:11:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.319+0000 7f18827fc700 1 -- 172.21.15.5:0/2128447798 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f187c0965b0 con 0x7f188c1021b0 2023-10-07T00:11:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18780a1500 msgr2=0x7f18780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18780a1500 0x7f18780a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f188c198140 tx=0x7f188800b5d0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1021b0 msgr2=0x7f188c1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1021b0 0x7f188c1971b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f187c00e9a0 tx=0x7f187c00ed60 comp rx=0 tx=0).stop 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 shutdown_connections 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18780a1500 0x7f18780a39c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188c102b50 0x7f188c19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c100fc0 0x7f188c196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 --2- 172.21.15.5:0/2128447798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1021b0 0x7f188c1971b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 >> 172.21.15.5:0/2128447798 conn(0x7f188c0fc530 msgr2=0x7f188c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 shutdown_connections 2023-10-07T00:11:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.322+0000 7f18933ff700 1 -- 172.21.15.5:0/2128447798 wait complete. 2023-10-07T00:11:18.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-07T00:11:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.556+0000 7f59125ff700 1 -- 172.21.15.5:0/2453936194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c100fc0 msgr2=0x7f590c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.556+0000 7f59125ff700 1 --2- 172.21.15.5:0/2453936194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c100fc0 0x7f590c1013e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0099c0 tx=0x7f58fc009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.557+0000 7f59125ff700 1 -- 172.21.15.5:0/2453936194 shutdown_connections 2023-10-07T00:11:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.557+0000 7f59125ff700 1 --2- 172.21.15.5:0/2453936194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f590c102b50 0x7f590c109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.557+0000 7f59125ff700 1 --2- 172.21.15.5:0/2453936194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c100fc0 0x7f590c1013e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.557+0000 7f59125ff700 1 --2- 172.21.15.5:0/2453936194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f590c1021b0 0x7f590c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.557+0000 7f59125ff700 1 -- 172.21.15.5:0/2453936194 >> 172.21.15.5:0/2453936194 conn(0x7f590c0fc530 msgr2=0x7f590c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.557+0000 7f59125ff700 1 -- 172.21.15.5:0/2453936194 shutdown_connections 2023-10-07T00:11:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.557+0000 7f59125ff700 1 -- 172.21.15.5:0/2453936194 wait complete. 2023-10-07T00:11:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f59125ff700 1 Processor -- start 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f59125ff700 1 -- start start 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f59125ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f590c100fc0 0x7f590c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f59125ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f590c1021b0 0x7f590c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f59125ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c102b50 0x7f590c1a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f59125ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c1a0970 con 0x7f590c102b50 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f59125ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c1a0ab0 con 0x7f590c100fc0 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f59125ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c1a0c40 con 0x7f590c1021b0 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f5910b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c102b50 0x7f590c1a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:18.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f5910b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c102b50 0x7f590c1a03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43950/0 (socket says 172.21.15.5:43950) 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.558+0000 7f5910b9c700 1 -- 172.21.15.5:0/2007787804 learned_addr learned my addr 172.21.15.5:0/2007787804 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f590b7fe700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f590c1021b0 0x7f590c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f590bfff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f590c100fc0 0x7f590c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f5910b9c700 1 -- 172.21.15.5:0/2007787804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f590c1021b0 msgr2=0x7f590c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f5910b9c700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f590c1021b0 0x7f590c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f5910b9c700 1 -- 172.21.15.5:0/2007787804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f590c100fc0 msgr2=0x7f590c198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f5910b9c700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f590c100fc0 0x7f590c198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f5910b9c700 1 -- 172.21.15.5:0/2007787804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0095f0 con 0x7f590c102b50 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f5910b9c700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c102b50 0x7f590c1a03a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5904007ee0 tx=0x7f590400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f59097fa700 1 -- 172.21.15.5:0/2007787804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904017070 con 0x7f590c102b50 2023-10-07T00:11:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f59097fa700 1 -- 172.21.15.5:0/2007787804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f590400f040 con 0x7f590c102b50 2023-10-07T00:11:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f59097fa700 1 -- 172.21.15.5:0/2007787804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904005710 con 0x7f590c102b50 2023-10-07T00:11:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.559+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c1a0f20 con 0x7f590c102b50 2023-10-07T00:11:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.560+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c1a1350 con 0x7f590c102b50 2023-10-07T00:11:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.560+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c10c6d0 con 0x7f590c102b50 2023-10-07T00:11:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.563+0000 7f59097fa700 1 -- 172.21.15.5:0/2007787804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5904005870 con 0x7f590c102b50 2023-10-07T00:11:18.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.565+0000 7f59097fa700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58f40a1500 0x7f58f40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:18.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.565+0000 7f59097fa700 1 -- 172.21.15.5:0/2007787804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f59040cca10 con 0x7f590c102b50 2023-10-07T00:11:18.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.565+0000 7f590bfff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58f40a1500 0x7f58f40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.566+0000 7f590bfff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58f40a1500 0x7f58f40a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009990 tx=0x7f58fc01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.567+0000 7f59097fa700 1 -- 172.21.15.5:0/2007787804 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5904096120 con 0x7f590c102b50 2023-10-07T00:11:18.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:18.828+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f590c1a1540 con 0x7f590c102b50 2023-10-07T00:11:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.326+0000 7f59097fa700 1 -- 172.21.15.5:0/2007787804 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f5904099740 con 0x7f590c102b50 2023-10-07T00:11:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58f40a1500 msgr2=0x7f58f40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58f40a1500 0x7f58f40a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009990 tx=0x7f58fc01a040 comp rx=0 tx=0).stop 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c102b50 msgr2=0x7f590c1a03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c102b50 0x7f590c1a03a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5904007ee0 tx=0x7f590400d3b0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 shutdown_connections 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58f40a1500 0x7f58f40a39c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c102b50 0x7f590c1a03a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f590c100fc0 0x7f590c198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 --2- 172.21.15.5:0/2007787804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f590c1021b0 0x7f590c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 >> 172.21.15.5:0/2007787804 conn(0x7f590c0fc530 msgr2=0x7f590c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 shutdown_connections 2023-10-07T00:11:19.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.330+0000 7f59125ff700 1 -- 172.21.15.5:0/2007787804 wait complete. 2023-10-07T00:11:19.359 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-10-07T00:11:19.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-07T00:11:19.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 -- 172.21.15.5:0/3446696831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d401021b0 msgr2=0x7f5d40102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:19.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 --2- 172.21.15.5:0/3446696831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d401021b0 0x7f5d40102610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d340099c0 tx=0x7f5d34009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 -- 172.21.15.5:0/3446696831 shutdown_connections 2023-10-07T00:11:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 --2- 172.21.15.5:0/3446696831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d40102b50 0x7f5d40109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 --2- 172.21.15.5:0/3446696831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d40100fc0 0x7f5d401013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 --2- 172.21.15.5:0/3446696831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d401021b0 0x7f5d40102610 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 -- 172.21.15.5:0/3446696831 >> 172.21.15.5:0/3446696831 conn(0x7f5d400fc530 msgr2=0x7f5d400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 -- 172.21.15.5:0/3446696831 shutdown_connections 2023-10-07T00:11:19.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.570+0000 7f5d467ff700 1 -- 172.21.15.5:0/3446696831 wait complete. 2023-10-07T00:11:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.571+0000 7f5d467ff700 1 Processor -- start 2023-10-07T00:11:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.571+0000 7f5d467ff700 1 -- start start 2023-10-07T00:11:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.571+0000 7f5d467ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d40100fc0 0x7f5d40074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.571+0000 7f5d467ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d401021b0 0x7f5d400732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.571+0000 7f5d467ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d40102b50 0x7f5d400737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.571+0000 7f5d467ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d40073f80 con 0x7f5d40102b50 2023-10-07T00:11:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.571+0000 7f5d467ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400740f0 con 0x7f5d401021b0 2023-10-07T00:11:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.571+0000 7f5d467ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d401a0c60 con 0x7f5d40100fc0 2023-10-07T00:11:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d40102b50 0x7f5d400737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d40102b50 0x7f5d400737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43974/0 (socket says 172.21.15.5:43974) 2023-10-07T00:11:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 -- 172.21.15.5:0/2640414956 learned_addr learned my addr 172.21.15.5:0/2640414956 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d3ffff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d40100fc0 0x7f5d40074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d3f7fe700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d401021b0 0x7f5d400732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 -- 172.21.15.5:0/2640414956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d40100fc0 msgr2=0x7f5d40074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d40100fc0 0x7f5d40074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 -- 172.21.15.5:0/2640414956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d401021b0 msgr2=0x7f5d400732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d401021b0 0x7f5d400732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 -- 172.21.15.5:0/2640414956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340095f0 con 0x7f5d40102b50 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.572+0000 7f5d44d9c700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d40102b50 0x7f5d400737e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d38007ee0 tx=0x7f5d3800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.573+0000 7f5d3d7fa700 1 -- 172.21.15.5:0/2640414956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38017070 con 0x7f5d40102b50 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.573+0000 7f5d3d7fa700 1 -- 172.21.15.5:0/2640414956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d3800f040 con 0x7f5d40102b50 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.573+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d401a0f40 con 0x7f5d40102b50 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.573+0000 7f5d3d7fa700 1 -- 172.21.15.5:0/2640414956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38005570 con 0x7f5d40102b50 2023-10-07T00:11:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.573+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d401a13c0 con 0x7f5d40102b50 2023-10-07T00:11:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.574+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d40107f70 con 0x7f5d40102b50 2023-10-07T00:11:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.576+0000 7f5d3d7fa700 1 -- 172.21.15.5:0/2640414956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5d3800db20 con 0x7f5d40102b50 2023-10-07T00:11:19.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.577+0000 7f5d3d7fa700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d280a1500 0x7f5d280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:19.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.577+0000 7f5d3d7fa700 1 -- 172.21.15.5:0/2640414956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5d380cc2e0 con 0x7f5d40102b50 2023-10-07T00:11:19.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.577+0000 7f5d3ffff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d280a1500 0x7f5d280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.578+0000 7f5d3ffff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d280a1500 0x7f5d280a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d40102010 tx=0x7f5d3000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.581+0000 7f5d3d7fa700 1 -- 172.21.15.5:0/2640414956 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d380959f0 con 0x7f5d40102b50 2023-10-07T00:11:19.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2128447798' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-07T00:11:19.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:active 2023-10-07T00:11:19.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-mon[129406]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-07T00:11:19.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-mon[129406]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2023-10-07T00:11:19.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-mon[129406]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2023-10-07T00:11:19.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-mon[129406]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-07T00:11:19.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2007787804' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-07T00:11:19.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:19 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2128447798' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-07T00:11:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:19 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:active 2023-10-07T00:11:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:19 smithi088 ceph-mon[103111]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-07T00:11:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:19 smithi088 ceph-mon[103111]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2023-10-07T00:11:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:19 smithi088 ceph-mon[103111]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2023-10-07T00:11:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:19 smithi088 ceph-mon[103111]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-07T00:11:19.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:19 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2007787804' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-07T00:11:19.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:19 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2128447798' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-07T00:11:19.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:19 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:active 2023-10-07T00:11:19.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:19 smithi112 ceph-mon[133548]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-07T00:11:19.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:19 smithi112 ceph-mon[133548]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2023-10-07T00:11:19.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:19 smithi112 ceph-mon[133548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2023-10-07T00:11:19.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:19 smithi112 ceph-mon[133548]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-07T00:11:19.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:19 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2007787804' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-07T00:11:19.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.841+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d4002d310 con 0x7f5d280a1500 2023-10-07T00:11:19.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.891+0000 7f5d3d7fa700 1 -- 172.21.15.5:0/2640414956 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5d4002d310 con 0x7f5d280a1500 2023-10-07T00:11:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d280a1500 msgr2=0x7f5d280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d280a1500 0x7f5d280a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d40102010 tx=0x7f5d3000b410 comp rx=0 tx=0).stop 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d40102b50 msgr2=0x7f5d400737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d40102b50 0x7f5d400737e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d38007ee0 tx=0x7f5d3800d3b0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 shutdown_connections 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d280a1500 0x7f5d280a39c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d40102b50 0x7f5d400737e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d40100fc0 0x7f5d40074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 --2- 172.21.15.5:0/2640414956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d401021b0 0x7f5d400732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 >> 172.21.15.5:0/2640414956 conn(0x7f5d400fc530 msgr2=0x7f5d400fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 shutdown_connections 2023-10-07T00:11:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:19.894+0000 7f5d467ff700 1 -- 172.21.15.5:0/2640414956 wait complete. 2023-10-07T00:11:19.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-07T00:11:20.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:11:19.848+0000 7f26ca0db700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T00:11:20.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:11:19.848+0000 7f26ca0db700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T00:11:20.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:11:19.848+0000 7f26ca0db700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T00:11:20.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:11:19.848+0000 7f26ca0db700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T00:11:20.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:11:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:11:19.848+0000 7f26ca0db700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-07T00:11:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 -- 172.21.15.5:0/3498633135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970102b10 msgr2=0x7f39701093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 --2- 172.21.15.5:0/3498633135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970102b10 0x7f39701093c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f396800b0d0 tx=0x7f396800b3e0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 -- 172.21.15.5:0/3498633135 shutdown_connections 2023-10-07T00:11:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 --2- 172.21.15.5:0/3498633135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970102b10 0x7f39701093c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 --2- 172.21.15.5:0/3498633135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3970100f80 0x7f39701013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 --2- 172.21.15.5:0/3498633135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3970102170 0x7f39701025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 -- 172.21.15.5:0/3498633135 >> 172.21.15.5:0/3498633135 conn(0x7f39700fc510 msgr2=0x7f39700fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 -- 172.21.15.5:0/3498633135 shutdown_connections 2023-10-07T00:11:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.121+0000 7f39781ff700 1 -- 172.21.15.5:0/3498633135 wait complete. 2023-10-07T00:11:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.122+0000 7f39781ff700 1 Processor -- start 2023-10-07T00:11:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.122+0000 7f39781ff700 1 -- start start 2023-10-07T00:11:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.122+0000 7f39781ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970100f80 0x7f3970198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.122+0000 7f39781ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3970102170 0x7f39701993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.122+0000 7f39781ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3970102b10 0x7f39701a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.122+0000 7f39781ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39701a0a20 con 0x7f3970100f80 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.122+0000 7f39781ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39701a0b60 con 0x7f3970102b10 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.122+0000 7f39781ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39701a0cf0 con 0x7f3970102170 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970100f80 0x7f3970198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970100f80 0x7f3970198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44020/0 (socket says 172.21.15.5:44020) 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 -- 172.21.15.5:0/266736853 learned_addr learned my addr 172.21.15.5:0/266736853 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f397679c700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3970102b10 0x7f39701a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f397579a700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3970102170 0x7f39701993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 -- 172.21.15.5:0/266736853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3970102170 msgr2=0x7f39701993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3970102170 0x7f39701993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 -- 172.21.15.5:0/266736853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3970102b10 msgr2=0x7f39701a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3970102b10 0x7f39701a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 -- 172.21.15.5:0/266736853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968009d00 con 0x7f3970100f80 2023-10-07T00:11:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f397579a700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3970102170 0x7f39701993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:11:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3975f9b700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970100f80 0x7f3970198ea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f396c00e970 tx=0x7f396c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3966ffd700 1 -- 172.21.15.5:0/266736853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c009790 con 0x7f3970100f80 2023-10-07T00:11:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3966ffd700 1 -- 172.21.15.5:0/266736853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f396c00eec0 con 0x7f3970100f80 2023-10-07T00:11:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.123+0000 7f3966ffd700 1 -- 172.21.15.5:0/266736853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c003c10 con 0x7f3970100f80 2023-10-07T00:11:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.124+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39701a0fd0 con 0x7f3970100f80 2023-10-07T00:11:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.124+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39701a1390 con 0x7f3970100f80 2023-10-07T00:11:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.125+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3970193460 con 0x7f3970100f80 2023-10-07T00:11:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.127+0000 7f3966ffd700 1 -- 172.21.15.5:0/266736853 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f396c004870 con 0x7f3970100f80 2023-10-07T00:11:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.128+0000 7f3966ffd700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f395c0a1480 0x7f395c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:20.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.128+0000 7f3966ffd700 1 -- 172.21.15.5:0/266736853 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f396c014070 con 0x7f3970100f80 2023-10-07T00:11:20.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.128+0000 7f397579a700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f395c0a1480 0x7f395c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:20.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.129+0000 7f397579a700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f395c0a1480 0x7f395c0a3940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3960009cb0 tx=0x7f3960009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:20.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.130+0000 7f3966ffd700 1 -- 172.21.15.5:0/266736853 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f396c0966e0 con 0x7f3970100f80 2023-10-07T00:11:20.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.377+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f397002d2e0 con 0x7f395c0a1480 2023-10-07T00:11:20.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.382+0000 7f3966ffd700 1 -- 172.21.15.5:0/266736853 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f397002d2e0 con 0x7f395c0a1480 2023-10-07T00:11:20.383 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c 2023-10-07T00:11:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f395c0a1480 msgr2=0x7f395c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f395c0a1480 0x7f395c0a3940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3960009cb0 tx=0x7f3960009260 comp rx=0 tx=0).stop 2023-10-07T00:11:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970100f80 msgr2=0x7f3970198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970100f80 0x7f3970198ea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f396c00e970 tx=0x7f396c00ec80 comp rx=0 tx=0).stop 2023-10-07T00:11:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 shutdown_connections 2023-10-07T00:11:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f395c0a1480 0x7f395c0a3940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3970102b10 0x7f39701a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3970100f80 0x7f3970198ea0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 --2- 172.21.15.5:0/266736853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3970102170 0x7f39701993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 >> 172.21.15.5:0/266736853 conn(0x7f39700fc510 msgr2=0x7f3970107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 shutdown_connections 2023-10-07T00:11:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.384+0000 7f39781ff700 1 -- 172.21.15.5:0/266736853 wait complete. 2023-10-07T00:11:20.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-07T00:11:20.608 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2007787804' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] up:active 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: daemon mds.i is now active in filesystem cephfs as rank 3 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] up:active 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: daemon mds.g assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: Cluster is now healthy 2023-10-07T00:11:20.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2023-10-07T00:11:20.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-07T00:11:20.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-07T00:11:20.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:20 smithi005 ceph-mon[129406]: daemon mds.g is now active in filesystem cephfs as rank 4 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1625503593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c0100fc0 msgr2=0x7ff8c01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1625503593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c0100fc0 0x7ff8c01013e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40099c0 tx=0x7ff8b4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1625503593 shutdown_connections 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1625503593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8c0102b50 0x7ff8c0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1625503593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c0100fc0 0x7ff8c01013e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1625503593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c01021b0 0x7ff8c0102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1625503593 >> 172.21.15.5:0/1625503593 conn(0x7ff8c00fc530 msgr2=0x7ff8c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1625503593 shutdown_connections 2023-10-07T00:11:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.610+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1625503593 wait complete. 2023-10-07T00:11:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.611+0000 7ff8c6fff700 1 Processor -- start 2023-10-07T00:11:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8c6fff700 1 -- start start 2023-10-07T00:11:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8c6fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c0100fc0 0x7ff8c0196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8c6fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c01021b0 0x7ff8c01971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8c6fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8c0102b50 0x7ff8c019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8c6fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c019e7c0 con 0x7ff8c01021b0 2023-10-07T00:11:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8c6fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c019e930 con 0x7ff8c0102b50 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8c6fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c019eaf0 con 0x7ff8c0100fc0 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c01021b0 0x7ff8c01971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c01021b0 0x7ff8c01971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44046/0 (socket says 172.21.15.5:44046) 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8bffff700 1 -- 172.21.15.5:0/1302961041 learned_addr learned my addr 172.21.15.5:0/1302961041 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.612+0000 7ff8c559c700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8c0102b50 0x7ff8c019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8c4d9b700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c0100fc0 0x7ff8c0196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bffff700 1 -- 172.21.15.5:0/1302961041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c0100fc0 msgr2=0x7ff8c0196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bffff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c0100fc0 0x7ff8c0196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bffff700 1 -- 172.21.15.5:0/1302961041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8c0102b50 msgr2=0x7ff8c019e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bffff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8c0102b50 0x7ff8c019e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bffff700 1 -- 172.21.15.5:0/1302961041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40095f0 con 0x7ff8c01021b0 2023-10-07T00:11:20.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bffff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c01021b0 0x7ff8c01971c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00d950 tx=0x7ff8ac00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:20.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bdffb700 1 -- 172.21.15.5:0/1302961041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac009940 con 0x7ff8c01021b0 2023-10-07T00:11:20.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c019edd0 con 0x7ff8c01021b0 2023-10-07T00:11:20.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bdffb700 1 -- 172.21.15.5:0/1302961041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8ac010460 con 0x7ff8c01021b0 2023-10-07T00:11:20.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8bdffb700 1 -- 172.21.15.5:0/1302961041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00f620 con 0x7ff8c01021b0 2023-10-07T00:11:20.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.613+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c019f200 con 0x7ff8c01021b0 2023-10-07T00:11:20.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.614+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c0107f10 con 0x7ff8c01021b0 2023-10-07T00:11:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.616+0000 7ff8bdffb700 1 -- 172.21.15.5:0/1302961041 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff8ac0105d0 con 0x7ff8c01021b0 2023-10-07T00:11:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.618+0000 7ff8bdffb700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff8b00a1480 0x7ff8b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.618+0000 7ff8bdffb700 1 -- 172.21.15.5:0/1302961041 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff8ac0ccaa0 con 0x7ff8c01021b0 2023-10-07T00:11:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.618+0000 7ff8c4d9b700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff8b00a1480 0x7ff8b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.619+0000 7ff8c4d9b700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff8b00a1480 0x7ff8b00a3940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400b580 tx=0x7ff8b4005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:20.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.620+0000 7ff8bdffb700 1 -- 172.21.15.5:0/1302961041 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff8ac0961b0 con 0x7ff8c01021b0 2023-10-07T00:11:20.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2007787804' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-07T00:11:20.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] up:active 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: daemon mds.i is now active in filesystem cephfs as rank 3 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] up:active 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: daemon mds.g assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: Cluster is now healthy 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-07T00:11:20.703 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-07T00:11:20.704 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:20 smithi088 ceph-mon[103111]: daemon mds.g is now active in filesystem cephfs as rank 4 2023-10-07T00:11:20.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2007787804' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-07T00:11:20.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] up:active 2023-10-07T00:11:20.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: daemon mds.i is now active in filesystem cephfs as rank 3 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] up:active 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: daemon mds.g assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: Cluster is now healthy 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-07T00:11:20.748 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:20 smithi112 ceph-mon[133548]: daemon mds.g is now active in filesystem cephfs as rank 4 2023-10-07T00:11:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.871+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8c002d160 con 0x7ff8b00a1480 2023-10-07T00:11:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.897+0000 7ff8bdffb700 1 -- 172.21.15.5:0/1302961041 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff8c002d160 con 0x7ff8b00a1480 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff8b00a1480 msgr2=0x7ff8b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff8b00a1480 0x7ff8b00a3940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400b580 tx=0x7ff8b4005e80 comp rx=0 tx=0).stop 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c01021b0 msgr2=0x7ff8c01971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c01021b0 0x7ff8c01971c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00d950 tx=0x7ff8ac00dc60 comp rx=0 tx=0).stop 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 shutdown_connections 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff8b00a1480 0x7ff8b00a3940 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8c0102b50 0x7ff8c019e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c0100fc0 0x7ff8c0196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 --2- 172.21.15.5:0/1302961041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c01021b0 0x7ff8c01971c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.899+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 >> 172.21.15.5:0/1302961041 conn(0x7ff8c00fc530 msgr2=0x7ff8c00fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:20.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.900+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 shutdown_connections 2023-10-07T00:11:20.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:20.900+0000 7ff8c6fff700 1 -- 172.21.15.5:0/1302961041 wait complete. 2023-10-07T00:11:20.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-07T00:11:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 -- 172.21.15.5:0/1076005358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 msgr2=0x7f767810b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 --2- 172.21.15.5:0/1076005358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 0x7f767810b310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f767000b0a0 tx=0x7f767000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 -- 172.21.15.5:0/1076005358 shutdown_connections 2023-10-07T00:11:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 --2- 172.21.15.5:0/1076005358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 0x7f767810b310 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 --2- 172.21.15.5:0/1076005358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7678074ef0 0x7f7678073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 --2- 172.21.15.5:0/1076005358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7678073910 0x7f7678073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 -- 172.21.15.5:0/1076005358 >> 172.21.15.5:0/1076005358 conn(0x7f76780fc530 msgr2=0x7f76780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 -- 172.21.15.5:0/1076005358 shutdown_connections 2023-10-07T00:11:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.126+0000 7f767ffff700 1 -- 172.21.15.5:0/1076005358 wait complete. 2023-10-07T00:11:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.127+0000 7f767ffff700 1 Processor -- start 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.127+0000 7f767ffff700 1 -- start start 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.127+0000 7f767ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7678073910 0x7f7678198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.127+0000 7f767ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7678074ef0 0x7f76781993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.127+0000 7f767ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 0x7f76781a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.127+0000 7f767ffff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781a09e0 con 0x7f7678108e80 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.127+0000 7f767ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781a0b20 con 0x7f7678073910 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.127+0000 7f767ffff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781a0cb0 con 0x7f7678074ef0 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 0x7f76781a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 0x7f76781a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44062/0 (socket says 172.21.15.5:44062) 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 -- 172.21.15.5:0/3514781258 learned_addr learned my addr 172.21.15.5:0/3514781258 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767dd9b700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7678073910 0x7f7678198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767d59a700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7678074ef0 0x7f76781993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 -- 172.21.15.5:0/3514781258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7678074ef0 msgr2=0x7f76781993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7678074ef0 0x7f76781993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 -- 172.21.15.5:0/3514781258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7678073910 msgr2=0x7f7678198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7678073910 0x7f7678198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 -- 172.21.15.5:0/3514781258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7670009d00 con 0x7f7678108e80 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767dd9b700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7678073910 0x7f7678198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767d59a700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7678074ef0 0x7f76781993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767e59c700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 0x7f76781a0410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f767000b070 tx=0x7f7670004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f766effd700 1 -- 172.21.15.5:0/3514781258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767000e040 con 0x7f7678108e80 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f766effd700 1 -- 172.21.15.5:0/3514781258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7670003e90 con 0x7f7678108e80 2023-10-07T00:11:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f766effd700 1 -- 172.21.15.5:0/3514781258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670004020 con 0x7f7678108e80 2023-10-07T00:11:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.128+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76781a0f30 con 0x7f7678108e80 2023-10-07T00:11:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.129+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76781a12a0 con 0x7f7678108e80 2023-10-07T00:11:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.130+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7678107530 con 0x7f7678108e80 2023-10-07T00:11:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.132+0000 7f766effd700 1 -- 172.21.15.5:0/3514781258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f767001b660 con 0x7f7678108e80 2023-10-07T00:11:21.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.133+0000 7f766effd700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76640a1480 0x7f76640a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:21.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.133+0000 7f766effd700 1 -- 172.21.15.5:0/3514781258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f76700ce340 con 0x7f7678108e80 2023-10-07T00:11:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.134+0000 7f767dd9b700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76640a1480 0x7f76640a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.134+0000 7f767dd9b700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76640a1480 0x7f76640a3940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7674005fd0 tx=0x7f7674005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.137+0000 7f766effd700 1 -- 172.21.15.5:0/3514781258 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7670097ae0 con 0x7f7678108e80 2023-10-07T00:11:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.386+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f767802d270 con 0x7f76640a1480 2023-10-07T00:11:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.390+0000 7f766effd700 1 -- 172.21.15.5:0/3514781258 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f767802d270 con 0x7f76640a1480 2023-10-07T00:11:21.392 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/_nogroup/sv_1/d915e9d9-caea-4c76-84ac-44d5ed60445f 2023-10-07T00:11:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76640a1480 msgr2=0x7f76640a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76640a1480 0x7f76640a3940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7674005fd0 tx=0x7f7674005ee0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 msgr2=0x7f76781a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 0x7f76781a0410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f767000b070 tx=0x7f7670004d30 comp rx=0 tx=0).stop 2023-10-07T00:11:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 shutdown_connections 2023-10-07T00:11:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76640a1480 0x7f76640a3940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7678108e80 0x7f76781a0410 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7678073910 0x7f7678198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 --2- 172.21.15.5:0/3514781258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7678074ef0 0x7f76781993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 >> 172.21.15.5:0/3514781258 conn(0x7f76780fc530 msgr2=0x7f76780fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 shutdown_connections 2023-10-07T00:11:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.393+0000 7f767ffff700 1 -- 172.21.15.5:0/3514781258 wait complete. 2023-10-07T00:11:21.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:11:21.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 -- 172.21.15.5:0/4291109534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 msgr2=0x7fbff4102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/4291109534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 0x7fbff4102600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80099c0 tx=0x7fbfe8009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 -- 172.21.15.5:0/4291109534 shutdown_connections 2023-10-07T00:11:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/4291109534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbff4102b40 0x7fbff41093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/4291109534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbff4100fb0 0x7fbff41013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/4291109534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 0x7fbff4102600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 -- 172.21.15.5:0/4291109534 >> 172.21.15.5:0/4291109534 conn(0x7fbff40fc520 msgr2=0x7fbff40fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 -- 172.21.15.5:0/4291109534 shutdown_connections 2023-10-07T00:11:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.615+0000 7fbffa3ff700 1 -- 172.21.15.5:0/4291109534 wait complete. 2023-10-07T00:11:21.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.616+0000 7fbffa3ff700 1 Processor -- start 2023-10-07T00:11:21.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.616+0000 7fbffa3ff700 1 -- start start 2023-10-07T00:11:21.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.616+0000 7fbffa3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbff4100fb0 0x7fbff4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:21.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.616+0000 7fbffa3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 0x7fbff40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:21.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.616+0000 7fbffa3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbff4102b40 0x7fbff40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbffa3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4073f80 con 0x7fbff41021a0 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbffa3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40740f0 con 0x7fbff4102b40 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbffa3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41a0c40 con 0x7fbff4100fb0 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 0x7fbff40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 0x7fbff40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44086/0 (socket says 172.21.15.5:44086) 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 -- 172.21.15.5:0/3154640560 learned_addr learned my addr 172.21.15.5:0/3154640560 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff3fff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbff4100fb0 0x7fbff4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff899c700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbff4102b40 0x7fbff40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 -- 172.21.15.5:0/3154640560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbff4100fb0 msgr2=0x7fbff4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbff4100fb0 0x7fbff4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 -- 172.21.15.5:0/3154640560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbff4102b40 msgr2=0x7fbff40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbff4102b40 0x7fbff40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 -- 172.21.15.5:0/3154640560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe80095f0 con 0x7fbff41021a0 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.617+0000 7fbff37fe700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 0x7fbff40732a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8000c00 tx=0x7fbfe800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.618+0000 7fbff17fa700 1 -- 172.21.15.5:0/3154640560 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe801d070 con 0x7fbff41021a0 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.618+0000 7fbff17fa700 1 -- 172.21.15.5:0/3154640560 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbfe800fe70 con 0x7fbff41021a0 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.618+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff41a0ec0 con 0x7fbff41021a0 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.618+0000 7fbff17fa700 1 -- 172.21.15.5:0/3154640560 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80173f0 con 0x7fbff41021a0 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.618+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff41a12e0 con 0x7fbff41021a0 2023-10-07T00:11:21.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.619+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff4107f90 con 0x7fbff41021a0 2023-10-07T00:11:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.622+0000 7fbff17fa700 1 -- 172.21.15.5:0/3154640560 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbfe8022470 con 0x7fbff41021a0 2023-10-07T00:11:21.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.624+0000 7fbff17fa700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbfdc0a1500 0x7fbfdc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:21.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.624+0000 7fbff17fa700 1 -- 172.21.15.5:0/3154640560 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbfe80cdbd0 con 0x7fbff41021a0 2023-10-07T00:11:21.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.624+0000 7fbff3fff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbfdc0a1500 0x7fbfdc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:21.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.625+0000 7fbff3fff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbfdc0a1500 0x7fbfdc0a39c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbff4102000 tx=0x7fbfe4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.627+0000 7fbff17fa700 1 -- 172.21.15.5:0/3154640560 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbfe805d100 con 0x7fbff41021a0 2023-10-07T00:11:21.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:21 smithi005 ceph-mon[129406]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:21.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:21 smithi005 ceph-mon[129406]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:21.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:21 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] up:active 2023-10-07T00:11:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:21 smithi005 ceph-mon[129406]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-07T00:11:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:21 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:11:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.894+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbff402d1a0 con 0x7fbff41021a0 2023-10-07T00:11:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.894+0000 7fbff17fa700 1 -- 172.21.15.5:0/3154640560 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7fbfe8097370 con 0x7fbff41021a0 2023-10-07T00:11:21.896 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:21.896 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:11:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbfdc0a1500 msgr2=0x7fbfdc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbfdc0a1500 0x7fbfdc0a39c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbff4102000 tx=0x7fbfe4009260 comp rx=0 tx=0).stop 2023-10-07T00:11:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 msgr2=0x7fbff40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 0x7fbff40732a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8000c00 tx=0x7fbfe800fa00 comp rx=0 tx=0).stop 2023-10-07T00:11:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 shutdown_connections 2023-10-07T00:11:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fbfdc0a1500 0x7fbfdc0a39c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbff4102b40 0x7fbff40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbff4100fb0 0x7fbff4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 --2- 172.21.15.5:0/3154640560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff41021a0 0x7fbff40732a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 >> 172.21.15.5:0/3154640560 conn(0x7fbff40fc520 msgr2=0x7fbff40fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 shutdown_connections 2023-10-07T00:11:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:21.897+0000 7fbffa3ff700 1 -- 172.21.15.5:0/3154640560 wait complete. 2023-10-07T00:11:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:11:21.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:11:21.952 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:21 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-b[139175]: 2023-10-07T00:11:21.708+0000 7f8319a34700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-07T00:11:21.952 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:11:21 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-b[139175]: 2023-10-07T00:11:21.708+0000 7f8319a34700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-07T00:11:21.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:21 smithi088 ceph-mon[103111]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:21.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:21 smithi088 ceph-mon[103111]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:21.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:21 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] up:active 2023-10-07T00:11:21.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:21 smithi088 ceph-mon[103111]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-07T00:11:21.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:21 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:11:21.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:21 smithi112 ceph-mon[133548]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:21.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:21 smithi112 ceph-mon[133548]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:21.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:21 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] up:active 2023-10-07T00:11:21.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:21 smithi112 ceph-mon[133548]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-07T00:11:21.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:21 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:11:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.118+0000 7fa73f3ff700 1 -- 172.21.15.5:0/3066964984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738073910 msgr2=0x7fa738073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.118+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/3066964984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738073910 0x7fa738073d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa728009990 tx=0x7fa728009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.119+0000 7fa73f3ff700 1 -- 172.21.15.5:0/3066964984 shutdown_connections 2023-10-07T00:11:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.119+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/3066964984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa738108e70 0x7fa73810b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.119+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/3066964984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa738074ef0 0x7fa738073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.119+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/3066964984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738073910 0x7fa738073d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.119+0000 7fa73f3ff700 1 -- 172.21.15.5:0/3066964984 >> 172.21.15.5:0/3066964984 conn(0x7fa7380fc520 msgr2=0x7fa7380fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.119+0000 7fa73f3ff700 1 -- 172.21.15.5:0/3066964984 shutdown_connections 2023-10-07T00:11:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.119+0000 7fa73f3ff700 1 -- 172.21.15.5:0/3066964984 wait complete. 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73f3ff700 1 Processor -- start 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73f3ff700 1 -- start start 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73f3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa738073910 0x7fa738198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73f3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738074ef0 0x7fa738199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73f3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa738108e70 0x7fa7381a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73f3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381a09b0 con 0x7fa738074ef0 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73f3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381a0af0 con 0x7fa738108e70 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73f3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381a0c80 con 0x7fa738073910 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73c99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738074ef0 0x7fa738199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73c99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738074ef0 0x7fa738199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38404/0 (socket says 172.21.15.5:38404) 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.120+0000 7fa73c99a700 1 -- 172.21.15.5:0/730470224 learned_addr learned my addr 172.21.15.5:0/730470224 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73d19b700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa738073910 0x7fa738198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73d99c700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa738108e70 0x7fa7381a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73c99a700 1 -- 172.21.15.5:0/730470224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa738073910 msgr2=0x7fa738198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73c99a700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa738073910 0x7fa738198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73c99a700 1 -- 172.21.15.5:0/730470224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa738108e70 msgr2=0x7fa7381a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73c99a700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa738108e70 0x7fa7381a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73c99a700 1 -- 172.21.15.5:0/730470224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280095f0 con 0x7fa738074ef0 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73c99a700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738074ef0 0x7fa738199370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa7280098e0 tx=0x7fa728004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa72e7fc700 1 -- 172.21.15.5:0/730470224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72801d070 con 0x7fa738074ef0 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa72e7fc700 1 -- 172.21.15.5:0/730470224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa72800be30 con 0x7fa738074ef0 2023-10-07T00:11:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7381a0f00 con 0x7fa738074ef0 2023-10-07T00:11:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.121+0000 7fa72e7fc700 1 -- 172.21.15.5:0/730470224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728022dd0 con 0x7fa738074ef0 2023-10-07T00:11:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.122+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7381a1270 con 0x7fa738074ef0 2023-10-07T00:11:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.123+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa738107520 con 0x7fa738074ef0 2023-10-07T00:11:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.125+0000 7fa72e7fc700 1 -- 172.21.15.5:0/730470224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa728022570 con 0x7fa738074ef0 2023-10-07T00:11:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.126+0000 7fa72e7fc700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7240a1480 0x7fa7240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.126+0000 7fa72e7fc700 1 -- 172.21.15.5:0/730470224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa7280ce210 con 0x7fa738074ef0 2023-10-07T00:11:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.126+0000 7fa73d19b700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7240a1480 0x7fa7240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.127+0000 7fa73d19b700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7240a1480 0x7fa7240a3940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa734009c60 tx=0x7fa734009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.130+0000 7fa72e7fc700 1 -- 172.21.15.5:0/730470224 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa7280979b0 con 0x7fa738074ef0 2023-10-07T00:11:22.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.341+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa73810e8a0 con 0x7fa738074ef0 2023-10-07T00:11:22.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.343+0000 7fa72e7fc700 1 -- 172.21.15.5:0/730470224 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22000 (secure 0 0 0) 0x7fa72809afd0 con 0x7fa738074ef0 2023-10-07T00:11:22.344 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:22.345 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:14.815312+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:11:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7240a1480 msgr2=0x7fa7240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7240a1480 0x7fa7240a3940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa734009c60 tx=0x7fa734009260 comp rx=0 tx=0).stop 2023-10-07T00:11:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738074ef0 msgr2=0x7fa738199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738074ef0 0x7fa738199370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa7280098e0 tx=0x7fa728004730 comp rx=0 tx=0).stop 2023-10-07T00:11:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 shutdown_connections 2023-10-07T00:11:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7240a1480 0x7fa7240a3940 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa738108e70 0x7fa7381a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa738073910 0x7fa738198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 --2- 172.21.15.5:0/730470224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa738074ef0 0x7fa738199370 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 >> 172.21.15.5:0/730470224 conn(0x7fa7380fc520 msgr2=0x7fa7380fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:22.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 shutdown_connections 2023-10-07T00:11:22.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.345+0000 7fa73f3ff700 1 -- 172.21.15.5:0/730470224 wait complete. 2023-10-07T00:11:22.366 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T00:11:22.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T00:11:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 -- 172.21.15.5:0/269695536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630101ae0 msgr2=0x7f9630103ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 --2- 172.21.15.5:0/269695536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630101ae0 0x7f9630103ed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f962c009990 tx=0x7f962c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 -- 172.21.15.5:0/269695536 shutdown_connections 2023-10-07T00:11:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 --2- 172.21.15.5:0/269695536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9630106d40 0x7f9630109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 --2- 172.21.15.5:0/269695536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630101ae0 0x7f9630103ed0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 --2- 172.21.15.5:0/269695536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9630104410 0x7f9630106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 -- 172.21.15.5:0/269695536 >> 172.21.15.5:0/269695536 conn(0x7f96300fb410 msgr2=0x7f96300fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 -- 172.21.15.5:0/269695536 shutdown_connections 2023-10-07T00:11:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.568+0000 7f96377ff700 1 -- 172.21.15.5:0/269695536 wait complete. 2023-10-07T00:11:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.570+0000 7f96377ff700 1 Processor -- start 2023-10-07T00:11:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.570+0000 7f96377ff700 1 -- start start 2023-10-07T00:11:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.570+0000 7f96377ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9630101ae0 0x7f9630101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.570+0000 7f96377ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630104410 0x7f96300ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.570+0000 7f96377ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9630106d40 0x7f96300fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.570+0000 7f96377ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9630100770 con 0x7f9630104410 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.570+0000 7f96377ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96301008e0 con 0x7f9630101ae0 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.570+0000 7f96377ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96301a0bf0 con 0x7f9630106d40 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630104410 0x7f96300ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630104410 0x7f96300ffa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38422/0 (socket says 172.21.15.5:38422) 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 -- 172.21.15.5:0/707471005 learned_addr learned my addr 172.21.15.5:0/707471005 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9635d9c700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9630106d40 0x7f96300fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f963559b700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9630101ae0 0x7f9630101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 -- 172.21.15.5:0/707471005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9630106d40 msgr2=0x7f96300fffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9630106d40 0x7f96300fffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 -- 172.21.15.5:0/707471005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9630101ae0 msgr2=0x7f9630101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9630101ae0 0x7f9630101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 -- 172.21.15.5:0/707471005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0095f0 con 0x7f9630104410 2023-10-07T00:11:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9635d9c700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9630106d40 0x7f96300fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:11:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.571+0000 7f9634d9a700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630104410 0x7f96300ffa90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f962000d980 tx=0x7f962000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.572+0000 7f96267fc700 1 -- 172.21.15.5:0/707471005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000bb60 con 0x7f9630104410 2023-10-07T00:11:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.572+0000 7f96267fc700 1 -- 172.21.15.5:0/707471005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9620007640 con 0x7f9630104410 2023-10-07T00:11:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.572+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96301a0ed0 con 0x7f9630104410 2023-10-07T00:11:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.572+0000 7f96267fc700 1 -- 172.21.15.5:0/707471005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620004d60 con 0x7f9630104410 2023-10-07T00:11:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.572+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96301a1350 con 0x7f9630104410 2023-10-07T00:11:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.573+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96300fcf90 con 0x7f9630104410 2023-10-07T00:11:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.575+0000 7f96267fc700 1 -- 172.21.15.5:0/707471005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9620004020 con 0x7f9630104410 2023-10-07T00:11:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.577+0000 7f96267fc700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f961c0a1480 0x7f961c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.577+0000 7f96267fc700 1 -- 172.21.15.5:0/707471005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f96200ccb80 con 0x7f9630104410 2023-10-07T00:11:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.577+0000 7f963559b700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f961c0a1480 0x7f961c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.578+0000 7f963559b700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f961c0a1480 0x7f961c0a3940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f962c006010 tx=0x7f962c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.581+0000 7f96267fc700 1 -- 172.21.15.5:0/707471005 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9620096290 con 0x7f9630104410 2023-10-07T00:11:22.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.677+0000 7f96267fc700 1 -- 172.21.15.5:0/707471005 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f9620096660 con 0x7f9630104410 2023-10-07T00:11:22.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.797+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f963002d1f0 con 0x7f961c0a1480 2023-10-07T00:11:22.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.810+0000 7f96267fc700 1 -- 172.21.15.5:0/707471005 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335971 (secure 0 0 0) 0x7f963002d1f0 con 0x7f961c0a1480 2023-10-07T00:11:22.816 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f961c0a1480 msgr2=0x7f961c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f961c0a1480 0x7f961c0a3940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f962c006010 tx=0x7f962c00b260 comp rx=0 tx=0).stop 2023-10-07T00:11:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630104410 msgr2=0x7f96300ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630104410 0x7f96300ffa90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f962000d980 tx=0x7f962000dd40 comp rx=0 tx=0).stop 2023-10-07T00:11:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 shutdown_connections 2023-10-07T00:11:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f961c0a1480 0x7f961c0a3940 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9630106d40 0x7f96300fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9630101ae0 0x7f9630101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 --2- 172.21.15.5:0/707471005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9630104410 0x7f96300ffa90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 >> 172.21.15.5:0/707471005 conn(0x7f96300fb410 msgr2=0x7f9630102750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 shutdown_connections 2023-10-07T00:11:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:22.815+0000 7f96377ff700 1 -- 172.21.15.5:0/707471005 wait complete. 2023-10-07T00:11:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-07T00:11:22.835 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2023-10-07T00:11:21.643385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":614428,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":151,"num_read_kb":130,"num_write":330,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335392,"kb_used_data":11168,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606432,"statfs":{"total":1151940427776,"available":1151596986368,"internally_reserved":0,"allocated":11436032,"data_stored":7097739,"data_compressed":108477,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24060,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":149,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001983"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107856+0000","last_change":"2023-10-07T00:11:13.845315+0000","last_active":"2023-10-07T00:11:15.107856+0000","last_peered":"2023-10-07T00:11:15.107856+0000","last_clean":"2023-10-07T00:11:15.107856+0000","last_became_active":"2023-10-07T00:11:13.844330+0000","last_became_peered":"2023-10-07T00:11:13.844330+0000","last_unstale":"2023-10-07T00:11:15.107856+0000","last_undegraded":"2023-10-07T00:11:15.107856+0000","last_fullsized":"2023-10-07T00:11:15.107856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:26.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107999+0000","last_change":"2023-10-07T00:11:13.842602+0000","last_active":"2023-10-07T00:11:15.107999+0000","last_peered":"2023-10-07T00:11:15.107999+0000","last_clean":"2023-10-07T00:11:15.107999+0000","last_became_active":"2023-10-07T00:11:13.842296+0000","last_became_peered":"2023-10-07T00:11:13.842296+0000","last_unstale":"2023-10-07T00:11:15.107999+0000","last_undegraded":"2023-10-07T00:11:15.107999+0000","last_fullsized":"2023-10-07T00:11:15.107999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:51.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108371+0000","last_change":"2023-10-07T00:11:13.850567+0000","last_active":"2023-10-07T00:11:15.108371+0000","last_peered":"2023-10-07T00:11:15.108371+0000","last_clean":"2023-10-07T00:11:15.108371+0000","last_became_active":"2023-10-07T00:11:13.850212+0000","last_became_peered":"2023-10-07T00:11:13.850212+0000","last_unstale":"2023-10-07T00:11:15.108371+0000","last_undegraded":"2023-10-07T00:11:15.108371+0000","last_fullsized":"2023-10-07T00:11:15.108371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:51.539752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819587+0000","last_change":"2023-10-07T00:11:13.839742+0000","last_active":"2023-10-07T00:11:14.819587+0000","last_peered":"2023-10-07T00:11:14.819587+0000","last_clean":"2023-10-07T00:11:14.819587+0000","last_became_active":"2023-10-07T00:11:13.839041+0000","last_became_peered":"2023-10-07T00:11:13.839041+0000","last_unstale":"2023-10-07T00:11:14.819587+0000","last_undegraded":"2023-10-07T00:11:14.819587+0000","last_fullsized":"2023-10-07T00:11:14.819587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:59.241248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819492+0000","last_change":"2023-10-07T00:11:13.834839+0000","last_active":"2023-10-07T00:11:14.819492+0000","last_peered":"2023-10-07T00:11:14.819492+0000","last_clean":"2023-10-07T00:11:14.819492+0000","last_became_active":"2023-10-07T00:11:13.834529+0000","last_became_peered":"2023-10-07T00:11:13.834529+0000","last_unstale":"2023-10-07T00:11:14.819492+0000","last_undegraded":"2023-10-07T00:11:14.819492+0000","last_fullsized":"2023-10-07T00:11:14.819492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:23.831424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107576+0000","last_change":"2023-10-07T00:11:13.835102+0000","last_active":"2023-10-07T00:11:15.107576+0000","last_peered":"2023-10-07T00:11:15.107576+0000","last_clean":"2023-10-07T00:11:15.107576+0000","last_became_active":"2023-10-07T00:11:13.834781+0000","last_became_peered":"2023-10-07T00:11:13.834781+0000","last_unstale":"2023-10-07T00:11:15.107576+0000","last_undegraded":"2023-10-07T00:11:15.107576+0000","last_fullsized":"2023-10-07T00:11:15.107576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:16:55.912464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108827+0000","last_change":"2023-10-07T00:11:13.840222+0000","last_active":"2023-10-07T00:11:15.108827+0000","last_peered":"2023-10-07T00:11:15.108827+0000","last_clean":"2023-10-07T00:11:15.108827+0000","last_became_active":"2023-10-07T00:11:13.839910+0000","last_became_peered":"2023-10-07T00:11:13.839910+0000","last_unstale":"2023-10-07T00:11:15.108827+0000","last_undegraded":"2023-10-07T00:11:15.108827+0000","last_fullsized":"2023-10-07T00:11:15.108827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:20:19.476394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.818903+0000","last_change":"2023-10-07T00:11:13.842772+0000","last_active":"2023-10-07T00:11:14.818903+0000","last_peered":"2023-10-07T00:11:14.818903+0000","last_clean":"2023-10-07T00:11:14.818903+0000","last_became_active":"2023-10-07T00:11:13.841610+0000","last_became_peered":"2023-10-07T00:11:13.841610+0000","last_unstale":"2023-10-07T00:11:14.818903+0000","last_undegraded":"2023-10-07T00:11:14.818903+0000","last_fullsized":"2023-10-07T00:11:14.818903+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:04:51.988705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107759+0000","last_change":"2023-10-07T00:11:13.836990+0000","last_active":"2023-10-07T00:11:15.107759+0000","last_peered":"2023-10-07T00:11:15.107759+0000","last_clean":"2023-10-07T00:11:15.107759+0000","last_became_active":"2023-10-07T00:11:13.836699+0000","last_became_peered":"2023-10-07T00:11:13.836699+0000","last_unstale":"2023-10-07T00:11:15.107759+0000","last_undegraded":"2023-10-07T00:11:15.107759+0000","last_fullsized":"2023-10-07T00:11:15.107759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:18:20.450573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108016+0000","last_change":"2023-10-07T00:11:13.832127+0000","last_active":"2023-10-07T00:11:15.108016+0000","last_peered":"2023-10-07T00:11:15.108016+0000","last_clean":"2023-10-07T00:11:15.108016+0000","last_became_active":"2023-10-07T00:11:13.831661+0000","last_became_peered":"2023-10-07T00:11:13.831661+0000","last_unstale":"2023-10-07T00:11:15.108016+0000","last_undegraded":"2023-10-07T00:11:15.108016+0000","last_fullsized":"2023-10-07T00:11:15.108016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:53:21.665541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108668+0000","last_change":"2023-10-07T00:11:13.841699+0000","last_active":"2023-10-07T00:11:15.108668+0000","last_peered":"2023-10-07T00:11:15.108668+0000","last_clean":"2023-10-07T00:11:15.108668+0000","last_became_active":"2023-10-07T00:11:13.841295+0000","last_became_peered":"2023-10-07T00:11:13.841295+0000","last_unstale":"2023-10-07T00:11:15.108668+0000","last_undegraded":"2023-10-07T00:11:15.108668+0000","last_fullsized":"2023-10-07T00:11:15.108668+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:24:56.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819565+0000","last_change":"2023-10-07T00:11:13.839951+0000","last_active":"2023-10-07T00:11:14.819565+0000","last_peered":"2023-10-07T00:11:14.819565+0000","last_clean":"2023-10-07T00:11:14.819565+0000","last_became_active":"2023-10-07T00:11:13.839473+0000","last_became_peered":"2023-10-07T00:11:13.839473+0000","last_unstale":"2023-10-07T00:11:14.819565+0000","last_undegraded":"2023-10-07T00:11:14.819565+0000","last_fullsized":"2023-10-07T00:11:14.819565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108547+0000","last_change":"2023-10-07T00:11:13.838714+0000","last_active":"2023-10-07T00:11:15.108547+0000","last_peered":"2023-10-07T00:11:15.108547+0000","last_clean":"2023-10-07T00:11:15.108547+0000","last_became_active":"2023-10-07T00:11:13.838222+0000","last_became_peered":"2023-10-07T00:11:13.838222+0000","last_unstale":"2023-10-07T00:11:15.108547+0000","last_undegraded":"2023-10-07T00:11:15.108547+0000","last_fullsized":"2023-10-07T00:11:15.108547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:11:43.194204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108769+0000","last_change":"2023-10-07T00:11:13.843075+0000","last_active":"2023-10-07T00:11:15.108769+0000","last_peered":"2023-10-07T00:11:15.108769+0000","last_clean":"2023-10-07T00:11:15.108769+0000","last_became_active":"2023-10-07T00:11:13.842742+0000","last_became_peered":"2023-10-07T00:11:13.842742+0000","last_unstale":"2023-10-07T00:11:15.108769+0000","last_undegraded":"2023-10-07T00:11:15.108769+0000","last_fullsized":"2023-10-07T00:11:15.108769+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:53:12.713979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108339+0000","last_change":"2023-10-07T00:11:13.841635+0000","last_active":"2023-10-07T00:11:15.108339+0000","last_peered":"2023-10-07T00:11:15.108339+0000","last_clean":"2023-10-07T00:11:15.108339+0000","last_became_active":"2023-10-07T00:11:13.841291+0000","last_became_peered":"2023-10-07T00:11:13.841291+0000","last_unstale":"2023-10-07T00:11:15.108339+0000","last_undegraded":"2023-10-07T00:11:15.108339+0000","last_fullsized":"2023-10-07T00:11:15.108339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:48:38.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107086+0000","last_change":"2023-10-07T00:11:13.842365+0000","last_active":"2023-10-07T00:11:15.107086+0000","last_peered":"2023-10-07T00:11:15.107086+0000","last_clean":"2023-10-07T00:11:15.107086+0000","last_became_active":"2023-10-07T00:11:13.842057+0000","last_became_peered":"2023-10-07T00:11:13.842057+0000","last_unstale":"2023-10-07T00:11:15.107086+0000","last_undegraded":"2023-10-07T00:11:15.107086+0000","last_fullsized":"2023-10-07T00:11:15.107086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:36.575712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107943+0000","last_change":"2023-10-07T00:11:13.845746+0000","last_active":"2023-10-07T00:11:15.107943+0000","last_peered":"2023-10-07T00:11:15.107943+0000","last_clean":"2023-10-07T00:11:15.107943+0000","last_became_active":"2023-10-07T00:11:13.844828+0000","last_became_peered":"2023-10-07T00:11:13.844828+0000","last_unstale":"2023-10-07T00:11:15.107943+0000","last_undegraded":"2023-10-07T00:11:15.107943+0000","last_fullsized":"2023-10-07T00:11:15.107943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:34:00.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.109954+0000","last_change":"2023-10-07T00:11:13.837749+0000","last_active":"2023-10-07T00:11:15.109954+0000","last_peered":"2023-10-07T00:11:15.109954+0000","last_clean":"2023-10-07T00:11:15.109954+0000","last_became_active":"2023-10-07T00:11:13.837400+0000","last_became_peered":"2023-10-07T00:11:13.837400+0000","last_unstale":"2023-10-07T00:11:15.109954+0000","last_undegraded":"2023-10-07T00:11:15.109954+0000","last_fullsized":"2023-10-07T00:11:15.109954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:40.190065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.958722+0000","last_change":"2023-10-07T00:11:13.833086+0000","last_active":"2023-10-07T00:11:14.958722+0000","last_peered":"2023-10-07T00:11:14.958722+0000","last_clean":"2023-10-07T00:11:14.958722+0000","last_became_active":"2023-10-07T00:11:13.832748+0000","last_became_peered":"2023-10-07T00:11:13.832748+0000","last_unstale":"2023-10-07T00:11:14.958722+0000","last_undegraded":"2023-10-07T00:11:14.958722+0000","last_fullsized":"2023-10-07T00:11:14.958722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:29.176224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.341056+0000","last_change":"2023-10-07T00:11:12.835440+0000","last_active":"2023-10-07T00:11:18.341056+0000","last_peered":"2023-10-07T00:11:18.341056+0000","last_clean":"2023-10-07T00:11:18.341056+0000","last_became_active":"2023-10-07T00:11:12.835094+0000","last_became_peered":"2023-10-07T00:11:12.835094+0000","last_unstale":"2023-10-07T00:11:18.341056+0000","last_undegraded":"2023-10-07T00:11:18.341056+0000","last_fullsized":"2023-10-07T00:11:18.341056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:13.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819293+0000","last_change":"2023-10-07T00:11:13.847832+0000","last_active":"2023-10-07T00:11:14.819293+0000","last_peered":"2023-10-07T00:11:14.819293+0000","last_clean":"2023-10-07T00:11:14.819293+0000","last_became_active":"2023-10-07T00:11:13.847436+0000","last_became_peered":"2023-10-07T00:11:13.847436+0000","last_unstale":"2023-10-07T00:11:14.819293+0000","last_undegraded":"2023-10-07T00:11:14.819293+0000","last_fullsized":"2023-10-07T00:11:14.819293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:47:07.409132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:13.860431+0000","last_change":"2023-10-07T00:11:12.842832+0000","last_active":"2023-10-07T00:11:13.860431+0000","last_peered":"2023-10-07T00:11:13.860431+0000","last_clean":"2023-10-07T00:11:13.860431+0000","last_became_active":"2023-10-07T00:11:12.842296+0000","last_became_peered":"2023-10-07T00:11:12.842296+0000","last_unstale":"2023-10-07T00:11:13.860431+0000","last_undegraded":"2023-10-07T00:11:13.860431+0000","last_fullsized":"2023-10-07T00:11:13.860431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:00.968303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108812+0000","last_change":"2023-10-07T00:11:13.851259+0000","last_active":"2023-10-07T00:11:15.108812+0000","last_peered":"2023-10-07T00:11:15.108812+0000","last_clean":"2023-10-07T00:11:15.108812+0000","last_became_active":"2023-10-07T00:11:13.850963+0000","last_became_peered":"2023-10-07T00:11:13.850963+0000","last_unstale":"2023-10-07T00:11:15.108812+0000","last_undegraded":"2023-10-07T00:11:15.108812+0000","last_fullsized":"2023-10-07T00:11:15.108812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:52.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.338857+0000","last_change":"2023-10-07T00:11:12.835286+0000","last_active":"2023-10-07T00:11:18.338857+0000","last_peered":"2023-10-07T00:11:18.338857+0000","last_clean":"2023-10-07T00:11:18.338857+0000","last_became_active":"2023-10-07T00:11:12.834890+0000","last_became_peered":"2023-10-07T00:11:12.834890+0000","last_unstale":"2023-10-07T00:11:18.338857+0000","last_undegraded":"2023-10-07T00:11:18.338857+0000","last_fullsized":"2023-10-07T00:11:18.338857+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:06:05.225849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107407+0000","last_change":"2023-10-07T00:11:13.831174+0000","last_active":"2023-10-07T00:11:15.107407+0000","last_peered":"2023-10-07T00:11:15.107407+0000","last_clean":"2023-10-07T00:11:15.107407+0000","last_became_active":"2023-10-07T00:11:13.830868+0000","last_became_peered":"2023-10-07T00:11:13.830868+0000","last_unstale":"2023-10-07T00:11:15.107407+0000","last_undegraded":"2023-10-07T00:11:15.107407+0000","last_fullsized":"2023-10-07T00:11:15.107407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:20.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:13.860451+0000","last_change":"2023-10-07T00:11:12.835740+0000","last_active":"2023-10-07T00:11:13.860451+0000","last_peered":"2023-10-07T00:11:13.860451+0000","last_clean":"2023-10-07T00:11:13.860451+0000","last_became_active":"2023-10-07T00:11:12.835035+0000","last_became_peered":"2023-10-07T00:11:12.835035+0000","last_unstale":"2023-10-07T00:11:13.860451+0000","last_undegraded":"2023-10-07T00:11:13.860451+0000","last_fullsized":"2023-10-07T00:11:13.860451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:36:07.447748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854991+0000","last_change":"2023-10-07T00:11:13.847940+0000","last_active":"2023-10-07T00:11:14.854991+0000","last_peered":"2023-10-07T00:11:14.854991+0000","last_clean":"2023-10-07T00:11:14.854991+0000","last_became_active":"2023-10-07T00:11:13.847595+0000","last_became_peered":"2023-10-07T00:11:13.847595+0000","last_unstale":"2023-10-07T00:11:14.854991+0000","last_undegraded":"2023-10-07T00:11:14.854991+0000","last_fullsized":"2023-10-07T00:11:14.854991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:28.004429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.649674+0000","last_change":"2023-10-07T00:11:12.834885+0000","last_active":"2023-10-07T00:11:19.649674+0000","last_peered":"2023-10-07T00:11:19.649674+0000","last_clean":"2023-10-07T00:11:19.649674+0000","last_became_active":"2023-10-07T00:11:12.834542+0000","last_became_peered":"2023-10-07T00:11:12.834542+0000","last_unstale":"2023-10-07T00:11:19.649674+0000","last_undegraded":"2023-10-07T00:11:19.649674+0000","last_fullsized":"2023-10-07T00:11:19.649674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:28:10.495978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819468+0000","last_change":"2023-10-07T00:11:13.838732+0000","last_active":"2023-10-07T00:11:14.819468+0000","last_peered":"2023-10-07T00:11:14.819468+0000","last_clean":"2023-10-07T00:11:14.819468+0000","last_became_active":"2023-10-07T00:11:13.838408+0000","last_became_peered":"2023-10-07T00:11:13.838408+0000","last_unstale":"2023-10-07T00:11:14.819468+0000","last_undegraded":"2023-10-07T00:11:14.819468+0000","last_fullsized":"2023-10-07T00:11:14.819468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:55:55.039399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.346748+0000","last_change":"2023-10-07T00:11:12.831778+0000","last_active":"2023-10-07T00:11:19.346748+0000","last_peered":"2023-10-07T00:11:19.346748+0000","last_clean":"2023-10-07T00:11:19.346748+0000","last_became_active":"2023-10-07T00:11:12.831479+0000","last_became_peered":"2023-10-07T00:11:12.831479+0000","last_unstale":"2023-10-07T00:11:19.346748+0000","last_undegraded":"2023-10-07T00:11:19.346748+0000","last_fullsized":"2023-10-07T00:11:19.346748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:12:57.994585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854806+0000","last_change":"2023-10-07T00:11:13.843341+0000","last_active":"2023-10-07T00:11:14.854806+0000","last_peered":"2023-10-07T00:11:14.854806+0000","last_clean":"2023-10-07T00:11:14.854806+0000","last_became_active":"2023-10-07T00:11:13.843017+0000","last_became_peered":"2023-10-07T00:11:13.843017+0000","last_unstale":"2023-10-07T00:11:14.854806+0000","last_undegraded":"2023-10-07T00:11:14.854806+0000","last_fullsized":"2023-10-07T00:11:14.854806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:09.595934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107809+0000","last_change":"2023-10-07T00:11:12.825556+0000","last_active":"2023-10-07T00:11:15.107809+0000","last_peered":"2023-10-07T00:11:15.107809+0000","last_clean":"2023-10-07T00:11:15.107809+0000","last_became_active":"2023-10-07T00:11:12.825189+0000","last_became_peered":"2023-10-07T00:11:12.825189+0000","last_unstale":"2023-10-07T00:11:15.107809+0000","last_undegraded":"2023-10-07T00:11:15.107809+0000","last_fullsized":"2023-10-07T00:11:15.107809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:20:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.818848+0000","last_change":"2023-10-07T00:11:13.843111+0000","last_active":"2023-10-07T00:11:14.818848+0000","last_peered":"2023-10-07T00:11:14.818848+0000","last_clean":"2023-10-07T00:11:14.818848+0000","last_became_active":"2023-10-07T00:11:13.842277+0000","last_became_peered":"2023-10-07T00:11:13.842277+0000","last_unstale":"2023-10-07T00:11:14.818848+0000","last_undegraded":"2023-10-07T00:11:14.818848+0000","last_fullsized":"2023-10-07T00:11:14.818848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:40.869037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.651827+0000","last_change":"2023-10-07T00:11:12.835239+0000","last_active":"2023-10-07T00:11:19.651827+0000","last_peered":"2023-10-07T00:11:19.651827+0000","last_clean":"2023-10-07T00:11:19.651827+0000","last_became_active":"2023-10-07T00:11:12.834912+0000","last_became_peered":"2023-10-07T00:11:12.834912+0000","last_unstale":"2023-10-07T00:11:19.651827+0000","last_undegraded":"2023-10-07T00:11:19.651827+0000","last_fullsized":"2023-10-07T00:11:19.651827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:32:44.097208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.109764+0000","last_change":"2023-10-07T00:11:13.837642+0000","last_active":"2023-10-07T00:11:15.109764+0000","last_peered":"2023-10-07T00:11:15.109764+0000","last_clean":"2023-10-07T00:11:15.109764+0000","last_became_active":"2023-10-07T00:11:13.837291+0000","last_became_peered":"2023-10-07T00:11:13.837291+0000","last_unstale":"2023-10-07T00:11:15.109764+0000","last_undegraded":"2023-10-07T00:11:15.109764+0000","last_fullsized":"2023-10-07T00:11:15.109764+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:19:14.445816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.648094+0000","last_change":"2023-10-07T00:11:12.826373+0000","last_active":"2023-10-07T00:11:19.648094+0000","last_peered":"2023-10-07T00:11:19.648094+0000","last_clean":"2023-10-07T00:11:19.648094+0000","last_became_active":"2023-10-07T00:11:12.826017+0000","last_became_peered":"2023-10-07T00:11:12.826017+0000","last_unstale":"2023-10-07T00:11:19.648094+0000","last_undegraded":"2023-10-07T00:11:19.648094+0000","last_fullsized":"2023-10-07T00:11:19.648094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:52:03.101632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108185+0000","last_change":"2023-10-07T00:11:13.830879+0000","last_active":"2023-10-07T00:11:15.108185+0000","last_peered":"2023-10-07T00:11:15.108185+0000","last_clean":"2023-10-07T00:11:15.108185+0000","last_became_active":"2023-10-07T00:11:13.830571+0000","last_became_peered":"2023-10-07T00:11:13.830571+0000","last_unstale":"2023-10-07T00:11:15.108185+0000","last_undegraded":"2023-10-07T00:11:15.108185+0000","last_fullsized":"2023-10-07T00:11:15.108185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:36.703499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108422+0000","last_change":"2023-10-07T00:11:12.833952+0000","last_active":"2023-10-07T00:11:15.108422+0000","last_peered":"2023-10-07T00:11:15.108422+0000","last_clean":"2023-10-07T00:11:15.108422+0000","last_became_active":"2023-10-07T00:11:12.833545+0000","last_became_peered":"2023-10-07T00:11:12.833545+0000","last_unstale":"2023-10-07T00:11:15.108422+0000","last_undegraded":"2023-10-07T00:11:15.108422+0000","last_fullsized":"2023-10-07T00:11:15.108422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:28:12.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108685+0000","last_change":"2023-10-07T00:11:13.843758+0000","last_active":"2023-10-07T00:11:15.108685+0000","last_peered":"2023-10-07T00:11:15.108685+0000","last_clean":"2023-10-07T00:11:15.108685+0000","last_became_active":"2023-10-07T00:11:13.843443+0000","last_became_peered":"2023-10-07T00:11:13.843443+0000","last_unstale":"2023-10-07T00:11:15.108685+0000","last_undegraded":"2023-10-07T00:11:15.108685+0000","last_fullsized":"2023-10-07T00:11:15.108685+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:07:28.610304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.346920+0000","last_change":"2023-10-07T00:11:12.833043+0000","last_active":"2023-10-07T00:11:19.346920+0000","last_peered":"2023-10-07T00:11:19.346920+0000","last_clean":"2023-10-07T00:11:19.346920+0000","last_became_active":"2023-10-07T00:11:12.832632+0000","last_became_peered":"2023-10-07T00:11:12.832632+0000","last_unstale":"2023-10-07T00:11:19.346920+0000","last_undegraded":"2023-10-07T00:11:19.346920+0000","last_fullsized":"2023-10-07T00:11:19.346920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:14:25.148603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107626+0000","last_change":"2023-10-07T00:11:13.831129+0000","last_active":"2023-10-07T00:11:15.107626+0000","last_peered":"2023-10-07T00:11:15.107626+0000","last_clean":"2023-10-07T00:11:15.107626+0000","last_became_active":"2023-10-07T00:11:13.830365+0000","last_became_peered":"2023-10-07T00:11:13.830365+0000","last_unstale":"2023-10-07T00:11:15.107626+0000","last_undegraded":"2023-10-07T00:11:15.107626+0000","last_fullsized":"2023-10-07T00:11:15.107626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:22:00.580441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'16","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.882928+0000","last_change":"2023-10-07T00:11:12.834426+0000","last_active":"2023-10-07T00:11:19.882928+0000","last_peered":"2023-10-07T00:11:19.882928+0000","last_clean":"2023-10-07T00:11:19.882928+0000","last_became_active":"2023-10-07T00:11:12.834097+0000","last_became_peered":"2023-10-07T00:11:12.834097+0000","last_unstale":"2023-10-07T00:11:19.882928+0000","last_undegraded":"2023-10-07T00:11:19.882928+0000","last_fullsized":"2023-10-07T00:11:19.882928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:17:36.511377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18977,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819762+0000","last_change":"2023-10-07T00:11:13.832332+0000","last_active":"2023-10-07T00:11:14.819762+0000","last_peered":"2023-10-07T00:11:14.819762+0000","last_clean":"2023-10-07T00:11:14.819762+0000","last_became_active":"2023-10-07T00:11:13.832000+0000","last_became_peered":"2023-10-07T00:11:13.832000+0000","last_unstale":"2023-10-07T00:11:14.819762+0000","last_undegraded":"2023-10-07T00:11:14.819762+0000","last_fullsized":"2023-10-07T00:11:14.819762+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:39.913331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.656354+0000","last_change":"2023-10-07T00:11:12.839399+0000","last_active":"2023-10-07T00:11:19.656354+0000","last_peered":"2023-10-07T00:11:19.656354+0000","last_clean":"2023-10-07T00:11:19.656354+0000","last_became_active":"2023-10-07T00:11:12.838997+0000","last_became_peered":"2023-10-07T00:11:12.838997+0000","last_unstale":"2023-10-07T00:11:19.656354+0000","last_undegraded":"2023-10-07T00:11:19.656354+0000","last_fullsized":"2023-10-07T00:11:19.656354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:11.194224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107894+0000","last_change":"2023-10-07T00:11:13.830832+0000","last_active":"2023-10-07T00:11:15.107894+0000","last_peered":"2023-10-07T00:11:15.107894+0000","last_clean":"2023-10-07T00:11:15.107894+0000","last_became_active":"2023-10-07T00:11:13.830373+0000","last_became_peered":"2023-10-07T00:11:13.830373+0000","last_unstale":"2023-10-07T00:11:15.107894+0000","last_undegraded":"2023-10-07T00:11:15.107894+0000","last_fullsized":"2023-10-07T00:11:15.107894+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:08.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.346111+0000","last_change":"2023-10-07T00:11:12.834543+0000","last_active":"2023-10-07T00:11:19.346111+0000","last_peered":"2023-10-07T00:11:19.346111+0000","last_clean":"2023-10-07T00:11:19.346111+0000","last_became_active":"2023-10-07T00:11:12.834213+0000","last_became_peered":"2023-10-07T00:11:12.834213+0000","last_unstale":"2023-10-07T00:11:19.346111+0000","last_undegraded":"2023-10-07T00:11:19.346111+0000","last_fullsized":"2023-10-07T00:11:19.346111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:57:35.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108494+0000","last_change":"2023-10-07T00:11:13.830645+0000","last_active":"2023-10-07T00:11:15.108494+0000","last_peered":"2023-10-07T00:11:15.108494+0000","last_clean":"2023-10-07T00:11:15.108494+0000","last_became_active":"2023-10-07T00:11:13.830331+0000","last_became_peered":"2023-10-07T00:11:13.830331+0000","last_unstale":"2023-10-07T00:11:15.108494+0000","last_undegraded":"2023-10-07T00:11:15.108494+0000","last_fullsized":"2023-10-07T00:11:15.108494+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:19:55.226177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.650867+0000","last_change":"2023-10-07T00:11:12.830062+0000","last_active":"2023-10-07T00:11:19.650867+0000","last_peered":"2023-10-07T00:11:19.650867+0000","last_clean":"2023-10-07T00:11:19.650867+0000","last_became_active":"2023-10-07T00:11:12.829734+0000","last_became_peered":"2023-10-07T00:11:12.829734+0000","last_unstale":"2023-10-07T00:11:19.650867+0000","last_undegraded":"2023-10-07T00:11:19.650867+0000","last_fullsized":"2023-10-07T00:11:19.650867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:59.658154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107927+0000","last_change":"2023-10-07T00:11:13.840915+0000","last_active":"2023-10-07T00:11:15.107927+0000","last_peered":"2023-10-07T00:11:15.107927+0000","last_clean":"2023-10-07T00:11:15.107927+0000","last_became_active":"2023-10-07T00:11:13.840584+0000","last_became_peered":"2023-10-07T00:11:13.840584+0000","last_unstale":"2023-10-07T00:11:15.107927+0000","last_undegraded":"2023-10-07T00:11:15.107927+0000","last_fullsized":"2023-10-07T00:11:15.107927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:27:58.672800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.340131+0000","last_change":"2023-10-07T00:11:12.829034+0000","last_active":"2023-10-07T00:11:18.340131+0000","last_peered":"2023-10-07T00:11:18.340131+0000","last_clean":"2023-10-07T00:11:18.340131+0000","last_became_active":"2023-10-07T00:11:12.828671+0000","last_became_peered":"2023-10-07T00:11:12.828671+0000","last_unstale":"2023-10-07T00:11:18.340131+0000","last_undegraded":"2023-10-07T00:11:18.340131+0000","last_fullsized":"2023-10-07T00:11:18.340131+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:09:14.203804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854758+0000","last_change":"2023-10-07T00:11:13.843029+0000","last_active":"2023-10-07T00:11:14.854758+0000","last_peered":"2023-10-07T00:11:14.854758+0000","last_clean":"2023-10-07T00:11:14.854758+0000","last_became_active":"2023-10-07T00:11:13.842714+0000","last_became_peered":"2023-10-07T00:11:13.842714+0000","last_unstale":"2023-10-07T00:11:14.854758+0000","last_undegraded":"2023-10-07T00:11:14.854758+0000","last_fullsized":"2023-10-07T00:11:14.854758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:46.147059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:13.858184+0000","last_change":"2023-10-07T00:11:12.830887+0000","last_active":"2023-10-07T00:11:13.858184+0000","last_peered":"2023-10-07T00:11:13.858184+0000","last_clean":"2023-10-07T00:11:13.858184+0000","last_became_active":"2023-10-07T00:11:12.830500+0000","last_became_peered":"2023-10-07T00:11:12.830500+0000","last_unstale":"2023-10-07T00:11:13.858184+0000","last_undegraded":"2023-10-07T00:11:13.858184+0000","last_fullsized":"2023-10-07T00:11:13.858184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:39.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107838+0000","last_change":"2023-10-07T00:11:13.838823+0000","last_active":"2023-10-07T00:11:15.107838+0000","last_peered":"2023-10-07T00:11:15.107838+0000","last_clean":"2023-10-07T00:11:15.107838+0000","last_became_active":"2023-10-07T00:11:13.838491+0000","last_became_peered":"2023-10-07T00:11:13.838491+0000","last_unstale":"2023-10-07T00:11:15.107838+0000","last_undegraded":"2023-10-07T00:11:15.107838+0000","last_fullsized":"2023-10-07T00:11:15.107838+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:29:31.340686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.149966+0000","last_change":"2023-10-07T00:11:12.838303+0000","last_active":"2023-10-07T00:11:14.149966+0000","last_peered":"2023-10-07T00:11:14.149966+0000","last_clean":"2023-10-07T00:11:14.149966+0000","last_became_active":"2023-10-07T00:11:12.837891+0000","last_became_peered":"2023-10-07T00:11:12.837891+0000","last_unstale":"2023-10-07T00:11:14.149966+0000","last_undegraded":"2023-10-07T00:11:14.149966+0000","last_fullsized":"2023-10-07T00:11:14.149966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:56.957653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.363318+0000","last_change":"2023-10-07T00:11:13.840109+0000","last_active":"2023-10-07T00:11:15.363318+0000","last_peered":"2023-10-07T00:11:15.363318+0000","last_clean":"2023-10-07T00:11:15.363318+0000","last_became_active":"2023-10-07T00:11:13.839767+0000","last_became_peered":"2023-10-07T00:11:13.839767+0000","last_unstale":"2023-10-07T00:11:15.363318+0000","last_undegraded":"2023-10-07T00:11:15.363318+0000","last_fullsized":"2023-10-07T00:11:15.363318+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:24.236839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108337+0000","last_change":"2023-10-07T00:11:12.837365+0000","last_active":"2023-10-07T00:11:15.108337+0000","last_peered":"2023-10-07T00:11:15.108337+0000","last_clean":"2023-10-07T00:11:15.108337+0000","last_became_active":"2023-10-07T00:11:12.836992+0000","last_became_peered":"2023-10-07T00:11:12.836992+0000","last_unstale":"2023-10-07T00:11:15.108337+0000","last_undegraded":"2023-10-07T00:11:15.108337+0000","last_fullsized":"2023-10-07T00:11:15.108337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:24:09.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107864+0000","last_change":"2023-10-07T00:11:13.851151+0000","last_active":"2023-10-07T00:11:15.107864+0000","last_peered":"2023-10-07T00:11:15.107864+0000","last_clean":"2023-10-07T00:11:15.107864+0000","last_became_active":"2023-10-07T00:11:13.850807+0000","last_became_peered":"2023-10-07T00:11:13.850807+0000","last_unstale":"2023-10-07T00:11:15.107864+0000","last_undegraded":"2023-10-07T00:11:15.107864+0000","last_fullsized":"2023-10-07T00:11:15.107864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:17:42.857720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854870+0000","last_change":"2023-10-07T00:11:13.844143+0000","last_active":"2023-10-07T00:11:14.854870+0000","last_peered":"2023-10-07T00:11:14.854870+0000","last_clean":"2023-10-07T00:11:14.854870+0000","last_became_active":"2023-10-07T00:11:13.843633+0000","last_became_peered":"2023-10-07T00:11:13.843633+0000","last_unstale":"2023-10-07T00:11:14.854870+0000","last_undegraded":"2023-10-07T00:11:14.854870+0000","last_fullsized":"2023-10-07T00:11:14.854870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:42:20.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107714+0000","last_change":"2023-10-07T00:11:12.836076+0000","last_active":"2023-10-07T00:11:15.107714+0000","last_peered":"2023-10-07T00:11:15.107714+0000","last_clean":"2023-10-07T00:11:15.107714+0000","last_became_active":"2023-10-07T00:11:12.835709+0000","last_became_peered":"2023-10-07T00:11:12.835709+0000","last_unstale":"2023-10-07T00:11:15.107714+0000","last_undegraded":"2023-10-07T00:11:15.107714+0000","last_fullsized":"2023-10-07T00:11:15.107714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.096103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819194+0000","last_change":"2023-10-07T00:11:13.844429+0000","last_active":"2023-10-07T00:11:14.819194+0000","last_peered":"2023-10-07T00:11:14.819194+0000","last_clean":"2023-10-07T00:11:14.819194+0000","last_became_active":"2023-10-07T00:11:13.844075+0000","last_became_peered":"2023-10-07T00:11:13.844075+0000","last_unstale":"2023-10-07T00:11:14.819194+0000","last_undegraded":"2023-10-07T00:11:14.819194+0000","last_fullsized":"2023-10-07T00:11:14.819194+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:01:05.832929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.644947+0000","last_change":"2023-10-07T00:11:12.839717+0000","last_active":"2023-10-07T00:11:19.644947+0000","last_peered":"2023-10-07T00:11:19.644947+0000","last_clean":"2023-10-07T00:11:19.644947+0000","last_became_active":"2023-10-07T00:11:12.839287+0000","last_became_peered":"2023-10-07T00:11:12.839287+0000","last_unstale":"2023-10-07T00:11:19.644947+0000","last_undegraded":"2023-10-07T00:11:19.644947+0000","last_fullsized":"2023-10-07T00:11:19.644947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:11.170207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":311,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:13.825106+0000","last_change":"2023-10-07T00:09:53.652919+0000","last_active":"2023-10-07T00:11:13.825106+0000","last_peered":"2023-10-07T00:11:13.825106+0000","last_clean":"2023-10-07T00:11:13.825106+0000","last_became_active":"2023-10-07T00:09:53.652407+0000","last_became_peered":"2023-10-07T00:09:53.652407+0000","last_unstale":"2023-10-07T00:11:13.825106+0000","last_undegraded":"2023-10-07T00:11:13.825106+0000","last_fullsized":"2023-10-07T00:11:13.825106+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_clean_scrub_stamp":"2023-10-07T00:06:22.557862+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:33:55.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107614+0000","last_change":"2023-10-07T00:11:13.830797+0000","last_active":"2023-10-07T00:11:15.107614+0000","last_peered":"2023-10-07T00:11:15.107614+0000","last_clean":"2023-10-07T00:11:15.107614+0000","last_became_active":"2023-10-07T00:11:13.830467+0000","last_became_peered":"2023-10-07T00:11:13.830467+0000","last_unstale":"2023-10-07T00:11:15.107614+0000","last_undegraded":"2023-10-07T00:11:15.107614+0000","last_fullsized":"2023-10-07T00:11:15.107614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:48.545184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108157+0000","last_change":"2023-10-07T00:11:12.836000+0000","last_active":"2023-10-07T00:11:15.108157+0000","last_peered":"2023-10-07T00:11:15.108157+0000","last_clean":"2023-10-07T00:11:15.108157+0000","last_became_active":"2023-10-07T00:11:12.835588+0000","last_became_peered":"2023-10-07T00:11:12.835588+0000","last_unstale":"2023-10-07T00:11:15.108157+0000","last_undegraded":"2023-10-07T00:11:15.108157+0000","last_fullsized":"2023-10-07T00:11:15.108157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:55:54.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819821+0000","last_change":"2023-10-07T00:11:12.832622+0000","last_active":"2023-10-07T00:11:14.819821+0000","last_peered":"2023-10-07T00:11:14.819821+0000","last_clean":"2023-10-07T00:11:14.819821+0000","last_became_active":"2023-10-07T00:11:12.832215+0000","last_became_peered":"2023-10-07T00:11:12.832215+0000","last_unstale":"2023-10-07T00:11:14.819821+0000","last_undegraded":"2023-10-07T00:11:14.819821+0000","last_fullsized":"2023-10-07T00:11:14.819821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:35.867540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108577+0000","last_change":"2023-10-07T00:11:13.828373+0000","last_active":"2023-10-07T00:11:15.108577+0000","last_peered":"2023-10-07T00:11:15.108577+0000","last_clean":"2023-10-07T00:11:15.108577+0000","last_became_active":"2023-10-07T00:11:13.827999+0000","last_became_peered":"2023-10-07T00:11:13.827999+0000","last_unstale":"2023-10-07T00:11:15.108577+0000","last_undegraded":"2023-10-07T00:11:15.108577+0000","last_fullsized":"2023-10-07T00:11:15.108577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:43.551348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.340724+0000","last_change":"2023-10-07T00:11:12.840166+0000","last_active":"2023-10-07T00:11:18.340724+0000","last_peered":"2023-10-07T00:11:18.340724+0000","last_clean":"2023-10-07T00:11:18.340724+0000","last_became_active":"2023-10-07T00:11:12.839831+0000","last_became_peered":"2023-10-07T00:11:12.839831+0000","last_unstale":"2023-10-07T00:11:18.340724+0000","last_undegraded":"2023-10-07T00:11:18.340724+0000","last_fullsized":"2023-10-07T00:11:18.340724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:47.190379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819470+0000","last_change":"2023-10-07T00:11:13.838814+0000","last_active":"2023-10-07T00:11:14.819470+0000","last_peered":"2023-10-07T00:11:14.819470+0000","last_clean":"2023-10-07T00:11:14.819470+0000","last_became_active":"2023-10-07T00:11:13.838468+0000","last_became_peered":"2023-10-07T00:11:13.838468+0000","last_unstale":"2023-10-07T00:11:14.819470+0000","last_undegraded":"2023-10-07T00:11:14.819470+0000","last_fullsized":"2023-10-07T00:11:14.819470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:29:38.944450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.654842+0000","last_change":"2023-10-07T00:11:12.837042+0000","last_active":"2023-10-07T00:11:19.654842+0000","last_peered":"2023-10-07T00:11:19.654842+0000","last_clean":"2023-10-07T00:11:19.654842+0000","last_became_active":"2023-10-07T00:11:12.836605+0000","last_became_peered":"2023-10-07T00:11:12.836605+0000","last_unstale":"2023-10-07T00:11:19.654842+0000","last_undegraded":"2023-10-07T00:11:19.654842+0000","last_fullsized":"2023-10-07T00:11:19.654842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:30:13.684063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108139+0000","last_change":"2023-10-07T00:11:13.840778+0000","last_active":"2023-10-07T00:11:15.108139+0000","last_peered":"2023-10-07T00:11:15.108139+0000","last_clean":"2023-10-07T00:11:15.108139+0000","last_became_active":"2023-10-07T00:11:13.840472+0000","last_became_peered":"2023-10-07T00:11:13.840472+0000","last_unstale":"2023-10-07T00:11:15.108139+0000","last_undegraded":"2023-10-07T00:11:15.108139+0000","last_fullsized":"2023-10-07T00:11:15.108139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:59.088416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:17.328545+0000","last_change":"2023-10-07T00:11:12.838534+0000","last_active":"2023-10-07T00:11:17.328545+0000","last_peered":"2023-10-07T00:11:17.328545+0000","last_clean":"2023-10-07T00:11:17.328545+0000","last_became_active":"2023-10-07T00:11:12.838220+0000","last_became_peered":"2023-10-07T00:11:12.838220+0000","last_unstale":"2023-10-07T00:11:17.328545+0000","last_undegraded":"2023-10-07T00:11:17.328545+0000","last_fullsized":"2023-10-07T00:11:17.328545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:16:47.170815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819290+0000","last_change":"2023-10-07T00:11:13.831506+0000","last_active":"2023-10-07T00:11:14.819290+0000","last_peered":"2023-10-07T00:11:14.819290+0000","last_clean":"2023-10-07T00:11:14.819290+0000","last_became_active":"2023-10-07T00:11:13.831093+0000","last_became_peered":"2023-10-07T00:11:13.831093+0000","last_unstale":"2023-10-07T00:11:14.819290+0000","last_undegraded":"2023-10-07T00:11:14.819290+0000","last_fullsized":"2023-10-07T00:11:14.819290+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:02.749470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:17.329623+0000","last_change":"2023-10-07T00:11:12.841662+0000","last_active":"2023-10-07T00:11:17.329623+0000","last_peered":"2023-10-07T00:11:17.329623+0000","last_clean":"2023-10-07T00:11:17.329623+0000","last_became_active":"2023-10-07T00:11:12.841207+0000","last_became_peered":"2023-10-07T00:11:12.841207+0000","last_unstale":"2023-10-07T00:11:17.329623+0000","last_undegraded":"2023-10-07T00:11:17.329623+0000","last_fullsized":"2023-10-07T00:11:17.329623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:10.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107673+0000","last_change":"2023-10-07T00:11:13.844943+0000","last_active":"2023-10-07T00:11:15.107673+0000","last_peered":"2023-10-07T00:11:15.107673+0000","last_clean":"2023-10-07T00:11:15.107673+0000","last_became_active":"2023-10-07T00:11:13.844387+0000","last_became_peered":"2023-10-07T00:11:13.844387+0000","last_unstale":"2023-10-07T00:11:15.107673+0000","last_undegraded":"2023-10-07T00:11:15.107673+0000","last_fullsized":"2023-10-07T00:11:15.107673+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:35.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.492389+0000","last_change":"2023-10-07T00:11:12.838191+0000","last_active":"2023-10-07T00:11:18.492389+0000","last_peered":"2023-10-07T00:11:18.492389+0000","last_clean":"2023-10-07T00:11:18.492389+0000","last_became_active":"2023-10-07T00:11:12.837821+0000","last_became_peered":"2023-10-07T00:11:12.837821+0000","last_unstale":"2023-10-07T00:11:18.492389+0000","last_undegraded":"2023-10-07T00:11:18.492389+0000","last_fullsized":"2023-10-07T00:11:18.492389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:16:38.519554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819280+0000","last_change":"2023-10-07T00:11:13.841478+0000","last_active":"2023-10-07T00:11:14.819280+0000","last_peered":"2023-10-07T00:11:14.819280+0000","last_clean":"2023-10-07T00:11:14.819280+0000","last_became_active":"2023-10-07T00:11:13.841085+0000","last_became_peered":"2023-10-07T00:11:13.841085+0000","last_unstale":"2023-10-07T00:11:14.819280+0000","last_undegraded":"2023-10-07T00:11:14.819280+0000","last_fullsized":"2023-10-07T00:11:14.819280+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:54:03.100980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:17.328686+0000","last_change":"2023-10-07T00:11:12.831175+0000","last_active":"2023-10-07T00:11:17.328686+0000","last_peered":"2023-10-07T00:11:17.328686+0000","last_clean":"2023-10-07T00:11:17.328686+0000","last_became_active":"2023-10-07T00:11:12.830859+0000","last_became_peered":"2023-10-07T00:11:12.830859+0000","last_unstale":"2023-10-07T00:11:17.328686+0000","last_undegraded":"2023-10-07T00:11:17.328686+0000","last_fullsized":"2023-10-07T00:11:17.328686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:07.072334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108557+0000","last_change":"2023-10-07T00:11:13.834163+0000","last_active":"2023-10-07T00:11:15.108557+0000","last_peered":"2023-10-07T00:11:15.108557+0000","last_clean":"2023-10-07T00:11:15.108557+0000","last_became_active":"2023-10-07T00:11:13.833807+0000","last_became_peered":"2023-10-07T00:11:13.833807+0000","last_unstale":"2023-10-07T00:11:15.108557+0000","last_undegraded":"2023-10-07T00:11:15.108557+0000","last_fullsized":"2023-10-07T00:11:15.108557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:12:18.606936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.656443+0000","last_change":"2023-10-07T00:11:12.835598+0000","last_active":"2023-10-07T00:11:19.656443+0000","last_peered":"2023-10-07T00:11:19.656443+0000","last_clean":"2023-10-07T00:11:19.656443+0000","last_became_active":"2023-10-07T00:11:12.835295+0000","last_became_peered":"2023-10-07T00:11:12.835295+0000","last_unstale":"2023-10-07T00:11:19.656443+0000","last_undegraded":"2023-10-07T00:11:19.656443+0000","last_fullsized":"2023-10-07T00:11:19.656443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:40:52.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108734+0000","last_change":"2023-10-07T00:11:13.837918+0000","last_active":"2023-10-07T00:11:15.108734+0000","last_peered":"2023-10-07T00:11:15.108734+0000","last_clean":"2023-10-07T00:11:15.108734+0000","last_became_active":"2023-10-07T00:11:13.834284+0000","last_became_peered":"2023-10-07T00:11:13.834284+0000","last_unstale":"2023-10-07T00:11:15.108734+0000","last_undegraded":"2023-10-07T00:11:15.108734+0000","last_fullsized":"2023-10-07T00:11:15.108734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:49:47.081395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.647775+0000","last_change":"2023-10-07T00:11:12.839362+0000","last_active":"2023-10-07T00:11:19.647775+0000","last_peered":"2023-10-07T00:11:19.647775+0000","last_clean":"2023-10-07T00:11:19.647775+0000","last_became_active":"2023-10-07T00:11:12.838902+0000","last_became_peered":"2023-10-07T00:11:12.838902+0000","last_unstale":"2023-10-07T00:11:19.647775+0000","last_undegraded":"2023-10-07T00:11:19.647775+0000","last_fullsized":"2023-10-07T00:11:19.647775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:05:34.649556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107902+0000","last_change":"2023-10-07T00:11:13.839356+0000","last_active":"2023-10-07T00:11:15.107902+0000","last_peered":"2023-10-07T00:11:15.107902+0000","last_clean":"2023-10-07T00:11:15.107902+0000","last_became_active":"2023-10-07T00:11:13.838936+0000","last_became_peered":"2023-10-07T00:11:13.838936+0000","last_unstale":"2023-10-07T00:11:15.107902+0000","last_undegraded":"2023-10-07T00:11:15.107902+0000","last_fullsized":"2023-10-07T00:11:15.107902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:02.860174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108098+0000","last_change":"2023-10-07T00:11:12.839966+0000","last_active":"2023-10-07T00:11:15.108098+0000","last_peered":"2023-10-07T00:11:15.108098+0000","last_clean":"2023-10-07T00:11:15.108098+0000","last_became_active":"2023-10-07T00:11:12.839505+0000","last_became_peered":"2023-10-07T00:11:12.839505+0000","last_unstale":"2023-10-07T00:11:15.108098+0000","last_undegraded":"2023-10-07T00:11:15.108098+0000","last_fullsized":"2023-10-07T00:11:15.108098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:45:50.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108758+0000","last_change":"2023-10-07T00:11:13.839478+0000","last_active":"2023-10-07T00:11:15.108758+0000","last_peered":"2023-10-07T00:11:15.108758+0000","last_clean":"2023-10-07T00:11:15.108758+0000","last_became_active":"2023-10-07T00:11:13.839097+0000","last_became_peered":"2023-10-07T00:11:13.839097+0000","last_unstale":"2023-10-07T00:11:15.108758+0000","last_undegraded":"2023-10-07T00:11:15.108758+0000","last_fullsized":"2023-10-07T00:11:15.108758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:55.668486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107736+0000","last_change":"2023-10-07T00:11:13.839518+0000","last_active":"2023-10-07T00:11:15.107736+0000","last_peered":"2023-10-07T00:11:15.107736+0000","last_clean":"2023-10-07T00:11:15.107736+0000","last_became_active":"2023-10-07T00:11:13.839189+0000","last_became_peered":"2023-10-07T00:11:13.839189+0000","last_unstale":"2023-10-07T00:11:15.107736+0000","last_undegraded":"2023-10-07T00:11:15.107736+0000","last_fullsized":"2023-10-07T00:11:15.107736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:30:34.647955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.958718+0000","last_change":"2023-10-07T00:11:13.835135+0000","last_active":"2023-10-07T00:11:14.958718+0000","last_peered":"2023-10-07T00:11:14.958718+0000","last_clean":"2023-10-07T00:11:14.958718+0000","last_became_active":"2023-10-07T00:11:13.834785+0000","last_became_peered":"2023-10-07T00:11:13.834785+0000","last_unstale":"2023-10-07T00:11:14.958718+0000","last_undegraded":"2023-10-07T00:11:14.958718+0000","last_fullsized":"2023-10-07T00:11:14.958718+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:00.136304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.958635+0000","last_change":"2023-10-07T00:11:13.841371+0000","last_active":"2023-10-07T00:11:14.958635+0000","last_peered":"2023-10-07T00:11:14.958635+0000","last_clean":"2023-10-07T00:11:14.958635+0000","last_became_active":"2023-10-07T00:11:13.840986+0000","last_became_peered":"2023-10-07T00:11:13.840986+0000","last_unstale":"2023-10-07T00:11:14.958635+0000","last_undegraded":"2023-10-07T00:11:14.958635+0000","last_fullsized":"2023-10-07T00:11:14.958635+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:49.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108223+0000","last_change":"2023-10-07T00:11:13.844865+0000","last_active":"2023-10-07T00:11:15.108223+0000","last_peered":"2023-10-07T00:11:15.108223+0000","last_clean":"2023-10-07T00:11:15.108223+0000","last_became_active":"2023-10-07T00:11:13.844495+0000","last_became_peered":"2023-10-07T00:11:13.844495+0000","last_unstale":"2023-10-07T00:11:15.108223+0000","last_undegraded":"2023-10-07T00:11:15.108223+0000","last_fullsized":"2023-10-07T00:11:15.108223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:00:29.862865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108736+0000","last_change":"2023-10-07T00:11:13.841126+0000","last_active":"2023-10-07T00:11:15.108736+0000","last_peered":"2023-10-07T00:11:15.108736+0000","last_clean":"2023-10-07T00:11:15.108736+0000","last_became_active":"2023-10-07T00:11:13.840748+0000","last_became_peered":"2023-10-07T00:11:13.840748+0000","last_unstale":"2023-10-07T00:11:15.108736+0000","last_undegraded":"2023-10-07T00:11:15.108736+0000","last_fullsized":"2023-10-07T00:11:15.108736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:55.444456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107855+0000","last_change":"2023-10-07T00:11:13.840320+0000","last_active":"2023-10-07T00:11:15.107855+0000","last_peered":"2023-10-07T00:11:15.107855+0000","last_clean":"2023-10-07T00:11:15.107855+0000","last_became_active":"2023-10-07T00:11:13.839993+0000","last_became_peered":"2023-10-07T00:11:13.839993+0000","last_unstale":"2023-10-07T00:11:15.107855+0000","last_undegraded":"2023-10-07T00:11:15.107855+0000","last_fullsized":"2023-10-07T00:11:15.107855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:29:39.843550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.958812+0000","last_change":"2023-10-07T00:11:13.830436+0000","last_active":"2023-10-07T00:11:14.958812+0000","last_peered":"2023-10-07T00:11:14.958812+0000","last_clean":"2023-10-07T00:11:14.958812+0000","last_became_active":"2023-10-07T00:11:13.827974+0000","last_became_peered":"2023-10-07T00:11:13.827974+0000","last_unstale":"2023-10-07T00:11:14.958812+0000","last_undegraded":"2023-10-07T00:11:14.958812+0000","last_fullsized":"2023-10-07T00:11:14.958812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:46.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819462+0000","last_change":"2023-10-07T00:11:13.833929+0000","last_active":"2023-10-07T00:11:14.819462+0000","last_peered":"2023-10-07T00:11:14.819462+0000","last_clean":"2023-10-07T00:11:14.819462+0000","last_became_active":"2023-10-07T00:11:13.833539+0000","last_became_peered":"2023-10-07T00:11:13.833539+0000","last_unstale":"2023-10-07T00:11:14.819462+0000","last_undegraded":"2023-10-07T00:11:14.819462+0000","last_fullsized":"2023-10-07T00:11:14.819462+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:46:04.981559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854656+0000","last_change":"2023-10-07T00:11:13.837959+0000","last_active":"2023-10-07T00:11:14.854656+0000","last_peered":"2023-10-07T00:11:14.854656+0000","last_clean":"2023-10-07T00:11:14.854656+0000","last_became_active":"2023-10-07T00:11:13.837650+0000","last_became_peered":"2023-10-07T00:11:13.837650+0000","last_unstale":"2023-10-07T00:11:14.854656+0000","last_undegraded":"2023-10-07T00:11:14.854656+0000","last_fullsized":"2023-10-07T00:11:14.854656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:41.068847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.818868+0000","last_change":"2023-10-07T00:11:13.847348+0000","last_active":"2023-10-07T00:11:14.818868+0000","last_peered":"2023-10-07T00:11:14.818868+0000","last_clean":"2023-10-07T00:11:14.818868+0000","last_became_active":"2023-10-07T00:11:13.846988+0000","last_became_peered":"2023-10-07T00:11:13.846988+0000","last_unstale":"2023-10-07T00:11:14.818868+0000","last_undegraded":"2023-10-07T00:11:14.818868+0000","last_fullsized":"2023-10-07T00:11:14.818868+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.960128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108199+0000","last_change":"2023-10-07T00:11:13.831801+0000","last_active":"2023-10-07T00:11:15.108199+0000","last_peered":"2023-10-07T00:11:15.108199+0000","last_clean":"2023-10-07T00:11:15.108199+0000","last_became_active":"2023-10-07T00:11:13.831497+0000","last_became_peered":"2023-10-07T00:11:13.831497+0000","last_unstale":"2023-10-07T00:11:15.108199+0000","last_undegraded":"2023-10-07T00:11:15.108199+0000","last_fullsized":"2023-10-07T00:11:15.108199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:43.802252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108687+0000","last_change":"2023-10-07T00:11:13.841423+0000","last_active":"2023-10-07T00:11:15.108687+0000","last_peered":"2023-10-07T00:11:15.108687+0000","last_clean":"2023-10-07T00:11:15.108687+0000","last_became_active":"2023-10-07T00:11:13.841115+0000","last_became_peered":"2023-10-07T00:11:13.841115+0000","last_unstale":"2023-10-07T00:11:15.108687+0000","last_undegraded":"2023-10-07T00:11:15.108687+0000","last_fullsized":"2023-10-07T00:11:15.108687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:32.355577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107701+0000","last_change":"2023-10-07T00:11:13.840162+0000","last_active":"2023-10-07T00:11:15.107701+0000","last_peered":"2023-10-07T00:11:15.107701+0000","last_clean":"2023-10-07T00:11:15.107701+0000","last_became_active":"2023-10-07T00:11:13.839760+0000","last_became_peered":"2023-10-07T00:11:13.839760+0000","last_unstale":"2023-10-07T00:11:15.107701+0000","last_undegraded":"2023-10-07T00:11:15.107701+0000","last_fullsized":"2023-10-07T00:11:15.107701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.727027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248175,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23937,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":148,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":50994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350991,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":10,"up_from":73,"seq":313532612628,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1035076,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.496}]},{"osd":2,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61199999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.71099999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56499999999999995}]},{"osd":8,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79400000000000004}]},{"osd":9,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.024},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.73199999999999998}]},{"osd":11,"last update":"Sat Oct 7 00:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.069},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.77100000000000002}]}]},{"osd":9,"up_from":68,"seq":292057776153,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":442144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":1.804}]},{"osd":1,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":1.016}]},{"osd":3,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.495},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.982}]},{"osd":4,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.8540000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.88200000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.528},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":2.1179999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.83099999999999996}]},{"osd":10,"last update":"Sat Oct 7 00:10:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.8899999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.611}]}]},{"osd":8,"up_from":60,"seq":257698037791,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":442098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88900000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.503},{"interface":"front","average":{"1min":0.625,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.47999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.89800000000000002,"5min":1.117,"15min":1.117},"last":0.64300000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.59899999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95899999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83199999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44}]},{"osd":3,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.073,"15min":1.073},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.877,"5min":1.498,"15min":1.498},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.629},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.438,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90400000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.747},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93799999999999994,"5min":1.389,"15min":1.389},"last":0.72899999999999998}]},{"osd":7,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.85499999999999998},"min":{"1min":0.63600000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.66200000000000003}]},{"osd":9,"last update":"Sat Oct 7 00:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80700000000000005}]},{"osd":10,"last update":"Sat Oct 7 00:10:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.873},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":1031979,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93999999999999995,"5min":1.149,"15min":1.149},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91200000000000003,"5min":1.163,"15min":1.163},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.58399999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72399999999999998,"15min":0.71499999999999997},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.67700000000000005,"15min":0.68600000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0209999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.109,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.028},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.63800000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2729999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.177}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.81899999999999995,"15min":0.80500000000000005},"min":{"1min":0.66300000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.113}]},{"osd":9,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.147},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.78700000000000003}]},{"osd":10,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.208},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.85299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60099999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74199999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.47699999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.53400000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0880000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.495}]},{"osd":2,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76800000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.325,"15min":1.325},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.153,"5min":1.405,"15min":1.405},"last":0.67000000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":1.208,"15min":1.208},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97799999999999998,"5min":1.292,"15min":1.292},"last":0.58099999999999996}]},{"osd":7,"last update":"Sat Oct 7 00:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.60699999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.208,"5min":1.419,"15min":1.419},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.85099999999999998,"15min":0.83699999999999997},"min":{"1min":0.75700000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.325,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.83599999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.877,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89000000000000001,"15min":0.89500000000000002},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0089999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64900000000000002}]},{"osd":9,"last update":"Sat Oct 7 00:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.874},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.63600000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":442699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88300000000000001,"5min":1.018,"15min":1.018},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90900000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Oct 7 00:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.60699999999999998,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97199999999999998,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.71899999999999997}]},{"osd":3,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.66000000000000003,"15min":0.60999999999999999},"min":{"1min":0.55600000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0489999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Oct 7 00:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.52500000000000002,"15min":0.503},"min":{"1min":0.36799999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.45900000000000002}]},{"osd":5,"last update":"Sat Oct 7 00:10:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.69999999999999996,"15min":0.67300000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0349999999999999,"5min":1.107,"15min":1.107},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.503,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.503}]},{"osd":7,"last update":"Sat Oct 7 00:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.78900000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83899999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.59799999999999998}]},{"osd":9,"last update":"Sat Oct 7 00:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63100000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.82899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":442565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 00:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.502,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97599999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.72299999999999998}]},{"osd":2,"last update":"Sat Oct 7 00:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85199999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0189999999999999,"5min":1.024,"15min":1.024},"last":0.627}]},{"osd":3,"last update":"Sat Oct 7 00:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97499999999999998,"5min":1.113,"15min":1.113},"last":0.745},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64300000000000002,"15min":0.621},"min":{"1min":0.502,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.101,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98999999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 00:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.60999999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77000000000000002}]},{"osd":9,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.78500000000000003}]},{"osd":10,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.88400000000000001}]},{"osd":11,"last update":"Sat Oct 7 00:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.80600000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":462699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.84999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":1.048,"15min":1.048},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 7 00:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.82799999999999996}]},{"osd":3,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.91200000000000003,"5min":1.022,"15min":1.022},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Oct 7 00:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.48599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Oct 7 00:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81100000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.92200000000000004}]},{"osd":6,"last update":"Sat Oct 7 00:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.60099999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98299999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.87},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90100000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.81200000000000006},"min":{"1min":0.60099999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91200000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.72299999999999998}]},{"osd":8,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.46700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.753}]},{"osd":9,"last update":"Sat Oct 7 00:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.89100000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":1.048}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149751,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":441133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.42499999999999999,"15min":0.40699999999999997},"min":{"1min":0.36699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.45100000000000001,"15min":0.432},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:10:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63100000000000001}]},{"osd":2,"last update":"Sat Oct 7 00:10:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91600000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1399999999999999,"5min":1.284,"15min":1.284},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.02,"5min":1.048,"15min":1.048},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.167,"5min":1.169,"15min":1.169},"last":0.96799999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:10:47 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72299999999999998,"15min":0.69799999999999995},"min":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.68000000000000005},"min":{"1min":0.50800000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98599999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Sat Oct 7 00:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0920000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.71799999999999997,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.74099999999999999,"15min":0.72799999999999998},"min":{"1min":0.59999999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0800000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.84299999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.89400000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.052,"5min":1.103,"15min":1.103},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.746}]},{"osd":9,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.198},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.5189999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.252}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]}]},{"osd":4,"up_from":34,"seq":146028888116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56100000000000005,"15min":0.54300000000000004},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.67100000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.63,"5min":0.745,"15min":0.745},"last":0.495}]},{"osd":2,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.48899999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91200000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.51500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.624},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88800000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.44400000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:10:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.626},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.71899999999999997,"15min":0.70299999999999996},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Sat Oct 7 00:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.71699999999999997,"15min":0.69499999999999995},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0309999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70299999999999996,"15min":0.69199999999999995},"min":{"1min":0.52000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.51300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.753},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.57299999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.59899999999999998}]},{"osd":8,"last update":"Sat Oct 7 00:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.67400000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.84999999999999998}]},{"osd":9,"last update":"Sat Oct 7 00:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.56599999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724590,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1032873,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60699999999999998,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.78500000000000003,"15min":0.82999999999999996},"min":{"1min":0.48799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.034,"5min":5.96,"15min":5.96},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63700000000000001,"15min":0.61499999999999999},"min":{"1min":0.50600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.378}]},{"osd":3,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.503}]},{"osd":4,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.50800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0720000000000001,"5min":1.093,"15min":1.093},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.85899999999999999,"15min":0.92900000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93899999999999995,"5min":5.9100000000000001,"15min":5.9100000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.50700000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.90300000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Oct 7 00:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76800000000000002,"15min":0.76500000000000001},"min":{"1min":0.55100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63100000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68100000000000005}]},{"osd":9,"last update":"Sat Oct 7 00:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.81999999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":21339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":20713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T00:11:22.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T00:11:22.935 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:22 smithi005 ceph-mon[129406]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:22.936 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:22 smithi005 ceph-mon[129406]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:22.936 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:22 smithi005 ceph-mon[129406]: pgmap v302: 97 pgs: 97 active+clean; 600 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.6 KiB/s wr, 21 op/s 2023-10-07T00:11:22.936 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:22 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3154640560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:22.936 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:22 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/730470224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:22.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:22 smithi088 ceph-mon[103111]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:22.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:22 smithi088 ceph-mon[103111]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:22.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:22 smithi088 ceph-mon[103111]: pgmap v302: 97 pgs: 97 active+clean; 600 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.6 KiB/s wr, 21 op/s 2023-10-07T00:11:22.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:22 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3154640560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:22.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:22 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/730470224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:22 smithi112 ceph-mon[133548]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:22 smithi112 ceph-mon[133548]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:11:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:22 smithi112 ceph-mon[133548]: pgmap v302: 97 pgs: 97 active+clean; 600 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.6 KiB/s wr, 21 op/s 2023-10-07T00:11:22.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:22 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3154640560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:11:22.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:22 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/730470224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:23.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.076+0000 7f94dbbff700 1 -- 172.21.15.5:0/2940634577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 msgr2=0x7f94d4102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:23.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.076+0000 7f94dbbff700 1 --2- 172.21.15.5:0/2940634577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 0x7f94d4102610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f94c40099c0 tx=0x7f94c4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.077+0000 7f94dbbff700 1 -- 172.21.15.5:0/2940634577 shutdown_connections 2023-10-07T00:11:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.077+0000 7f94dbbff700 1 --2- 172.21.15.5:0/2940634577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d4102b50 0x7f94d4109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.077+0000 7f94dbbff700 1 --2- 172.21.15.5:0/2940634577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94d4100fc0 0x7f94d41013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.077+0000 7f94dbbff700 1 --2- 172.21.15.5:0/2940634577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 0x7f94d4102610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.077+0000 7f94dbbff700 1 -- 172.21.15.5:0/2940634577 >> 172.21.15.5:0/2940634577 conn(0x7f94d40fc530 msgr2=0x7f94d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.077+0000 7f94dbbff700 1 -- 172.21.15.5:0/2940634577 shutdown_connections 2023-10-07T00:11:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.077+0000 7f94dbbff700 1 -- 172.21.15.5:0/2940634577 wait complete. 2023-10-07T00:11:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.078+0000 7f94dbbff700 1 Processor -- start 2023-10-07T00:11:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.078+0000 7f94dbbff700 1 -- start start 2023-10-07T00:11:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.078+0000 7f94dbbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94d4100fc0 0x7f94d4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.078+0000 7f94dbbff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 0x7f94d40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.078+0000 7f94dbbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d4102b50 0x7f94d40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.078+0000 7f94dbbff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4073f80 con 0x7f94d41021b0 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.078+0000 7f94dbbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40740f0 con 0x7f94d4100fc0 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.078+0000 7f94dbbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d41a0c30 con 0x7f94d4102b50 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 0x7f94d40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 0x7f94d40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38428/0 (socket says 172.21.15.5:38428) 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 -- 172.21.15.5:0/1075308631 learned_addr learned my addr 172.21.15.5:0/1075308631 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d999b700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94d4100fc0 0x7f94d4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 -- 172.21.15.5:0/1075308631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d4102b50 msgr2=0x7f94d40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d4102b50 0x7f94d40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 -- 172.21.15.5:0/1075308631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94d4100fc0 msgr2=0x7f94d4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94d4100fc0 0x7f94d4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 -- 172.21.15.5:0/1075308631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40095f0 con 0x7f94d41021b0 2023-10-07T00:11:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d999b700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94d4100fc0 0x7f94d4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94d919a700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 0x7f94d40732a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f94c4005910 tx=0x7f94c4003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.079+0000 7f94caffd700 1 -- 172.21.15.5:0/1075308631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c401d070 con 0x7f94d41021b0 2023-10-07T00:11:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.080+0000 7f94caffd700 1 -- 172.21.15.5:0/1075308631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f94c400bd30 con 0x7f94d41021b0 2023-10-07T00:11:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.080+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d41a0eb0 con 0x7f94d41021b0 2023-10-07T00:11:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.080+0000 7f94caffd700 1 -- 172.21.15.5:0/1075308631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c4022d50 con 0x7f94d41021b0 2023-10-07T00:11:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.080+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d41a12d0 con 0x7f94d41021b0 2023-10-07T00:11:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.081+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d4107f70 con 0x7f94d41021b0 2023-10-07T00:11:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.083+0000 7f94caffd700 1 -- 172.21.15.5:0/1075308631 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f94c4003ff0 con 0x7f94d41021b0 2023-10-07T00:11:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.084+0000 7f94caffd700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f94c00a1510 0x7f94c00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.085+0000 7f94caffd700 1 -- 172.21.15.5:0/1075308631 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f94c40cea90 con 0x7f94d41021b0 2023-10-07T00:11:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.085+0000 7f94d999b700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f94c00a1510 0x7f94c00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.085+0000 7f94d999b700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f94c00a1510 0x7f94c00a39d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f94d0005fd0 tx=0x7f94d0005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:23.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.087+0000 7f94caffd700 1 -- 172.21.15.5:0/1075308631 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f94c40980d0 con 0x7f94d41021b0 2023-10-07T00:11:23.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.294+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94d402d2d0 con 0x7f94c00a1510 2023-10-07T00:11:23.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.305+0000 7f94caffd700 1 -- 172.21.15.5:0/1075308631 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335971 (secure 0 0 0) 0x7f94d402d2d0 con 0x7f94c00a1510 2023-10-07T00:11:23.310 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:23.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f94c00a1510 msgr2=0x7f94c00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:23.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f94c00a1510 0x7f94c00a39d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f94d0005fd0 tx=0x7f94d0005f00 comp rx=0 tx=0).stop 2023-10-07T00:11:23.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 msgr2=0x7f94d40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:23.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 0x7f94d40732a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f94c4005910 tx=0x7f94c4003b00 comp rx=0 tx=0).stop 2023-10-07T00:11:23.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 shutdown_connections 2023-10-07T00:11:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f94c00a1510 0x7f94c00a39d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d4102b50 0x7f94d40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94d4100fc0 0x7f94d4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 --2- 172.21.15.5:0/1075308631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d41021b0 0x7f94d40732a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 >> 172.21.15.5:0/1075308631 conn(0x7f94d40fc530 msgr2=0x7f94d40fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 shutdown_connections 2023-10-07T00:11:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:23.310+0000 7f94dbbff700 1 -- 172.21.15.5:0/1075308631 wait complete. 2023-10-07T00:11:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-07T00:11:23.331 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2023-10-07T00:11:21.643385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":614428,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":151,"num_read_kb":130,"num_write":330,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335392,"kb_used_data":11168,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606432,"statfs":{"total":1151940427776,"available":1151596986368,"internally_reserved":0,"allocated":11436032,"data_stored":7097739,"data_compressed":108477,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24060,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":149,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001983"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107856+0000","last_change":"2023-10-07T00:11:13.845315+0000","last_active":"2023-10-07T00:11:15.107856+0000","last_peered":"2023-10-07T00:11:15.107856+0000","last_clean":"2023-10-07T00:11:15.107856+0000","last_became_active":"2023-10-07T00:11:13.844330+0000","last_became_peered":"2023-10-07T00:11:13.844330+0000","last_unstale":"2023-10-07T00:11:15.107856+0000","last_undegraded":"2023-10-07T00:11:15.107856+0000","last_fullsized":"2023-10-07T00:11:15.107856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:26.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107999+0000","last_change":"2023-10-07T00:11:13.842602+0000","last_active":"2023-10-07T00:11:15.107999+0000","last_peered":"2023-10-07T00:11:15.107999+0000","last_clean":"2023-10-07T00:11:15.107999+0000","last_became_active":"2023-10-07T00:11:13.842296+0000","last_became_peered":"2023-10-07T00:11:13.842296+0000","last_unstale":"2023-10-07T00:11:15.107999+0000","last_undegraded":"2023-10-07T00:11:15.107999+0000","last_fullsized":"2023-10-07T00:11:15.107999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:51.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108371+0000","last_change":"2023-10-07T00:11:13.850567+0000","last_active":"2023-10-07T00:11:15.108371+0000","last_peered":"2023-10-07T00:11:15.108371+0000","last_clean":"2023-10-07T00:11:15.108371+0000","last_became_active":"2023-10-07T00:11:13.850212+0000","last_became_peered":"2023-10-07T00:11:13.850212+0000","last_unstale":"2023-10-07T00:11:15.108371+0000","last_undegraded":"2023-10-07T00:11:15.108371+0000","last_fullsized":"2023-10-07T00:11:15.108371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:51.539752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819587+0000","last_change":"2023-10-07T00:11:13.839742+0000","last_active":"2023-10-07T00:11:14.819587+0000","last_peered":"2023-10-07T00:11:14.819587+0000","last_clean":"2023-10-07T00:11:14.819587+0000","last_became_active":"2023-10-07T00:11:13.839041+0000","last_became_peered":"2023-10-07T00:11:13.839041+0000","last_unstale":"2023-10-07T00:11:14.819587+0000","last_undegraded":"2023-10-07T00:11:14.819587+0000","last_fullsized":"2023-10-07T00:11:14.819587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:59.241248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819492+0000","last_change":"2023-10-07T00:11:13.834839+0000","last_active":"2023-10-07T00:11:14.819492+0000","last_peered":"2023-10-07T00:11:14.819492+0000","last_clean":"2023-10-07T00:11:14.819492+0000","last_became_active":"2023-10-07T00:11:13.834529+0000","last_became_peered":"2023-10-07T00:11:13.834529+0000","last_unstale":"2023-10-07T00:11:14.819492+0000","last_undegraded":"2023-10-07T00:11:14.819492+0000","last_fullsized":"2023-10-07T00:11:14.819492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:23.831424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107576+0000","last_change":"2023-10-07T00:11:13.835102+0000","last_active":"2023-10-07T00:11:15.107576+0000","last_peered":"2023-10-07T00:11:15.107576+0000","last_clean":"2023-10-07T00:11:15.107576+0000","last_became_active":"2023-10-07T00:11:13.834781+0000","last_became_peered":"2023-10-07T00:11:13.834781+0000","last_unstale":"2023-10-07T00:11:15.107576+0000","last_undegraded":"2023-10-07T00:11:15.107576+0000","last_fullsized":"2023-10-07T00:11:15.107576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:16:55.912464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108827+0000","last_change":"2023-10-07T00:11:13.840222+0000","last_active":"2023-10-07T00:11:15.108827+0000","last_peered":"2023-10-07T00:11:15.108827+0000","last_clean":"2023-10-07T00:11:15.108827+0000","last_became_active":"2023-10-07T00:11:13.839910+0000","last_became_peered":"2023-10-07T00:11:13.839910+0000","last_unstale":"2023-10-07T00:11:15.108827+0000","last_undegraded":"2023-10-07T00:11:15.108827+0000","last_fullsized":"2023-10-07T00:11:15.108827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:20:19.476394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.818903+0000","last_change":"2023-10-07T00:11:13.842772+0000","last_active":"2023-10-07T00:11:14.818903+0000","last_peered":"2023-10-07T00:11:14.818903+0000","last_clean":"2023-10-07T00:11:14.818903+0000","last_became_active":"2023-10-07T00:11:13.841610+0000","last_became_peered":"2023-10-07T00:11:13.841610+0000","last_unstale":"2023-10-07T00:11:14.818903+0000","last_undegraded":"2023-10-07T00:11:14.818903+0000","last_fullsized":"2023-10-07T00:11:14.818903+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:04:51.988705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107759+0000","last_change":"2023-10-07T00:11:13.836990+0000","last_active":"2023-10-07T00:11:15.107759+0000","last_peered":"2023-10-07T00:11:15.107759+0000","last_clean":"2023-10-07T00:11:15.107759+0000","last_became_active":"2023-10-07T00:11:13.836699+0000","last_became_peered":"2023-10-07T00:11:13.836699+0000","last_unstale":"2023-10-07T00:11:15.107759+0000","last_undegraded":"2023-10-07T00:11:15.107759+0000","last_fullsized":"2023-10-07T00:11:15.107759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:18:20.450573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108016+0000","last_change":"2023-10-07T00:11:13.832127+0000","last_active":"2023-10-07T00:11:15.108016+0000","last_peered":"2023-10-07T00:11:15.108016+0000","last_clean":"2023-10-07T00:11:15.108016+0000","last_became_active":"2023-10-07T00:11:13.831661+0000","last_became_peered":"2023-10-07T00:11:13.831661+0000","last_unstale":"2023-10-07T00:11:15.108016+0000","last_undegraded":"2023-10-07T00:11:15.108016+0000","last_fullsized":"2023-10-07T00:11:15.108016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:53:21.665541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108668+0000","last_change":"2023-10-07T00:11:13.841699+0000","last_active":"2023-10-07T00:11:15.108668+0000","last_peered":"2023-10-07T00:11:15.108668+0000","last_clean":"2023-10-07T00:11:15.108668+0000","last_became_active":"2023-10-07T00:11:13.841295+0000","last_became_peered":"2023-10-07T00:11:13.841295+0000","last_unstale":"2023-10-07T00:11:15.108668+0000","last_undegraded":"2023-10-07T00:11:15.108668+0000","last_fullsized":"2023-10-07T00:11:15.108668+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:24:56.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819565+0000","last_change":"2023-10-07T00:11:13.839951+0000","last_active":"2023-10-07T00:11:14.819565+0000","last_peered":"2023-10-07T00:11:14.819565+0000","last_clean":"2023-10-07T00:11:14.819565+0000","last_became_active":"2023-10-07T00:11:13.839473+0000","last_became_peered":"2023-10-07T00:11:13.839473+0000","last_unstale":"2023-10-07T00:11:14.819565+0000","last_undegraded":"2023-10-07T00:11:14.819565+0000","last_fullsized":"2023-10-07T00:11:14.819565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108547+0000","last_change":"2023-10-07T00:11:13.838714+0000","last_active":"2023-10-07T00:11:15.108547+0000","last_peered":"2023-10-07T00:11:15.108547+0000","last_clean":"2023-10-07T00:11:15.108547+0000","last_became_active":"2023-10-07T00:11:13.838222+0000","last_became_peered":"2023-10-07T00:11:13.838222+0000","last_unstale":"2023-10-07T00:11:15.108547+0000","last_undegraded":"2023-10-07T00:11:15.108547+0000","last_fullsized":"2023-10-07T00:11:15.108547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:11:43.194204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108769+0000","last_change":"2023-10-07T00:11:13.843075+0000","last_active":"2023-10-07T00:11:15.108769+0000","last_peered":"2023-10-07T00:11:15.108769+0000","last_clean":"2023-10-07T00:11:15.108769+0000","last_became_active":"2023-10-07T00:11:13.842742+0000","last_became_peered":"2023-10-07T00:11:13.842742+0000","last_unstale":"2023-10-07T00:11:15.108769+0000","last_undegraded":"2023-10-07T00:11:15.108769+0000","last_fullsized":"2023-10-07T00:11:15.108769+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:53:12.713979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108339+0000","last_change":"2023-10-07T00:11:13.841635+0000","last_active":"2023-10-07T00:11:15.108339+0000","last_peered":"2023-10-07T00:11:15.108339+0000","last_clean":"2023-10-07T00:11:15.108339+0000","last_became_active":"2023-10-07T00:11:13.841291+0000","last_became_peered":"2023-10-07T00:11:13.841291+0000","last_unstale":"2023-10-07T00:11:15.108339+0000","last_undegraded":"2023-10-07T00:11:15.108339+0000","last_fullsized":"2023-10-07T00:11:15.108339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:48:38.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107086+0000","last_change":"2023-10-07T00:11:13.842365+0000","last_active":"2023-10-07T00:11:15.107086+0000","last_peered":"2023-10-07T00:11:15.107086+0000","last_clean":"2023-10-07T00:11:15.107086+0000","last_became_active":"2023-10-07T00:11:13.842057+0000","last_became_peered":"2023-10-07T00:11:13.842057+0000","last_unstale":"2023-10-07T00:11:15.107086+0000","last_undegraded":"2023-10-07T00:11:15.107086+0000","last_fullsized":"2023-10-07T00:11:15.107086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:36.575712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107943+0000","last_change":"2023-10-07T00:11:13.845746+0000","last_active":"2023-10-07T00:11:15.107943+0000","last_peered":"2023-10-07T00:11:15.107943+0000","last_clean":"2023-10-07T00:11:15.107943+0000","last_became_active":"2023-10-07T00:11:13.844828+0000","last_became_peered":"2023-10-07T00:11:13.844828+0000","last_unstale":"2023-10-07T00:11:15.107943+0000","last_undegraded":"2023-10-07T00:11:15.107943+0000","last_fullsized":"2023-10-07T00:11:15.107943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:34:00.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.109954+0000","last_change":"2023-10-07T00:11:13.837749+0000","last_active":"2023-10-07T00:11:15.109954+0000","last_peered":"2023-10-07T00:11:15.109954+0000","last_clean":"2023-10-07T00:11:15.109954+0000","last_became_active":"2023-10-07T00:11:13.837400+0000","last_became_peered":"2023-10-07T00:11:13.837400+0000","last_unstale":"2023-10-07T00:11:15.109954+0000","last_undegraded":"2023-10-07T00:11:15.109954+0000","last_fullsized":"2023-10-07T00:11:15.109954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:40.190065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.958722+0000","last_change":"2023-10-07T00:11:13.833086+0000","last_active":"2023-10-07T00:11:14.958722+0000","last_peered":"2023-10-07T00:11:14.958722+0000","last_clean":"2023-10-07T00:11:14.958722+0000","last_became_active":"2023-10-07T00:11:13.832748+0000","last_became_peered":"2023-10-07T00:11:13.832748+0000","last_unstale":"2023-10-07T00:11:14.958722+0000","last_undegraded":"2023-10-07T00:11:14.958722+0000","last_fullsized":"2023-10-07T00:11:14.958722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:29.176224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.341056+0000","last_change":"2023-10-07T00:11:12.835440+0000","last_active":"2023-10-07T00:11:18.341056+0000","last_peered":"2023-10-07T00:11:18.341056+0000","last_clean":"2023-10-07T00:11:18.341056+0000","last_became_active":"2023-10-07T00:11:12.835094+0000","last_became_peered":"2023-10-07T00:11:12.835094+0000","last_unstale":"2023-10-07T00:11:18.341056+0000","last_undegraded":"2023-10-07T00:11:18.341056+0000","last_fullsized":"2023-10-07T00:11:18.341056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:13.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819293+0000","last_change":"2023-10-07T00:11:13.847832+0000","last_active":"2023-10-07T00:11:14.819293+0000","last_peered":"2023-10-07T00:11:14.819293+0000","last_clean":"2023-10-07T00:11:14.819293+0000","last_became_active":"2023-10-07T00:11:13.847436+0000","last_became_peered":"2023-10-07T00:11:13.847436+0000","last_unstale":"2023-10-07T00:11:14.819293+0000","last_undegraded":"2023-10-07T00:11:14.819293+0000","last_fullsized":"2023-10-07T00:11:14.819293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:47:07.409132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:13.860431+0000","last_change":"2023-10-07T00:11:12.842832+0000","last_active":"2023-10-07T00:11:13.860431+0000","last_peered":"2023-10-07T00:11:13.860431+0000","last_clean":"2023-10-07T00:11:13.860431+0000","last_became_active":"2023-10-07T00:11:12.842296+0000","last_became_peered":"2023-10-07T00:11:12.842296+0000","last_unstale":"2023-10-07T00:11:13.860431+0000","last_undegraded":"2023-10-07T00:11:13.860431+0000","last_fullsized":"2023-10-07T00:11:13.860431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:00.968303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108812+0000","last_change":"2023-10-07T00:11:13.851259+0000","last_active":"2023-10-07T00:11:15.108812+0000","last_peered":"2023-10-07T00:11:15.108812+0000","last_clean":"2023-10-07T00:11:15.108812+0000","last_became_active":"2023-10-07T00:11:13.850963+0000","last_became_peered":"2023-10-07T00:11:13.850963+0000","last_unstale":"2023-10-07T00:11:15.108812+0000","last_undegraded":"2023-10-07T00:11:15.108812+0000","last_fullsized":"2023-10-07T00:11:15.108812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:52.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.338857+0000","last_change":"2023-10-07T00:11:12.835286+0000","last_active":"2023-10-07T00:11:18.338857+0000","last_peered":"2023-10-07T00:11:18.338857+0000","last_clean":"2023-10-07T00:11:18.338857+0000","last_became_active":"2023-10-07T00:11:12.834890+0000","last_became_peered":"2023-10-07T00:11:12.834890+0000","last_unstale":"2023-10-07T00:11:18.338857+0000","last_undegraded":"2023-10-07T00:11:18.338857+0000","last_fullsized":"2023-10-07T00:11:18.338857+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:06:05.225849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107407+0000","last_change":"2023-10-07T00:11:13.831174+0000","last_active":"2023-10-07T00:11:15.107407+0000","last_peered":"2023-10-07T00:11:15.107407+0000","last_clean":"2023-10-07T00:11:15.107407+0000","last_became_active":"2023-10-07T00:11:13.830868+0000","last_became_peered":"2023-10-07T00:11:13.830868+0000","last_unstale":"2023-10-07T00:11:15.107407+0000","last_undegraded":"2023-10-07T00:11:15.107407+0000","last_fullsized":"2023-10-07T00:11:15.107407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:20.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:13.860451+0000","last_change":"2023-10-07T00:11:12.835740+0000","last_active":"2023-10-07T00:11:13.860451+0000","last_peered":"2023-10-07T00:11:13.860451+0000","last_clean":"2023-10-07T00:11:13.860451+0000","last_became_active":"2023-10-07T00:11:12.835035+0000","last_became_peered":"2023-10-07T00:11:12.835035+0000","last_unstale":"2023-10-07T00:11:13.860451+0000","last_undegraded":"2023-10-07T00:11:13.860451+0000","last_fullsized":"2023-10-07T00:11:13.860451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:36:07.447748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854991+0000","last_change":"2023-10-07T00:11:13.847940+0000","last_active":"2023-10-07T00:11:14.854991+0000","last_peered":"2023-10-07T00:11:14.854991+0000","last_clean":"2023-10-07T00:11:14.854991+0000","last_became_active":"2023-10-07T00:11:13.847595+0000","last_became_peered":"2023-10-07T00:11:13.847595+0000","last_unstale":"2023-10-07T00:11:14.854991+0000","last_undegraded":"2023-10-07T00:11:14.854991+0000","last_fullsized":"2023-10-07T00:11:14.854991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:28.004429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.649674+0000","last_change":"2023-10-07T00:11:12.834885+0000","last_active":"2023-10-07T00:11:19.649674+0000","last_peered":"2023-10-07T00:11:19.649674+0000","last_clean":"2023-10-07T00:11:19.649674+0000","last_became_active":"2023-10-07T00:11:12.834542+0000","last_became_peered":"2023-10-07T00:11:12.834542+0000","last_unstale":"2023-10-07T00:11:19.649674+0000","last_undegraded":"2023-10-07T00:11:19.649674+0000","last_fullsized":"2023-10-07T00:11:19.649674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:28:10.495978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819468+0000","last_change":"2023-10-07T00:11:13.838732+0000","last_active":"2023-10-07T00:11:14.819468+0000","last_peered":"2023-10-07T00:11:14.819468+0000","last_clean":"2023-10-07T00:11:14.819468+0000","last_became_active":"2023-10-07T00:11:13.838408+0000","last_became_peered":"2023-10-07T00:11:13.838408+0000","last_unstale":"2023-10-07T00:11:14.819468+0000","last_undegraded":"2023-10-07T00:11:14.819468+0000","last_fullsized":"2023-10-07T00:11:14.819468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:55:55.039399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.346748+0000","last_change":"2023-10-07T00:11:12.831778+0000","last_active":"2023-10-07T00:11:19.346748+0000","last_peered":"2023-10-07T00:11:19.346748+0000","last_clean":"2023-10-07T00:11:19.346748+0000","last_became_active":"2023-10-07T00:11:12.831479+0000","last_became_peered":"2023-10-07T00:11:12.831479+0000","last_unstale":"2023-10-07T00:11:19.346748+0000","last_undegraded":"2023-10-07T00:11:19.346748+0000","last_fullsized":"2023-10-07T00:11:19.346748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:12:57.994585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854806+0000","last_change":"2023-10-07T00:11:13.843341+0000","last_active":"2023-10-07T00:11:14.854806+0000","last_peered":"2023-10-07T00:11:14.854806+0000","last_clean":"2023-10-07T00:11:14.854806+0000","last_became_active":"2023-10-07T00:11:13.843017+0000","last_became_peered":"2023-10-07T00:11:13.843017+0000","last_unstale":"2023-10-07T00:11:14.854806+0000","last_undegraded":"2023-10-07T00:11:14.854806+0000","last_fullsized":"2023-10-07T00:11:14.854806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:09.595934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107809+0000","last_change":"2023-10-07T00:11:12.825556+0000","last_active":"2023-10-07T00:11:15.107809+0000","last_peered":"2023-10-07T00:11:15.107809+0000","last_clean":"2023-10-07T00:11:15.107809+0000","last_became_active":"2023-10-07T00:11:12.825189+0000","last_became_peered":"2023-10-07T00:11:12.825189+0000","last_unstale":"2023-10-07T00:11:15.107809+0000","last_undegraded":"2023-10-07T00:11:15.107809+0000","last_fullsized":"2023-10-07T00:11:15.107809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:20:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.818848+0000","last_change":"2023-10-07T00:11:13.843111+0000","last_active":"2023-10-07T00:11:14.818848+0000","last_peered":"2023-10-07T00:11:14.818848+0000","last_clean":"2023-10-07T00:11:14.818848+0000","last_became_active":"2023-10-07T00:11:13.842277+0000","last_became_peered":"2023-10-07T00:11:13.842277+0000","last_unstale":"2023-10-07T00:11:14.818848+0000","last_undegraded":"2023-10-07T00:11:14.818848+0000","last_fullsized":"2023-10-07T00:11:14.818848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:40.869037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.651827+0000","last_change":"2023-10-07T00:11:12.835239+0000","last_active":"2023-10-07T00:11:19.651827+0000","last_peered":"2023-10-07T00:11:19.651827+0000","last_clean":"2023-10-07T00:11:19.651827+0000","last_became_active":"2023-10-07T00:11:12.834912+0000","last_became_peered":"2023-10-07T00:11:12.834912+0000","last_unstale":"2023-10-07T00:11:19.651827+0000","last_undegraded":"2023-10-07T00:11:19.651827+0000","last_fullsized":"2023-10-07T00:11:19.651827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:32:44.097208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.109764+0000","last_change":"2023-10-07T00:11:13.837642+0000","last_active":"2023-10-07T00:11:15.109764+0000","last_peered":"2023-10-07T00:11:15.109764+0000","last_clean":"2023-10-07T00:11:15.109764+0000","last_became_active":"2023-10-07T00:11:13.837291+0000","last_became_peered":"2023-10-07T00:11:13.837291+0000","last_unstale":"2023-10-07T00:11:15.109764+0000","last_undegraded":"2023-10-07T00:11:15.109764+0000","last_fullsized":"2023-10-07T00:11:15.109764+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:19:14.445816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.648094+0000","last_change":"2023-10-07T00:11:12.826373+0000","last_active":"2023-10-07T00:11:19.648094+0000","last_peered":"2023-10-07T00:11:19.648094+0000","last_clean":"2023-10-07T00:11:19.648094+0000","last_became_active":"2023-10-07T00:11:12.826017+0000","last_became_peered":"2023-10-07T00:11:12.826017+0000","last_unstale":"2023-10-07T00:11:19.648094+0000","last_undegraded":"2023-10-07T00:11:19.648094+0000","last_fullsized":"2023-10-07T00:11:19.648094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:52:03.101632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108185+0000","last_change":"2023-10-07T00:11:13.830879+0000","last_active":"2023-10-07T00:11:15.108185+0000","last_peered":"2023-10-07T00:11:15.108185+0000","last_clean":"2023-10-07T00:11:15.108185+0000","last_became_active":"2023-10-07T00:11:13.830571+0000","last_became_peered":"2023-10-07T00:11:13.830571+0000","last_unstale":"2023-10-07T00:11:15.108185+0000","last_undegraded":"2023-10-07T00:11:15.108185+0000","last_fullsized":"2023-10-07T00:11:15.108185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:36.703499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108422+0000","last_change":"2023-10-07T00:11:12.833952+0000","last_active":"2023-10-07T00:11:15.108422+0000","last_peered":"2023-10-07T00:11:15.108422+0000","last_clean":"2023-10-07T00:11:15.108422+0000","last_became_active":"2023-10-07T00:11:12.833545+0000","last_became_peered":"2023-10-07T00:11:12.833545+0000","last_unstale":"2023-10-07T00:11:15.108422+0000","last_undegraded":"2023-10-07T00:11:15.108422+0000","last_fullsized":"2023-10-07T00:11:15.108422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:28:12.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108685+0000","last_change":"2023-10-07T00:11:13.843758+0000","last_active":"2023-10-07T00:11:15.108685+0000","last_peered":"2023-10-07T00:11:15.108685+0000","last_clean":"2023-10-07T00:11:15.108685+0000","last_became_active":"2023-10-07T00:11:13.843443+0000","last_became_peered":"2023-10-07T00:11:13.843443+0000","last_unstale":"2023-10-07T00:11:15.108685+0000","last_undegraded":"2023-10-07T00:11:15.108685+0000","last_fullsized":"2023-10-07T00:11:15.108685+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:07:28.610304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.346920+0000","last_change":"2023-10-07T00:11:12.833043+0000","last_active":"2023-10-07T00:11:19.346920+0000","last_peered":"2023-10-07T00:11:19.346920+0000","last_clean":"2023-10-07T00:11:19.346920+0000","last_became_active":"2023-10-07T00:11:12.832632+0000","last_became_peered":"2023-10-07T00:11:12.832632+0000","last_unstale":"2023-10-07T00:11:19.346920+0000","last_undegraded":"2023-10-07T00:11:19.346920+0000","last_fullsized":"2023-10-07T00:11:19.346920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:14:25.148603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107626+0000","last_change":"2023-10-07T00:11:13.831129+0000","last_active":"2023-10-07T00:11:15.107626+0000","last_peered":"2023-10-07T00:11:15.107626+0000","last_clean":"2023-10-07T00:11:15.107626+0000","last_became_active":"2023-10-07T00:11:13.830365+0000","last_became_peered":"2023-10-07T00:11:13.830365+0000","last_unstale":"2023-10-07T00:11:15.107626+0000","last_undegraded":"2023-10-07T00:11:15.107626+0000","last_fullsized":"2023-10-07T00:11:15.107626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:22:00.580441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'16","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.882928+0000","last_change":"2023-10-07T00:11:12.834426+0000","last_active":"2023-10-07T00:11:19.882928+0000","last_peered":"2023-10-07T00:11:19.882928+0000","last_clean":"2023-10-07T00:11:19.882928+0000","last_became_active":"2023-10-07T00:11:12.834097+0000","last_became_peered":"2023-10-07T00:11:12.834097+0000","last_unstale":"2023-10-07T00:11:19.882928+0000","last_undegraded":"2023-10-07T00:11:19.882928+0000","last_fullsized":"2023-10-07T00:11:19.882928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:17:36.511377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18977,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819762+0000","last_change":"2023-10-07T00:11:13.832332+0000","last_active":"2023-10-07T00:11:14.819762+0000","last_peered":"2023-10-07T00:11:14.819762+0000","last_clean":"2023-10-07T00:11:14.819762+0000","last_became_active":"2023-10-07T00:11:13.832000+0000","last_became_peered":"2023-10-07T00:11:13.832000+0000","last_unstale":"2023-10-07T00:11:14.819762+0000","last_undegraded":"2023-10-07T00:11:14.819762+0000","last_fullsized":"2023-10-07T00:11:14.819762+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:39.913331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.656354+0000","last_change":"2023-10-07T00:11:12.839399+0000","last_active":"2023-10-07T00:11:19.656354+0000","last_peered":"2023-10-07T00:11:19.656354+0000","last_clean":"2023-10-07T00:11:19.656354+0000","last_became_active":"2023-10-07T00:11:12.838997+0000","last_became_peered":"2023-10-07T00:11:12.838997+0000","last_unstale":"2023-10-07T00:11:19.656354+0000","last_undegraded":"2023-10-07T00:11:19.656354+0000","last_fullsized":"2023-10-07T00:11:19.656354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:11.194224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107894+0000","last_change":"2023-10-07T00:11:13.830832+0000","last_active":"2023-10-07T00:11:15.107894+0000","last_peered":"2023-10-07T00:11:15.107894+0000","last_clean":"2023-10-07T00:11:15.107894+0000","last_became_active":"2023-10-07T00:11:13.830373+0000","last_became_peered":"2023-10-07T00:11:13.830373+0000","last_unstale":"2023-10-07T00:11:15.107894+0000","last_undegraded":"2023-10-07T00:11:15.107894+0000","last_fullsized":"2023-10-07T00:11:15.107894+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:08.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.346111+0000","last_change":"2023-10-07T00:11:12.834543+0000","last_active":"2023-10-07T00:11:19.346111+0000","last_peered":"2023-10-07T00:11:19.346111+0000","last_clean":"2023-10-07T00:11:19.346111+0000","last_became_active":"2023-10-07T00:11:12.834213+0000","last_became_peered":"2023-10-07T00:11:12.834213+0000","last_unstale":"2023-10-07T00:11:19.346111+0000","last_undegraded":"2023-10-07T00:11:19.346111+0000","last_fullsized":"2023-10-07T00:11:19.346111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:57:35.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108494+0000","last_change":"2023-10-07T00:11:13.830645+0000","last_active":"2023-10-07T00:11:15.108494+0000","last_peered":"2023-10-07T00:11:15.108494+0000","last_clean":"2023-10-07T00:11:15.108494+0000","last_became_active":"2023-10-07T00:11:13.830331+0000","last_became_peered":"2023-10-07T00:11:13.830331+0000","last_unstale":"2023-10-07T00:11:15.108494+0000","last_undegraded":"2023-10-07T00:11:15.108494+0000","last_fullsized":"2023-10-07T00:11:15.108494+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:19:55.226177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.650867+0000","last_change":"2023-10-07T00:11:12.830062+0000","last_active":"2023-10-07T00:11:19.650867+0000","last_peered":"2023-10-07T00:11:19.650867+0000","last_clean":"2023-10-07T00:11:19.650867+0000","last_became_active":"2023-10-07T00:11:12.829734+0000","last_became_peered":"2023-10-07T00:11:12.829734+0000","last_unstale":"2023-10-07T00:11:19.650867+0000","last_undegraded":"2023-10-07T00:11:19.650867+0000","last_fullsized":"2023-10-07T00:11:19.650867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:59.658154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107927+0000","last_change":"2023-10-07T00:11:13.840915+0000","last_active":"2023-10-07T00:11:15.107927+0000","last_peered":"2023-10-07T00:11:15.107927+0000","last_clean":"2023-10-07T00:11:15.107927+0000","last_became_active":"2023-10-07T00:11:13.840584+0000","last_became_peered":"2023-10-07T00:11:13.840584+0000","last_unstale":"2023-10-07T00:11:15.107927+0000","last_undegraded":"2023-10-07T00:11:15.107927+0000","last_fullsized":"2023-10-07T00:11:15.107927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:27:58.672800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.340131+0000","last_change":"2023-10-07T00:11:12.829034+0000","last_active":"2023-10-07T00:11:18.340131+0000","last_peered":"2023-10-07T00:11:18.340131+0000","last_clean":"2023-10-07T00:11:18.340131+0000","last_became_active":"2023-10-07T00:11:12.828671+0000","last_became_peered":"2023-10-07T00:11:12.828671+0000","last_unstale":"2023-10-07T00:11:18.340131+0000","last_undegraded":"2023-10-07T00:11:18.340131+0000","last_fullsized":"2023-10-07T00:11:18.340131+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:09:14.203804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854758+0000","last_change":"2023-10-07T00:11:13.843029+0000","last_active":"2023-10-07T00:11:14.854758+0000","last_peered":"2023-10-07T00:11:14.854758+0000","last_clean":"2023-10-07T00:11:14.854758+0000","last_became_active":"2023-10-07T00:11:13.842714+0000","last_became_peered":"2023-10-07T00:11:13.842714+0000","last_unstale":"2023-10-07T00:11:14.854758+0000","last_undegraded":"2023-10-07T00:11:14.854758+0000","last_fullsized":"2023-10-07T00:11:14.854758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:46.147059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:13.858184+0000","last_change":"2023-10-07T00:11:12.830887+0000","last_active":"2023-10-07T00:11:13.858184+0000","last_peered":"2023-10-07T00:11:13.858184+0000","last_clean":"2023-10-07T00:11:13.858184+0000","last_became_active":"2023-10-07T00:11:12.830500+0000","last_became_peered":"2023-10-07T00:11:12.830500+0000","last_unstale":"2023-10-07T00:11:13.858184+0000","last_undegraded":"2023-10-07T00:11:13.858184+0000","last_fullsized":"2023-10-07T00:11:13.858184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:39.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107838+0000","last_change":"2023-10-07T00:11:13.838823+0000","last_active":"2023-10-07T00:11:15.107838+0000","last_peered":"2023-10-07T00:11:15.107838+0000","last_clean":"2023-10-07T00:11:15.107838+0000","last_became_active":"2023-10-07T00:11:13.838491+0000","last_became_peered":"2023-10-07T00:11:13.838491+0000","last_unstale":"2023-10-07T00:11:15.107838+0000","last_undegraded":"2023-10-07T00:11:15.107838+0000","last_fullsized":"2023-10-07T00:11:15.107838+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:29:31.340686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.149966+0000","last_change":"2023-10-07T00:11:12.838303+0000","last_active":"2023-10-07T00:11:14.149966+0000","last_peered":"2023-10-07T00:11:14.149966+0000","last_clean":"2023-10-07T00:11:14.149966+0000","last_became_active":"2023-10-07T00:11:12.837891+0000","last_became_peered":"2023-10-07T00:11:12.837891+0000","last_unstale":"2023-10-07T00:11:14.149966+0000","last_undegraded":"2023-10-07T00:11:14.149966+0000","last_fullsized":"2023-10-07T00:11:14.149966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:56.957653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.363318+0000","last_change":"2023-10-07T00:11:13.840109+0000","last_active":"2023-10-07T00:11:15.363318+0000","last_peered":"2023-10-07T00:11:15.363318+0000","last_clean":"2023-10-07T00:11:15.363318+0000","last_became_active":"2023-10-07T00:11:13.839767+0000","last_became_peered":"2023-10-07T00:11:13.839767+0000","last_unstale":"2023-10-07T00:11:15.363318+0000","last_undegraded":"2023-10-07T00:11:15.363318+0000","last_fullsized":"2023-10-07T00:11:15.363318+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:24.236839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108337+0000","last_change":"2023-10-07T00:11:12.837365+0000","last_active":"2023-10-07T00:11:15.108337+0000","last_peered":"2023-10-07T00:11:15.108337+0000","last_clean":"2023-10-07T00:11:15.108337+0000","last_became_active":"2023-10-07T00:11:12.836992+0000","last_became_peered":"2023-10-07T00:11:12.836992+0000","last_unstale":"2023-10-07T00:11:15.108337+0000","last_undegraded":"2023-10-07T00:11:15.108337+0000","last_fullsized":"2023-10-07T00:11:15.108337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:24:09.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107864+0000","last_change":"2023-10-07T00:11:13.851151+0000","last_active":"2023-10-07T00:11:15.107864+0000","last_peered":"2023-10-07T00:11:15.107864+0000","last_clean":"2023-10-07T00:11:15.107864+0000","last_became_active":"2023-10-07T00:11:13.850807+0000","last_became_peered":"2023-10-07T00:11:13.850807+0000","last_unstale":"2023-10-07T00:11:15.107864+0000","last_undegraded":"2023-10-07T00:11:15.107864+0000","last_fullsized":"2023-10-07T00:11:15.107864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:17:42.857720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854870+0000","last_change":"2023-10-07T00:11:13.844143+0000","last_active":"2023-10-07T00:11:14.854870+0000","last_peered":"2023-10-07T00:11:14.854870+0000","last_clean":"2023-10-07T00:11:14.854870+0000","last_became_active":"2023-10-07T00:11:13.843633+0000","last_became_peered":"2023-10-07T00:11:13.843633+0000","last_unstale":"2023-10-07T00:11:14.854870+0000","last_undegraded":"2023-10-07T00:11:14.854870+0000","last_fullsized":"2023-10-07T00:11:14.854870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:42:20.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107714+0000","last_change":"2023-10-07T00:11:12.836076+0000","last_active":"2023-10-07T00:11:15.107714+0000","last_peered":"2023-10-07T00:11:15.107714+0000","last_clean":"2023-10-07T00:11:15.107714+0000","last_became_active":"2023-10-07T00:11:12.835709+0000","last_became_peered":"2023-10-07T00:11:12.835709+0000","last_unstale":"2023-10-07T00:11:15.107714+0000","last_undegraded":"2023-10-07T00:11:15.107714+0000","last_fullsized":"2023-10-07T00:11:15.107714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.096103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819194+0000","last_change":"2023-10-07T00:11:13.844429+0000","last_active":"2023-10-07T00:11:14.819194+0000","last_peered":"2023-10-07T00:11:14.819194+0000","last_clean":"2023-10-07T00:11:14.819194+0000","last_became_active":"2023-10-07T00:11:13.844075+0000","last_became_peered":"2023-10-07T00:11:13.844075+0000","last_unstale":"2023-10-07T00:11:14.819194+0000","last_undegraded":"2023-10-07T00:11:14.819194+0000","last_fullsized":"2023-10-07T00:11:14.819194+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:01:05.832929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.644947+0000","last_change":"2023-10-07T00:11:12.839717+0000","last_active":"2023-10-07T00:11:19.644947+0000","last_peered":"2023-10-07T00:11:19.644947+0000","last_clean":"2023-10-07T00:11:19.644947+0000","last_became_active":"2023-10-07T00:11:12.839287+0000","last_became_peered":"2023-10-07T00:11:12.839287+0000","last_unstale":"2023-10-07T00:11:19.644947+0000","last_undegraded":"2023-10-07T00:11:19.644947+0000","last_fullsized":"2023-10-07T00:11:19.644947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:11.170207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":311,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-07T00:11:13.825106+0000","last_change":"2023-10-07T00:09:53.652919+0000","last_active":"2023-10-07T00:11:13.825106+0000","last_peered":"2023-10-07T00:11:13.825106+0000","last_clean":"2023-10-07T00:11:13.825106+0000","last_became_active":"2023-10-07T00:09:53.652407+0000","last_became_peered":"2023-10-07T00:09:53.652407+0000","last_unstale":"2023-10-07T00:11:13.825106+0000","last_undegraded":"2023-10-07T00:11:13.825106+0000","last_fullsized":"2023-10-07T00:11:13.825106+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_clean_scrub_stamp":"2023-10-07T00:06:22.557862+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:33:55.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107614+0000","last_change":"2023-10-07T00:11:13.830797+0000","last_active":"2023-10-07T00:11:15.107614+0000","last_peered":"2023-10-07T00:11:15.107614+0000","last_clean":"2023-10-07T00:11:15.107614+0000","last_became_active":"2023-10-07T00:11:13.830467+0000","last_became_peered":"2023-10-07T00:11:13.830467+0000","last_unstale":"2023-10-07T00:11:15.107614+0000","last_undegraded":"2023-10-07T00:11:15.107614+0000","last_fullsized":"2023-10-07T00:11:15.107614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:48.545184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108157+0000","last_change":"2023-10-07T00:11:12.836000+0000","last_active":"2023-10-07T00:11:15.108157+0000","last_peered":"2023-10-07T00:11:15.108157+0000","last_clean":"2023-10-07T00:11:15.108157+0000","last_became_active":"2023-10-07T00:11:12.835588+0000","last_became_peered":"2023-10-07T00:11:12.835588+0000","last_unstale":"2023-10-07T00:11:15.108157+0000","last_undegraded":"2023-10-07T00:11:15.108157+0000","last_fullsized":"2023-10-07T00:11:15.108157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:55:54.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819821+0000","last_change":"2023-10-07T00:11:12.832622+0000","last_active":"2023-10-07T00:11:14.819821+0000","last_peered":"2023-10-07T00:11:14.819821+0000","last_clean":"2023-10-07T00:11:14.819821+0000","last_became_active":"2023-10-07T00:11:12.832215+0000","last_became_peered":"2023-10-07T00:11:12.832215+0000","last_unstale":"2023-10-07T00:11:14.819821+0000","last_undegraded":"2023-10-07T00:11:14.819821+0000","last_fullsized":"2023-10-07T00:11:14.819821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:35.867540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108577+0000","last_change":"2023-10-07T00:11:13.828373+0000","last_active":"2023-10-07T00:11:15.108577+0000","last_peered":"2023-10-07T00:11:15.108577+0000","last_clean":"2023-10-07T00:11:15.108577+0000","last_became_active":"2023-10-07T00:11:13.827999+0000","last_became_peered":"2023-10-07T00:11:13.827999+0000","last_unstale":"2023-10-07T00:11:15.108577+0000","last_undegraded":"2023-10-07T00:11:15.108577+0000","last_fullsized":"2023-10-07T00:11:15.108577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:43.551348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.340724+0000","last_change":"2023-10-07T00:11:12.840166+0000","last_active":"2023-10-07T00:11:18.340724+0000","last_peered":"2023-10-07T00:11:18.340724+0000","last_clean":"2023-10-07T00:11:18.340724+0000","last_became_active":"2023-10-07T00:11:12.839831+0000","last_became_peered":"2023-10-07T00:11:12.839831+0000","last_unstale":"2023-10-07T00:11:18.340724+0000","last_undegraded":"2023-10-07T00:11:18.340724+0000","last_fullsized":"2023-10-07T00:11:18.340724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:47.190379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819470+0000","last_change":"2023-10-07T00:11:13.838814+0000","last_active":"2023-10-07T00:11:14.819470+0000","last_peered":"2023-10-07T00:11:14.819470+0000","last_clean":"2023-10-07T00:11:14.819470+0000","last_became_active":"2023-10-07T00:11:13.838468+0000","last_became_peered":"2023-10-07T00:11:13.838468+0000","last_unstale":"2023-10-07T00:11:14.819470+0000","last_undegraded":"2023-10-07T00:11:14.819470+0000","last_fullsized":"2023-10-07T00:11:14.819470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:29:38.944450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.654842+0000","last_change":"2023-10-07T00:11:12.837042+0000","last_active":"2023-10-07T00:11:19.654842+0000","last_peered":"2023-10-07T00:11:19.654842+0000","last_clean":"2023-10-07T00:11:19.654842+0000","last_became_active":"2023-10-07T00:11:12.836605+0000","last_became_peered":"2023-10-07T00:11:12.836605+0000","last_unstale":"2023-10-07T00:11:19.654842+0000","last_undegraded":"2023-10-07T00:11:19.654842+0000","last_fullsized":"2023-10-07T00:11:19.654842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:30:13.684063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108139+0000","last_change":"2023-10-07T00:11:13.840778+0000","last_active":"2023-10-07T00:11:15.108139+0000","last_peered":"2023-10-07T00:11:15.108139+0000","last_clean":"2023-10-07T00:11:15.108139+0000","last_became_active":"2023-10-07T00:11:13.840472+0000","last_became_peered":"2023-10-07T00:11:13.840472+0000","last_unstale":"2023-10-07T00:11:15.108139+0000","last_undegraded":"2023-10-07T00:11:15.108139+0000","last_fullsized":"2023-10-07T00:11:15.108139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:59.088416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:17.328545+0000","last_change":"2023-10-07T00:11:12.838534+0000","last_active":"2023-10-07T00:11:17.328545+0000","last_peered":"2023-10-07T00:11:17.328545+0000","last_clean":"2023-10-07T00:11:17.328545+0000","last_became_active":"2023-10-07T00:11:12.838220+0000","last_became_peered":"2023-10-07T00:11:12.838220+0000","last_unstale":"2023-10-07T00:11:17.328545+0000","last_undegraded":"2023-10-07T00:11:17.328545+0000","last_fullsized":"2023-10-07T00:11:17.328545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:16:47.170815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819290+0000","last_change":"2023-10-07T00:11:13.831506+0000","last_active":"2023-10-07T00:11:14.819290+0000","last_peered":"2023-10-07T00:11:14.819290+0000","last_clean":"2023-10-07T00:11:14.819290+0000","last_became_active":"2023-10-07T00:11:13.831093+0000","last_became_peered":"2023-10-07T00:11:13.831093+0000","last_unstale":"2023-10-07T00:11:14.819290+0000","last_undegraded":"2023-10-07T00:11:14.819290+0000","last_fullsized":"2023-10-07T00:11:14.819290+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:02.749470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:17.329623+0000","last_change":"2023-10-07T00:11:12.841662+0000","last_active":"2023-10-07T00:11:17.329623+0000","last_peered":"2023-10-07T00:11:17.329623+0000","last_clean":"2023-10-07T00:11:17.329623+0000","last_became_active":"2023-10-07T00:11:12.841207+0000","last_became_peered":"2023-10-07T00:11:12.841207+0000","last_unstale":"2023-10-07T00:11:17.329623+0000","last_undegraded":"2023-10-07T00:11:17.329623+0000","last_fullsized":"2023-10-07T00:11:17.329623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:10.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107673+0000","last_change":"2023-10-07T00:11:13.844943+0000","last_active":"2023-10-07T00:11:15.107673+0000","last_peered":"2023-10-07T00:11:15.107673+0000","last_clean":"2023-10-07T00:11:15.107673+0000","last_became_active":"2023-10-07T00:11:13.844387+0000","last_became_peered":"2023-10-07T00:11:13.844387+0000","last_unstale":"2023-10-07T00:11:15.107673+0000","last_undegraded":"2023-10-07T00:11:15.107673+0000","last_fullsized":"2023-10-07T00:11:15.107673+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:35.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:18.492389+0000","last_change":"2023-10-07T00:11:12.838191+0000","last_active":"2023-10-07T00:11:18.492389+0000","last_peered":"2023-10-07T00:11:18.492389+0000","last_clean":"2023-10-07T00:11:18.492389+0000","last_became_active":"2023-10-07T00:11:12.837821+0000","last_became_peered":"2023-10-07T00:11:12.837821+0000","last_unstale":"2023-10-07T00:11:18.492389+0000","last_undegraded":"2023-10-07T00:11:18.492389+0000","last_fullsized":"2023-10-07T00:11:18.492389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:16:38.519554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819280+0000","last_change":"2023-10-07T00:11:13.841478+0000","last_active":"2023-10-07T00:11:14.819280+0000","last_peered":"2023-10-07T00:11:14.819280+0000","last_clean":"2023-10-07T00:11:14.819280+0000","last_became_active":"2023-10-07T00:11:13.841085+0000","last_became_peered":"2023-10-07T00:11:13.841085+0000","last_unstale":"2023-10-07T00:11:14.819280+0000","last_undegraded":"2023-10-07T00:11:14.819280+0000","last_fullsized":"2023-10-07T00:11:14.819280+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:54:03.100980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:17.328686+0000","last_change":"2023-10-07T00:11:12.831175+0000","last_active":"2023-10-07T00:11:17.328686+0000","last_peered":"2023-10-07T00:11:17.328686+0000","last_clean":"2023-10-07T00:11:17.328686+0000","last_became_active":"2023-10-07T00:11:12.830859+0000","last_became_peered":"2023-10-07T00:11:12.830859+0000","last_unstale":"2023-10-07T00:11:17.328686+0000","last_undegraded":"2023-10-07T00:11:17.328686+0000","last_fullsized":"2023-10-07T00:11:17.328686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:07.072334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108557+0000","last_change":"2023-10-07T00:11:13.834163+0000","last_active":"2023-10-07T00:11:15.108557+0000","last_peered":"2023-10-07T00:11:15.108557+0000","last_clean":"2023-10-07T00:11:15.108557+0000","last_became_active":"2023-10-07T00:11:13.833807+0000","last_became_peered":"2023-10-07T00:11:13.833807+0000","last_unstale":"2023-10-07T00:11:15.108557+0000","last_undegraded":"2023-10-07T00:11:15.108557+0000","last_fullsized":"2023-10-07T00:11:15.108557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:12:18.606936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.656443+0000","last_change":"2023-10-07T00:11:12.835598+0000","last_active":"2023-10-07T00:11:19.656443+0000","last_peered":"2023-10-07T00:11:19.656443+0000","last_clean":"2023-10-07T00:11:19.656443+0000","last_became_active":"2023-10-07T00:11:12.835295+0000","last_became_peered":"2023-10-07T00:11:12.835295+0000","last_unstale":"2023-10-07T00:11:19.656443+0000","last_undegraded":"2023-10-07T00:11:19.656443+0000","last_fullsized":"2023-10-07T00:11:19.656443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:40:52.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108734+0000","last_change":"2023-10-07T00:11:13.837918+0000","last_active":"2023-10-07T00:11:15.108734+0000","last_peered":"2023-10-07T00:11:15.108734+0000","last_clean":"2023-10-07T00:11:15.108734+0000","last_became_active":"2023-10-07T00:11:13.834284+0000","last_became_peered":"2023-10-07T00:11:13.834284+0000","last_unstale":"2023-10-07T00:11:15.108734+0000","last_undegraded":"2023-10-07T00:11:15.108734+0000","last_fullsized":"2023-10-07T00:11:15.108734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:49:47.081395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:19.647775+0000","last_change":"2023-10-07T00:11:12.839362+0000","last_active":"2023-10-07T00:11:19.647775+0000","last_peered":"2023-10-07T00:11:19.647775+0000","last_clean":"2023-10-07T00:11:19.647775+0000","last_became_active":"2023-10-07T00:11:12.838902+0000","last_became_peered":"2023-10-07T00:11:12.838902+0000","last_unstale":"2023-10-07T00:11:19.647775+0000","last_undegraded":"2023-10-07T00:11:19.647775+0000","last_fullsized":"2023-10-07T00:11:19.647775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:05:34.649556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107902+0000","last_change":"2023-10-07T00:11:13.839356+0000","last_active":"2023-10-07T00:11:15.107902+0000","last_peered":"2023-10-07T00:11:15.107902+0000","last_clean":"2023-10-07T00:11:15.107902+0000","last_became_active":"2023-10-07T00:11:13.838936+0000","last_became_peered":"2023-10-07T00:11:13.838936+0000","last_unstale":"2023-10-07T00:11:15.107902+0000","last_undegraded":"2023-10-07T00:11:15.107902+0000","last_fullsized":"2023-10-07T00:11:15.107902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:02.860174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108098+0000","last_change":"2023-10-07T00:11:12.839966+0000","last_active":"2023-10-07T00:11:15.108098+0000","last_peered":"2023-10-07T00:11:15.108098+0000","last_clean":"2023-10-07T00:11:15.108098+0000","last_became_active":"2023-10-07T00:11:12.839505+0000","last_became_peered":"2023-10-07T00:11:12.839505+0000","last_unstale":"2023-10-07T00:11:15.108098+0000","last_undegraded":"2023-10-07T00:11:15.108098+0000","last_fullsized":"2023-10-07T00:11:15.108098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:45:50.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108758+0000","last_change":"2023-10-07T00:11:13.839478+0000","last_active":"2023-10-07T00:11:15.108758+0000","last_peered":"2023-10-07T00:11:15.108758+0000","last_clean":"2023-10-07T00:11:15.108758+0000","last_became_active":"2023-10-07T00:11:13.839097+0000","last_became_peered":"2023-10-07T00:11:13.839097+0000","last_unstale":"2023-10-07T00:11:15.108758+0000","last_undegraded":"2023-10-07T00:11:15.108758+0000","last_fullsized":"2023-10-07T00:11:15.108758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:55.668486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107736+0000","last_change":"2023-10-07T00:11:13.839518+0000","last_active":"2023-10-07T00:11:15.107736+0000","last_peered":"2023-10-07T00:11:15.107736+0000","last_clean":"2023-10-07T00:11:15.107736+0000","last_became_active":"2023-10-07T00:11:13.839189+0000","last_became_peered":"2023-10-07T00:11:13.839189+0000","last_unstale":"2023-10-07T00:11:15.107736+0000","last_undegraded":"2023-10-07T00:11:15.107736+0000","last_fullsized":"2023-10-07T00:11:15.107736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:30:34.647955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.958718+0000","last_change":"2023-10-07T00:11:13.835135+0000","last_active":"2023-10-07T00:11:14.958718+0000","last_peered":"2023-10-07T00:11:14.958718+0000","last_clean":"2023-10-07T00:11:14.958718+0000","last_became_active":"2023-10-07T00:11:13.834785+0000","last_became_peered":"2023-10-07T00:11:13.834785+0000","last_unstale":"2023-10-07T00:11:14.958718+0000","last_undegraded":"2023-10-07T00:11:14.958718+0000","last_fullsized":"2023-10-07T00:11:14.958718+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:00.136304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.958635+0000","last_change":"2023-10-07T00:11:13.841371+0000","last_active":"2023-10-07T00:11:14.958635+0000","last_peered":"2023-10-07T00:11:14.958635+0000","last_clean":"2023-10-07T00:11:14.958635+0000","last_became_active":"2023-10-07T00:11:13.840986+0000","last_became_peered":"2023-10-07T00:11:13.840986+0000","last_unstale":"2023-10-07T00:11:14.958635+0000","last_undegraded":"2023-10-07T00:11:14.958635+0000","last_fullsized":"2023-10-07T00:11:14.958635+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:49.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108223+0000","last_change":"2023-10-07T00:11:13.844865+0000","last_active":"2023-10-07T00:11:15.108223+0000","last_peered":"2023-10-07T00:11:15.108223+0000","last_clean":"2023-10-07T00:11:15.108223+0000","last_became_active":"2023-10-07T00:11:13.844495+0000","last_became_peered":"2023-10-07T00:11:13.844495+0000","last_unstale":"2023-10-07T00:11:15.108223+0000","last_undegraded":"2023-10-07T00:11:15.108223+0000","last_fullsized":"2023-10-07T00:11:15.108223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:00:29.862865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108736+0000","last_change":"2023-10-07T00:11:13.841126+0000","last_active":"2023-10-07T00:11:15.108736+0000","last_peered":"2023-10-07T00:11:15.108736+0000","last_clean":"2023-10-07T00:11:15.108736+0000","last_became_active":"2023-10-07T00:11:13.840748+0000","last_became_peered":"2023-10-07T00:11:13.840748+0000","last_unstale":"2023-10-07T00:11:15.108736+0000","last_undegraded":"2023-10-07T00:11:15.108736+0000","last_fullsized":"2023-10-07T00:11:15.108736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:55.444456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107855+0000","last_change":"2023-10-07T00:11:13.840320+0000","last_active":"2023-10-07T00:11:15.107855+0000","last_peered":"2023-10-07T00:11:15.107855+0000","last_clean":"2023-10-07T00:11:15.107855+0000","last_became_active":"2023-10-07T00:11:13.839993+0000","last_became_peered":"2023-10-07T00:11:13.839993+0000","last_unstale":"2023-10-07T00:11:15.107855+0000","last_undegraded":"2023-10-07T00:11:15.107855+0000","last_fullsized":"2023-10-07T00:11:15.107855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:29:39.843550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.958812+0000","last_change":"2023-10-07T00:11:13.830436+0000","last_active":"2023-10-07T00:11:14.958812+0000","last_peered":"2023-10-07T00:11:14.958812+0000","last_clean":"2023-10-07T00:11:14.958812+0000","last_became_active":"2023-10-07T00:11:13.827974+0000","last_became_peered":"2023-10-07T00:11:13.827974+0000","last_unstale":"2023-10-07T00:11:14.958812+0000","last_undegraded":"2023-10-07T00:11:14.958812+0000","last_fullsized":"2023-10-07T00:11:14.958812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:46.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.819462+0000","last_change":"2023-10-07T00:11:13.833929+0000","last_active":"2023-10-07T00:11:14.819462+0000","last_peered":"2023-10-07T00:11:14.819462+0000","last_clean":"2023-10-07T00:11:14.819462+0000","last_became_active":"2023-10-07T00:11:13.833539+0000","last_became_peered":"2023-10-07T00:11:13.833539+0000","last_unstale":"2023-10-07T00:11:14.819462+0000","last_undegraded":"2023-10-07T00:11:14.819462+0000","last_fullsized":"2023-10-07T00:11:14.819462+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:46:04.981559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.854656+0000","last_change":"2023-10-07T00:11:13.837959+0000","last_active":"2023-10-07T00:11:14.854656+0000","last_peered":"2023-10-07T00:11:14.854656+0000","last_clean":"2023-10-07T00:11:14.854656+0000","last_became_active":"2023-10-07T00:11:13.837650+0000","last_became_peered":"2023-10-07T00:11:13.837650+0000","last_unstale":"2023-10-07T00:11:14.854656+0000","last_undegraded":"2023-10-07T00:11:14.854656+0000","last_fullsized":"2023-10-07T00:11:14.854656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:41.068847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:14.818868+0000","last_change":"2023-10-07T00:11:13.847348+0000","last_active":"2023-10-07T00:11:14.818868+0000","last_peered":"2023-10-07T00:11:14.818868+0000","last_clean":"2023-10-07T00:11:14.818868+0000","last_became_active":"2023-10-07T00:11:13.846988+0000","last_became_peered":"2023-10-07T00:11:13.846988+0000","last_unstale":"2023-10-07T00:11:14.818868+0000","last_undegraded":"2023-10-07T00:11:14.818868+0000","last_fullsized":"2023-10-07T00:11:14.818868+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.960128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108199+0000","last_change":"2023-10-07T00:11:13.831801+0000","last_active":"2023-10-07T00:11:15.108199+0000","last_peered":"2023-10-07T00:11:15.108199+0000","last_clean":"2023-10-07T00:11:15.108199+0000","last_became_active":"2023-10-07T00:11:13.831497+0000","last_became_peered":"2023-10-07T00:11:13.831497+0000","last_unstale":"2023-10-07T00:11:15.108199+0000","last_undegraded":"2023-10-07T00:11:15.108199+0000","last_fullsized":"2023-10-07T00:11:15.108199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:43.802252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.108687+0000","last_change":"2023-10-07T00:11:13.841423+0000","last_active":"2023-10-07T00:11:15.108687+0000","last_peered":"2023-10-07T00:11:15.108687+0000","last_clean":"2023-10-07T00:11:15.108687+0000","last_became_active":"2023-10-07T00:11:13.841115+0000","last_became_peered":"2023-10-07T00:11:13.841115+0000","last_unstale":"2023-10-07T00:11:15.108687+0000","last_undegraded":"2023-10-07T00:11:15.108687+0000","last_fullsized":"2023-10-07T00:11:15.108687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:32.355577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-07T00:11:15.107701+0000","last_change":"2023-10-07T00:11:13.840162+0000","last_active":"2023-10-07T00:11:15.107701+0000","last_peered":"2023-10-07T00:11:15.107701+0000","last_clean":"2023-10-07T00:11:15.107701+0000","last_became_active":"2023-10-07T00:11:13.839760+0000","last_became_peered":"2023-10-07T00:11:13.839760+0000","last_unstale":"2023-10-07T00:11:15.107701+0000","last_undegraded":"2023-10-07T00:11:15.107701+0000","last_fullsized":"2023-10-07T00:11:15.107701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.727027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248175,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23937,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":148,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":50994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350991,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":10,"up_from":73,"seq":313532612628,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1035076,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.496}]},{"osd":2,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61199999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.71099999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56499999999999995}]},{"osd":8,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79400000000000004}]},{"osd":9,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.024},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.73199999999999998}]},{"osd":11,"last update":"Sat Oct 7 00:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.069},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.77100000000000002}]}]},{"osd":9,"up_from":68,"seq":292057776153,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":442144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":1.804}]},{"osd":1,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":1.016}]},{"osd":3,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.495},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.982}]},{"osd":4,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.8540000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.88200000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.528},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":2.1179999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.83099999999999996}]},{"osd":10,"last update":"Sat Oct 7 00:10:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.8899999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.611}]}]},{"osd":8,"up_from":60,"seq":257698037791,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":442098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88900000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.503},{"interface":"front","average":{"1min":0.625,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.47999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.89800000000000002,"5min":1.117,"15min":1.117},"last":0.64300000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.59899999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95899999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83199999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44}]},{"osd":3,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.073,"15min":1.073},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.877,"5min":1.498,"15min":1.498},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.629},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.438,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90400000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.747},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93799999999999994,"5min":1.389,"15min":1.389},"last":0.72899999999999998}]},{"osd":7,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.85499999999999998},"min":{"1min":0.63600000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.66200000000000003}]},{"osd":9,"last update":"Sat Oct 7 00:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80700000000000005}]},{"osd":10,"last update":"Sat Oct 7 00:10:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.873},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":1031979,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93999999999999995,"5min":1.149,"15min":1.149},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91200000000000003,"5min":1.163,"15min":1.163},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.58399999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72399999999999998,"15min":0.71499999999999997},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.67700000000000005,"15min":0.68600000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0209999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.109,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.028},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.63800000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2729999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.177}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.81899999999999995,"15min":0.80500000000000005},"min":{"1min":0.66300000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.113}]},{"osd":9,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.147},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.78700000000000003}]},{"osd":10,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.208},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.85299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60099999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74199999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.47699999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.53400000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0880000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.495}]},{"osd":2,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76800000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.325,"15min":1.325},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.153,"5min":1.405,"15min":1.405},"last":0.67000000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":1.208,"15min":1.208},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97799999999999998,"5min":1.292,"15min":1.292},"last":0.58099999999999996}]},{"osd":7,"last update":"Sat Oct 7 00:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.60699999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.208,"5min":1.419,"15min":1.419},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.85099999999999998,"15min":0.83699999999999997},"min":{"1min":0.75700000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.325,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.83599999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.877,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89000000000000001,"15min":0.89500000000000002},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0089999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64900000000000002}]},{"osd":9,"last update":"Sat Oct 7 00:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.874},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.63600000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":442699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88300000000000001,"5min":1.018,"15min":1.018},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90900000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Oct 7 00:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.60699999999999998,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97199999999999998,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.71899999999999997}]},{"osd":3,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.66000000000000003,"15min":0.60999999999999999},"min":{"1min":0.55600000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0489999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Oct 7 00:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.52500000000000002,"15min":0.503},"min":{"1min":0.36799999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.45900000000000002}]},{"osd":5,"last update":"Sat Oct 7 00:10:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.69999999999999996,"15min":0.67300000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0349999999999999,"5min":1.107,"15min":1.107},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.503,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.503}]},{"osd":7,"last update":"Sat Oct 7 00:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.78900000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83899999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.59799999999999998}]},{"osd":9,"last update":"Sat Oct 7 00:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63100000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.82899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":442565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 00:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.502,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97599999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.72299999999999998}]},{"osd":2,"last update":"Sat Oct 7 00:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85199999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0189999999999999,"5min":1.024,"15min":1.024},"last":0.627}]},{"osd":3,"last update":"Sat Oct 7 00:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97499999999999998,"5min":1.113,"15min":1.113},"last":0.745},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64300000000000002,"15min":0.621},"min":{"1min":0.502,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.101,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98999999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 00:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.60999999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77000000000000002}]},{"osd":9,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.78500000000000003}]},{"osd":10,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.88400000000000001}]},{"osd":11,"last update":"Sat Oct 7 00:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.80600000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":462699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.84999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":1.048,"15min":1.048},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 7 00:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.82799999999999996}]},{"osd":3,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.91200000000000003,"5min":1.022,"15min":1.022},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Oct 7 00:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.48599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Oct 7 00:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81100000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.92200000000000004}]},{"osd":6,"last update":"Sat Oct 7 00:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.60099999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98299999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.87},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90100000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.81200000000000006},"min":{"1min":0.60099999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91200000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.72299999999999998}]},{"osd":8,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.46700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.753}]},{"osd":9,"last update":"Sat Oct 7 00:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.89100000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":1.048}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149751,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":441133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.42499999999999999,"15min":0.40699999999999997},"min":{"1min":0.36699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.45100000000000001,"15min":0.432},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:10:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63100000000000001}]},{"osd":2,"last update":"Sat Oct 7 00:10:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91600000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1399999999999999,"5min":1.284,"15min":1.284},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.02,"5min":1.048,"15min":1.048},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.167,"5min":1.169,"15min":1.169},"last":0.96799999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:10:47 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72299999999999998,"15min":0.69799999999999995},"min":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.68000000000000005},"min":{"1min":0.50800000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98599999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Sat Oct 7 00:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0920000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.71799999999999997,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.74099999999999999,"15min":0.72799999999999998},"min":{"1min":0.59999999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0800000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.84299999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.89400000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.052,"5min":1.103,"15min":1.103},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.746}]},{"osd":9,"last update":"Sat Oct 7 00:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.198},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.5189999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.252}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]}]},{"osd":4,"up_from":34,"seq":146028888116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56100000000000005,"15min":0.54300000000000004},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.67100000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.63,"5min":0.745,"15min":0.745},"last":0.495}]},{"osd":2,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.48899999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91200000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.51500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.624},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88800000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.44400000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:10:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.626},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.71899999999999997,"15min":0.70299999999999996},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Sat Oct 7 00:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.71699999999999997,"15min":0.69499999999999995},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0309999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70299999999999996,"15min":0.69199999999999995},"min":{"1min":0.52000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.51300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.753},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.57299999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.59899999999999998}]},{"osd":8,"last update":"Sat Oct 7 00:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.67400000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.84999999999999998}]},{"osd":9,"last update":"Sat Oct 7 00:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.56599999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724590,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1032873,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60699999999999998,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.78500000000000003,"15min":0.82999999999999996},"min":{"1min":0.48799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.034,"5min":5.96,"15min":5.96},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63700000000000001,"15min":0.61499999999999999},"min":{"1min":0.50600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.378}]},{"osd":3,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.503}]},{"osd":4,"last update":"Sat Oct 7 00:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.50800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0720000000000001,"5min":1.093,"15min":1.093},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.85899999999999999,"15min":0.92900000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93899999999999995,"5min":5.9100000000000001,"15min":5.9100000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.50700000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.90300000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Oct 7 00:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76800000000000002,"15min":0.76500000000000001},"min":{"1min":0.55100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63100000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68100000000000005}]},{"osd":9,"last update":"Sat Oct 7 00:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.81999999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":21339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":20713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T00:11:23.340 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T00:11:23.340 INFO:tasks.cephadm:Setting up client nodes... 2023-10-07T00:11:23.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-07T00:11:23.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:23 smithi088 ceph-mon[103111]: mgrmap e17: x(active, since 7m), standbys: y, z 2023-10-07T00:11:23.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:23 smithi088 ceph-mon[103111]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:11:23.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:23 smithi112 ceph-mon[133548]: mgrmap e17: x(active, since 7m), standbys: y, z 2023-10-07T00:11:23.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:23 smithi112 ceph-mon[133548]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:11:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:24.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:23 smithi005 ceph-mon[129406]: mgrmap e17: x(active, since 7m), standbys: y, z 2023-10-07T00:11:24.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:23 smithi005 ceph-mon[129406]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:11:24.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:24 smithi088 ceph-mon[103111]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:11:24.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:24 smithi088 ceph-mon[103111]: pgmap v303: 97 pgs: 97 active+clean; 601 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.0 KiB/s wr, 21 op/s 2023-10-07T00:11:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:24 smithi112 ceph-mon[133548]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:11:24.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:24 smithi112 ceph-mon[133548]: pgmap v303: 97 pgs: 97 active+clean; 601 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.0 KiB/s wr, 21 op/s 2023-10-07T00:11:25.038 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:24 smithi005 ceph-mon[129406]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:11:25.038 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:24 smithi005 ceph-mon[129406]: pgmap v303: 97 pgs: 97 active+clean; 601 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.0 KiB/s wr, 21 op/s 2023-10-07T00:11:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.624+0000 7f06d4150700 1 -- 172.21.15.5:0/2789289900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc102b50 msgr2=0x7f06cc109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.624+0000 7f06d4150700 1 --2- 172.21.15.5:0/2789289900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc102b50 0x7f06cc109400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f06c400b0d0 tx=0x7f06c400b3e0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.624+0000 7f06d4150700 1 -- 172.21.15.5:0/2789289900 shutdown_connections 2023-10-07T00:11:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.624+0000 7f06d4150700 1 --2- 172.21.15.5:0/2789289900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc102b50 0x7f06cc109400 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.624+0000 7f06d4150700 1 --2- 172.21.15.5:0/2789289900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc100fb0 0x7f06cc1013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.624+0000 7f06d4150700 1 --2- 172.21.15.5:0/2789289900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06cc1021b0 0x7f06cc102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.624+0000 7f06d4150700 1 -- 172.21.15.5:0/2789289900 >> 172.21.15.5:0/2789289900 conn(0x7f06cc0fc570 msgr2=0x7f06cc0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.625+0000 7f06d4150700 1 -- 172.21.15.5:0/2789289900 shutdown_connections 2023-10-07T00:11:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.625+0000 7f06d4150700 1 -- 172.21.15.5:0/2789289900 wait complete. 2023-10-07T00:11:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d4150700 1 Processor -- start 2023-10-07T00:11:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d4150700 1 -- start start 2023-10-07T00:11:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d4150700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc100fb0 0x7f06cc198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d4150700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06cc1021b0 0x7f06cc1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d4150700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc102b50 0x7f06cc1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d4150700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1a0a20 con 0x7f06cc100fb0 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d4150700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1a0b60 con 0x7f06cc1021b0 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d4150700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1a0cf0 con 0x7f06cc102b50 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d1eec700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc100fb0 0x7f06cc198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d1eec700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc100fb0 0x7f06cc198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38452/0 (socket says 172.21.15.5:38452) 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d1eec700 1 -- 172.21.15.5:0/2686012808 learned_addr learned my addr 172.21.15.5:0/2686012808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.626+0000 7f06d16eb700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06cc1021b0 0x7f06cc1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06d26ed700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc102b50 0x7f06cc1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06d1eec700 1 -- 172.21.15.5:0/2686012808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc102b50 msgr2=0x7f06cc1a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06d1eec700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc102b50 0x7f06cc1a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06d1eec700 1 -- 172.21.15.5:0/2686012808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06cc1021b0 msgr2=0x7f06cc1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06d1eec700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06cc1021b0 0x7f06cc1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06d1eec700 1 -- 172.21.15.5:0/2686012808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4009d00 con 0x7f06cc100fb0 2023-10-07T00:11:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06d1eec700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc100fb0 0x7f06cc198e90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f06c800d9b0 tx=0x7f06c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06c2ffd700 1 -- 172.21.15.5:0/2686012808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8004020 con 0x7f06cc100fb0 2023-10-07T00:11:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06c2ffd700 1 -- 172.21.15.5:0/2686012808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06c8009730 con 0x7f06cc100fb0 2023-10-07T00:11:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06c2ffd700 1 -- 172.21.15.5:0/2686012808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80039c0 con 0x7f06cc100fb0 2023-10-07T00:11:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.627+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc1a0fd0 con 0x7f06cc100fb0 2023-10-07T00:11:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.628+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc1a1330 con 0x7f06cc100fb0 2023-10-07T00:11:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.629+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc1934a0 con 0x7f06cc100fb0 2023-10-07T00:11:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.630+0000 7f06c2ffd700 1 -- 172.21.15.5:0/2686012808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f06c80098a0 con 0x7f06cc100fb0 2023-10-07T00:11:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.632+0000 7f06c2ffd700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f06b80a1510 0x7f06b80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.632+0000 7f06c2ffd700 1 -- 172.21.15.5:0/2686012808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f06c80cc9d0 con 0x7f06cc100fb0 2023-10-07T00:11:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.632+0000 7f06d16eb700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f06b80a1510 0x7f06b80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.633+0000 7f06d16eb700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f06b80a1510 0x7f06b80a39d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06bc005950 tx=0x7f06bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.636+0000 7f06c2ffd700 1 -- 172.21.15.5:0/2686012808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f06c8096080 con 0x7f06cc100fb0 2023-10-07T00:11:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.930+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f06cc02d0c0 con 0x7f06cc100fb0 2023-10-07T00:11:25.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.933+0000 7f06c2ffd700 1 -- 172.21.15.5:0/2686012808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f06c80996a0 con 0x7f06cc100fb0 2023-10-07T00:11:25.934 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-07T00:11:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAtoiBlXo2LNxAAAdY8hD4E+OvxfNJBA8J1AA== 2023-10-07T00:11:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f06b80a1510 msgr2=0x7f06b80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f06b80a1510 0x7f06b80a39d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06bc005950 tx=0x7f06bc00b410 comp rx=0 tx=0).stop 2023-10-07T00:11:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc100fb0 msgr2=0x7f06cc198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc100fb0 0x7f06cc198e90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f06c800d9b0 tx=0x7f06c800dcc0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 shutdown_connections 2023-10-07T00:11:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f06b80a1510 0x7f06b80a39d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc102b50 0x7f06cc1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06cc100fb0 0x7f06cc198e90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 --2- 172.21.15.5:0/2686012808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06cc1021b0 0x7f06cc1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.935+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 >> 172.21.15.5:0/2686012808 conn(0x7f06cc0fc570 msgr2=0x7f06cc107a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:25.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.936+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 shutdown_connections 2023-10-07T00:11:25.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:25.936+0000 7f06d4150700 1 -- 172.21.15.5:0/2686012808 wait complete. 2023-10-07T00:11:26.390 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:11:26.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-07T00:11:26.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-07T00:11:26.494 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-07T00:11:26.494 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-07T00:11:26.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-07T00:11:26.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:26 smithi088 ceph-mon[103111]: pgmap v304: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 9.6 KiB/s wr, 27 op/s 2023-10-07T00:11:26.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:26 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2686012808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-07T00:11:26.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:26 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2686012808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-07T00:11:26.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:26 smithi112 ceph-mon[133548]: pgmap v304: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 9.6 KiB/s wr, 27 op/s 2023-10-07T00:11:26.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:26 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2686012808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-07T00:11:26.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:26 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2686012808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-07T00:11:27.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:26 smithi005 ceph-mon[129406]: pgmap v304: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 9.6 KiB/s wr, 27 op/s 2023-10-07T00:11:27.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:26 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2686012808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-07T00:11:27.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:26 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2686012808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-07T00:11:27.271 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.672+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/1019329367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 msgr2=0x7f6ca0101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.672+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/1019329367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 0x7f6ca0101400 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6c940099c0 tx=0x7f6c94009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.673+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/1019329367 shutdown_connections 2023-10-07T00:11:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.673+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/1019329367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ca0101940 0x7f6ca010ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.673+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/1019329367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca0106f90 0x7f6ca0107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.673+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/1019329367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 0x7f6ca0101400 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.673+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/1019329367 >> 172.21.15.5:0/1019329367 conn(0x7f6ca00780a0 msgr2=0x7f6ca00784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.673+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/1019329367 shutdown_connections 2023-10-07T00:11:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.673+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/1019329367 wait complete. 2023-10-07T00:11:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.674+0000 7f6ca6a4d700 1 Processor -- start 2023-10-07T00:11:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.674+0000 7f6ca6a4d700 1 -- start start 2023-10-07T00:11:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6ca6a4d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 0x7f6ca0196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6ca6a4d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ca0101940 0x7f6ca01974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6ca6a4d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca0106f90 0x7f6ca019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6ca6a4d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca019bf30 con 0x7f6ca0100f80 2023-10-07T00:11:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6ca6a4d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca019c0a0 con 0x7f6ca0101940 2023-10-07T00:11:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6ca6a4d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca019c260 con 0x7f6ca0106f90 2023-10-07T00:11:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 0x7f6ca0196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 0x7f6ca0196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38478/0 (socket says 172.21.15.5:38478) 2023-10-07T00:11:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6c9f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ca0101940 0x7f6ca01974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.675+0000 7f6c9ffff700 1 -- 172.21.15.5:0/41422713 learned_addr learned my addr 172.21.15.5:0/41422713 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6ca4fea700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca0106f90 0x7f6ca019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9ffff700 1 -- 172.21.15.5:0/41422713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca0106f90 msgr2=0x7f6ca019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9ffff700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca0106f90 0x7f6ca019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9ffff700 1 -- 172.21.15.5:0/41422713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ca0101940 msgr2=0x7f6ca01974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9ffff700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ca0101940 0x7f6ca01974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9ffff700 1 -- 172.21.15.5:0/41422713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940095f0 con 0x7f6ca0100f80 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9ffff700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 0x7f6ca0196f70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000e9a0 tx=0x7f6c9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9d7fa700 1 -- 172.21.15.5:0/41422713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90009790 con 0x7f6ca0100f80 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca019c540 con 0x7f6ca0100f80 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9d7fa700 1 -- 172.21.15.5:0/41422713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c9000cbd0 con 0x7f6ca0100f80 2023-10-07T00:11:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6c9d7fa700 1 -- 172.21.15.5:0/41422713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90018680 con 0x7f6ca0100f80 2023-10-07T00:11:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.676+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca01a3da0 con 0x7f6ca0100f80 2023-10-07T00:11:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.677+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca004ebb0 con 0x7f6ca0100f80 2023-10-07T00:11:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.679+0000 7f6c9d7fa700 1 -- 172.21.15.5:0/41422713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f6c9000cd40 con 0x7f6ca0100f80 2023-10-07T00:11:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.681+0000 7f6c9d7fa700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c880a1510 0x7f6c880a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.681+0000 7f6c9d7fa700 1 -- 172.21.15.5:0/41422713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6c90014070 con 0x7f6ca0100f80 2023-10-07T00:11:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.681+0000 7f6c9f7fe700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c880a1510 0x7f6c880a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.682+0000 7f6c9f7fe700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c880a1510 0x7f6c880a39d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c94006010 tx=0x7f6c94005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.685+0000 7f6c9d7fa700 1 -- 172.21.15.5:0/41422713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c90052100 con 0x7f6ca0100f80 2023-10-07T00:11:28.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:28 smithi088 ceph-mon[103111]: pgmap v305: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2023-10-07T00:11:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.954+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6ca0110df0 con 0x7f6ca0100f80 2023-10-07T00:11:28.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.959+0000 7f6c9d7fa700 1 -- 172.21.15.5:0/41422713 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260396 (secure 0 0 0) 0x7f6c900965b0 con 0x7f6ca0100f80 2023-10-07T00:11:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c880a1510 msgr2=0x7f6c880a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c880a1510 0x7f6c880a39d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c94006010 tx=0x7f6c94005c00 comp rx=0 tx=0).stop 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 msgr2=0x7f6ca0196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 0x7f6ca0196f70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000e9a0 tx=0x7f6c9000ecb0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 shutdown_connections 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c880a1510 0x7f6c880a39d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca0106f90 0x7f6ca019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ca0100f80 0x7f6ca0196f70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 --2- 172.21.15.5:0/41422713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ca0101940 0x7f6ca01974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 >> 172.21.15.5:0/41422713 conn(0x7f6ca00780a0 msgr2=0x7f6ca00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:28.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 shutdown_connections 2023-10-07T00:11:28.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:28.964+0000 7f6ca6a4d700 1 -- 172.21.15.5:0/41422713 wait complete. 2023-10-07T00:11:28.988 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:28 smithi005 ceph-mon[129406]: pgmap v305: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2023-10-07T00:11:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:28 smithi112 ceph-mon[133548]: pgmap v305: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2023-10-07T00:11:29.457 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":227111979},{"type":"v1","addr":"172.21.15.5:6801","nonce":227111979}]},"active_addr":"172.21.15.5:6801/227111979","active_change":"2023-10-07T00:03:49.552351+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14220,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24106,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.5:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2895170237}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2217075891}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2721372777}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3241448954}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2763449905}]}]} 2023-10-07T00:11:29.466 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-07T00:11:29.466 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-07T00:11:29.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-07T00:11:29.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:29 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/41422713' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-07T00:11:29.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:29 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/41422713' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-07T00:11:30.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:29 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/41422713' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-07T00:11:30.239 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:30.843 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:30 smithi005 ceph-mon[129406]: pgmap v306: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2023-10-07T00:11:30.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:30 smithi088 ceph-mon[103111]: pgmap v306: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2023-10-07T00:11:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:30 smithi112 ceph-mon[133548]: pgmap v306: 97 pgs: 97 active+clean; 624 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2023-10-07T00:11:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 -- 172.21.15.5:0/3244227453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 msgr2=0x7fb424101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 --2- 172.21.15.5:0/3244227453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 0x7fb424101400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4180099c0 tx=0x7fb418009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 -- 172.21.15.5:0/3244227453 shutdown_connections 2023-10-07T00:11:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 --2- 172.21.15.5:0/3244227453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb424101940 0x7fb42410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 --2- 172.21.15.5:0/3244227453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb424106f90 0x7fb424107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 --2- 172.21.15.5:0/3244227453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 0x7fb424101400 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 -- 172.21.15.5:0/3244227453 >> 172.21.15.5:0/3244227453 conn(0x7fb4240780a0 msgr2=0x7fb4240784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 -- 172.21.15.5:0/3244227453 shutdown_connections 2023-10-07T00:11:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.683+0000 7fb42977e700 1 -- 172.21.15.5:0/3244227453 wait complete. 2023-10-07T00:11:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.684+0000 7fb42977e700 1 Processor -- start 2023-10-07T00:11:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.684+0000 7fb42977e700 1 -- start start 2023-10-07T00:11:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.684+0000 7fb42977e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 0x7fb424196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.684+0000 7fb42977e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb424101940 0x7fb424197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.684+0000 7fb42977e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb424106f90 0x7fb42419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.684+0000 7fb42977e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42419bee0 con 0x7fb424100f80 2023-10-07T00:11:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.684+0000 7fb42977e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42419c050 con 0x7fb424106f90 2023-10-07T00:11:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.684+0000 7fb42977e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42419c210 con 0x7fb424101940 2023-10-07T00:11:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 0x7fb424196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 0x7fb424196f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38482/0 (socket says 172.21.15.5:38482) 2023-10-07T00:11:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 -- 172.21.15.5:0/3503020531 learned_addr learned my addr 172.21.15.5:0/3503020531 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb4237fe700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb424106f90 0x7fb42419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb4227fc700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb424101940 0x7fb424197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 -- 172.21.15.5:0/3503020531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb424101940 msgr2=0x7fb424197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb424101940 0x7fb424197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 -- 172.21.15.5:0/3503020531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb424106f90 msgr2=0x7fb42419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb424106f90 0x7fb42419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 -- 172.21.15.5:0/3503020531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180095f0 con 0x7fb424100f80 2023-10-07T00:11:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb4227fc700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb424101940 0x7fb424197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb4237fe700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb424106f90 0x7fb42419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:11:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.685+0000 7fb422ffd700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 0x7fb424196f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c9b0 tx=0x7fb41400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.686+0000 7fb40bfff700 1 -- 172.21.15.5:0/3503020531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414007b00 con 0x7fb424100f80 2023-10-07T00:11:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.686+0000 7fb40bfff700 1 -- 172.21.15.5:0/3503020531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb414007c60 con 0x7fb424100f80 2023-10-07T00:11:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.686+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42419c4f0 con 0x7fb424100f80 2023-10-07T00:11:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.686+0000 7fb40bfff700 1 -- 172.21.15.5:0/3503020531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414018660 con 0x7fb424100f80 2023-10-07T00:11:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.686+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4241a3d50 con 0x7fb424100f80 2023-10-07T00:11:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.687+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42404ebb0 con 0x7fb424100f80 2023-10-07T00:11:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.689+0000 7fb40bfff700 1 -- 172.21.15.5:0/3503020531 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb41400f450 con 0x7fb424100f80 2023-10-07T00:11:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.690+0000 7fb40bfff700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb40c0a1590 0x7fb40c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.690+0000 7fb40bfff700 1 -- 172.21.15.5:0/3503020531 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb4140ccfa0 con 0x7fb424100f80 2023-10-07T00:11:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.691+0000 7fb4227fc700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb40c0a1590 0x7fb40c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.691+0000 7fb4227fc700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb40c0a1590 0x7fb40c0a3a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb418006010 tx=0x7fb418000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.693+0000 7fb40bfff700 1 -- 172.21.15.5:0/3503020531 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb4140965d0 con 0x7fb424100f80 2023-10-07T00:11:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.904+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb424110e90 con 0x7fb424100f80 2023-10-07T00:11:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.906+0000 7fb40bfff700 1 -- 172.21.15.5:0/3503020531 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22000 (secure 0 0 0) 0x7fb414099bf0 con 0x7fb424100f80 2023-10-07T00:11:31.908 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:31.908 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:14.815312+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:11:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.908+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb40c0a1590 msgr2=0x7fb40c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.908+0000 7fb42977e700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb40c0a1590 0x7fb40c0a3a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb418006010 tx=0x7fb418000bc0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.908+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 msgr2=0x7fb424196f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.908+0000 7fb42977e700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 0x7fb424196f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c9b0 tx=0x7fb41400cd70 comp rx=0 tx=0).stop 2023-10-07T00:11:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.909+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 shutdown_connections 2023-10-07T00:11:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.909+0000 7fb42977e700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb40c0a1590 0x7fb40c0a3a50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.909+0000 7fb42977e700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb424106f90 0x7fb42419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.909+0000 7fb42977e700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424100f80 0x7fb424196f20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.909+0000 7fb42977e700 1 --2- 172.21.15.5:0/3503020531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb424101940 0x7fb424197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.909+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 >> 172.21.15.5:0/3503020531 conn(0x7fb4240780a0 msgr2=0x7fb4240ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.909+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 shutdown_connections 2023-10-07T00:11:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:31.909+0000 7fb42977e700 1 -- 172.21.15.5:0/3503020531 wait complete. 2023-10-07T00:11:32.317 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-07T00:11:32.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-07T00:11:32.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:32 smithi088 ceph-mon[103111]: pgmap v307: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2023-10-07T00:11:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:32 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3503020531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:32 smithi112 ceph-mon[133548]: pgmap v307: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2023-10-07T00:11:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:32 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3503020531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:33.058 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:33.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:32 smithi005 ceph-mon[129406]: pgmap v307: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2023-10-07T00:11:33.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:32 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3503020531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 -- 172.21.15.5:0/131468602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0100f80 msgr2=0x7fb0f0101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 --2- 172.21.15.5:0/131468602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0100f80 0x7fb0f0101400 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40099c0 tx=0x7fb0e4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 -- 172.21.15.5:0/131468602 shutdown_connections 2023-10-07T00:11:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 --2- 172.21.15.5:0/131468602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0f0101940 0x7fb0f010ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 --2- 172.21.15.5:0/131468602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f0106f90 0x7fb0f0107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 --2- 172.21.15.5:0/131468602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0100f80 0x7fb0f0101400 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 -- 172.21.15.5:0/131468602 >> 172.21.15.5:0/131468602 conn(0x7fb0f00780a0 msgr2=0x7fb0f00784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 -- 172.21.15.5:0/131468602 shutdown_connections 2023-10-07T00:11:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.556+0000 7fb0f695e700 1 -- 172.21.15.5:0/131468602 wait complete. 2023-10-07T00:11:34.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.557+0000 7fb0f695e700 1 Processor -- start 2023-10-07T00:11:34.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.557+0000 7fb0f695e700 1 -- start start 2023-10-07T00:11:34.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0f695e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0f0100f80 0x7fb0f00731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0f695e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0101940 0x7fb0f00736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0f695e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f0106f90 0x7fb0f0073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0f695e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f01a5370 con 0x7fb0f0101940 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0f695e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f01a54e0 con 0x7fb0f0100f80 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0f695e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f01a56a0 con 0x7fb0f0106f90 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0ef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0101940 0x7fb0f00736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0ef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0101940 0x7fb0f00736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59326/0 (socket says 172.21.15.5:59326) 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0ef7fe700 1 -- 172.21.15.5:0/1705673426 learned_addr learned my addr 172.21.15.5:0/1705673426 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0f4efb700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f0106f90 0x7fb0f0073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0effff700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0f0100f80 0x7fb0f00731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0ef7fe700 1 -- 172.21.15.5:0/1705673426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f0106f90 msgr2=0x7fb0f0073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0ef7fe700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f0106f90 0x7fb0f0073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0ef7fe700 1 -- 172.21.15.5:0/1705673426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0f0100f80 msgr2=0x7fb0f00731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0ef7fe700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0f0100f80 0x7fb0f00731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.558+0000 7fb0ef7fe700 1 -- 172.21.15.5:0/1705673426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40095f0 con 0x7fb0f0101940 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.559+0000 7fb0ef7fe700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0101940 0x7fb0f00736f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005910 tx=0x7fb0e400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.559+0000 7fb0ed7fa700 1 -- 172.21.15.5:0/1705673426 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e401d070 con 0x7fb0f0101940 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.559+0000 7fb0ed7fa700 1 -- 172.21.15.5:0/1705673426 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0e4005050 con 0x7fb0f0101940 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.559+0000 7fb0ed7fa700 1 -- 172.21.15.5:0/1705673426 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4004950 con 0x7fb0f0101940 2023-10-07T00:11:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.559+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f01a5920 con 0x7fb0f0101940 2023-10-07T00:11:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.559+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f01a5d30 con 0x7fb0f0101940 2023-10-07T00:11:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.560+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f004ebb0 con 0x7fb0f0101940 2023-10-07T00:11:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.562+0000 7fb0ed7fa700 1 -- 172.21.15.5:0/1705673426 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb0e40051c0 con 0x7fb0f0101940 2023-10-07T00:11:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.564+0000 7fb0ed7fa700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb0d80a1590 0x7fb0d80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.564+0000 7fb0ed7fa700 1 -- 172.21.15.5:0/1705673426 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb0e40cda30 con 0x7fb0f0101940 2023-10-07T00:11:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.564+0000 7fb0effff700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb0d80a1590 0x7fb0d80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.565+0000 7fb0effff700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb0d80a1590 0x7fb0d80a3a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009be0 tx=0x7fb0e0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:34.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.568+0000 7fb0ed7fa700 1 -- 172.21.15.5:0/1705673426 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb0e4097070 con 0x7fb0f0101940 2023-10-07T00:11:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.782+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0f00746e0 con 0x7fb0f0101940 2023-10-07T00:11:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.783+0000 7fb0ed7fa700 1 -- 172.21.15.5:0/1705673426 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22000 (secure 0 0 0) 0x7fb0e40054c0 con 0x7fb0f0101940 2023-10-07T00:11:34.786 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:11:34.786 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:14.815312+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:11:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb0d80a1590 msgr2=0x7fb0d80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb0d80a1590 0x7fb0d80a3a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009be0 tx=0x7fb0e0009260 comp rx=0 tx=0).stop 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0101940 msgr2=0x7fb0f00736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0101940 0x7fb0f00736f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005910 tx=0x7fb0e400f690 comp rx=0 tx=0).stop 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 shutdown_connections 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb0d80a1590 0x7fb0d80a3a50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f0106f90 0x7fb0f0073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0f0100f80 0x7fb0f00731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 --2- 172.21.15.5:0/1705673426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0f0101940 0x7fb0f00736f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 >> 172.21.15.5:0/1705673426 conn(0x7fb0f00780a0 msgr2=0x7fb0f00ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 shutdown_connections 2023-10-07T00:11:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:34.786+0000 7fb0f695e700 1 -- 172.21.15.5:0/1705673426 wait complete. 2023-10-07T00:11:34.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:34 smithi088 ceph-mon[103111]: pgmap v308: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2023-10-07T00:11:34.955 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:34 smithi005 ceph-mon[129406]: pgmap v308: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2023-10-07T00:11:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:34 smithi112 ceph-mon[133548]: pgmap v308: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2023-10-07T00:11:35.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-07T00:11:35.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-07T00:11:35.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-07T00:11:35.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-07T00:11:35.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-07T00:11:35.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-07T00:11:35.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-07T00:11:35.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-07T00:11:35.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-07T00:11:35.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-07T00:11:35.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-07T00:11:35.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-07T00:11:35.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:35 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1705673426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:35.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:35 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1705673426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:36.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:35 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1705673426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:11:36.789 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:36 smithi005 ceph-mon[129406]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 KiB/s wr, 17 op/s 2023-10-07T00:11:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:36 smithi088 ceph-mon[103111]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 KiB/s wr, 17 op/s 2023-10-07T00:11:37.206 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:36 smithi112 ceph-mon[133548]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 KiB/s wr, 17 op/s 2023-10-07T00:11:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:38.014 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:39.081 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:38 smithi005 ceph-mon[129406]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-07T00:11:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:38 smithi088 ceph-mon[103111]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-07T00:11:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:38 smithi112 ceph-mon[133548]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-07T00:11:40.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:40 smithi088 ceph-mon[103111]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2023-10-07T00:11:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:40 smithi112 ceph-mon[133548]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2023-10-07T00:11:41.036 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:40 smithi005 ceph-mon[129406]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2023-10-07T00:11:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.633+0000 7fa9560d1700 1 -- 172.21.15.5:0/878582039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 msgr2=0x7fa950107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.633+0000 7fa9560d1700 1 --2- 172.21.15.5:0/878582039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 0x7fa950107370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa9400099c0 tx=0x7fa940009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.634+0000 7fa9560d1700 1 -- 172.21.15.5:0/878582039 shutdown_connections 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.634+0000 7fa9560d1700 1 --2- 172.21.15.5:0/878582039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa950101940 0x7fa95010ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.634+0000 7fa9560d1700 1 --2- 172.21.15.5:0/878582039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 0x7fa950107370 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.634+0000 7fa9560d1700 1 --2- 172.21.15.5:0/878582039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa950100f80 0x7fa950101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.634+0000 7fa9560d1700 1 -- 172.21.15.5:0/878582039 >> 172.21.15.5:0/878582039 conn(0x7fa9500780a0 msgr2=0x7fa9500784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.634+0000 7fa9560d1700 1 -- 172.21.15.5:0/878582039 shutdown_connections 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.634+0000 7fa9560d1700 1 -- 172.21.15.5:0/878582039 wait complete. 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.635+0000 7fa9560d1700 1 Processor -- start 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.636+0000 7fa9560d1700 1 -- start start 2023-10-07T00:11:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.636+0000 7fa9560d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa950100f80 0x7fa9500731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.636+0000 7fa9560d1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa950101940 0x7fa9500736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.636+0000 7fa9560d1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 0x7fa950073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.636+0000 7fa9560d1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a5300 con 0x7fa950106f90 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.636+0000 7fa9560d1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a5470 con 0x7fa950101940 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.636+0000 7fa9560d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a5630 con 0x7fa950100f80 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 0x7fa950073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 0x7fa950073c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59342/0 (socket says 172.21.15.5:59342) 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94ffff700 1 -- 172.21.15.5:0/1879773269 learned_addr learned my addr 172.21.15.5:0/1879773269 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94effd700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa950101940 0x7fa9500736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94f7fe700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa950100f80 0x7fa9500731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94ffff700 1 -- 172.21.15.5:0/1879773269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa950100f80 msgr2=0x7fa9500731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94ffff700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa950100f80 0x7fa9500731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94ffff700 1 -- 172.21.15.5:0/1879773269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa950101940 msgr2=0x7fa9500736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94ffff700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa950101940 0x7fa9500736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.637+0000 7fa94ffff700 1 -- 172.21.15.5:0/1879773269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9400095f0 con 0x7fa950106f90 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.638+0000 7fa94ffff700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 0x7fa950073c70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa94800cca0 tx=0x7fa94800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.638+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800aaf0 con 0x7fa950106f90 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.638+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa94800ac50 con 0x7fa950106f90 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.638+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9501a5910 con 0x7fa950106f90 2023-10-07T00:11:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.638+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9480115e0 con 0x7fa950106f90 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.638+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9501a5e10 con 0x7fa950106f90 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.639+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa950111090 con 0x7fa950106f90 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.641+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa948012420 con 0x7fa950106f90 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.643+0000 7fa94cff9700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa9380a1510 0x7fa9380a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.643+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa9480cd2e0 con 0x7fa950106f90 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.643+0000 7fa94f7fe700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa9380a1510 0x7fa9380a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.643+0000 7fa94cff9700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] conn(0x7fa9380aacf0 0x7fa9380ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.643+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 --> [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9380ad7c0 con 0x7fa9380aacf0 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.643+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9480cd650 con 0x7fa950106f90 2023-10-07T00:11:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.644+0000 7fa94effd700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] conn(0x7fa9380aacf0 0x7fa9380ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.644+0000 7fa94f7fe700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa9380a1510 0x7fa9380a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa940006010 tx=0x7fa940003680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.644+0000 7fa94effd700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] conn(0x7fa9380aacf0 0x7fa9380ad110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.646+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 <== osd.3 v2:172.21.15.5:6810/2022754248 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa9380ad7c0 con 0x7fa9380aacf0 2023-10-07T00:11:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.664+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 --> [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa95004ebb0 con 0x7fa9380aacf0 2023-10-07T00:11:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.664+0000 7fa94cff9700 1 -- 172.21.15.5:0/1879773269 <== osd.3 v2:172.21.15.5:6810/2022754248 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa95004ebb0 con 0x7fa9380aacf0 2023-10-07T00:11:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] conn(0x7fa9380aacf0 msgr2=0x7fa9380ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] conn(0x7fa9380aacf0 0x7fa9380ad110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa9380a1510 msgr2=0x7fa9380a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa9380a1510 0x7fa9380a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa940006010 tx=0x7fa940003680 comp rx=0 tx=0).stop 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 msgr2=0x7fa950073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 --2- 172.21.15.5:0/1879773269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa950106f90 0x7fa950073c70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa94800cca0 tx=0x7fa94800a060 comp rx=0 tx=0).stop 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa94ffff700 1 -- 172.21.15.5:0/1879773269 reap_dead start 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 shutdown_connections 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 >> 172.21.15.5:0/1879773269 conn(0x7fa9500780a0 msgr2=0x7fa9500ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 shutdown_connections 2023-10-07T00:11:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:41.665+0000 7fa9560d1700 1 -- 172.21.15.5:0/1879773269 wait complete. 2023-10-07T00:11:42.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 -- 172.21.15.5:0/3828564104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 msgr2=0x7fdbac10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:42.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 --2- 172.21.15.5:0/3828564104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 0x7fdbac10ddb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdba400b0d0 tx=0x7fdba400b3e0 comp rx=0 tx=0).stop 2023-10-07T00:11:42.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 -- 172.21.15.5:0/3828564104 shutdown_connections 2023-10-07T00:11:42.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 --2- 172.21.15.5:0/3828564104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 0x7fdbac10ddb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:42.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 --2- 172.21.15.5:0/3828564104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbac106f90 0x7fdbac107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 --2- 172.21.15.5:0/3828564104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac100f80 0x7fdbac101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 -- 172.21.15.5:0/3828564104 >> 172.21.15.5:0/3828564104 conn(0x7fdbac0780a0 msgr2=0x7fdbac0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 -- 172.21.15.5:0/3828564104 shutdown_connections 2023-10-07T00:11:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.116+0000 7fdbb4179700 1 -- 172.21.15.5:0/3828564104 wait complete. 2023-10-07T00:11:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.117+0000 7fdbb4179700 1 Processor -- start 2023-10-07T00:11:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.118+0000 7fdbb4179700 1 -- start start 2023-10-07T00:11:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.118+0000 7fdbb4179700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac100f80 0x7fdbac196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.118+0000 7fdbb4179700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 0x7fdbac197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.118+0000 7fdbb4179700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbac106f90 0x7fdbac19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.118+0000 7fdbb4179700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac19bfb0 con 0x7fdbac101940 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.118+0000 7fdbb4179700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac19c120 con 0x7fdbac100f80 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.118+0000 7fdbb4179700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac19c2e0 con 0x7fdbac106f90 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 0x7fdbac197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 0x7fdbac197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45118/0 (socket says 172.21.15.5:45118) 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 -- 172.21.15.5:0/2796917333 learned_addr learned my addr 172.21.15.5:0/2796917333 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb2716700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbac106f90 0x7fdbac19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1f15700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac100f80 0x7fdbac196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 -- 172.21.15.5:0/2796917333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbac106f90 msgr2=0x7fdbac19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbac106f90 0x7fdbac19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 -- 172.21.15.5:0/2796917333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac100f80 msgr2=0x7fdbac196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac100f80 0x7fdbac196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 -- 172.21.15.5:0/2796917333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4009d00 con 0x7fdbac101940 2023-10-07T00:11:42.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdbb1714700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 0x7fdbac197530 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00d980 tx=0x7fdb9c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.119+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c004220 con 0x7fdbac101940 2023-10-07T00:11:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.120+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac19c5c0 con 0x7fdbac101940 2023-10-07T00:11:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.120+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb9c007640 con 0x7fdbac101940 2023-10-07T00:11:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.120+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c005660 con 0x7fdbac101940 2023-10-07T00:11:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.120+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac1a3e20 con 0x7fdbac101940 2023-10-07T00:11:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.120+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbac04ebb0 con 0x7fdbac101940 2023-10-07T00:11:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.123+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fdb9c004750 con 0x7fdbac101940 2023-10-07T00:11:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.124+0000 7fdba2ffd700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb980a1510 0x7fdb980a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.124+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdb9c0cd190 con 0x7fdbac101940 2023-10-07T00:11:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.124+0000 7fdbb1f15700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb980a1510 0x7fdb980a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.124+0000 7fdba2ffd700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] conn(0x7fdb980aacf0 0x7fdb980ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.124+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 --> [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb980ad7c0 con 0x7fdb980aacf0 2023-10-07T00:11:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.124+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb9c0cd500 con 0x7fdbac101940 2023-10-07T00:11:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.125+0000 7fdbb2716700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] conn(0x7fdb980aacf0 0x7fdb980ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.125+0000 7fdbb1f15700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb980a1510 0x7fdb980a39d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009be0 tx=0x7fdba8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.125+0000 7fdbb2716700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] conn(0x7fdb980aacf0 0x7fdb980ad110 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.126+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 <== osd.0 v2:172.21.15.5:6802/42244744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdb980ad7c0 con 0x7fdb980aacf0 2023-10-07T00:11:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.144+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 --> [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdbac111000 con 0x7fdb980aacf0 2023-10-07T00:11:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.144+0000 7fdba2ffd700 1 -- 172.21.15.5:0/2796917333 <== osd.0 v2:172.21.15.5:6802/42244744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdba4007db0 con 0x7fdb980aacf0 2023-10-07T00:11:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] conn(0x7fdb980aacf0 msgr2=0x7fdb980ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] conn(0x7fdb980aacf0 0x7fdb980ad110 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb980a1510 msgr2=0x7fdb980a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb980a1510 0x7fdb980a39d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009be0 tx=0x7fdba8009260 comp rx=0 tx=0).stop 2023-10-07T00:11:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 msgr2=0x7fdbac197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 --2- 172.21.15.5:0/2796917333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac101940 0x7fdbac197530 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00d980 tx=0x7fdb9c00dc90 comp rx=0 tx=0).stop 2023-10-07T00:11:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb2716700 1 -- 172.21.15.5:0/2796917333 reap_dead start 2023-10-07T00:11:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 shutdown_connections 2023-10-07T00:11:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 >> 172.21.15.5:0/2796917333 conn(0x7fdbac0780a0 msgr2=0x7fdbac0ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 shutdown_connections 2023-10-07T00:11:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:42.145+0000 7fdbb4179700 1 -- 172.21.15.5:0/2796917333 wait complete. 2023-10-07T00:11:42.908 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:42 smithi005 ceph-mon[129406]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-10-07T00:11:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:42 smithi112 ceph-mon[133548]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-10-07T00:11:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:42 smithi088 ceph-mon[103111]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-10-07T00:11:43.491 INFO:teuthology.orchestra.run.smithi005.stdout:111669149756 2023-10-07T00:11:43.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-07T00:11:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.881+0000 7f25d3e43700 1 -- 172.21.15.5:0/3645259263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25cc100f80 msgr2=0x7f25cc101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.881+0000 7f25d3e43700 1 --2- 172.21.15.5:0/3645259263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25cc100f80 0x7f25cc101400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0099c0 tx=0x7f25bc009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.882+0000 7f25d3e43700 1 -- 172.21.15.5:0/3645259263 shutdown_connections 2023-10-07T00:11:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.882+0000 7f25d3e43700 1 --2- 172.21.15.5:0/3645259263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25cc101940 0x7f25cc10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.882+0000 7f25d3e43700 1 --2- 172.21.15.5:0/3645259263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25cc106f90 0x7f25cc107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.882+0000 7f25d3e43700 1 --2- 172.21.15.5:0/3645259263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25cc100f80 0x7f25cc101400 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.882+0000 7f25d3e43700 1 -- 172.21.15.5:0/3645259263 >> 172.21.15.5:0/3645259263 conn(0x7f25cc0780a0 msgr2=0x7f25cc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.882+0000 7f25d3e43700 1 -- 172.21.15.5:0/3645259263 shutdown_connections 2023-10-07T00:11:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.882+0000 7f25d3e43700 1 -- 172.21.15.5:0/3645259263 wait complete. 2023-10-07T00:11:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.883+0000 7f25d3e43700 1 Processor -- start 2023-10-07T00:11:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.883+0000 7f25d3e43700 1 -- start start 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.884+0000 7f25d3e43700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25cc100f80 0x7f25cc19d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.884+0000 7f25d3e43700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25cc101940 0x7f25cc19da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.884+0000 7f25d3e43700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25cc106f90 0x7f25cc1a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.884+0000 7f25d3e43700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a2470 con 0x7f25cc106f90 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.884+0000 7f25d3e43700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a25e0 con 0x7f25cc100f80 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.884+0000 7f25d3e43700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a27a0 con 0x7f25cc101940 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.884+0000 7f25d23e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25cc106f90 0x7f25cc1a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d13de700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25cc101940 0x7f25cc19da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d1bdf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25cc100f80 0x7f25cc19d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d1bdf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25cc100f80 0x7f25cc19d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:59072/0 (socket says 172.21.15.5:59072) 2023-10-07T00:11:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d13de700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25cc101940 0x7f25cc19da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:39272/0 (socket says 172.21.15.5:39272) 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d1bdf700 1 -- 172.21.15.5:0/3514847476 learned_addr learned my addr 172.21.15.5:0/3514847476 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d23e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25cc106f90 0x7f25cc1a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45162/0 (socket says 172.21.15.5:45162) 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d1bdf700 1 -- 172.21.15.5:0/3514847476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25cc101940 msgr2=0x7f25cc19da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d1bdf700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25cc101940 0x7f25cc19da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d1bdf700 1 -- 172.21.15.5:0/3514847476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25cc106f90 msgr2=0x7f25cc1a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d1bdf700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25cc106f90 0x7f25cc1a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.885+0000 7f25d1bdf700 1 -- 172.21.15.5:0/3514847476 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0095f0 con 0x7f25cc100f80 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.886+0000 7f25d1bdf700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25cc100f80 0x7f25cc19d500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25c800e9a0 tx=0x7f25c800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.886+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8009790 con 0x7f25cc100f80 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.886+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc1a2a80 con 0x7f25cc100f80 2023-10-07T00:11:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.886+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25c8010430 con 0x7f25cc100f80 2023-10-07T00:11:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.886+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800cea0 con 0x7f25cc100f80 2023-10-07T00:11:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.886+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1aa2e0 con 0x7f25cc100f80 2023-10-07T00:11:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.887+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25cc04ebb0 con 0x7f25cc100f80 2023-10-07T00:11:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.890+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f25c80105a0 con 0x7f25cc100f80 2023-10-07T00:11:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.891+0000 7f25c2ffd700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f25b80a1590 0x7f25b80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.891+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f25c8014070 con 0x7f25cc100f80 2023-10-07T00:11:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.892+0000 7f25d13de700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f25b80a1590 0x7f25b80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.892+0000 7f25c2ffd700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] conn(0x7f25b80aad70 0x7f25b80ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.892+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 --> [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25b80ad840 con 0x7f25b80aad70 2023-10-07T00:11:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.892+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c80cd4f0 con 0x7f25cc100f80 2023-10-07T00:11:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.892+0000 7f25d13de700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f25b80a1590 0x7f25b80a3a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009990 tx=0x7f25bc005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.892+0000 7f25d23e0700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] conn(0x7f25b80aad70 0x7f25b80ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.893+0000 7f25d23e0700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] conn(0x7f25b80aad70 0x7f25b80ad190 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.894+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 <== osd.2 v2:172.21.15.112:6800/2199456889 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f25b80ad840 con 0x7f25b80aad70 2023-10-07T00:11:43.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.912+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 --> [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25cc10eee0 con 0x7f25b80aad70 2023-10-07T00:11:43.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25c2ffd700 1 -- 172.21.15.5:0/3514847476 <== osd.2 v2:172.21.15.112:6800/2199456889 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f25c40091d0 con 0x7f25b80aad70 2023-10-07T00:11:43.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 >> [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] conn(0x7f25b80aad70 msgr2=0x7f25b80ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d3e43700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] conn(0x7f25b80aad70 0x7f25b80ad190 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f25b80a1590 msgr2=0x7f25b80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d3e43700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f25b80a1590 0x7f25b80a3a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009990 tx=0x7f25bc005c00 comp rx=0 tx=0).stop 2023-10-07T00:11:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25cc100f80 msgr2=0x7f25cc19d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d3e43700 1 --2- 172.21.15.5:0/3514847476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25cc100f80 0x7f25cc19d500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25c800e9a0 tx=0x7f25c800ecb0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d23e0700 1 -- 172.21.15.5:0/3514847476 reap_dead start 2023-10-07T00:11:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 shutdown_connections 2023-10-07T00:11:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.913+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 >> 172.21.15.5:0/3514847476 conn(0x7f25cc0780a0 msgr2=0x7f25cc0ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.914+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 shutdown_connections 2023-10-07T00:11:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.914+0000 7f25d3e43700 1 -- 172.21.15.5:0/3514847476 wait complete. 2023-10-07T00:11:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 -- 172.21.15.5:0/2036617987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70103d60 msgr2=0x7fce70107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 --2- 172.21.15.5:0/2036617987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70103d60 0x7fce70107db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce600098f0 tx=0x7fce60009c00 comp rx=0 tx=0).stop 2023-10-07T00:11:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 -- 172.21.15.5:0/2036617987 shutdown_connections 2023-10-07T00:11:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 --2- 172.21.15.5:0/2036617987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce70108490 0x7fce70110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 --2- 172.21.15.5:0/2036617987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce701033b0 0x7fce70103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 --2- 172.21.15.5:0/2036617987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70103d60 0x7fce70107db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 -- 172.21.15.5:0/2036617987 >> 172.21.15.5:0/2036617987 conn(0x7fce700fec20 msgr2=0x7fce70101040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 -- 172.21.15.5:0/2036617987 shutdown_connections 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.811+0000 7fce78148700 1 -- 172.21.15.5:0/2036617987 wait complete. 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.812+0000 7fce78148700 1 Processor -- start 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.812+0000 7fce78148700 1 -- start start 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.813+0000 7fce78148700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce701033b0 0x7fce7010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.813+0000 7fce78148700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce70103d60 0x7fce7010cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.813+0000 7fce78148700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70108490 0x7fce7010d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.813+0000 7fce78148700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7010d660 con 0x7fce70103d60 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.813+0000 7fce78148700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7010d7d0 con 0x7fce701033b0 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.813+0000 7fce78148700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7010d990 con 0x7fce70108490 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce75ee4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce701033b0 0x7fce7010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce766e5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70108490 0x7fce7010d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce766e5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70108490 0x7fce7010d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:39256/0 (socket says 172.21.15.5:39256) 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce766e5700 1 -- 172.21.15.5:0/580359165 learned_addr learned my addr 172.21.15.5:0/580359165 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce766e5700 1 -- 172.21.15.5:0/580359165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce701033b0 msgr2=0x7fce7010fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce766e5700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce701033b0 0x7fce7010fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce756e3700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce70103d60 0x7fce7010cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce766e5700 1 -- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce70103d60 msgr2=0x7fce7010cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce766e5700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce70103d60 0x7fce7010cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.814+0000 7fce766e5700 1 -- 172.21.15.5:0/580359165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0095f0 con 0x7fce70108490 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.815+0000 7fce756e3700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce70103d60 0x7fce7010cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.815+0000 7fce766e5700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70108490 0x7fce7010d120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce68007ee0 tx=0x7fce6800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.816+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6800ddd0 con 0x7fce70108490 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.816+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce6800f040 con 0x7fce70108490 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.816+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680047d0 con 0x7fce70108490 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.816+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce60009520 con 0x7fce70108490 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.816+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7019fa00 con 0x7fce70108490 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.818+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce70113240 con 0x7fce70108490 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.821+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fce68003a00 con 0x7fce70108490 2023-10-07T00:11:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.822+0000 7fce66ffd700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fce5c0a1660 0x7fce5c0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.822+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fce680cc500 con 0x7fce70108490 2023-10-07T00:11:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.823+0000 7fce66ffd700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] conn(0x7fce5c0aae40 0x7fce5c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.823+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 --> [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce5c0ad910 con 0x7fce5c0aae40 2023-10-07T00:11:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.823+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce680cec10 con 0x7fce70108490 2023-10-07T00:11:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.823+0000 7fce75ee4700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fce5c0a1660 0x7fce5c0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.824+0000 7fce756e3700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] conn(0x7fce5c0aae40 0x7fce5c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.825+0000 7fce75ee4700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fce5c0a1660 0x7fce5c0a3b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce6c005fd0 tx=0x7fce6c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.826+0000 7fce756e3700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] conn(0x7fce5c0aae40 0x7fce5c0ad260 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.827+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 <== osd.1 v2:172.21.15.88:6800/124757240 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fce5c0ad910 con 0x7fce5c0aae40 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.857+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 --> [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce7004ebb0 con 0x7fce5c0aae40 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.858+0000 7fce66ffd700 1 -- 172.21.15.5:0/580359165 <== osd.1 v2:172.21.15.88:6800/124757240 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fce7004ebb0 con 0x7fce5c0aae40 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 >> [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] conn(0x7fce5c0aae40 msgr2=0x7fce5c0ad260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] conn(0x7fce5c0aae40 0x7fce5c0ad260 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fce5c0a1660 msgr2=0x7fce5c0a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fce5c0a1660 0x7fce5c0a3b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce6c005fd0 tx=0x7fce6c009310 comp rx=0 tx=0).stop 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70108490 msgr2=0x7fce7010d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 --2- 172.21.15.5:0/580359165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce70108490 0x7fce7010d120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce68007ee0 tx=0x7fce6800d3b0 comp rx=0 tx=0).stop 2023-10-07T00:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce766e5700 1 -- 172.21.15.5:0/580359165 reap_dead start 2023-10-07T00:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 shutdown_connections 2023-10-07T00:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 >> 172.21.15.5:0/580359165 conn(0x7fce700fec20 msgr2=0x7fce700ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 shutdown_connections 2023-10-07T00:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:43.859+0000 7fce78148700 1 -- 172.21.15.5:0/580359165 wait complete. 2023-10-07T00:11:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 -- 172.21.15.5:0/1220079459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c101950 msgr2=0x7fc58c1059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 --2- 172.21.15.5:0/1220079459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c101950 0x7fc58c1059a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc580009990 tx=0x7fc580009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 -- 172.21.15.5:0/1220079459 shutdown_connections 2023-10-07T00:11:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 --2- 172.21.15.5:0/1220079459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc58c106080 0x7fc58c10dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 --2- 172.21.15.5:0/1220079459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc58c100fa0 0x7fc58c101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 --2- 172.21.15.5:0/1220079459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c101950 0x7fc58c1059a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 -- 172.21.15.5:0/1220079459 >> 172.21.15.5:0/1220079459 conn(0x7fc58c0fc8b0 msgr2=0x7fc58c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 -- 172.21.15.5:0/1220079459 shutdown_connections 2023-10-07T00:11:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.650+0000 7fc59083c700 1 -- 172.21.15.5:0/1220079459 wait complete. 2023-10-07T00:11:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.651+0000 7fc59083c700 1 Processor -- start 2023-10-07T00:11:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.651+0000 7fc59083c700 1 -- start start 2023-10-07T00:11:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.651+0000 7fc59083c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c100fa0 0x7fc58c196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.651+0000 7fc59083c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc58c101950 0x7fc58c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.651+0000 7fc59083c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc58c106080 0x7fc58c19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.651+0000 7fc59083c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c19bdd0 con 0x7fc58c100fa0 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.651+0000 7fc59083c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c19bf40 con 0x7fc58c106080 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.651+0000 7fc59083c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c19c100 con 0x7fc58c101950 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c100fa0 0x7fc58c196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c100fa0 0x7fc58c196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45180/0 (socket says 172.21.15.5:45180) 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 -- 172.21.15.5:0/306579756 learned_addr learned my addr 172.21.15.5:0/306579756 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58b59e700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc58c106080 0x7fc58c19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58a59c700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc58c101950 0x7fc58c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 -- 172.21.15.5:0/306579756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc58c101950 msgr2=0x7fc58c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc58c101950 0x7fc58c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 -- 172.21.15.5:0/306579756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc58c106080 msgr2=0x7fc58c19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc58c106080 0x7fc58c19b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 -- 172.21.15.5:0/306579756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5800095f0 con 0x7fc58c100fa0 2023-10-07T00:11:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.652+0000 7fc58ad9d700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c100fa0 0x7fc58c196e10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00b530 tx=0x7fc57c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.653+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c011830 con 0x7fc58c100fa0 2023-10-07T00:11:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.653+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc57c011e20 con 0x7fc58c100fa0 2023-10-07T00:11:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.653+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c19c3e0 con 0x7fc58c100fa0 2023-10-07T00:11:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.653+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c010db0 con 0x7fc58c100fa0 2023-10-07T00:11:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.653+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c1a3c40 con 0x7fc58c100fa0 2023-10-07T00:11:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.654+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc58c04f400 con 0x7fc58c100fa0 2023-10-07T00:11:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.656+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fc57c011990 con 0x7fc58c100fa0 2023-10-07T00:11:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.657+0000 7fc573fff700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5740a1510 0x7fc5740a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.657+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc57c0ccc40 con 0x7fc58c100fa0 2023-10-07T00:11:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.657+0000 7fc58a59c700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5740a1510 0x7fc5740a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.658+0000 7fc573fff700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] conn(0x7fc5740aacf0 0x7fc5740ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.658+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 --> [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5740ad7c0 con 0x7fc5740aacf0 2023-10-07T00:11:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.658+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57c0ccfb0 con 0x7fc58c100fa0 2023-10-07T00:11:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.658+0000 7fc58a59c700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5740a1510 0x7fc5740a39d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc5800036c0 tx=0x7fc58000b560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:44.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.658+0000 7fc58b59e700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] conn(0x7fc5740aacf0 0x7fc5740ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:44.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.659+0000 7fc58b59e700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] conn(0x7fc5740aacf0 0x7fc5740ad110 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.660+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 <== osd.8 v2:172.21.15.112:6816/857535520 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc5740ad7c0 con 0x7fc5740aacf0 2023-10-07T00:11:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.678+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 --> [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc58c110ef0 con 0x7fc5740aacf0 2023-10-07T00:11:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.679+0000 7fc573fff700 1 -- 172.21.15.5:0/306579756 <== osd.8 v2:172.21.15.112:6816/857535520 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc58400f040 con 0x7fc5740aacf0 2023-10-07T00:11:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.679+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 >> [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] conn(0x7fc5740aacf0 msgr2=0x7fc5740ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.679+0000 7fc59083c700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] conn(0x7fc5740aacf0 0x7fc5740ad110 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5740a1510 msgr2=0x7fc5740a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc59083c700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5740a1510 0x7fc5740a39d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc5800036c0 tx=0x7fc58000b560 comp rx=0 tx=0).stop 2023-10-07T00:11:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c100fa0 msgr2=0x7fc58c196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc59083c700 1 --2- 172.21.15.5:0/306579756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c100fa0 0x7fc58c196e10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00b530 tx=0x7fc57c00b840 comp rx=0 tx=0).stop 2023-10-07T00:11:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc58b59e700 1 -- 172.21.15.5:0/306579756 reap_dead start 2023-10-07T00:11:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 shutdown_connections 2023-10-07T00:11:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 >> 172.21.15.5:0/306579756 conn(0x7fc58c0fc8b0 msgr2=0x7fc58c105210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 shutdown_connections 2023-10-07T00:11:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:44.680+0000 7fc59083c700 1 -- 172.21.15.5:0/306579756 wait complete. 2023-10-07T00:11:44.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:44 smithi005 ceph-mon[129406]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-07T00:11:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:44 smithi112 ceph-mon[133548]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-07T00:11:45.115 INFO:teuthology.orchestra.run.smithi005.stdout:34359738445 2023-10-07T00:11:45.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 -- 172.21.15.5:0/738234174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc764068c00 msgr2=0x7fc764068fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 --2- 172.21.15.5:0/738234174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc764068c00 0x7fc764068fe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc760009990 tx=0x7fc760009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 -- 172.21.15.5:0/738234174 shutdown_connections 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 --2- 172.21.15.5:0/738234174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7641062b0 0x7fc76410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 --2- 172.21.15.5:0/738234174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc764068c00 0x7fc764068fe0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 --2- 172.21.15.5:0/738234174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7640695b0 0x7fc764105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 -- 172.21.15.5:0/738234174 >> 172.21.15.5:0/738234174 conn(0x7fc764075e00 msgr2=0x7fc764076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 -- 172.21.15.5:0/738234174 shutdown_connections 2023-10-07T00:11:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.126+0000 7fc76c7ac700 1 -- 172.21.15.5:0/738234174 wait complete. 2023-10-07T00:11:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.127+0000 7fc76c7ac700 1 Processor -- start 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.127+0000 7fc76c7ac700 1 -- start start 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76c7ac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764068c00 0x7fc764199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76c7ac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7640695b0 0x7fc764199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76c7ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7641062b0 0x7fc76419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76c7ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76419e1f0 con 0x7fc7641062b0 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76c7ac700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76419e360 con 0x7fc7640695b0 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76c7ac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76419e520 con 0x7fc764068c00 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76a548700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764068c00 0x7fc764199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76a548700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764068c00 0x7fc764199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:39316/0 (socket says 172.21.15.5:39316) 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76a548700 1 -- 172.21.15.5:0/167042096 learned_addr learned my addr 172.21.15.5:0/167042096 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc76ad49700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7641062b0 0x7fc76419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.128+0000 7fc769d47700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7640695b0 0x7fc764199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc76a548700 1 -- 172.21.15.5:0/167042096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7640695b0 msgr2=0x7fc764199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc76a548700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7640695b0 0x7fc764199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc76a548700 1 -- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7641062b0 msgr2=0x7fc76419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc76a548700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7641062b0 0x7fc76419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc76a548700 1 -- 172.21.15.5:0/167042096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600095f0 con 0x7fc764068c00 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc76ad49700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7641062b0 0x7fc76419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc76a548700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764068c00 0x7fc764199230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc760000c00 tx=0x7fc760004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76001d070 con 0x7fc764068c00 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc760022470 con 0x7fc764068c00 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760017650 con 0x7fc764068c00 2023-10-07T00:11:45.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.129+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76419e7a0 con 0x7fc764068c00 2023-10-07T00:11:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.130+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7641a5e90 con 0x7fc764068c00 2023-10-07T00:11:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.130+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc764110fb0 con 0x7fc764068c00 2023-10-07T00:11:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.133+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fc7600225e0 con 0x7fc764068c00 2023-10-07T00:11:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.135+0000 7fc75b7fe700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc7500a1510 0x7fc7500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.135+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc7600cebc0 con 0x7fc764068c00 2023-10-07T00:11:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.135+0000 7fc769d47700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc7500a1510 0x7fc7500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.135+0000 7fc75b7fe700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] conn(0x7fc7500aacf0 0x7fc7500ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.135+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 --> [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7500ad7c0 con 0x7fc7500aacf0 2023-10-07T00:11:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.135+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7600cef30 con 0x7fc764068c00 2023-10-07T00:11:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.136+0000 7fc769d47700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc7500a1510 0x7fc7500a39d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc76419a850 tx=0x7fc754009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.136+0000 7fc76ad49700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] conn(0x7fc7500aacf0 0x7fc7500ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.137+0000 7fc76ad49700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] conn(0x7fc7500aacf0 0x7fc7500ad110 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.138+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 <== osd.11 v2:172.21.15.112:6824/4122527507 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc7500ad7c0 con 0x7fc7500aacf0 2023-10-07T00:11:45.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.156+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 --> [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc76404ebb0 con 0x7fc7500aacf0 2023-10-07T00:11:45.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.157+0000 7fc75b7fe700 1 -- 172.21.15.5:0/167042096 <== osd.11 v2:172.21.15.112:6824/4122527507 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc76404ebb0 con 0x7fc7500aacf0 2023-10-07T00:11:45.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.157+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 >> [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] conn(0x7fc7500aacf0 msgr2=0x7fc7500ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.157+0000 7fc76c7ac700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] conn(0x7fc7500aacf0 0x7fc7500ad110 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc7500a1510 msgr2=0x7fc7500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76c7ac700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc7500a1510 0x7fc7500a39d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc76419a850 tx=0x7fc754009260 comp rx=0 tx=0).stop 2023-10-07T00:11:45.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764068c00 msgr2=0x7fc764199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76c7ac700 1 --2- 172.21.15.5:0/167042096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764068c00 0x7fc764199230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc760000c00 tx=0x7fc760004730 comp rx=0 tx=0).stop 2023-10-07T00:11:45.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76ad49700 1 -- 172.21.15.5:0/167042096 reap_dead start 2023-10-07T00:11:45.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 shutdown_connections 2023-10-07T00:11:45.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 >> 172.21.15.5:0/167042096 conn(0x7fc764075e00 msgr2=0x7fc7640fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:45.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 shutdown_connections 2023-10-07T00:11:45.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.158+0000 7fc76c7ac700 1 -- 172.21.15.5:0/167042096 wait complete. 2023-10-07T00:11:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:44 smithi088 ceph-mon[103111]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-07T00:11:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.181+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1347788252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f38103960 msgr2=0x7f9f38103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.181+0000 7f9f3fd62700 1 --2- 172.21.15.5:0/1347788252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f38103960 0x7f9f38103de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009f90 tx=0x7f9f3000b330 comp rx=0 tx=0).stop 2023-10-07T00:11:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.181+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1347788252 shutdown_connections 2023-10-07T00:11:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.181+0000 7f9f3fd62700 1 --2- 172.21.15.5:0/1347788252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f38103960 0x7f9f38103de0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.182+0000 7f9f3fd62700 1 --2- 172.21.15.5:0/1347788252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f38105ef0 0x7f9f380689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.182+0000 7f9f3fd62700 1 --2- 172.21.15.5:0/1347788252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f38068ee0 0x7f9f38069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.182+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1347788252 >> 172.21.15.5:0/1347788252 conn(0x7f9f38075e00 msgr2=0x7f9f38076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.182+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1347788252 shutdown_connections 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.182+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1347788252 wait complete. 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.183+0000 7f9f3fd62700 1 Processor -- start 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.183+0000 7f9f3fd62700 1 -- start start 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3fd62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f38068ee0 0x7f9f3819d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3fd62700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f38103960 0x7f9f3819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3fd62700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f38105ef0 0x7f9f381a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3fd62700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381a24a0 con 0x7f9f38068ee0 2023-10-07T00:11:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3fd62700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381a2610 con 0x7f9f38103960 2023-10-07T00:11:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3fd62700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381a27d0 con 0x7f9f38105ef0 2023-10-07T00:11:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3dafe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f38068ee0 0x7f9f3819d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3dafe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f38068ee0 0x7f9f3819d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45212/0 (socket says 172.21.15.5:45212) 2023-10-07T00:11:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3dafe700 1 -- 172.21.15.5:0/1915405086 learned_addr learned my addr 172.21.15.5:0/1915405086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.184+0000 7f9f3e2ff700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f38105ef0 0x7f9f381a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f3d2fd700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f38103960 0x7f9f3819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f3dafe700 1 -- 172.21.15.5:0/1915405086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f38105ef0 msgr2=0x7f9f381a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f3dafe700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f38105ef0 0x7f9f381a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f3dafe700 1 -- 172.21.15.5:0/1915405086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f38103960 msgr2=0x7f9f3819da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f3dafe700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f38103960 0x7f9f3819da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f3dafe700 1 -- 172.21.15.5:0/1915405086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280095f0 con 0x7f9f38068ee0 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f3e2ff700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f38105ef0 0x7f9f381a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f3dafe700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f38068ee0 0x7f9f3819d4e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400e9a0 tx=0x7f9f3400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.185+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34009790 con 0x7f9f38068ee0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.186+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f30009c40 con 0x7f9f38068ee0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.186+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f3400cbd0 con 0x7f9f38068ee0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.186+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34018680 con 0x7f9f38068ee0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.186+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f381aa140 con 0x7f9f38068ee0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.187+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f3804ebb0 con 0x7f9f38068ee0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.189+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f9f3400cd40 con 0x7f9f38068ee0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.191+0000 7f9f2effd700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9f240a1510 0x7f9f240a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.191+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9f34014070 con 0x7f9f38068ee0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.191+0000 7f9f3d2fd700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9f240a1510 0x7f9f240a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.191+0000 7f9f2effd700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] conn(0x7f9f240aacf0 0x7f9f240ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.191+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 --> [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f240ad7c0 con 0x7f9f240aacf0 2023-10-07T00:11:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.191+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f340cd710 con 0x7f9f38068ee0 2023-10-07T00:11:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.192+0000 7f9f3d2fd700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9f240a1510 0x7f9f240a39d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f3819eb00 tx=0x7f9f28009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.192+0000 7f9f3e2ff700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] conn(0x7f9f240aacf0 0x7f9f240ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.193+0000 7f9f3e2ff700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] conn(0x7f9f240aacf0 0x7f9f240ad110 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.194+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 <== osd.4 v2:172.21.15.88:6808/4020627890 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9f240ad7c0 con 0x7f9f240aacf0 2023-10-07T00:11:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.212+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 --> [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f38117550 con 0x7f9f240aacf0 2023-10-07T00:11:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f2effd700 1 -- 172.21.15.5:0/1915405086 <== osd.4 v2:172.21.15.88:6808/4020627890 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9f30004a50 con 0x7f9f240aacf0 2023-10-07T00:11:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 >> [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] conn(0x7f9f240aacf0 msgr2=0x7f9f240ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] conn(0x7f9f240aacf0 0x7f9f240ad110 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9f240a1510 msgr2=0x7f9f240a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9f240a1510 0x7f9f240a39d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f3819eb00 tx=0x7f9f28009310 comp rx=0 tx=0).stop 2023-10-07T00:11:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f38068ee0 msgr2=0x7f9f3819d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 --2- 172.21.15.5:0/1915405086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f38068ee0 0x7f9f3819d4e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400e9a0 tx=0x7f9f3400ed60 comp rx=0 tx=0).stop 2023-10-07T00:11:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3e2ff700 1 -- 172.21.15.5:0/1915405086 reap_dead start 2023-10-07T00:11:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 shutdown_connections 2023-10-07T00:11:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 >> 172.21.15.5:0/1915405086 conn(0x7f9f38075e00 msgr2=0x7f9f380fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.213+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 shutdown_connections 2023-10-07T00:11:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.214+0000 7f9f3fd62700 1 -- 172.21.15.5:0/1915405086 wait complete. 2023-10-07T00:11:45.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.822+0000 7f33c47e8700 1 -- 172.21.15.5:0/312208895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc100f80 msgr2=0x7f33bc101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.822+0000 7f33c47e8700 1 --2- 172.21.15.5:0/312208895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc100f80 0x7f33bc101400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0099c0 tx=0x7f33ac009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.823+0000 7f33c47e8700 1 -- 172.21.15.5:0/312208895 shutdown_connections 2023-10-07T00:11:45.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.823+0000 7f33c47e8700 1 --2- 172.21.15.5:0/312208895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33bc101940 0x7f33bc10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.823+0000 7f33c47e8700 1 --2- 172.21.15.5:0/312208895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33bc106f90 0x7f33bc107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.823+0000 7f33c47e8700 1 --2- 172.21.15.5:0/312208895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc100f80 0x7f33bc101400 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.823+0000 7f33c47e8700 1 -- 172.21.15.5:0/312208895 >> 172.21.15.5:0/312208895 conn(0x7f33bc0780a0 msgr2=0x7f33bc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:45.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.823+0000 7f33c47e8700 1 -- 172.21.15.5:0/312208895 shutdown_connections 2023-10-07T00:11:45.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.823+0000 7f33c47e8700 1 -- 172.21.15.5:0/312208895 wait complete. 2023-10-07T00:11:45.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.824+0000 7f33c47e8700 1 Processor -- start 2023-10-07T00:11:45.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.825+0000 7f33c47e8700 1 -- start start 2023-10-07T00:11:45.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.825+0000 7f33c47e8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33bc100f80 0x7f33bc199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.825+0000 7f33c47e8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc101940 0x7f33bc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.825+0000 7f33c47e8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33bc106f90 0x7f33bc19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.825+0000 7f33c47e8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc19e150 con 0x7f33bc101940 2023-10-07T00:11:45.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.825+0000 7f33c47e8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc19e2c0 con 0x7f33bc106f90 2023-10-07T00:11:45.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.825+0000 7f33c47e8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc19e480 con 0x7f33bc100f80 2023-10-07T00:11:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc101940 0x7f33bc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc101940 0x7f33bc1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45228/0 (socket says 172.21.15.5:45228) 2023-10-07T00:11:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 -- 172.21.15.5:0/306181941 learned_addr learned my addr 172.21.15.5:0/306181941 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c2584700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33bc100f80 0x7f33bc199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c2d85700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33bc106f90 0x7f33bc19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 -- 172.21.15.5:0/306181941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33bc100f80 msgr2=0x7f33bc199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33bc100f80 0x7f33bc199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 -- 172.21.15.5:0/306181941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33bc106f90 msgr2=0x7f33bc19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33bc106f90 0x7f33bc19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 -- 172.21.15.5:0/306181941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0095f0 con 0x7f33bc101940 2023-10-07T00:11:45.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.826+0000 7f33c1d83700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc101940 0x7f33bc1996d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f33ac005910 tx=0x7f33ac00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.827+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac01d070 con 0x7f33bc101940 2023-10-07T00:11:45.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.827+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33ac005050 con 0x7f33bc101940 2023-10-07T00:11:45.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.827+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0049b0 con 0x7f33bc101940 2023-10-07T00:11:45.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.827+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc19e700 con 0x7f33bc101940 2023-10-07T00:11:45.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.827+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc1a5df0 con 0x7f33bc101940 2023-10-07T00:11:45.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.828+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33bc110fc0 con 0x7f33bc101940 2023-10-07T00:11:45.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.830+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f33ac0054c0 con 0x7f33bc101940 2023-10-07T00:11:45.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.832+0000 7f33b37fe700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33a80a1510 0x7f33a80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.832+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f33ac0cdb70 con 0x7f33bc101940 2023-10-07T00:11:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.833+0000 7f33b37fe700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] conn(0x7f33a80aacf0 0x7f33a80ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.833+0000 7f33c2584700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33a80a1510 0x7f33a80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.833+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 --> [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33a80ad7c0 con 0x7f33a80aacf0 2023-10-07T00:11:45.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.833+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33ac0d22a0 con 0x7f33bc101940 2023-10-07T00:11:45.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.833+0000 7f33c2d85700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] conn(0x7f33a80aacf0 0x7f33a80ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:45.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.834+0000 7f33c2584700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33a80a1510 0x7f33a80a39d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009be0 tx=0x7f33b8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.834+0000 7f33c2d85700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] conn(0x7f33a80aacf0 0x7f33a80ad110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:45.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.835+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 <== osd.9 v2:172.21.15.5:6826/1378383866 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f33a80ad7c0 con 0x7f33a80aacf0 2023-10-07T00:11:45.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.857+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 --> [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33bc04ebb0 con 0x7f33a80aacf0 2023-10-07T00:11:45.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.858+0000 7f33b37fe700 1 -- 172.21.15.5:0/306181941 <== osd.9 v2:172.21.15.5:6826/1378383866 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f33bc04ebb0 con 0x7f33a80aacf0 2023-10-07T00:11:45.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.858+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] conn(0x7f33a80aacf0 msgr2=0x7f33a80ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.858+0000 7f33c47e8700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] conn(0x7f33a80aacf0 0x7f33a80ad110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:45.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.858+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33a80a1510 msgr2=0x7f33a80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.858+0000 7f33c47e8700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33a80a1510 0x7f33a80a39d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009be0 tx=0x7f33b8009260 comp rx=0 tx=0).stop 2023-10-07T00:11:45.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.858+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc101940 msgr2=0x7f33bc1996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.858+0000 7f33c47e8700 1 --2- 172.21.15.5:0/306181941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33bc101940 0x7f33bc1996d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f33ac005910 tx=0x7f33ac00f690 comp rx=0 tx=0).stop 2023-10-07T00:11:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.859+0000 7f33c2d85700 1 -- 172.21.15.5:0/306181941 reap_dead start 2023-10-07T00:11:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.859+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 shutdown_connections 2023-10-07T00:11:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.859+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 >> 172.21.15.5:0/306181941 conn(0x7f33bc0780a0 msgr2=0x7f33bc10c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.859+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 shutdown_connections 2023-10-07T00:11:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:45.859+0000 7f33c47e8700 1 -- 172.21.15.5:0/306181941 wait complete. 2023-10-07T00:11:46.137 INFO:teuthology.orchestra.run.smithi005.stdout:55834574921 2023-10-07T00:11:46.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-07T00:11:46.385 INFO:teuthology.orchestra.run.smithi005.stdout:257698037797 2023-10-07T00:11:46.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-07T00:11:46.599 INFO:teuthology.orchestra.run.smithi005.stdout:146028888122 2023-10-07T00:11:46.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-07T00:11:46.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:46 smithi005 ceph-mon[129406]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2023-10-07T00:11:46.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:46 smithi112 ceph-mon[133548]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 -- 172.21.15.5:0/1995944888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8074ef0 msgr2=0x7fa1f80730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 --2- 172.21.15.5:0/1995944888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8074ef0 0x7fa1f80730e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009990 tx=0x7fa1f4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 -- 172.21.15.5:0/1995944888 shutdown_connections 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 --2- 172.21.15.5:0/1995944888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f8111bc0 0x7fa1f8113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 --2- 172.21.15.5:0/1995944888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8074ef0 0x7fa1f80730e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 --2- 172.21.15.5:0/1995944888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f8073620 0x7fa1f8073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 -- 172.21.15.5:0/1995944888 >> 172.21.15.5:0/1995944888 conn(0x7fa1f80780a0 msgr2=0x7fa1f80784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 -- 172.21.15.5:0/1995944888 shutdown_connections 2023-10-07T00:11:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.167+0000 7fa2005f2700 1 -- 172.21.15.5:0/1995944888 wait complete. 2023-10-07T00:11:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.168+0000 7fa2005f2700 1 Processor -- start 2023-10-07T00:11:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.168+0000 7fa2005f2700 1 -- start start 2023-10-07T00:11:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa2005f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f8073620 0x7fa1f819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa2005f2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f8074ef0 0x7fa1f819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa2005f2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8111bc0 0x7fa1f81a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa2005f2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f81a25f0 con 0x7fa1f8111bc0 2023-10-07T00:11:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa2005f2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f81a2760 con 0x7fa1f8073620 2023-10-07T00:11:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa2005f2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f81a2920 con 0x7fa1f8074ef0 2023-10-07T00:11:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa1feb8f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8111bc0 0x7fa1f81a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa1feb8f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8111bc0 0x7fa1f81a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45252/0 (socket says 172.21.15.5:45252) 2023-10-07T00:11:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa1feb8f700 1 -- 172.21.15.5:0/1866401591 learned_addr learned my addr 172.21.15.5:0/1866401591 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa1fe38e700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f8073620 0x7fa1f819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.169+0000 7fa1fdb8d700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f8074ef0 0x7fa1f819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.170+0000 7fa1feb8f700 1 -- 172.21.15.5:0/1866401591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f8074ef0 msgr2=0x7fa1f819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.170+0000 7fa1feb8f700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f8074ef0 0x7fa1f819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.170+0000 7fa1feb8f700 1 -- 172.21.15.5:0/1866401591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f8073620 msgr2=0x7fa1f819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.170+0000 7fa1feb8f700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f8073620 0x7fa1f819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.170+0000 7fa1feb8f700 1 -- 172.21.15.5:0/1866401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40095f0 con 0x7fa1f8111bc0 2023-10-07T00:11:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.170+0000 7fa1feb8f700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8111bc0 0x7fa1f81a1fe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0007f10 tx=0x7fa1f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.170+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0004db0 con 0x7fa1f8111bc0 2023-10-07T00:11:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.171+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f81a2c00 con 0x7fa1f8111bc0 2023-10-07T00:11:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.171+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1f000f040 con 0x7fa1f8111bc0 2023-10-07T00:11:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.171+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0005850 con 0x7fa1f8111bc0 2023-10-07T00:11:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.171+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f81aa460 con 0x7fa1f8111bc0 2023-10-07T00:11:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.172+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1f8117620 con 0x7fa1f8111bc0 2023-10-07T00:11:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.174+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa1f0004f10 con 0x7fa1f8111bc0 2023-10-07T00:11:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.175+0000 7fa1ef7fe700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa1e40a1590 0x7fa1e40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.176+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa1f00ccf70 con 0x7fa1f8111bc0 2023-10-07T00:11:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.176+0000 7fa1fe38e700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa1e40a1590 0x7fa1e40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.176+0000 7fa1ef7fe700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] conn(0x7fa1e40aad70 0x7fa1e40ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.176+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 --> [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1e40ad840 con 0x7fa1e40aad70 2023-10-07T00:11:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.176+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1f00cd2e0 con 0x7fa1f8111bc0 2023-10-07T00:11:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.176+0000 7fa1fdb8d700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] conn(0x7fa1e40aad70 0x7fa1e40ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.176+0000 7fa1fe38e700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa1e40a1590 0x7fa1e40a3a50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400b5c0 tx=0x7fa1f4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.177+0000 7fa1fdb8d700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] conn(0x7fa1e40aad70 0x7fa1e40ad190 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.178+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 <== osd.5 v2:172.21.15.112:6808/2766325588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa1e40ad840 con 0x7fa1e40aad70 2023-10-07T00:11:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.197+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 --> [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa1f804ebb0 con 0x7fa1e40aad70 2023-10-07T00:11:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.198+0000 7fa1ef7fe700 1 -- 172.21.15.5:0/1866401591 <== osd.5 v2:172.21.15.112:6808/2766325588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa1f804ebb0 con 0x7fa1e40aad70 2023-10-07T00:11:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 >> [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] conn(0x7fa1e40aad70 msgr2=0x7fa1e40ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] conn(0x7fa1e40aad70 0x7fa1e40ad190 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa1e40a1590 msgr2=0x7fa1e40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa1e40a1590 0x7fa1e40a3a50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400b5c0 tx=0x7fa1f4005fb0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8111bc0 msgr2=0x7fa1f81a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 --2- 172.21.15.5:0/1866401591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f8111bc0 0x7fa1f81a1fe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0007f10 tx=0x7fa1f000d3b0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa1feb8f700 1 -- 172.21.15.5:0/1866401591 reap_dead start 2023-10-07T00:11:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 shutdown_connections 2023-10-07T00:11:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 >> 172.21.15.5:0/1866401591 conn(0x7fa1f80780a0 msgr2=0x7fa1f8110440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 shutdown_connections 2023-10-07T00:11:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.199+0000 7fa2005f2700 1 -- 172.21.15.5:0/1866401591 wait complete. 2023-10-07T00:11:47.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:46 smithi088 ceph-mon[103111]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2023-10-07T00:11:47.223 INFO:teuthology.orchestra.run.smithi005.stdout:77309411395 2023-10-07T00:11:47.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-07T00:11:47.614 INFO:teuthology.orchestra.run.smithi005.stdout:347892350997 2023-10-07T00:11:47.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-07T00:11:47.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.962+0000 7fa7205ad700 1 -- 172.21.15.5:0/439172958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101170 msgr2=0x7fa718101550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.962+0000 7fa7205ad700 1 --2- 172.21.15.5:0/439172958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101170 0x7fa718101550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa714009990 tx=0x7fa714009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.962+0000 7fa7205ad700 1 -- 172.21.15.5:0/439172958 shutdown_connections 2023-10-07T00:11:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.962+0000 7fa7205ad700 1 --2- 172.21.15.5:0/439172958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa718106250 0x7fa71810de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.962+0000 7fa7205ad700 1 --2- 172.21.15.5:0/439172958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101170 0x7fa718101550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.962+0000 7fa7205ad700 1 --2- 172.21.15.5:0/439172958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa718101b20 0x7fa718105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.963+0000 7fa7205ad700 1 -- 172.21.15.5:0/439172958 >> 172.21.15.5:0/439172958 conn(0x7fa7180fca20 msgr2=0x7fa7180fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.963+0000 7fa7205ad700 1 -- 172.21.15.5:0/439172958 shutdown_connections 2023-10-07T00:11:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.963+0000 7fa7205ad700 1 -- 172.21.15.5:0/439172958 wait complete. 2023-10-07T00:11:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.964+0000 7fa7205ad700 1 Processor -- start 2023-10-07T00:11:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.964+0000 7fa7205ad700 1 -- start start 2023-10-07T00:11:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.964+0000 7fa7205ad700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa718101170 0x7fa718197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.964+0000 7fa7205ad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101b20 0x7fa718197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.964+0000 7fa7205ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa718106250 0x7fa71819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.964+0000 7fa7205ad700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71819bff0 con 0x7fa718101b20 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.964+0000 7fa7205ad700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71819c160 con 0x7fa718106250 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.964+0000 7fa7205ad700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71819c320 con 0x7fa718101170 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101b20 0x7fa718197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101b20 0x7fa718197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45262/0 (socket says 172.21.15.5:45262) 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 -- 172.21.15.5:0/2407435049 learned_addr learned my addr 172.21.15.5:0/2407435049 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71eb4a700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa718106250 0x7fa71819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71e349700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa718101170 0x7fa718197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 -- 172.21.15.5:0/2407435049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa718101170 msgr2=0x7fa718197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa718101170 0x7fa718197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 -- 172.21.15.5:0/2407435049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa718106250 msgr2=0x7fa71819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa718106250 0x7fa71819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 -- 172.21.15.5:0/2407435049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140095f0 con 0x7fa718101b20 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71e349700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa718101170 0x7fa718197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.965+0000 7fa71db48700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101b20 0x7fa718197570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa70800d980 tx=0x7fa70800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.966+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708009930 con 0x7fa718101b20 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.966+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa708010460 con 0x7fa718101b20 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.966+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70800f620 con 0x7fa718101b20 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.966+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71819c600 con 0x7fa718101b20 2023-10-07T00:11:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.966+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7181a3e60 con 0x7fa718101b20 2023-10-07T00:11:47.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.967+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7181110a0 con 0x7fa718101b20 2023-10-07T00:11:47.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.969+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa7080105d0 con 0x7fa718101b20 2023-10-07T00:11:47.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.970+0000 7fa70f7fe700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7040a1510 0x7fa7040a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.970+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa7080ccc60 con 0x7fa718101b20 2023-10-07T00:11:47.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.970+0000 7fa71e349700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7040a1510 0x7fa7040a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.971+0000 7fa70f7fe700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] conn(0x7fa7040aacf0 0x7fa7040ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:47.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.971+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 --> [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7040ad7c0 con 0x7fa7040aacf0 2023-10-07T00:11:47.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.971+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7080ccfd0 con 0x7fa718101b20 2023-10-07T00:11:47.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.971+0000 7fa71e349700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7040a1510 0x7fa7040a39d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa714000c00 tx=0x7fa71400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.971+0000 7fa71eb4a700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] conn(0x7fa7040aacf0 0x7fa7040ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.972+0000 7fa71eb4a700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] conn(0x7fa7040aacf0 0x7fa7040ad110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:47.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.973+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 <== osd.10 v2:172.21.15.88:6824/4083736515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa7040ad7c0 con 0x7fa7040aacf0 2023-10-07T00:11:47.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.992+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 --> [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa71804ebb0 con 0x7fa7040aacf0 2023-10-07T00:11:47.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa70f7fe700 1 -- 172.21.15.5:0/2407435049 <== osd.10 v2:172.21.15.88:6824/4083736515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa71804ebb0 con 0x7fa7040aacf0 2023-10-07T00:11:47.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 >> [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] conn(0x7fa7040aacf0 msgr2=0x7fa7040ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa7205ad700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] conn(0x7fa7040aacf0 0x7fa7040ad110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:47.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7040a1510 msgr2=0x7fa7040a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa7205ad700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7040a1510 0x7fa7040a39d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa714000c00 tx=0x7fa71400b540 comp rx=0 tx=0).stop 2023-10-07T00:11:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101b20 msgr2=0x7fa718197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa7205ad700 1 --2- 172.21.15.5:0/2407435049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa718101b20 0x7fa718197570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa70800d980 tx=0x7fa70800dc90 comp rx=0 tx=0).stop 2023-10-07T00:11:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa71eb4a700 1 -- 172.21.15.5:0/2407435049 reap_dead start 2023-10-07T00:11:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 shutdown_connections 2023-10-07T00:11:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.993+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 >> 172.21.15.5:0/2407435049 conn(0x7fa7180fca20 msgr2=0x7fa7180fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.994+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 shutdown_connections 2023-10-07T00:11:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:47.994+0000 7fa7205ad700 1 -- 172.21.15.5:0/2407435049 wait complete. 2023-10-07T00:11:48.274 INFO:teuthology.orchestra.run.smithi005.stdout:167503724596 2023-10-07T00:11:48.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-07T00:11:48.717 INFO:teuthology.orchestra.run.smithi005.stdout:292057776159 2023-10-07T00:11:48.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-07T00:11:48.791 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:48 smithi005 ceph-mon[129406]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-07T00:11:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/588004939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 msgr2=0x7fd4e8105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 --2- 172.21.15.5:0/588004939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 0x7fd4e8105b70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009990 tx=0x7fd4dc009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/588004939 shutdown_connections 2023-10-07T00:11:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 --2- 172.21.15.5:0/588004939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e8106250 0x7fd4e810de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 --2- 172.21.15.5:0/588004939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8101170 0x7fd4e8101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 --2- 172.21.15.5:0/588004939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 0x7fd4e8105b70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/588004939 >> 172.21.15.5:0/588004939 conn(0x7fd4e80fc9a0 msgr2=0x7fd4e80fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/588004939 shutdown_connections 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.891+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/588004939 wait complete. 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.893+0000 7fd4ed1f0700 1 Processor -- start 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.893+0000 7fd4ed1f0700 1 -- start start 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4ed1f0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e8101170 0x7fd4e8196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4ed1f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 0x7fd4e8197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4ed1f0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8106250 0x7fd4e819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4ed1f0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e819bee0 con 0x7fd4e8101b20 2023-10-07T00:11:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4ed1f0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e819c050 con 0x7fd4e8106250 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4ed1f0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e819c210 con 0x7fd4e8101170 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 0x7fd4e8197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 0x7fd4e8197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45268/0 (socket says 172.21.15.5:45268) 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e659c700 1 -- 172.21.15.5:0/3522802421 learned_addr learned my addr 172.21.15.5:0/3522802421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e6d9d700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e8101170 0x7fd4e8196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e759e700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8106250 0x7fd4e819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e659c700 1 -- 172.21.15.5:0/3522802421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e8101170 msgr2=0x7fd4e8196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e659c700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e8101170 0x7fd4e8196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e659c700 1 -- 172.21.15.5:0/3522802421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8106250 msgr2=0x7fd4e819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e659c700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8106250 0x7fd4e819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e659c700 1 -- 172.21.15.5:0/3522802421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc0095f0 con 0x7fd4e8101b20 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.894+0000 7fd4e759e700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8106250 0x7fd4e819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.895+0000 7fd4e659c700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 0x7fd4e8197460 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0059d0 tx=0x7fd4dc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.895+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc01d070 con 0x7fd4e8101b20 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.895+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e819c490 con 0x7fd4e8101b20 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.895+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd4dc004000 con 0x7fd4e8101b20 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.895+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc022c00 con 0x7fd4e8101b20 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.895+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e81a3d50 con 0x7fd4e8101b20 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.896+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4e8110fb0 con 0x7fd4e8101b20 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.898+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fd4dc022470 con 0x7fd4e8101b20 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.899+0000 7fd4cffff700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4d00a1510 0x7fd4d00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.900+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd4dc0ced60 con 0x7fd4e8101b20 2023-10-07T00:11:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.900+0000 7fd4e6d9d700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4d00a1510 0x7fd4d00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.900+0000 7fd4cffff700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] conn(0x7fd4d00aacf0 0x7fd4d00ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.900+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 --> [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4d00ad7c0 con 0x7fd4d00aacf0 2023-10-07T00:11:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.900+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4dc0cf0d0 con 0x7fd4e8101b20 2023-10-07T00:11:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.900+0000 7fd4e759e700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] conn(0x7fd4d00aacf0 0x7fd4d00ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.900+0000 7fd4e6d9d700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4d00a1510 0x7fd4d00a39d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800ac50 tx=0x7fd4d800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.901+0000 7fd4e759e700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] conn(0x7fd4d00aacf0 0x7fd4d00ad110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.902+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 <== osd.6 v2:172.21.15.5:6818/4273879818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd4d00ad7c0 con 0x7fd4d00aacf0 2023-10-07T00:11:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.921+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 --> [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4e804ebb0 con 0x7fd4d00aacf0 2023-10-07T00:11:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.922+0000 7fd4cffff700 1 -- 172.21.15.5:0/3522802421 <== osd.6 v2:172.21.15.5:6818/4273879818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd4e804ebb0 con 0x7fd4d00aacf0 2023-10-07T00:11:48.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] conn(0x7fd4d00aacf0 msgr2=0x7fd4d00ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:48.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] conn(0x7fd4d00aacf0 0x7fd4d00ad110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:48.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4d00a1510 msgr2=0x7fd4d00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4d00a1510 0x7fd4d00a39d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800ac50 tx=0x7fd4d800a380 comp rx=0 tx=0).stop 2023-10-07T00:11:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 msgr2=0x7fd4e8197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 --2- 172.21.15.5:0/3522802421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4e8101b20 0x7fd4e8197460 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0059d0 tx=0x7fd4dc005740 comp rx=0 tx=0).stop 2023-10-07T00:11:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4e759e700 1 -- 172.21.15.5:0/3522802421 reap_dead start 2023-10-07T00:11:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 shutdown_connections 2023-10-07T00:11:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 >> 172.21.15.5:0/3522802421 conn(0x7fd4e80fc9a0 msgr2=0x7fd4e80fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 shutdown_connections 2023-10-07T00:11:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:48.923+0000 7fd4ed1f0700 1 -- 172.21.15.5:0/3522802421 wait complete. 2023-10-07T00:11:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:48 smithi112 ceph-mon[133548]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-07T00:11:48.998 INFO:teuthology.orchestra.run.smithi005.stdout:313532612634 2023-10-07T00:11:48.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-07T00:11:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.187+0000 7fa7cba80700 1 -- 172.21.15.5:0/2338788451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c4073620 msgr2=0x7fa7c4073a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.187+0000 7fa7cba80700 1 --2- 172.21.15.5:0/2338788451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c4073620 0x7fa7c4073a80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009990 tx=0x7fa7b4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.187+0000 7fa7cba80700 1 -- 172.21.15.5:0/2338788451 shutdown_connections 2023-10-07T00:11:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.187+0000 7fa7cba80700 1 --2- 172.21.15.5:0/2338788451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c4111bc0 0x7fa7c4113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.187+0000 7fa7cba80700 1 --2- 172.21.15.5:0/2338788451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c4074ef0 0x7fa7c40730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.187+0000 7fa7cba80700 1 --2- 172.21.15.5:0/2338788451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c4073620 0x7fa7c4073a80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.187+0000 7fa7cba80700 1 -- 172.21.15.5:0/2338788451 >> 172.21.15.5:0/2338788451 conn(0x7fa7c40780a0 msgr2=0x7fa7c40784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.187+0000 7fa7cba80700 1 -- 172.21.15.5:0/2338788451 shutdown_connections 2023-10-07T00:11:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.188+0000 7fa7cba80700 1 -- 172.21.15.5:0/2338788451 wait complete. 2023-10-07T00:11:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.189+0000 7fa7cba80700 1 Processor -- start 2023-10-07T00:11:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.189+0000 7fa7cba80700 1 -- start start 2023-10-07T00:11:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7cba80700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c4073620 0x7fa7c419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7cba80700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c4074ef0 0x7fa7c419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7cba80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c4111bc0 0x7fa7c41a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7cba80700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41a25f0 con 0x7fa7c4111bc0 2023-10-07T00:11:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7cba80700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41a2760 con 0x7fa7c4073620 2023-10-07T00:11:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7cba80700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41a2920 con 0x7fa7c4074ef0 2023-10-07T00:11:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7c981c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c4073620 0x7fa7c419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7c981c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c4073620 0x7fa7c419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:59222/0 (socket says 172.21.15.5:59222) 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7ca01d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c4111bc0 0x7fa7c41a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.190+0000 7fa7c981c700 1 -- 172.21.15.5:0/3238028375 learned_addr learned my addr 172.21.15.5:0/3238028375 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7c901b700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c4074ef0 0x7fa7c419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7ca01d700 1 -- 172.21.15.5:0/3238028375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c4074ef0 msgr2=0x7fa7c419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7ca01d700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c4074ef0 0x7fa7c419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7ca01d700 1 -- 172.21.15.5:0/3238028375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c4073620 msgr2=0x7fa7c419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7ca01d700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c4073620 0x7fa7c419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7ca01d700 1 -- 172.21.15.5:0/3238028375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40095f0 con 0x7fa7c4111bc0 2023-10-07T00:11:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7c901b700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c4074ef0 0x7fa7c419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7c981c700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c4073620 0x7fa7c419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:11:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7ca01d700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c4111bc0 0x7fa7c41a1fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4105360 tx=0x7fa7bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc009ea0 con 0x7fa7c4111bc0 2023-10-07T00:11:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7bc00f040 con 0x7fa7c4111bc0 2023-10-07T00:11:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c41a2c00 con 0x7fa7c4111bc0 2023-10-07T00:11:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.191+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc004280 con 0x7fa7c4111bc0 2023-10-07T00:11:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.192+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c41aa460 con 0x7fa7c4111bc0 2023-10-07T00:11:49.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.192+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7c4117660 con 0x7fa7c4111bc0 2023-10-07T00:11:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.195+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa7bc003a00 con 0x7fa7c4111bc0 2023-10-07T00:11:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.196+0000 7fa7baffd700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.197+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa7bc0cd110 con 0x7fa7c4111bc0 2023-10-07T00:11:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.197+0000 7fa7baffd700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] conn(0x7fa7b00aad70 0x7fa7b00ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.197+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 --> [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7b00ad840 con 0x7fa7b00aad70 2023-10-07T00:11:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.197+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7bc0cd5b0 con 0x7fa7c4111bc0 2023-10-07T00:11:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.197+0000 7fa7c981c700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.198+0000 7fa7c981c700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0011550 tx=0x7fa7c0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.199+0000 7fa7c901b700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] conn(0x7fa7b00aad70 0x7fa7b00ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.201+0000 7fa7c901b700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] conn(0x7fa7b00aad70 0x7fa7b00ad190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:48 smithi088 ceph-mon[103111]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-07T00:11:49.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.202+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 <== osd.7 v2:172.21.15.88:6816/3620600284 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa7b00ad840 con 0x7fa7b00aad70 2023-10-07T00:11:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.219+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 --> [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7c404ebb0 con 0x7fa7b00aad70 2023-10-07T00:11:49.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.220+0000 7fa7baffd700 1 -- 172.21.15.5:0/3238028375 <== osd.7 v2:172.21.15.88:6816/3620600284 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa7c404ebb0 con 0x7fa7b00aad70 2023-10-07T00:11:49.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 >> [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] conn(0x7fa7b00aad70 msgr2=0x7fa7b00ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:49.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] conn(0x7fa7b00aad70 0x7fa7b00ad190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:49.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 msgr2=0x7fa7b00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0011550 tx=0x7fa7c0009260 comp rx=0 tx=0).stop 2023-10-07T00:11:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c4111bc0 msgr2=0x7fa7c41a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 --2- 172.21.15.5:0/3238028375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c4111bc0 0x7fa7c41a1fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4105360 tx=0x7fa7bc00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:11:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7ca01d700 1 -- 172.21.15.5:0/3238028375 reap_dead start 2023-10-07T00:11:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 shutdown_connections 2023-10-07T00:11:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 >> 172.21.15.5:0/3238028375 conn(0x7fa7c40780a0 msgr2=0x7fa7c4110440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 shutdown_connections 2023-10-07T00:11:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:49.221+0000 7fa7cba80700 1 -- 172.21.15.5:0/3238028375 wait complete. 2023-10-07T00:11:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:49.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-07T00:11:49.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:49 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2023-10-07T00:11:50.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-07T00:11:50.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-07T00:11:50.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-07T00:11:50.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-07T00:11:50.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-07T00:11:50.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2023-10-07T00:11:50.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-10-07T00:11:50.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2023-10-07T00:11:50.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-07T00:11:50.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:49 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2023-10-07T00:11:50.104 INFO:teuthology.orchestra.run.smithi005.stdout:201863462959 2023-10-07T00:11:50.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-07T00:11:50.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-07T00:11:50.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-07T00:11:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-07T00:11:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-07T00:11:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-07T00:11:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2023-10-07T00:11:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-10-07T00:11:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2023-10-07T00:11:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-07T00:11:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:49 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2023-10-07T00:11:50.238 INFO:teuthology.orchestra.run.smithi005.stdout:223338299433 2023-10-07T00:11:50.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-07T00:11:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:50.493 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:50.739 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:50.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-07T00:11:50.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2023-10-07T00:11:50.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:50 smithi112 ceph-mon[133548]: osdmap e87: 12 total, 12 up, 12 in 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-10-07T00:11:51.045 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2023-10-07T00:11:51.046 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-07T00:11:51.046 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2023-10-07T00:11:51.046 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:50 smithi005 ceph-mon[129406]: osdmap e87: 12 total, 12 up, 12 in 2023-10-07T00:11:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2023-10-07T00:11:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-07T00:11:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2023-10-07T00:11:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:50 smithi088 ceph-mon[103111]: osdmap e87: 12 total, 12 up, 12 in 2023-10-07T00:11:52.009 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:51 smithi005 ceph-mon[129406]: osdmap e88: 12 total, 12 up, 12 in 2023-10-07T00:11:52.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:51 smithi088 ceph-mon[103111]: osdmap e88: 12 total, 12 up, 12 in 2023-10-07T00:11:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:51 smithi112 ceph-mon[133548]: osdmap e88: 12 total, 12 up, 12 in 2023-10-07T00:11:52.911 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:52 smithi005 ceph-mon[129406]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-10-07T00:11:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:52 smithi088 ceph-mon[103111]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-10-07T00:11:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:52 smithi112 ceph-mon[133548]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-10-07T00:11:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.397+0000 7f6b5381a700 1 -- 172.21.15.5:0/2137317665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c106f90 msgr2=0x7f6b4c107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.397+0000 7f6b5381a700 1 --2- 172.21.15.5:0/2137317665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c106f90 0x7f6b4c107370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b480099c0 tx=0x7f6b48009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.397+0000 7f6b5381a700 1 -- 172.21.15.5:0/2137317665 shutdown_connections 2023-10-07T00:11:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.397+0000 7f6b5381a700 1 --2- 172.21.15.5:0/2137317665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b4c101940 0x7f6b4c10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.397+0000 7f6b5381a700 1 --2- 172.21.15.5:0/2137317665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c106f90 0x7f6b4c107370 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.397+0000 7f6b5381a700 1 --2- 172.21.15.5:0/2137317665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b4c100f80 0x7f6b4c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.397+0000 7f6b5381a700 1 -- 172.21.15.5:0/2137317665 >> 172.21.15.5:0/2137317665 conn(0x7f6b4c0780a0 msgr2=0x7f6b4c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.398+0000 7f6b5381a700 1 -- 172.21.15.5:0/2137317665 shutdown_connections 2023-10-07T00:11:53.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.398+0000 7f6b5381a700 1 -- 172.21.15.5:0/2137317665 wait complete. 2023-10-07T00:11:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.399+0000 7f6b5381a700 1 Processor -- start 2023-10-07T00:11:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.399+0000 7f6b5381a700 1 -- start start 2023-10-07T00:11:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.399+0000 7f6b5381a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b4c100f80 0x7f6b4c0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.399+0000 7f6b5381a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c101940 0x7f6b4c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.399+0000 7f6b5381a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b4c106f90 0x7f6b4c073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.399+0000 7f6b5381a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1a5300 con 0x7f6b4c101940 2023-10-07T00:11:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.399+0000 7f6b5381a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1a5470 con 0x7f6b4c100f80 2023-10-07T00:11:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.399+0000 7f6b5381a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1a5630 con 0x7f6b4c106f90 2023-10-07T00:11:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c101940 0x7f6b4c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c101940 0x7f6b4c0736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44958/0 (socket says 172.21.15.5:44958) 2023-10-07T00:11:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 -- 172.21.15.5:0/728872856 learned_addr learned my addr 172.21.15.5:0/728872856 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b51db7700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b4c106f90 0x7f6b4c073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b515b6700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b4c100f80 0x7f6b4c0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 -- 172.21.15.5:0/728872856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b4c106f90 msgr2=0x7f6b4c073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b4c106f90 0x7f6b4c073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 -- 172.21.15.5:0/728872856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b4c100f80 msgr2=0x7f6b4c0731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b4c100f80 0x7f6b4c0731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 -- 172.21.15.5:0/728872856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b480095f0 con 0x7f6b4c101940 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b50db5700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c101940 0x7f6b4c0736f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b530 tx=0x7f6b3c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.400+0000 7f6b427fc700 1 -- 172.21.15.5:0/728872856 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c011830 con 0x7f6b4c101940 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.401+0000 7f6b427fc700 1 -- 172.21.15.5:0/728872856 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b3c011e20 con 0x7f6b4c101940 2023-10-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.401+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c1a5910 con 0x7f6b4c101940 2023-10-07T00:11:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.401+0000 7f6b427fc700 1 -- 172.21.15.5:0/728872856 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c010dd0 con 0x7f6b4c101940 2023-10-07T00:11:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.401+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c1a5e10 con 0x7f6b4c101940 2023-10-07T00:11:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.402+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c04ebb0 con 0x7f6b4c101940 2023-10-07T00:11:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.404+0000 7f6b427fc700 1 -- 172.21.15.5:0/728872856 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f6b3c011990 con 0x7f6b4c101940 2023-10-07T00:11:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.405+0000 7f6b427fc700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b380a1510 0x7f6b380a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.405+0000 7f6b427fc700 1 -- 172.21.15.5:0/728872856 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6b3c0cc980 con 0x7f6b4c101940 2023-10-07T00:11:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.405+0000 7f6b515b6700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b380a1510 0x7f6b380a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.406+0000 7f6b515b6700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b380a1510 0x7f6b380a39d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6b480036c0 tx=0x7f6b48009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.409+0000 7f6b427fc700 1 -- 172.21.15.5:0/728872856 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b3c095f10 con 0x7f6b4c101940 2023-10-07T00:11:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.659+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b4c110fb0 con 0x7f6b4c101940 2023-10-07T00:11:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.660+0000 7f6b427fc700 1 -- 172.21.15.5:0/728872856 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b3c099530 con 0x7f6b4c101940 2023-10-07T00:11:53.665 INFO:teuthology.orchestra.run.smithi005.stdout:34359738447 2023-10-07T00:11:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.665+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b380a1510 msgr2=0x7f6b380a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.665+0000 7f6b5381a700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b380a1510 0x7f6b380a39d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6b480036c0 tx=0x7f6b48009f10 comp rx=0 tx=0).stop 2023-10-07T00:11:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.665+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c101940 msgr2=0x7f6b4c0736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.665+0000 7f6b5381a700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c101940 0x7f6b4c0736f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b530 tx=0x7f6b3c00b8f0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.666+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 shutdown_connections 2023-10-07T00:11:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.666+0000 7f6b5381a700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6b380a1510 0x7f6b380a39d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.666+0000 7f6b5381a700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b4c106f90 0x7f6b4c073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.666+0000 7f6b5381a700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b4c100f80 0x7f6b4c0731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.666+0000 7f6b5381a700 1 --2- 172.21.15.5:0/728872856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b4c101940 0x7f6b4c0736f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.666+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 >> 172.21.15.5:0/728872856 conn(0x7f6b4c0780a0 msgr2=0x7f6b4c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.666+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 shutdown_connections 2023-10-07T00:11:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:53.666+0000 7f6b5381a700 1 -- 172.21.15.5:0/728872856 wait complete. 2023-10-07T00:11:53.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:53 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/728872856' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-07T00:11:54.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:53 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/728872856' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-07T00:11:54.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:53 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/728872856' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-07T00:11:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 -- 172.21.15.5:0/3275178528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 msgr2=0x7f64e410d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/3275178528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 0x7f64e410d7e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00b0a0 tx=0x7f64dc00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 -- 172.21.15.5:0/3275178528 shutdown_connections 2023-10-07T00:11:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/3275178528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 0x7f64e410d7e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/3275178528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e4101ef0 0x7f64e41022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/3275178528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e4102810 0x7f64e410ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 -- 172.21.15.5:0/3275178528 >> 172.21.15.5:0/3275178528 conn(0x7f64e40fb760 msgr2=0x7f64e40fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 -- 172.21.15.5:0/3275178528 shutdown_connections 2023-10-07T00:11:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.236+0000 7f64ea1b9700 1 -- 172.21.15.5:0/3275178528 wait complete. 2023-10-07T00:11:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.237+0000 7f64ea1b9700 1 Processor -- start 2023-10-07T00:11:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.237+0000 7f64ea1b9700 1 -- start start 2023-10-07T00:11:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64ea1b9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e4101ef0 0x7f64e40ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64ea1b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e4102810 0x7f64e4100090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64ea1b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 0x7f64e4100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64ea1b9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e41a5300 con 0x7f64e410b320 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64ea1b9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e41a5470 con 0x7f64e4101ef0 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64ea1b9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e41a5630 con 0x7f64e4102810 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e99b8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 0x7f64e4100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e89b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e4102810 0x7f64e4100090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e91b7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e4101ef0 0x7f64e40ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e99b8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 0x7f64e4100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45006/0 (socket says 172.21.15.5:45006) 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e99b8700 1 -- 172.21.15.5:0/1730892228 learned_addr learned my addr 172.21.15.5:0/1730892228 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e99b8700 1 -- 172.21.15.5:0/1730892228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e4102810 msgr2=0x7f64e4100090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e99b8700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e4102810 0x7f64e4100090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e99b8700 1 -- 172.21.15.5:0/1730892228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e4101ef0 msgr2=0x7f64e40ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e99b8700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e4101ef0 0x7f64e40ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.238+0000 7f64e99b8700 1 -- 172.21.15.5:0/1730892228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc009d00 con 0x7f64e410b320 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.239+0000 7f64e99b8700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 0x7f64e4100610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00b070 tx=0x7f64dc00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.239+0000 7f64da7fc700 1 -- 172.21.15.5:0/1730892228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00e040 con 0x7f64e410b320 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.239+0000 7f64da7fc700 1 -- 172.21.15.5:0/1730892228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64dc003e10 con 0x7f64e410b320 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.239+0000 7f64da7fc700 1 -- 172.21.15.5:0/1730892228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc01dea0 con 0x7f64e410b320 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.239+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e41a58b0 con 0x7f64e410b320 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.239+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e41a5d50 con 0x7f64e410b320 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.240+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e404f400 con 0x7f64e410b320 2023-10-07T00:11:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.242+0000 7f64da7fc700 1 -- 172.21.15.5:0/1730892228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f64dc01d480 con 0x7f64e410b320 2023-10-07T00:11:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.244+0000 7f64da7fc700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f64d00a1590 0x7f64d00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.244+0000 7f64da7fc700 1 -- 172.21.15.5:0/1730892228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f64dc0cde90 con 0x7f64e410b320 2023-10-07T00:11:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.244+0000 7f64e91b7700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f64d00a1590 0x7f64d00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.245+0000 7f64e91b7700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f64d00a1590 0x7f64d00a3a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009c60 tx=0x7f64e0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.248+0000 7f64da7fc700 1 -- 172.21.15.5:0/1730892228 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f64dc0973a0 con 0x7f64e410b320 2023-10-07T00:11:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.469+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f64e4101080 con 0x7f64e410b320 2023-10-07T00:11:54.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.470+0000 7f64da7fc700 1 -- 172.21.15.5:0/1730892228 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64dc09a9c0 con 0x7f64e410b320 2023-10-07T00:11:54.471 INFO:teuthology.orchestra.run.smithi005.stdout:146028888123 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f64d00a1590 msgr2=0x7f64d00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f64d00a1590 0x7f64d00a3a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009c60 tx=0x7f64e0009260 comp rx=0 tx=0).stop 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 msgr2=0x7f64e4100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 0x7f64e4100610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00b070 tx=0x7f64dc00bce0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 shutdown_connections 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f64d00a1590 0x7f64d00a3a50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64e410b320 0x7f64e4100610 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e4101ef0 0x7f64e40ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 --2- 172.21.15.5:0/1730892228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e4102810 0x7f64e4100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 >> 172.21.15.5:0/1730892228 conn(0x7f64e40fb760 msgr2=0x7f64e410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.472+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 shutdown_connections 2023-10-07T00:11:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.473+0000 7f64ea1b9700 1 -- 172.21.15.5:0/1730892228 wait complete. 2023-10-07T00:11:54.497 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/2373960044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc0730e0 msgr2=0x7fcfdc0734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/2373960044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc0730e0 0x7fcfdc0734c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009990 tx=0x7fcfd8009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/2373960044 shutdown_connections 2023-10-07T00:11:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/2373960044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc10d930 0x7fcfdc10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/2373960044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc0730e0 0x7fcfdc0734c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/2373960044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfdc073a00 0x7fcfdc10d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/2373960044 >> 172.21.15.5:0/2373960044 conn(0x7fcfdc0780a0 msgr2=0x7fcfdc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/2373960044 shutdown_connections 2023-10-07T00:11:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.216+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/2373960044 wait complete. 2023-10-07T00:11:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.217+0000 7fcfe3fe4700 1 Processor -- start 2023-10-07T00:11:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.217+0000 7fcfe3fe4700 1 -- start start 2023-10-07T00:11:54.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe3fe4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfdc0730e0 0x7fcfdc1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:54.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe3fe4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc073a00 0x7fcfdc199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:54.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe3fe4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc10d930 0x7fcfdc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:54.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe3fe4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc19e180 con 0x7fcfdc10d930 2023-10-07T00:11:54.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe3fe4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc19e2f0 con 0x7fcfdc0730e0 2023-10-07T00:11:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe3fe4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc19e4b0 con 0x7fcfdc073a00 2023-10-07T00:11:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe2581700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc10d930 0x7fcfdc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe2581700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc10d930 0x7fcfdc19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44986/0 (socket says 172.21.15.5:44986) 2023-10-07T00:11:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe2581700 1 -- 172.21.15.5:0/1412913868 learned_addr learned my addr 172.21.15.5:0/1412913868 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe1d80700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfdc0730e0 0x7fcfdc1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.218+0000 7fcfe157f700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc073a00 0x7fcfdc199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfe2581700 1 -- 172.21.15.5:0/1412913868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc073a00 msgr2=0x7fcfdc199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfe2581700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc073a00 0x7fcfdc199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfe2581700 1 -- 172.21.15.5:0/1412913868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfdc0730e0 msgr2=0x7fcfdc1991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfe2581700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfdc0730e0 0x7fcfdc1991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfe2581700 1 -- 172.21.15.5:0/1412913868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80095f0 con 0x7fcfdc10d930 2023-10-07T00:11:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfe2581700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc10d930 0x7fcfdc19db70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400ef90 tx=0x7fcfd400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfd2ffd700 1 -- 172.21.15.5:0/1412913868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4018070 con 0x7fcfdc10d930 2023-10-07T00:11:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfd2ffd700 1 -- 172.21.15.5:0/1412913868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfd400f040 con 0x7fcfdc10d930 2023-10-07T00:11:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfd2ffd700 1 -- 172.21.15.5:0/1412913868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd400cba0 con 0x7fcfdc10d930 2023-10-07T00:11:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc19e730 con 0x7fcfdc10d930 2023-10-07T00:11:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.219+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc1a5ff0 con 0x7fcfdc10d930 2023-10-07T00:11:54.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.220+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc04ebb0 con 0x7fcfdc10d930 2023-10-07T00:11:54.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.222+0000 7fcfd2ffd700 1 -- 172.21.15.5:0/1412913868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fcfd4003a00 con 0x7fcfdc10d930 2023-10-07T00:11:54.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.224+0000 7fcfd2ffd700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcfc80a1510 0x7fcfc80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:54.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.224+0000 7fcfd2ffd700 1 -- 172.21.15.5:0/1412913868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fcfd40cd260 con 0x7fcfdc10d930 2023-10-07T00:11:54.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.224+0000 7fcfe1d80700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcfc80a1510 0x7fcfc80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:54.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.225+0000 7fcfe1d80700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcfc80a1510 0x7fcfc80a39d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8006010 tx=0x7fcfd800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.227+0000 7fcfd2ffd700 1 -- 172.21.15.5:0/1412913868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcfd4096770 con 0x7fcfdc10d930 2023-10-07T00:11:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.457+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfdc113090 con 0x7fcfdc10d930 2023-10-07T00:11:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.457+0000 7fcfd2ffd700 1 -- 172.21.15.5:0/1412913868 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfd4099d90 con 0x7fcfdc10d930 2023-10-07T00:11:54.664 INFO:teuthology.orchestra.run.smithi005.stdout:111669149759 2023-10-07T00:11:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcfc80a1510 msgr2=0x7fcfc80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcfc80a1510 0x7fcfc80a39d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8006010 tx=0x7fcfd800b260 comp rx=0 tx=0).stop 2023-10-07T00:11:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc10d930 msgr2=0x7fcfdc19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc10d930 0x7fcfdc19db70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400ef90 tx=0x7fcfd400c3a0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 shutdown_connections 2023-10-07T00:11:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcfc80a1510 0x7fcfc80a39d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc10d930 0x7fcfdc19db70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfdc0730e0 0x7fcfdc1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 --2- 172.21.15.5:0/1412913868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc073a00 0x7fcfdc199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 >> 172.21.15.5:0/1412913868 conn(0x7fcfdc0780a0 msgr2=0x7fcfdc0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 shutdown_connections 2023-10-07T00:11:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:54.460+0000 7fcfe3fe4700 1 -- 172.21.15.5:0/1412913868 wait complete. 2023-10-07T00:11:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:54 smithi005 ceph-mon[129406]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 13 B/s, 0 objects/s recovering 2023-10-07T00:11:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:54 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1412913868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-07T00:11:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:54 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1730892228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-07T00:11:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:54 smithi088 ceph-mon[103111]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 13 B/s, 0 objects/s recovering 2023-10-07T00:11:55.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:54 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1412913868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-07T00:11:55.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:54 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1730892228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-07T00:11:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:54 smithi112 ceph-mon[133548]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 13 B/s, 0 objects/s recovering 2023-10-07T00:11:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:54 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1412913868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-07T00:11:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:54 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1730892228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-07T00:11:55.749 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738447 for osd.0 2023-10-07T00:11:55.749 DEBUG:teuthology.parallel:result is None 2023-10-07T00:11:55.874 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888122 got 146028888123 for osd.4 2023-10-07T00:11:55.874 DEBUG:teuthology.parallel:result is None 2023-10-07T00:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 -- 172.21.15.5:0/586415800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598106f90 msgr2=0x7f6598107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 --2- 172.21.15.5:0/586415800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598106f90 0x7f6598107370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65880099c0 tx=0x7f6588009cd0 comp rx=0 tx=0).stop 2023-10-07T00:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 -- 172.21.15.5:0/586415800 shutdown_connections 2023-10-07T00:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 --2- 172.21.15.5:0/586415800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6598101940 0x7f659810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 --2- 172.21.15.5:0/586415800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598106f90 0x7f6598107370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 --2- 172.21.15.5:0/586415800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6598100f80 0x7f6598101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 -- 172.21.15.5:0/586415800 >> 172.21.15.5:0/586415800 conn(0x7f65980780a0 msgr2=0x7f65980784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 -- 172.21.15.5:0/586415800 shutdown_connections 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.865+0000 7f659d59e700 1 -- 172.21.15.5:0/586415800 wait complete. 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.866+0000 7f659d59e700 1 Processor -- start 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.866+0000 7f659d59e700 1 -- start start 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.866+0000 7f659d59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6598100f80 0x7f6598199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f659d59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598101940 0x7f65981995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f659d59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6598106f90 0x7f659819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f659d59e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659819e040 con 0x7f6598106f90 2023-10-07T00:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f659d59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659819e1b0 con 0x7f6598101940 2023-10-07T00:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f659d59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659819e370 con 0x7f6598100f80 2023-10-07T00:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6598106f90 0x7f659819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6598106f90 0x7f659819da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45020/0 (socket says 172.21.15.5:45020) 2023-10-07T00:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65977fe700 1 -- 172.21.15.5:0/1500683626 learned_addr learned my addr 172.21.15.5:0/1500683626 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f6596ffd700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6598100f80 0x7f6598199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65967fc700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598101940 0x7f65981995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65977fe700 1 -- 172.21.15.5:0/1500683626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6598100f80 msgr2=0x7f6598199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65977fe700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6598100f80 0x7f6598199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65977fe700 1 -- 172.21.15.5:0/1500683626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598101940 msgr2=0x7f65981995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65977fe700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598101940 0x7f65981995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.867+0000 7f65977fe700 1 -- 172.21.15.5:0/1500683626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880095f0 con 0x7f6598106f90 2023-10-07T00:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.868+0000 7f65977fe700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6598106f90 0x7f659819da30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f659000efc0 tx=0x7f659000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.868+0000 7f657ffff700 1 -- 172.21.15.5:0/1500683626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590018070 con 0x7f6598106f90 2023-10-07T00:11:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.868+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659819e5f0 con 0x7f6598106f90 2023-10-07T00:11:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.868+0000 7f657ffff700 1 -- 172.21.15.5:0/1500683626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f659000f040 con 0x7f6598106f90 2023-10-07T00:11:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.868+0000 7f657ffff700 1 -- 172.21.15.5:0/1500683626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659000cbb0 con 0x7f6598106f90 2023-10-07T00:11:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.868+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65981a5eb0 con 0x7f6598106f90 2023-10-07T00:11:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.870+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659804ebb0 con 0x7f6598106f90 2023-10-07T00:11:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.872+0000 7f657ffff700 1 -- 172.21.15.5:0/1500683626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f659000cd50 con 0x7f6598106f90 2023-10-07T00:11:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.873+0000 7f657ffff700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f65800a1510 0x7f65800a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.873+0000 7f657ffff700 1 -- 172.21.15.5:0/1500683626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f65900cc890 con 0x7f6598106f90 2023-10-07T00:11:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.873+0000 7f6596ffd700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f65800a1510 0x7f65800a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.874+0000 7f6596ffd700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f65800a1510 0x7f65800a39d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f658800b580 tx=0x7f6588005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:55.878+0000 7f657ffff700 1 -- 172.21.15.5:0/1500683626 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6590095da0 con 0x7f6598106f90 2023-10-07T00:11:56.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.096+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6598110da0 con 0x7f6598106f90 2023-10-07T00:11:56.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.096+0000 7f657ffff700 1 -- 172.21.15.5:0/1500683626 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65900993c0 con 0x7f6598106f90 2023-10-07T00:11:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:167503724598 2023-10-07T00:11:56.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f65800a1510 msgr2=0x7f65800a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:56.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f65800a1510 0x7f65800a39d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f658800b580 tx=0x7f6588005c00 comp rx=0 tx=0).stop 2023-10-07T00:11:56.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6598106f90 msgr2=0x7f659819da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6598106f90 0x7f659819da30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f659000efc0 tx=0x7f659000c3a0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 shutdown_connections 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f65800a1510 0x7f65800a39d0 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f658800b580 tx=0x7f6588005c00 comp rx=0 tx=0).stop 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6598106f90 0x7f659819da30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6598100f80 0x7f6598199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 --2- 172.21.15.5:0/1500683626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598101940 0x7f65981995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.102+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 >> 172.21.15.5:0/1500683626 conn(0x7f65980780a0 msgr2=0x7f659810c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.103+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 shutdown_connections 2023-10-07T00:11:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.103+0000 7f659d59e700 1 -- 172.21.15.5:0/1500683626 wait complete. 2023-10-07T00:11:56.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.645+0000 7f8180226700 1 -- 172.21.15.5:0/3410875752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 msgr2=0x7f8178105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:56.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.645+0000 7f8180226700 1 --2- 172.21.15.5:0/3410875752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 0x7f8178105b80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8168009990 tx=0x7f8168009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.646+0000 7f8180226700 1 -- 172.21.15.5:0/3410875752 shutdown_connections 2023-10-07T00:11:56.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.646+0000 7f8180226700 1 --2- 172.21.15.5:0/3410875752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8178106260 0x7f817810de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.646+0000 7f8180226700 1 --2- 172.21.15.5:0/3410875752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8178101180 0x7f8178101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.646+0000 7f8180226700 1 --2- 172.21.15.5:0/3410875752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 0x7f8178105b80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.646+0000 7f8180226700 1 -- 172.21.15.5:0/3410875752 >> 172.21.15.5:0/3410875752 conn(0x7f81780fc9d0 msgr2=0x7f81780fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.646+0000 7f8180226700 1 -- 172.21.15.5:0/3410875752 shutdown_connections 2023-10-07T00:11:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.646+0000 7f8180226700 1 -- 172.21.15.5:0/3410875752 wait complete. 2023-10-07T00:11:56.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.647+0000 7f8180226700 1 Processor -- start 2023-10-07T00:11:56.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.647+0000 7f8180226700 1 -- start start 2023-10-07T00:11:56.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.647+0000 7f8180226700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8178101180 0x7f8178196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.647+0000 7f8180226700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 0x7f8178197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.647+0000 7f8180226700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8178106260 0x7f817819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.647+0000 7f8180226700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817819beb0 con 0x7f8178101b30 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.647+0000 7f8180226700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817819c020 con 0x7f8178101180 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.647+0000 7f8180226700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817819c1e0 con 0x7f8178106260 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 0x7f8178197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 0x7f8178197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45038/0 (socket says 172.21.15.5:45038) 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 -- 172.21.15.5:0/2246215523 learned_addr learned my addr 172.21.15.5:0/2246215523 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817dfc2700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8178101180 0x7f8178196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:56.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 -- 172.21.15.5:0/2246215523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8178106260 msgr2=0x7f817819b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:56.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817e7c3700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8178106260 0x7f817819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:56.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8178106260 0x7f817819b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 -- 172.21.15.5:0/2246215523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8178101180 msgr2=0x7f8178196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:56.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8178101180 0x7f8178196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 -- 172.21.15.5:0/2246215523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680095f0 con 0x7f8178101b30 2023-10-07T00:11:56.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817dfc2700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8178101180 0x7f8178196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:11:56.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817e7c3700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8178106260 0x7f817819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:56.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.648+0000 7f817d7c1700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 0x7f8178197430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8168004760 tx=0x7f8168004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.649+0000 7f816effd700 1 -- 172.21.15.5:0/2246215523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816801d070 con 0x7f8178101b30 2023-10-07T00:11:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.649+0000 7f816effd700 1 -- 172.21.15.5:0/2246215523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8168004cc0 con 0x7f8178101b30 2023-10-07T00:11:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.649+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817819c460 con 0x7f8178101b30 2023-10-07T00:11:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.649+0000 7f816effd700 1 -- 172.21.15.5:0/2246215523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168005080 con 0x7f8178101b30 2023-10-07T00:11:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.649+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81781a3b50 con 0x7f8178101b30 2023-10-07T00:11:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.650+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817804ebb0 con 0x7f8178101b30 2023-10-07T00:11:56.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.652+0000 7f816effd700 1 -- 172.21.15.5:0/2246215523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f8168003b70 con 0x7f8178101b30 2023-10-07T00:11:56.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.653+0000 7f816effd700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81640a1510 0x7f81640a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.653+0000 7f816effd700 1 -- 172.21.15.5:0/2246215523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f81680cdd60 con 0x7f8178101b30 2023-10-07T00:11:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.654+0000 7f817dfc2700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81640a1510 0x7f81640a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.654+0000 7f817dfc2700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81640a1510 0x7f81640a39d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8174005fd0 tx=0x7f8174005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:56.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.657+0000 7f816effd700 1 -- 172.21.15.5:0/2246215523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8168097270 con 0x7f8178101b30 2023-10-07T00:11:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.903+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f8178198250 con 0x7f8178101b30 2023-10-07T00:11:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.904+0000 7f816effd700 1 -- 172.21.15.5:0/2246215523 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f816809a890 con 0x7f8178101b30 2023-10-07T00:11:56.906 INFO:teuthology.orchestra.run.smithi005.stdout:257698037799 2023-10-07T00:11:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81640a1510 msgr2=0x7f81640a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81640a1510 0x7f81640a39d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8174005fd0 tx=0x7f8174005e30 comp rx=0 tx=0).stop 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 msgr2=0x7f8178197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 0x7f8178197430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8168004760 tx=0x7f8168004790 comp rx=0 tx=0).stop 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 shutdown_connections 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f81640a1510 0x7f81640a39d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8178106260 0x7f817819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8178101180 0x7f8178196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 --2- 172.21.15.5:0/2246215523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8178101b30 0x7f8178197430 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.907+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 >> 172.21.15.5:0/2246215523 conn(0x7f81780fc9d0 msgr2=0x7f81780fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.908+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 shutdown_connections 2023-10-07T00:11:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:56.908+0000 7f8180226700 1 -- 172.21.15.5:0/2246215523 wait complete. 2023-10-07T00:11:57.078 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:57.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.074+0000 7fecd3167700 1 -- 172.21.15.5:0/1791133307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc068ee0 msgr2=0x7feccc069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:57.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.074+0000 7fecd3167700 1 --2- 172.21.15.5:0/1791133307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc068ee0 0x7feccc069360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecc001a9a0 tx=0x7fecc001acb0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:56 smithi005 ceph-mon[129406]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:11:57.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:56 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1500683626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-07T00:11:57.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.093+0000 7fecd3167700 1 -- 172.21.15.5:0/1791133307 shutdown_connections 2023-10-07T00:11:57.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.093+0000 7fecd3167700 1 --2- 172.21.15.5:0/1791133307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feccc103960 0x7feccc103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.093+0000 7fecd3167700 1 --2- 172.21.15.5:0/1791133307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc105ef0 0x7feccc0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.093+0000 7fecd3167700 1 --2- 172.21.15.5:0/1791133307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc068ee0 0x7feccc069360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.093+0000 7fecd3167700 1 -- 172.21.15.5:0/1791133307 >> 172.21.15.5:0/1791133307 conn(0x7feccc075e00 msgr2=0x7feccc076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.095+0000 7fecd3167700 1 -- 172.21.15.5:0/1791133307 shutdown_connections 2023-10-07T00:11:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.095+0000 7fecd3167700 1 -- 172.21.15.5:0/1791133307 wait complete. 2023-10-07T00:11:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.096+0000 7fecd3167700 1 Processor -- start 2023-10-07T00:11:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.097+0000 7fecd3167700 1 -- start start 2023-10-07T00:11:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.097+0000 7fecd3167700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc068ee0 0x7feccc10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.097+0000 7fecd3167700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc103960 0x7feccc110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.097+0000 7fecd3167700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feccc105ef0 0x7feccc1c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.097+0000 7fecd3167700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc110a10 con 0x7feccc105ef0 2023-10-07T00:11:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.097+0000 7fecd3167700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc1c3230 con 0x7feccc103960 2023-10-07T00:11:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.097+0000 7fecd3167700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc1c3370 con 0x7feccc068ee0 2023-10-07T00:11:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd1704700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feccc105ef0 0x7feccc1c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd1704700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feccc105ef0 0x7feccc1c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45042/0 (socket says 172.21.15.5:45042) 2023-10-07T00:11:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd1704700 1 -- 172.21.15.5:0/2568198313 learned_addr learned my addr 172.21.15.5:0/2568198313 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd0f03700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc068ee0 0x7feccc10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7feccbfff700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc103960 0x7feccc110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd1704700 1 -- 172.21.15.5:0/2568198313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc068ee0 msgr2=0x7feccc10fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd1704700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc068ee0 0x7feccc10fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd1704700 1 -- 172.21.15.5:0/2568198313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc103960 msgr2=0x7feccc110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:57.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd1704700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc103960 0x7feccc110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7fecd1704700 1 -- 172.21.15.5:0/2568198313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc001a600 con 0x7feccc105ef0 2023-10-07T00:11:57.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.098+0000 7feccbfff700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc103960 0x7feccc110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:57.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.099+0000 7fecd1704700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feccc105ef0 0x7feccc1c2cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fecc400b970 tx=0x7fecc400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:57.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.099+0000 7fecc9ffb700 1 -- 172.21.15.5:0/2568198313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400c950 con 0x7feccc105ef0 2023-10-07T00:11:57.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.099+0000 7fecc9ffb700 1 -- 172.21.15.5:0/2568198313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecc4014440 con 0x7feccc105ef0 2023-10-07T00:11:57.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.099+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc1c3600 con 0x7feccc105ef0 2023-10-07T00:11:57.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.099+0000 7fecc9ffb700 1 -- 172.21.15.5:0/2568198313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40075b0 con 0x7feccc105ef0 2023-10-07T00:11:57.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.099+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc1c3ab0 con 0x7feccc105ef0 2023-10-07T00:11:57.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.101+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc04ebb0 con 0x7feccc105ef0 2023-10-07T00:11:57.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.104+0000 7fecc9ffb700 1 -- 172.21.15.5:0/2568198313 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fecc40145b0 con 0x7feccc105ef0 2023-10-07T00:11:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.106+0000 7fecc9ffb700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fecbc0a1550 0x7fecbc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.106+0000 7fecc9ffb700 1 -- 172.21.15.5:0/2568198313 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fecc40cc9b0 con 0x7feccc105ef0 2023-10-07T00:11:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.106+0000 7fecd0f03700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fecbc0a1550 0x7fecbc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.107+0000 7fecd0f03700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fecbc0a1550 0x7fecbc0a3a10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009910 tx=0x7fecb8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.110+0000 7fecc9ffb700 1 -- 172.21.15.5:0/2568198313 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fecc4095fa0 con 0x7feccc105ef0 2023-10-07T00:11:57.118 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724596 got 167503724598 for osd.5 2023-10-07T00:11:57.118 DEBUG:teuthology.parallel:result is None 2023-10-07T00:11:57.120 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149756 got 111669149759 for osd.3 2023-10-07T00:11:57.120 DEBUG:teuthology.parallel:result is None 2023-10-07T00:11:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:56 smithi088 ceph-mon[103111]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:11:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:56 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1500683626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-07T00:11:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:56 smithi112 ceph-mon[133548]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:11:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:56 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1500683626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-07T00:11:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.342+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7feccc108ab0 con 0x7feccc105ef0 2023-10-07T00:11:57.345 INFO:teuthology.orchestra.run.smithi005.stdout:347892350999 2023-10-07T00:11:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.343+0000 7fecc9ffb700 1 -- 172.21.15.5:0/2568198313 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fecc4023020 con 0x7feccc105ef0 2023-10-07T00:11:57.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fecbc0a1550 msgr2=0x7fecbc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fecbc0a1550 0x7fecbc0a3a10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009910 tx=0x7fecb8008040 comp rx=0 tx=0).stop 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feccc105ef0 msgr2=0x7feccc1c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feccc105ef0 0x7feccc1c2cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fecc400b970 tx=0x7fecc400bd30 comp rx=0 tx=0).stop 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 shutdown_connections 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fecbc0a1550 0x7fecbc0a3a10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feccc105ef0 0x7feccc1c2cf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc068ee0 0x7feccc10fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 --2- 172.21.15.5:0/2568198313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feccc103960 0x7feccc110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 >> 172.21.15.5:0/2568198313 conn(0x7feccc075e00 msgr2=0x7feccc0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:57.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 shutdown_connections 2023-10-07T00:11:57.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:57.345+0000 7fecd3167700 1 -- 172.21.15.5:0/2568198313 wait complete. 2023-10-07T00:11:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:11:57.890 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:57 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2246215523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-07T00:11:57.890 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:57 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2568198313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-07T00:11:58.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:57 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2246215523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-07T00:11:58.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:57 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2568198313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-07T00:11:58.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:57 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2246215523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-07T00:11:58.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:57 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2568198313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-07T00:11:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.641+0000 7f4022fd8700 1 -- 172.21.15.5:0/791977905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 msgr2=0x7f401c10d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.641+0000 7f4022fd8700 1 --2- 172.21.15.5:0/791977905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 0x7f401c10d040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f400c009990 tx=0x7f400c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.642+0000 7f4022fd8700 1 -- 172.21.15.5:0/791977905 shutdown_connections 2023-10-07T00:11:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.642+0000 7f4022fd8700 1 --2- 172.21.15.5:0/791977905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f401c10d580 0x7f401c10f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.642+0000 7f4022fd8700 1 --2- 172.21.15.5:0/791977905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f401c0732e0 0x7f401c0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.642+0000 7f4022fd8700 1 --2- 172.21.15.5:0/791977905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 0x7f401c10d040 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.642+0000 7f4022fd8700 1 -- 172.21.15.5:0/791977905 >> 172.21.15.5:0/791977905 conn(0x7f401c0fc8b0 msgr2=0x7f401c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.642+0000 7f4022fd8700 1 -- 172.21.15.5:0/791977905 shutdown_connections 2023-10-07T00:11:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.642+0000 7f4022fd8700 1 -- 172.21.15.5:0/791977905 wait complete. 2023-10-07T00:11:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.643+0000 7f4022fd8700 1 Processor -- start 2023-10-07T00:11:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.643+0000 7f4022fd8700 1 -- start start 2023-10-07T00:11:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f4022fd8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f401c0732e0 0x7f401c198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f4022fd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 0x7f401c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f4022fd8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f401c10d580 0x7f401c19d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f4022fd8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c19df90 con 0x7f401c073c00 2023-10-07T00:11:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f4022fd8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c19e100 con 0x7f401c0732e0 2023-10-07T00:11:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f4022fd8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c19e2c0 con 0x7f401c10d580 2023-10-07T00:11:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f40217d5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 0x7f401c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f40217d5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 0x7f401c199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45058/0 (socket says 172.21.15.5:45058) 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f40217d5700 1 -- 172.21.15.5:0/2318393448 learned_addr learned my addr 172.21.15.5:0/2318393448 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f40227d7700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f401c10d580 0x7f401c19d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.644+0000 7f4021fd6700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f401c0732e0 0x7f401c198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f40217d5700 1 -- 172.21.15.5:0/2318393448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f401c10d580 msgr2=0x7f401c19d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f40217d5700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f401c10d580 0x7f401c19d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f40217d5700 1 -- 172.21.15.5:0/2318393448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f401c0732e0 msgr2=0x7f401c198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f40217d5700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f401c0732e0 0x7f401c198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f40217d5700 1 -- 172.21.15.5:0/2318393448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0095f0 con 0x7f401c073c00 2023-10-07T00:11:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f40217d5700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 0x7f401c199510 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f400c0036c0 tx=0x7f400c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f4012ffd700 1 -- 172.21.15.5:0/2318393448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c01d070 con 0x7f401c073c00 2023-10-07T00:11:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f4012ffd700 1 -- 172.21.15.5:0/2318393448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f400c003ec0 con 0x7f401c073c00 2023-10-07T00:11:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f4012ffd700 1 -- 172.21.15.5:0/2318393448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c022b90 con 0x7f401c073c00 2023-10-07T00:11:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.645+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c19e540 con 0x7f401c073c00 2023-10-07T00:11:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.646+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c1a5c30 con 0x7f401c073c00 2023-10-07T00:11:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.647+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c04f400 con 0x7f401c073c00 2023-10-07T00:11:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.651+0000 7f4012ffd700 1 -- 172.21.15.5:0/2318393448 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f400c004030 con 0x7f401c073c00 2023-10-07T00:11:58.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.652+0000 7f4012ffd700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40080a1510 0x7f40080a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:58.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.652+0000 7f4012ffd700 1 -- 172.21.15.5:0/2318393448 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f400c0ceb40 con 0x7f401c073c00 2023-10-07T00:11:58.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.653+0000 7f4021fd6700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40080a1510 0x7f40080a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:58.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.653+0000 7f4021fd6700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40080a1510 0x7f40080a39d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4018007be0 tx=0x7f40180073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.655+0000 7f4012ffd700 1 -- 172.21.15.5:0/2318393448 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f400c0980b0 con 0x7f401c073c00 2023-10-07T00:11:58.679 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350997 got 347892350999 for osd.11 2023-10-07T00:11:58.680 DEBUG:teuthology.parallel:result is None 2023-10-07T00:11:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.875+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f401c19a330 con 0x7f401c073c00 2023-10-07T00:11:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.876+0000 7f4012ffd700 1 -- 172.21.15.5:0/2318393448 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f400c027020 con 0x7f401c073c00 2023-10-07T00:11:58.877 INFO:teuthology.orchestra.run.smithi005.stdout:77309411398 2023-10-07T00:11:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40080a1510 msgr2=0x7f40080a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40080a1510 0x7f40080a39d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4018007be0 tx=0x7f40180073d0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 msgr2=0x7f401c199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 0x7f401c199510 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f400c0036c0 tx=0x7f400c005740 comp rx=0 tx=0).stop 2023-10-07T00:11:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 shutdown_connections 2023-10-07T00:11:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40080a1510 0x7f40080a39d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f401c10d580 0x7f401c19d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f401c0732e0 0x7f401c198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 --2- 172.21.15.5:0/2318393448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c073c00 0x7f401c199510 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.878+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 >> 172.21.15.5:0/2318393448 conn(0x7f401c0fc8b0 msgr2=0x7f401c10f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.879+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 shutdown_connections 2023-10-07T00:11:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:58.879+0000 7f4022fd8700 1 -- 172.21.15.5:0/2318393448 wait complete. 2023-10-07T00:11:58.907 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:58 smithi005 ceph-mon[129406]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:11:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:58 smithi088 ceph-mon[103111]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:11:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:58 smithi112 ceph-mon[133548]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 7.0 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:11:59.347 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037797 got 257698037799 for osd.8 2023-10-07T00:11:59.348 DEBUG:teuthology.parallel:result is None 2023-10-07T00:11:59.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.474+0000 7f96f359f700 1 -- 172.21.15.5:0/1857870423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec074ef0 msgr2=0x7f96ec0730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.474+0000 7f96f359f700 1 --2- 172.21.15.5:0/1857870423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec074ef0 0x7f96ec0730e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009990 tx=0x7f96e8009ca0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.475+0000 7f96f359f700 1 -- 172.21.15.5:0/1857870423 shutdown_connections 2023-10-07T00:11:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.475+0000 7f96f359f700 1 --2- 172.21.15.5:0/1857870423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96ec111bc0 0x7f96ec113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.475+0000 7f96f359f700 1 --2- 172.21.15.5:0/1857870423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec074ef0 0x7f96ec0730e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.475+0000 7f96f359f700 1 --2- 172.21.15.5:0/1857870423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96ec073620 0x7f96ec073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.475+0000 7f96f359f700 1 -- 172.21.15.5:0/1857870423 >> 172.21.15.5:0/1857870423 conn(0x7f96ec0780a0 msgr2=0x7f96ec0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.475+0000 7f96f359f700 1 -- 172.21.15.5:0/1857870423 shutdown_connections 2023-10-07T00:11:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.475+0000 7f96f359f700 1 -- 172.21.15.5:0/1857870423 wait complete. 2023-10-07T00:11:59.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.476+0000 7f96f359f700 1 Processor -- start 2023-10-07T00:11:59.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.476+0000 7f96f359f700 1 -- start start 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.476+0000 7f96f359f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec073620 0x7f96ec19d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.476+0000 7f96f359f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96ec074ef0 0x7f96ec19dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.476+0000 7f96f359f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96ec111bc0 0x7f96ec1a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.476+0000 7f96f359f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec1a2530 con 0x7f96ec073620 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.476+0000 7f96f359f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec1a26a0 con 0x7f96ec111bc0 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.476+0000 7f96f359f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec1a2860 con 0x7f96ec074ef0 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec073620 0x7f96ec19d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec073620 0x7f96ec19d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45078/0 (socket says 172.21.15.5:45078) 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 -- 172.21.15.5:0/24662678 learned_addr learned my addr 172.21.15.5:0/24662678 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f0b3a700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96ec074ef0 0x7f96ec19dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f1b3c700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96ec111bc0 0x7f96ec1a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 -- 172.21.15.5:0/24662678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96ec074ef0 msgr2=0x7f96ec19dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96ec074ef0 0x7f96ec19dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 -- 172.21.15.5:0/24662678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96ec111bc0 msgr2=0x7f96ec1a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96ec111bc0 0x7f96ec1a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 -- 172.21.15.5:0/24662678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80095f0 con 0x7f96ec073620 2023-10-07T00:11:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f1b3c700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96ec111bc0 0x7f96ec1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:11:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.477+0000 7f96f133b700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec073620 0x7f96ec19d570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96e8005740 tx=0x7f96e8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.478+0000 7f96e27fc700 1 -- 172.21.15.5:0/24662678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e801d070 con 0x7f96ec073620 2023-10-07T00:11:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.478+0000 7f96e27fc700 1 -- 172.21.15.5:0/24662678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96e800fbb0 con 0x7f96ec073620 2023-10-07T00:11:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.478+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec1a2ae0 con 0x7f96ec073620 2023-10-07T00:11:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.478+0000 7f96e27fc700 1 -- 172.21.15.5:0/24662678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80173f0 con 0x7f96ec073620 2023-10-07T00:11:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.478+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec1aa3a0 con 0x7f96ec073620 2023-10-07T00:11:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.479+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec04ebb0 con 0x7f96ec073620 2023-10-07T00:11:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.482+0000 7f96e27fc700 1 -- 172.21.15.5:0/24662678 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f96e8022470 con 0x7f96ec073620 2023-10-07T00:11:59.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.484+0000 7f96e27fc700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f96d80a1590 0x7f96d80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.485+0000 7f96e27fc700 1 -- 172.21.15.5:0/24662678 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f96e80ce6c0 con 0x7f96ec073620 2023-10-07T00:11:59.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.485+0000 7f96f0b3a700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f96d80a1590 0x7f96d80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.485+0000 7f96f0b3a700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f96d80a1590 0x7f96d80a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f96ec19eb90 tx=0x7f96dc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.487+0000 7f96e27fc700 1 -- 172.21.15.5:0/24662678 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f96e8097bd0 con 0x7f96ec073620 2023-10-07T00:11:59.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 -- 172.21.15.5:0/2360770518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378103960 msgr2=0x7f5378103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 --2- 172.21.15.5:0/2360770518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378103960 0x7f5378103de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5370009f90 tx=0x7f537000b330 comp rx=0 tx=0).stop 2023-10-07T00:11:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 -- 172.21.15.5:0/2360770518 shutdown_connections 2023-10-07T00:11:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 --2- 172.21.15.5:0/2360770518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378103960 0x7f5378103de0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 --2- 172.21.15.5:0/2360770518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5378105ef0 0x7f53780689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 --2- 172.21.15.5:0/2360770518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5378068ee0 0x7f5378069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 -- 172.21.15.5:0/2360770518 >> 172.21.15.5:0/2360770518 conn(0x7f5378075e00 msgr2=0x7f5378076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 -- 172.21.15.5:0/2360770518 shutdown_connections 2023-10-07T00:11:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.525+0000 7f537d42f700 1 -- 172.21.15.5:0/2360770518 wait complete. 2023-10-07T00:11:59.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.526+0000 7f537d42f700 1 Processor -- start 2023-10-07T00:11:59.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.526+0000 7f537d42f700 1 -- start start 2023-10-07T00:11:59.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f537d42f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378068ee0 0x7f537819d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f537d42f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5378103960 0x7f537819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f537d42f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5378105ef0 0x7f53781a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f537d42f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53781a24a0 con 0x7f5378105ef0 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f537d42f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53781a2610 con 0x7f5378103960 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f537d42f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53781a27d0 con 0x7f5378068ee0 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f53777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5378105ef0 0x7f53781a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f5376ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378068ee0 0x7f537819d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f53777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5378105ef0 0x7f53781a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45098/0 (socket says 172.21.15.5:45098) 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f5376ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378068ee0 0x7f537819d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:44488/0 (socket says 172.21.15.5:44488) 2023-10-07T00:11:59.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f53777fe700 1 -- 172.21.15.5:0/2847289018 learned_addr learned my addr 172.21.15.5:0/2847289018 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:59.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.527+0000 7f53767fc700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5378103960 0x7f537819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f53777fe700 1 -- 172.21.15.5:0/2847289018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378068ee0 msgr2=0x7f537819d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f53777fe700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378068ee0 0x7f537819d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f53777fe700 1 -- 172.21.15.5:0/2847289018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5378103960 msgr2=0x7f537819da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f53777fe700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5378103960 0x7f537819da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f53777fe700 1 -- 172.21.15.5:0/2847289018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5370009c40 con 0x7f5378105ef0 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f53777fe700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5378105ef0 0x7f53781a1e90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5370009f60 tx=0x7f5370007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f535ffff700 1 -- 172.21.15.5:0/2847289018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537000e040 con 0x7f5378105ef0 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53781a2a50 con 0x7f5378105ef0 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f535ffff700 1 -- 172.21.15.5:0/2847289018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5370004e40 con 0x7f5378105ef0 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f535ffff700 1 -- 172.21.15.5:0/2847289018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537001b6b0 con 0x7f5378105ef0 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.528+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53781aa310 con 0x7f5378105ef0 2023-10-07T00:11:59.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.529+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537804ebb0 con 0x7f5378105ef0 2023-10-07T00:11:59.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.533+0000 7f535ffff700 1 -- 172.21.15.5:0/2847289018 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f537001b810 con 0x7f5378105ef0 2023-10-07T00:11:59.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.534+0000 7f535ffff700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f53600a1510 0x7f53600a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.534+0000 7f535ffff700 1 -- 172.21.15.5:0/2847289018 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f53700cf060 con 0x7f5378105ef0 2023-10-07T00:11:59.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.535+0000 7f5376ffd700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f53600a1510 0x7f53600a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.535+0000 7f5376ffd700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f53600a1510 0x7f53600a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5368009c60 tx=0x7f5368009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:59.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.539+0000 7f535ffff700 1 -- 172.21.15.5:0/2847289018 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5370098570 con 0x7f5378105ef0 2023-10-07T00:11:59.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.729+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96ec19e8d0 con 0x7f96ec073620 2023-10-07T00:11:59.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.730+0000 7f96e27fc700 1 -- 172.21.15.5:0/24662678 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96e809b1f0 con 0x7f96ec073620 2023-10-07T00:11:59.731 INFO:teuthology.orchestra.run.smithi005.stdout:55834574923 2023-10-07T00:11:59.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.732+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f96d80a1590 msgr2=0x7f96d80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.732+0000 7f96f359f700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f96d80a1590 0x7f96d80a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f96ec19eb90 tx=0x7f96dc009260 comp rx=0 tx=0).stop 2023-10-07T00:11:59.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.732+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec073620 msgr2=0x7f96ec19d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.732+0000 7f96f359f700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec073620 0x7f96ec19d570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96e8005740 tx=0x7f96e8005e80 comp rx=0 tx=0).stop 2023-10-07T00:11:59.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.733+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 shutdown_connections 2023-10-07T00:11:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.733+0000 7f96f359f700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f96d80a1590 0x7f96d80a3a50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.733+0000 7f96f359f700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96ec111bc0 0x7f96ec1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.733+0000 7f96f359f700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96ec073620 0x7f96ec19d570 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.733+0000 7f96f359f700 1 --2- 172.21.15.5:0/24662678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96ec074ef0 0x7f96ec19dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.733+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 >> 172.21.15.5:0/24662678 conn(0x7f96ec0780a0 msgr2=0x7f96ec1106e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.733+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 shutdown_connections 2023-10-07T00:11:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.733+0000 7f96f359f700 1 -- 172.21.15.5:0/24662678 wait complete. 2023-10-07T00:11:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.784+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f5378117280 con 0x7f5378105ef0 2023-10-07T00:11:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.785+0000 7f535ffff700 1 -- 172.21.15.5:0/2847289018 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5370021020 con 0x7f5378105ef0 2023-10-07T00:11:59.786 INFO:teuthology.orchestra.run.smithi005.stdout:292057776161 2023-10-07T00:11:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f53600a1510 msgr2=0x7f53600a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f53600a1510 0x7f53600a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5368009c60 tx=0x7f5368009260 comp rx=0 tx=0).stop 2023-10-07T00:11:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5378105ef0 msgr2=0x7f53781a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5378105ef0 0x7f53781a1e90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5370009f60 tx=0x7f5370007730 comp rx=0 tx=0).stop 2023-10-07T00:11:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 shutdown_connections 2023-10-07T00:11:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f53600a1510 0x7f53600a39d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5378105ef0 0x7f53781a1e90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5378068ee0 0x7f537819d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 --2- 172.21.15.5:0/2847289018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5378103960 0x7f537819da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 >> 172.21.15.5:0/2847289018 conn(0x7f5378075e00 msgr2=0x7f53780fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 shutdown_connections 2023-10-07T00:11:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.787+0000 7f537d42f700 1 -- 172.21.15.5:0/2847289018 wait complete. 2023-10-07T00:11:59.810 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:59 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2318393448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-07T00:11:59.810 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:11:59 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/24662678' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-07T00:11:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.963+0000 7f5d995ae700 1 -- 172.21.15.5:0/2027450158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d94100820 msgr2=0x7f5d9410cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.963+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2027450158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d94100820 0x7f5d9410cc90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00b0d0 tx=0x7f5d8c00b3e0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.964+0000 7f5d995ae700 1 -- 172.21.15.5:0/2027450158 shutdown_connections 2023-10-07T00:11:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.964+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2027450158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d94100820 0x7f5d9410cc90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.964+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2027450158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d94105e70 0x7f5d94106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.964+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2027450158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d940ffe60 0x7f5d941002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.964+0000 7f5d995ae700 1 -- 172.21.15.5:0/2027450158 >> 172.21.15.5:0/2027450158 conn(0x7f5d94075e00 msgr2=0x7f5d94076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:11:59.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.964+0000 7f5d995ae700 1 -- 172.21.15.5:0/2027450158 shutdown_connections 2023-10-07T00:11:59.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.964+0000 7f5d995ae700 1 -- 172.21.15.5:0/2027450158 wait complete. 2023-10-07T00:11:59.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.965+0000 7f5d995ae700 1 Processor -- start 2023-10-07T00:11:59.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.965+0000 7f5d995ae700 1 -- start start 2023-10-07T00:11:59.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d995ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940ffe60 0x7f5d94101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d995ae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d94100820 0x7f5d94102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d995ae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d94105e70 0x7f5d941025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d995ae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d941a5400 con 0x7f5d940ffe60 2023-10-07T00:11:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d995ae700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d941a5570 con 0x7f5d94105e70 2023-10-07T00:11:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d995ae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d941a5730 con 0x7f5d94100820 2023-10-07T00:11:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d92ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940ffe60 0x7f5d94101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d92ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940ffe60 0x7f5d94101ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45122/0 (socket says 172.21.15.5:45122) 2023-10-07T00:11:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d92ffd700 1 -- 172.21.15.5:0/2821595519 learned_addr learned my addr 172.21.15.5:0/2821595519 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:11:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d927fc700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d94100820 0x7f5d94102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.966+0000 7f5d937fe700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d94105e70 0x7f5d941025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d92ffd700 1 -- 172.21.15.5:0/2821595519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d94100820 msgr2=0x7f5d94102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d92ffd700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d94100820 0x7f5d94102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d92ffd700 1 -- 172.21.15.5:0/2821595519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d94105e70 msgr2=0x7f5d941025a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:11:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d92ffd700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d94105e70 0x7f5d941025a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:11:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d92ffd700 1 -- 172.21.15.5:0/2821595519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c009d00 con 0x7f5d940ffe60 2023-10-07T00:11:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d927fc700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d94100820 0x7f5d94102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:11:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d92ffd700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940ffe60 0x7f5d94101ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9a0 tx=0x7f5d8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:59.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d7bfff700 1 -- 172.21.15.5:0/2821595519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84009790 con 0x7f5d940ffe60 2023-10-07T00:11:59.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d7bfff700 1 -- 172.21.15.5:0/2821595519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d84010430 con 0x7f5d940ffe60 2023-10-07T00:11:59.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d7bfff700 1 -- 172.21.15.5:0/2821595519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400cea0 con 0x7f5d940ffe60 2023-10-07T00:11:59.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.967+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d941a5a10 con 0x7f5d940ffe60 2023-10-07T00:11:59.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.968+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d941a5ec0 con 0x7f5d940ffe60 2023-10-07T00:11:59.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.969+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9404ebb0 con 0x7f5d940ffe60 2023-10-07T00:11:59.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.971+0000 7f5d7bfff700 1 -- 172.21.15.5:0/2821595519 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f5d840105a0 con 0x7f5d940ffe60 2023-10-07T00:11:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.973+0000 7f5d7bfff700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d7c0a1610 0x7f5d7c0a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:11:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.973+0000 7f5d7bfff700 1 -- 172.21.15.5:0/2821595519 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5d84014070 con 0x7f5d940ffe60 2023-10-07T00:11:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.973+0000 7f5d927fc700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d7c0a1610 0x7f5d7c0a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:11:59.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.974+0000 7f5d927fc700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d7c0a1610 0x7f5d7c0a3ad0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5d941032d0 tx=0x7f5d88009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:11:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:11:59.977+0000 7f5d7bfff700 1 -- 172.21.15.5:0/2821595519 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d84096bb0 con 0x7f5d940ffe60 2023-10-07T00:12:00.036 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411398 for osd.2 2023-10-07T00:12:00.037 DEBUG:teuthology.parallel:result is None 2023-10-07T00:12:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.197+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f5d94103010 con 0x7f5d940ffe60 2023-10-07T00:12:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.197+0000 7f5d7bfff700 1 -- 172.21.15.5:0/2821595519 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f5d8409a1d0 con 0x7f5d940ffe60 2023-10-07T00:12:00.201 INFO:teuthology.orchestra.run.smithi005.stdout:313532612636 2023-10-07T00:12:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d7c0a1610 msgr2=0x7f5d7c0a3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d7c0a1610 0x7f5d7c0a3ad0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5d941032d0 tx=0x7f5d88009260 comp rx=0 tx=0).stop 2023-10-07T00:12:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940ffe60 msgr2=0x7f5d94101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940ffe60 0x7f5d94101ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9a0 tx=0x7f5d8400ecb0 comp rx=0 tx=0).stop 2023-10-07T00:12:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 shutdown_connections 2023-10-07T00:12:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5d7c0a1610 0x7f5d7c0a3ad0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d94105e70 0x7f5d941025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940ffe60 0x7f5d94101ae0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 --2- 172.21.15.5:0/2821595519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d94100820 0x7f5d94102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 >> 172.21.15.5:0/2821595519 conn(0x7f5d94075e00 msgr2=0x7f5d940fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 shutdown_connections 2023-10-07T00:12:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:00.200+0000 7f5d995ae700 1 -- 172.21.15.5:0/2821595519 wait complete. 2023-10-07T00:12:00.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:59 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2318393448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-07T00:12:00.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:11:59 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/24662678' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-07T00:12:00.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:59 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2318393448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-07T00:12:00.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:11:59 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/24662678' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-07T00:12:00.866 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574923 for osd.1 2023-10-07T00:12:00.866 DEBUG:teuthology.parallel:result is None 2023-10-07T00:12:01.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:00 smithi005 ceph-mon[129406]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 5.7 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:01.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:00 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2847289018' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-07T00:12:01.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:00 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2821595519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-07T00:12:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:00 smithi088 ceph-mon[103111]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 5.7 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:01.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:00 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2847289018' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-07T00:12:01.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:00 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2821595519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-07T00:12:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:00 smithi112 ceph-mon[133548]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 5.7 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:01.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:00 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2847289018' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-07T00:12:01.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:00 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2821595519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-07T00:12:01.416 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612634 got 313532612636 for osd.10 2023-10-07T00:12:01.416 DEBUG:teuthology.parallel:result is None 2023-10-07T00:12:01.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776159 got 292057776161 for osd.9 2023-10-07T00:12:01.541 DEBUG:teuthology.parallel:result is None 2023-10-07T00:12:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 -- 172.21.15.5:0/515072576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14108460 msgr2=0x7fea14110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 --2- 172.21.15.5:0/515072576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14108460 0x7fea14110030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00b0a0 tx=0x7fea0c00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 -- 172.21.15.5:0/515072576 shutdown_connections 2023-10-07T00:12:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 --2- 172.21.15.5:0/515072576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14108460 0x7fea14110030 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 --2- 172.21.15.5:0/515072576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea14103380 0x7fea14103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 --2- 172.21.15.5:0/515072576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea14103d30 0x7fea14107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 -- 172.21.15.5:0/515072576 >> 172.21.15.5:0/515072576 conn(0x7fea140fec10 msgr2=0x7fea14101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 -- 172.21.15.5:0/515072576 shutdown_connections 2023-10-07T00:12:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.911+0000 7fea1aaea700 1 -- 172.21.15.5:0/515072576 wait complete. 2023-10-07T00:12:01.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.912+0000 7fea1aaea700 1 Processor -- start 2023-10-07T00:12:01.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.912+0000 7fea1aaea700 1 -- start start 2023-10-07T00:12:01.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea1aaea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14103380 0x7fea141991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:01.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea1aaea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea14103d30 0x7fea14199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:01.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea1aaea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea14108460 0x7fea1419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea1aaea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1419e180 con 0x7fea14103380 2023-10-07T00:12:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea1aaea700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1419e2f0 con 0x7fea14103d30 2023-10-07T00:12:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea1aaea700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1419e4b0 con 0x7fea14108460 2023-10-07T00:12:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea18886700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14103380 0x7fea141991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea18886700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14103380 0x7fea141991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55670/0 (socket says 172.21.15.5:55670) 2023-10-07T00:12:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea18886700 1 -- 172.21.15.5:0/496272950 learned_addr learned my addr 172.21.15.5:0/496272950 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea13fff700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea14103d30 0x7fea14199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.913+0000 7fea19087700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea14108460 0x7fea1419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.914+0000 7fea13fff700 1 -- 172.21.15.5:0/496272950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea14108460 msgr2=0x7fea1419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.914+0000 7fea13fff700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea14108460 0x7fea1419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.914+0000 7fea13fff700 1 -- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14103380 msgr2=0x7fea141991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.914+0000 7fea13fff700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14103380 0x7fea141991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.914+0000 7fea13fff700 1 -- 172.21.15.5:0/496272950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c009d00 con 0x7fea14103d30 2023-10-07T00:12:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.914+0000 7fea13fff700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea14103d30 0x7fea14199700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea1406a580 tx=0x7fea0000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.915+0000 7fea11ffb700 1 -- 172.21.15.5:0/496272950 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0000f890 con 0x7fea14103d30 2023-10-07T00:12:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.915+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1419e790 con 0x7fea14103d30 2023-10-07T00:12:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.915+0000 7fea11ffb700 1 -- 172.21.15.5:0/496272950 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea0000fe80 con 0x7fea14103d30 2023-10-07T00:12:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.915+0000 7fea11ffb700 1 -- 172.21.15.5:0/496272950 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0000e3b0 con 0x7fea14103d30 2023-10-07T00:12:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.915+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea141a5ff0 con 0x7fea14103d30 2023-10-07T00:12:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.916+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1404ebb0 con 0x7fea14103d30 2023-10-07T00:12:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.918+0000 7fea11ffb700 1 -- 172.21.15.5:0/496272950 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fea0000f9f0 con 0x7fea14103d30 2023-10-07T00:12:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.920+0000 7fea11ffb700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fea040a1510 0x7fea040a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.920+0000 7fea11ffb700 1 -- 172.21.15.5:0/496272950 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fea000ccc20 con 0x7fea14103d30 2023-10-07T00:12:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.920+0000 7fea18886700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fea040a1510 0x7fea040a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.920+0000 7fea18886700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fea040a1510 0x7fea040a39d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea0800ad20 tx=0x7fea08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:01.922+0000 7fea11ffb700 1 -- 172.21.15.5:0/496272950 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fea000cce60 con 0x7fea14103d30 2023-10-07T00:12:02.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.144+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fea1419a520 con 0x7fea14103d30 2023-10-07T00:12:02.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.145+0000 7fea11ffb700 1 -- 172.21.15.5:0/496272950 <== mon.2 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea00016090 con 0x7fea14103d30 2023-10-07T00:12:02.146 INFO:teuthology.orchestra.run.smithi005.stdout:201863462961 2023-10-07T00:12:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fea040a1510 msgr2=0x7fea040a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fea040a1510 0x7fea040a39d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea0800ad20 tx=0x7fea08005f90 comp rx=0 tx=0).stop 2023-10-07T00:12:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea14103d30 msgr2=0x7fea14199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea14103d30 0x7fea14199700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea1406a580 tx=0x7fea0000dc30 comp rx=0 tx=0).stop 2023-10-07T00:12:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 shutdown_connections 2023-10-07T00:12:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fea040a1510 0x7fea040a39d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea14108460 0x7fea1419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea14103380 0x7fea141991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 --2- 172.21.15.5:0/496272950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea14103d30 0x7fea14199700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.147+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 >> 172.21.15.5:0/496272950 conn(0x7fea140fec10 msgr2=0x7fea140ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.148+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 shutdown_connections 2023-10-07T00:12:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.148+0000 7fea1aaea700 1 -- 172.21.15.5:0/496272950 wait complete. 2023-10-07T00:12:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.194+0000 7f5f95c10700 1 -- 172.21.15.5:0/2601569018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103d60 msgr2=0x7f5f90107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.194+0000 7f5f95c10700 1 --2- 172.21.15.5:0/2601569018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103d60 0x7f5f90107db0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009990 tx=0x7f5f84009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.194+0000 7f5f95c10700 1 -- 172.21.15.5:0/2601569018 shutdown_connections 2023-10-07T00:12:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.194+0000 7f5f95c10700 1 --2- 172.21.15.5:0/2601569018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f90108490 0x7f5f90110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.194+0000 7f5f95c10700 1 --2- 172.21.15.5:0/2601569018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f901033b0 0x7f5f90103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.194+0000 7f5f95c10700 1 --2- 172.21.15.5:0/2601569018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103d60 0x7f5f90107db0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.195+0000 7f5f95c10700 1 -- 172.21.15.5:0/2601569018 >> 172.21.15.5:0/2601569018 conn(0x7f5f900fec20 msgr2=0x7f5f90101040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.195+0000 7f5f95c10700 1 -- 172.21.15.5:0/2601569018 shutdown_connections 2023-10-07T00:12:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.195+0000 7f5f95c10700 1 -- 172.21.15.5:0/2601569018 wait complete. 2023-10-07T00:12:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.196+0000 7f5f95c10700 1 Processor -- start 2023-10-07T00:12:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.196+0000 7f5f95c10700 1 -- start start 2023-10-07T00:12:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f95c10700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f901033b0 0x7f5f90199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f95c10700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f90103d60 0x7f5f901996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f95c10700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108490 0x7f5f9019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f95c10700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9019e150 con 0x7f5f90108490 2023-10-07T00:12:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f95c10700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9019e2c0 con 0x7f5f90103d60 2023-10-07T00:12:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f95c10700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9019e480 con 0x7f5f901033b0 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f8ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108490 0x7f5f9019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f8ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108490 0x7f5f9019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55698/0 (socket says 172.21.15.5:55698) 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.197+0000 7f5f8ffff700 1 -- 172.21.15.5:0/1651992488 learned_addr learned my addr 172.21.15.5:0/1651992488 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8effd700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f90103d60 0x7f5f901996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8f7fe700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f901033b0 0x7f5f90199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8ffff700 1 -- 172.21.15.5:0/1651992488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f901033b0 msgr2=0x7f5f90199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8ffff700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f901033b0 0x7f5f90199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8ffff700 1 -- 172.21.15.5:0/1651992488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f90103d60 msgr2=0x7f5f901996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8ffff700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f90103d60 0x7f5f901996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8ffff700 1 -- 172.21.15.5:0/1651992488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840095f0 con 0x7f5f90108490 2023-10-07T00:12:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8effd700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f90103d60 0x7f5f901996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8ffff700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108490 0x7f5f9019db40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800ada0 tx=0x7f5f8800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8cff9700 1 -- 172.21.15.5:0/1651992488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800f070 con 0x7f5f90108490 2023-10-07T00:12:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8cff9700 1 -- 172.21.15.5:0/1651992488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f88007b30 con 0x7f5f90108490 2023-10-07T00:12:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9019e760 con 0x7f5f90108490 2023-10-07T00:12:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f8cff9700 1 -- 172.21.15.5:0/1651992488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880053e0 con 0x7f5f90108490 2023-10-07T00:12:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.198+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f901a5fc0 con 0x7f5f90108490 2023-10-07T00:12:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.200+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9004ebb0 con 0x7f5f90108490 2023-10-07T00:12:02.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.201+0000 7f5f8cff9700 1 -- 172.21.15.5:0/1651992488 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f5f8800c980 con 0x7f5f90108490 2023-10-07T00:12:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.204+0000 7f5f8cff9700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5f780a1510 0x7f5f780a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.204+0000 7f5f8cff9700 1 -- 172.21.15.5:0/1651992488 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5f880cc5c0 con 0x7f5f90108490 2023-10-07T00:12:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.204+0000 7f5f8f7fe700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5f780a1510 0x7f5f780a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.205+0000 7f5f8f7fe700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5f780a1510 0x7f5f780a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f80005fd0 tx=0x7f5f80005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.207+0000 7f5f8cff9700 1 -- 172.21.15.5:0/1651992488 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5f88095ad0 con 0x7f5f90108490 2023-10-07T00:12:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.451+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5f90113020 con 0x7f5f90108490 2023-10-07T00:12:02.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.451+0000 7f5f8cff9700 1 -- 172.21.15.5:0/1651992488 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f8800cc30 con 0x7f5f90108490 2023-10-07T00:12:02.453 INFO:teuthology.orchestra.run.smithi005.stdout:223338299435 2023-10-07T00:12:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5f780a1510 msgr2=0x7f5f780a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5f780a1510 0x7f5f780a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f80005fd0 tx=0x7f5f80005f60 comp rx=0 tx=0).stop 2023-10-07T00:12:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108490 msgr2=0x7f5f9019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108490 0x7f5f9019db40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800ada0 tx=0x7f5f8800c330 comp rx=0 tx=0).stop 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 shutdown_connections 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5f780a1510 0x7f5f780a39d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108490 0x7f5f9019db40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f901033b0 0x7f5f90199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 --2- 172.21.15.5:0/1651992488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f90103d60 0x7f5f901996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 >> 172.21.15.5:0/1651992488 conn(0x7f5f900fec20 msgr2=0x7f5f900ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 shutdown_connections 2023-10-07T00:12:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:02.454+0000 7f5f95c10700 1 -- 172.21.15.5:0/1651992488 wait complete. 2023-10-07T00:12:02.524 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462959 got 201863462961 for osd.6 2023-10-07T00:12:02.524 DEBUG:teuthology.parallel:result is None 2023-10-07T00:12:02.975 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299433 got 223338299435 for osd.7 2023-10-07T00:12:02.976 DEBUG:teuthology.parallel:result is None 2023-10-07T00:12:02.976 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-07T00:12:02.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-07T00:12:03.040 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:02 smithi005 ceph-mon[129406]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.1 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:03.040 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:02 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/496272950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-07T00:12:03.041 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:02 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1651992488' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-07T00:12:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:02 smithi088 ceph-mon[103111]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.1 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:02 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/496272950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-07T00:12:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:02 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1651992488' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-07T00:12:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:02 smithi112 ceph-mon[133548]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.1 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:02 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/496272950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-07T00:12:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:02 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1651992488' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-07T00:12:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:05.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:04 smithi005 ceph-mon[129406]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 4.7 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 -- 172.21.15.5:0/2898744364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0074ef0 msgr2=0x7f84c00730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 --2- 172.21.15.5:0/2898744364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0074ef0 0x7f84c00730e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009990 tx=0x7f84b0009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 -- 172.21.15.5:0/2898744364 shutdown_connections 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 --2- 172.21.15.5:0/2898744364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c0111bc0 0x7f84c0113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 --2- 172.21.15.5:0/2898744364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0074ef0 0x7f84c00730e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 --2- 172.21.15.5:0/2898744364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0073620 0x7f84c0073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 -- 172.21.15.5:0/2898744364 >> 172.21.15.5:0/2898744364 conn(0x7f84c00780a0 msgr2=0x7f84c00784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 -- 172.21.15.5:0/2898744364 shutdown_connections 2023-10-07T00:12:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.110+0000 7f84c6785700 1 -- 172.21.15.5:0/2898744364 wait complete. 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.111+0000 7f84c6785700 1 Processor -- start 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.111+0000 7f84c6785700 1 -- start start 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.111+0000 7f84c6785700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c0073620 0x7f84c01a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.111+0000 7f84c6785700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0074ef0 0x7f84c01a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.111+0000 7f84c6785700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0111bc0 0x7f84c019d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.111+0000 7f84c6785700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c019dba0 con 0x7f84c0111bc0 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.111+0000 7f84c6785700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c019dce0 con 0x7f84c0073620 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.111+0000 7f84c6785700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c019dea0 con 0x7f84c0074ef0 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0111bc0 0x7f84c019d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0111bc0 0x7f84c019d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55718/0 (socket says 172.21.15.5:55718) 2023-10-07T00:12:05.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 -- 172.21.15.5:0/3313099486 learned_addr learned my addr 172.21.15.5:0/3313099486 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84bffff700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c0073620 0x7f84c01a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84bf7fe700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0074ef0 0x7f84c01a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 -- 172.21.15.5:0/3313099486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0074ef0 msgr2=0x7f84c01a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0074ef0 0x7f84c01a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 -- 172.21.15.5:0/3313099486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c0073620 msgr2=0x7f84c01a3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c0073620 0x7f84c01a3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 -- 172.21.15.5:0/3313099486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00095f0 con 0x7f84c0111bc0 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.112+0000 7f84c4d22700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0111bc0 0x7f84c019d540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f84b8007ee0 tx=0x7f84b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.113+0000 7f84bd7fa700 1 -- 172.21.15.5:0/3313099486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8017070 con 0x7f84c0111bc0 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.113+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c019e180 con 0x7f84c0111bc0 2023-10-07T00:12:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.113+0000 7f84bd7fa700 1 -- 172.21.15.5:0/3313099486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84b800f040 con 0x7f84c0111bc0 2023-10-07T00:12:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.113+0000 7f84bd7fa700 1 -- 172.21.15.5:0/3313099486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8004310 con 0x7f84c0111bc0 2023-10-07T00:12:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.113+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c01aa500 con 0x7f84c0111bc0 2023-10-07T00:12:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.114+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c004ebb0 con 0x7f84c0111bc0 2023-10-07T00:12:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.116+0000 7f84bd7fa700 1 -- 172.21.15.5:0/3313099486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f84b800db20 con 0x7f84c0111bc0 2023-10-07T00:12:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.117+0000 7f84bd7fa700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f84a80a1590 0x7f84a80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.117+0000 7f84bd7fa700 1 -- 172.21.15.5:0/3313099486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f84b80cc410 con 0x7f84c0111bc0 2023-10-07T00:12:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.117+0000 7f84bffff700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f84a80a1590 0x7f84a80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.118+0000 7f84bffff700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f84a80a1590 0x7f84a80a3a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84b0006010 tx=0x7f84b000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.121+0000 7f84bd7fa700 1 -- 172.21.15.5:0/3313099486 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f84b80958f0 con 0x7f84c0111bc0 2023-10-07T00:12:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:04 smithi088 ceph-mon[103111]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 4.7 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:05.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:04 smithi112 ceph-mon[133548]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 4.7 KiB/s, 0 keys/s, 1 objects/s recovering 2023-10-07T00:12:05.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.328+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84c01174d0 con 0x7f84a80a1590 2023-10-07T00:12:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.339+0000 7f84bd7fa700 1 -- 172.21.15.5:0/3313099486 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340322 (secure 0 0 0) 0x7f84c01174d0 con 0x7f84a80a1590 2023-10-07T00:12:05.347 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:05.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.344+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f84a80a1590 msgr2=0x7f84a80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.344+0000 7f84c6785700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f84a80a1590 0x7f84a80a3a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84b0006010 tx=0x7f84b000b260 comp rx=0 tx=0).stop 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.344+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0111bc0 msgr2=0x7f84c019d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.344+0000 7f84c6785700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0111bc0 0x7f84c019d540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f84b8007ee0 tx=0x7f84b800d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.345+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 shutdown_connections 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.345+0000 7f84c6785700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f84a80a1590 0x7f84a80a3a50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.345+0000 7f84c6785700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c0111bc0 0x7f84c019d540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.345+0000 7f84c6785700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84c0073620 0x7f84c01a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.345+0000 7f84c6785700 1 --2- 172.21.15.5:0/3313099486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0074ef0 0x7f84c01a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.345+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 >> 172.21.15.5:0/3313099486 conn(0x7f84c00780a0 msgr2=0x7f84c0110440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.345+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 shutdown_connections 2023-10-07T00:12:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:05.345+0000 7f84c6785700 1 -- 172.21.15.5:0/3313099486 wait complete. 2023-10-07T00:12:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-07T00:12:05.894 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2023-10-07T00:12:03.654967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653866,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":557,"num_read_kb":396,"num_write":414,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1238300,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335996,"kb_used_data":11732,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605828,"statfs":{"total":1151940427776,"available":1151596367872,"internally_reserved":0,"allocated":12013568,"data_stored":7466898,"data_compressed":186885,"data_compressed_allocated":245760,"data_compressed_original":2019328,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":52,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":57564,"num_keys_recovered":7,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002796"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729502+0000","last_change":"2023-10-07T00:11:13.845315+0000","last_active":"2023-10-07T00:11:49.729502+0000","last_peered":"2023-10-07T00:11:49.729502+0000","last_clean":"2023-10-07T00:11:49.729502+0000","last_became_active":"2023-10-07T00:11:13.844330+0000","last_became_peered":"2023-10-07T00:11:13.844330+0000","last_unstale":"2023-10-07T00:11:49.729502+0000","last_undegraded":"2023-10-07T00:11:49.729502+0000","last_fullsized":"2023-10-07T00:11:49.729502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:26.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725619+0000","last_change":"2023-10-07T00:11:13.842602+0000","last_active":"2023-10-07T00:11:49.725619+0000","last_peered":"2023-10-07T00:11:49.725619+0000","last_clean":"2023-10-07T00:11:49.725619+0000","last_became_active":"2023-10-07T00:11:13.842296+0000","last_became_peered":"2023-10-07T00:11:13.842296+0000","last_unstale":"2023-10-07T00:11:49.725619+0000","last_undegraded":"2023-10-07T00:11:49.725619+0000","last_fullsized":"2023-10-07T00:11:49.725619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:51.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725522+0000","last_change":"2023-10-07T00:11:13.850567+0000","last_active":"2023-10-07T00:11:49.725522+0000","last_peered":"2023-10-07T00:11:49.725522+0000","last_clean":"2023-10-07T00:11:49.725522+0000","last_became_active":"2023-10-07T00:11:13.850212+0000","last_became_peered":"2023-10-07T00:11:13.850212+0000","last_unstale":"2023-10-07T00:11:49.725522+0000","last_undegraded":"2023-10-07T00:11:49.725522+0000","last_fullsized":"2023-10-07T00:11:49.725522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:51.539752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734525+0000","last_change":"2023-10-07T00:11:13.839742+0000","last_active":"2023-10-07T00:11:49.734525+0000","last_peered":"2023-10-07T00:11:49.734525+0000","last_clean":"2023-10-07T00:11:49.734525+0000","last_became_active":"2023-10-07T00:11:13.839041+0000","last_became_peered":"2023-10-07T00:11:13.839041+0000","last_unstale":"2023-10-07T00:11:49.734525+0000","last_undegraded":"2023-10-07T00:11:49.734525+0000","last_fullsized":"2023-10-07T00:11:49.734525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:59.241248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726468+0000","last_change":"2023-10-07T00:11:13.834839+0000","last_active":"2023-10-07T00:11:49.726468+0000","last_peered":"2023-10-07T00:11:49.726468+0000","last_clean":"2023-10-07T00:11:49.726468+0000","last_became_active":"2023-10-07T00:11:13.834529+0000","last_became_peered":"2023-10-07T00:11:13.834529+0000","last_unstale":"2023-10-07T00:11:49.726468+0000","last_undegraded":"2023-10-07T00:11:49.726468+0000","last_fullsized":"2023-10-07T00:11:49.726468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:23.831424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736591+0000","last_change":"2023-10-07T00:11:13.835102+0000","last_active":"2023-10-07T00:11:49.736591+0000","last_peered":"2023-10-07T00:11:49.736591+0000","last_clean":"2023-10-07T00:11:49.736591+0000","last_became_active":"2023-10-07T00:11:13.834781+0000","last_became_peered":"2023-10-07T00:11:13.834781+0000","last_unstale":"2023-10-07T00:11:49.736591+0000","last_undegraded":"2023-10-07T00:11:49.736591+0000","last_fullsized":"2023-10-07T00:11:49.736591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:16:55.912464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.781822+0000","last_change":"2023-10-07T00:11:50.781822+0000","last_active":"2023-10-07T00:11:50.781822+0000","last_peered":"2023-10-07T00:11:50.781822+0000","last_clean":"2023-10-07T00:11:50.781822+0000","last_became_active":"2023-10-07T00:11:50.781261+0000","last_became_peered":"2023-10-07T00:11:50.781261+0000","last_unstale":"2023-10-07T00:11:50.781822+0000","last_undegraded":"2023-10-07T00:11:50.781822+0000","last_fullsized":"2023-10-07T00:11:50.781822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:16.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731803+0000","last_change":"2023-10-07T00:11:13.842772+0000","last_active":"2023-10-07T00:11:49.731803+0000","last_peered":"2023-10-07T00:11:49.731803+0000","last_clean":"2023-10-07T00:11:49.731803+0000","last_became_active":"2023-10-07T00:11:13.841610+0000","last_became_peered":"2023-10-07T00:11:13.841610+0000","last_unstale":"2023-10-07T00:11:49.731803+0000","last_undegraded":"2023-10-07T00:11:49.731803+0000","last_fullsized":"2023-10-07T00:11:49.731803+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:04:51.988705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733744+0000","last_change":"2023-10-07T00:11:13.836990+0000","last_active":"2023-10-07T00:11:49.733744+0000","last_peered":"2023-10-07T00:11:49.733744+0000","last_clean":"2023-10-07T00:11:49.733744+0000","last_became_active":"2023-10-07T00:11:13.836699+0000","last_became_peered":"2023-10-07T00:11:13.836699+0000","last_unstale":"2023-10-07T00:11:49.733744+0000","last_undegraded":"2023-10-07T00:11:49.733744+0000","last_fullsized":"2023-10-07T00:11:49.733744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:18:20.450573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.736801+0000","last_change":"2023-10-07T00:11:50.736801+0000","last_active":"2023-10-07T00:11:50.736801+0000","last_peered":"2023-10-07T00:11:50.736801+0000","last_clean":"2023-10-07T00:11:50.736801+0000","last_became_active":"2023-10-07T00:11:50.736256+0000","last_became_peered":"2023-10-07T00:11:50.736256+0000","last_unstale":"2023-10-07T00:11:50.736801+0000","last_undegraded":"2023-10-07T00:11:50.736801+0000","last_fullsized":"2023-10-07T00:11:50.736801+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:35.622108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726373+0000","last_change":"2023-10-07T00:11:13.841699+0000","last_active":"2023-10-07T00:11:49.726373+0000","last_peered":"2023-10-07T00:11:49.726373+0000","last_clean":"2023-10-07T00:11:49.726373+0000","last_became_active":"2023-10-07T00:11:13.841295+0000","last_became_peered":"2023-10-07T00:11:13.841295+0000","last_unstale":"2023-10-07T00:11:49.726373+0000","last_undegraded":"2023-10-07T00:11:49.726373+0000","last_fullsized":"2023-10-07T00:11:49.726373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:24:56.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733949+0000","last_change":"2023-10-07T00:11:13.839951+0000","last_active":"2023-10-07T00:11:49.733949+0000","last_peered":"2023-10-07T00:11:49.733949+0000","last_clean":"2023-10-07T00:11:49.733949+0000","last_became_active":"2023-10-07T00:11:13.839473+0000","last_became_peered":"2023-10-07T00:11:13.839473+0000","last_unstale":"2023-10-07T00:11:49.733949+0000","last_undegraded":"2023-10-07T00:11:49.733949+0000","last_fullsized":"2023-10-07T00:11:49.733949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728867+0000","last_change":"2023-10-07T00:11:13.838714+0000","last_active":"2023-10-07T00:11:49.728867+0000","last_peered":"2023-10-07T00:11:49.728867+0000","last_clean":"2023-10-07T00:11:49.728867+0000","last_became_active":"2023-10-07T00:11:13.838222+0000","last_became_peered":"2023-10-07T00:11:13.838222+0000","last_unstale":"2023-10-07T00:11:49.728867+0000","last_undegraded":"2023-10-07T00:11:49.728867+0000","last_fullsized":"2023-10-07T00:11:49.728867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:11:43.194204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725360+0000","last_change":"2023-10-07T00:11:13.843075+0000","last_active":"2023-10-07T00:11:49.725360+0000","last_peered":"2023-10-07T00:11:49.725360+0000","last_clean":"2023-10-07T00:11:49.725360+0000","last_became_active":"2023-10-07T00:11:13.842742+0000","last_became_peered":"2023-10-07T00:11:13.842742+0000","last_unstale":"2023-10-07T00:11:49.725360+0000","last_undegraded":"2023-10-07T00:11:49.725360+0000","last_fullsized":"2023-10-07T00:11:49.725360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:53:12.713979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725271+0000","last_change":"2023-10-07T00:11:13.841635+0000","last_active":"2023-10-07T00:11:49.725271+0000","last_peered":"2023-10-07T00:11:49.725271+0000","last_clean":"2023-10-07T00:11:49.725271+0000","last_became_active":"2023-10-07T00:11:13.841291+0000","last_became_peered":"2023-10-07T00:11:13.841291+0000","last_unstale":"2023-10-07T00:11:49.725271+0000","last_undegraded":"2023-10-07T00:11:49.725271+0000","last_fullsized":"2023-10-07T00:11:49.725271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:48:38.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732543+0000","last_change":"2023-10-07T00:11:13.842365+0000","last_active":"2023-10-07T00:11:49.732543+0000","last_peered":"2023-10-07T00:11:49.732543+0000","last_clean":"2023-10-07T00:11:49.732543+0000","last_became_active":"2023-10-07T00:11:13.842057+0000","last_became_peered":"2023-10-07T00:11:13.842057+0000","last_unstale":"2023-10-07T00:11:49.732543+0000","last_undegraded":"2023-10-07T00:11:49.732543+0000","last_fullsized":"2023-10-07T00:11:49.732543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:36.575712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729600+0000","last_change":"2023-10-07T00:11:13.845746+0000","last_active":"2023-10-07T00:11:49.729600+0000","last_peered":"2023-10-07T00:11:49.729600+0000","last_clean":"2023-10-07T00:11:49.729600+0000","last_became_active":"2023-10-07T00:11:13.844828+0000","last_became_peered":"2023-10-07T00:11:13.844828+0000","last_unstale":"2023-10-07T00:11:49.729600+0000","last_undegraded":"2023-10-07T00:11:49.729600+0000","last_fullsized":"2023-10-07T00:11:49.729600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:34:00.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728722+0000","last_change":"2023-10-07T00:11:13.837749+0000","last_active":"2023-10-07T00:11:49.728722+0000","last_peered":"2023-10-07T00:11:49.728722+0000","last_clean":"2023-10-07T00:11:49.728722+0000","last_became_active":"2023-10-07T00:11:13.837400+0000","last_became_peered":"2023-10-07T00:11:13.837400+0000","last_unstale":"2023-10-07T00:11:49.728722+0000","last_undegraded":"2023-10-07T00:11:49.728722+0000","last_fullsized":"2023-10-07T00:11:49.728722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:40.190065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733555+0000","last_change":"2023-10-07T00:11:13.833086+0000","last_active":"2023-10-07T00:11:49.733555+0000","last_peered":"2023-10-07T00:11:49.733555+0000","last_clean":"2023-10-07T00:11:49.733555+0000","last_became_active":"2023-10-07T00:11:13.832748+0000","last_became_peered":"2023-10-07T00:11:13.832748+0000","last_unstale":"2023-10-07T00:11:49.733555+0000","last_undegraded":"2023-10-07T00:11:49.733555+0000","last_fullsized":"2023-10-07T00:11:49.733555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:29.176224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:57.746491+0000","last_change":"2023-10-07T00:11:12.835440+0000","last_active":"2023-10-07T00:11:57.746491+0000","last_peered":"2023-10-07T00:11:57.746491+0000","last_clean":"2023-10-07T00:11:57.746491+0000","last_became_active":"2023-10-07T00:11:12.835094+0000","last_became_peered":"2023-10-07T00:11:12.835094+0000","last_unstale":"2023-10-07T00:11:57.746491+0000","last_undegraded":"2023-10-07T00:11:57.746491+0000","last_fullsized":"2023-10-07T00:11:57.746491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:13.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731780+0000","last_change":"2023-10-07T00:11:13.847832+0000","last_active":"2023-10-07T00:11:49.731780+0000","last_peered":"2023-10-07T00:11:49.731780+0000","last_clean":"2023-10-07T00:11:49.731780+0000","last_became_active":"2023-10-07T00:11:13.847436+0000","last_became_peered":"2023-10-07T00:11:13.847436+0000","last_unstale":"2023-10-07T00:11:49.731780+0000","last_undegraded":"2023-10-07T00:11:49.731780+0000","last_fullsized":"2023-10-07T00:11:49.731780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:47:07.409132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732015+0000","last_change":"2023-10-07T00:11:12.842832+0000","last_active":"2023-10-07T00:11:49.732015+0000","last_peered":"2023-10-07T00:11:49.732015+0000","last_clean":"2023-10-07T00:11:49.732015+0000","last_became_active":"2023-10-07T00:11:12.842296+0000","last_became_peered":"2023-10-07T00:11:12.842296+0000","last_unstale":"2023-10-07T00:11:49.732015+0000","last_undegraded":"2023-10-07T00:11:49.732015+0000","last_fullsized":"2023-10-07T00:11:49.732015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:00.968303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726083+0000","last_change":"2023-10-07T00:11:13.851259+0000","last_active":"2023-10-07T00:11:49.726083+0000","last_peered":"2023-10-07T00:11:49.726083+0000","last_clean":"2023-10-07T00:11:49.726083+0000","last_became_active":"2023-10-07T00:11:13.850963+0000","last_became_peered":"2023-10-07T00:11:13.850963+0000","last_unstale":"2023-10-07T00:11:49.726083+0000","last_undegraded":"2023-10-07T00:11:49.726083+0000","last_fullsized":"2023-10-07T00:11:49.726083+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:52.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726990+0000","last_change":"2023-10-07T00:11:12.835286+0000","last_active":"2023-10-07T00:11:49.726990+0000","last_peered":"2023-10-07T00:11:49.726990+0000","last_clean":"2023-10-07T00:11:49.726990+0000","last_became_active":"2023-10-07T00:11:12.834890+0000","last_became_peered":"2023-10-07T00:11:12.834890+0000","last_unstale":"2023-10-07T00:11:49.726990+0000","last_undegraded":"2023-10-07T00:11:49.726990+0000","last_fullsized":"2023-10-07T00:11:49.726990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:06:05.225849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732721+0000","last_change":"2023-10-07T00:11:13.831174+0000","last_active":"2023-10-07T00:11:49.732721+0000","last_peered":"2023-10-07T00:11:49.732721+0000","last_clean":"2023-10-07T00:11:49.732721+0000","last_became_active":"2023-10-07T00:11:13.830868+0000","last_became_peered":"2023-10-07T00:11:13.830868+0000","last_unstale":"2023-10-07T00:11:49.732721+0000","last_undegraded":"2023-10-07T00:11:49.732721+0000","last_fullsized":"2023-10-07T00:11:49.732721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:20.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726737+0000","last_change":"2023-10-07T00:11:12.835740+0000","last_active":"2023-10-07T00:11:49.726737+0000","last_peered":"2023-10-07T00:11:49.726737+0000","last_clean":"2023-10-07T00:11:49.726737+0000","last_became_active":"2023-10-07T00:11:12.835035+0000","last_became_peered":"2023-10-07T00:11:12.835035+0000","last_unstale":"2023-10-07T00:11:49.726737+0000","last_undegraded":"2023-10-07T00:11:49.726737+0000","last_fullsized":"2023-10-07T00:11:49.726737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:36:07.447748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729611+0000","last_change":"2023-10-07T00:11:13.847940+0000","last_active":"2023-10-07T00:11:49.729611+0000","last_peered":"2023-10-07T00:11:49.729611+0000","last_clean":"2023-10-07T00:11:49.729611+0000","last_became_active":"2023-10-07T00:11:13.847595+0000","last_became_peered":"2023-10-07T00:11:13.847595+0000","last_unstale":"2023-10-07T00:11:49.729611+0000","last_undegraded":"2023-10-07T00:11:49.729611+0000","last_fullsized":"2023-10-07T00:11:49.729611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:28.004429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:57.753546+0000","last_change":"2023-10-07T00:11:50.743813+0000","last_active":"2023-10-07T00:11:57.753546+0000","last_peered":"2023-10-07T00:11:57.753546+0000","last_clean":"2023-10-07T00:11:57.753546+0000","last_became_active":"2023-10-07T00:11:50.739205+0000","last_became_peered":"2023-10-07T00:11:50.739205+0000","last_unstale":"2023-10-07T00:11:57.753546+0000","last_undegraded":"2023-10-07T00:11:57.753546+0000","last_fullsized":"2023-10-07T00:11:57.753546+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:26.630097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726681+0000","last_change":"2023-10-07T00:11:13.838732+0000","last_active":"2023-10-07T00:11:49.726681+0000","last_peered":"2023-10-07T00:11:49.726681+0000","last_clean":"2023-10-07T00:11:49.726681+0000","last_became_active":"2023-10-07T00:11:13.838408+0000","last_became_peered":"2023-10-07T00:11:13.838408+0000","last_unstale":"2023-10-07T00:11:49.726681+0000","last_undegraded":"2023-10-07T00:11:49.726681+0000","last_fullsized":"2023-10-07T00:11:49.726681+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:55:55.039399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736631+0000","last_change":"2023-10-07T00:11:12.831778+0000","last_active":"2023-10-07T00:11:49.736631+0000","last_peered":"2023-10-07T00:11:49.736631+0000","last_clean":"2023-10-07T00:11:49.736631+0000","last_became_active":"2023-10-07T00:11:12.831479+0000","last_became_peered":"2023-10-07T00:11:12.831479+0000","last_unstale":"2023-10-07T00:11:49.736631+0000","last_undegraded":"2023-10-07T00:11:49.736631+0000","last_fullsized":"2023-10-07T00:11:49.736631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:12:57.994585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.745021+0000","last_change":"2023-10-07T00:11:50.745021+0000","last_active":"2023-10-07T00:11:50.745021+0000","last_peered":"2023-10-07T00:11:50.745021+0000","last_clean":"2023-10-07T00:11:50.745021+0000","last_became_active":"2023-10-07T00:11:50.744570+0000","last_became_peered":"2023-10-07T00:11:50.744570+0000","last_unstale":"2023-10-07T00:11:50.745021+0000","last_undegraded":"2023-10-07T00:11:50.745021+0000","last_fullsized":"2023-10-07T00:11:50.745021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:54.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728874+0000","last_change":"2023-10-07T00:11:12.825556+0000","last_active":"2023-10-07T00:11:49.728874+0000","last_peered":"2023-10-07T00:11:49.728874+0000","last_clean":"2023-10-07T00:11:49.728874+0000","last_became_active":"2023-10-07T00:11:12.825189+0000","last_became_peered":"2023-10-07T00:11:12.825189+0000","last_unstale":"2023-10-07T00:11:49.728874+0000","last_undegraded":"2023-10-07T00:11:49.728874+0000","last_fullsized":"2023-10-07T00:11:49.728874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:20:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.782913+0000","last_change":"2023-10-07T00:11:50.781935+0000","last_active":"2023-10-07T00:11:50.782913+0000","last_peered":"2023-10-07T00:11:50.782913+0000","last_clean":"2023-10-07T00:11:50.782913+0000","last_became_active":"2023-10-07T00:11:50.781541+0000","last_became_peered":"2023-10-07T00:11:50.781541+0000","last_unstale":"2023-10-07T00:11:50.782913+0000","last_undegraded":"2023-10-07T00:11:50.782913+0000","last_fullsized":"2023-10-07T00:11:50.782913+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:29:18.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729367+0000","last_change":"2023-10-07T00:11:12.835239+0000","last_active":"2023-10-07T00:11:49.729367+0000","last_peered":"2023-10-07T00:11:49.729367+0000","last_clean":"2023-10-07T00:11:49.729367+0000","last_became_active":"2023-10-07T00:11:12.834912+0000","last_became_peered":"2023-10-07T00:11:12.834912+0000","last_unstale":"2023-10-07T00:11:49.729367+0000","last_undegraded":"2023-10-07T00:11:49.729367+0000","last_fullsized":"2023-10-07T00:11:49.729367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:32:44.097208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728391+0000","last_change":"2023-10-07T00:11:13.837642+0000","last_active":"2023-10-07T00:11:49.728391+0000","last_peered":"2023-10-07T00:11:49.728391+0000","last_clean":"2023-10-07T00:11:49.728391+0000","last_became_active":"2023-10-07T00:11:13.837291+0000","last_became_peered":"2023-10-07T00:11:13.837291+0000","last_unstale":"2023-10-07T00:11:49.728391+0000","last_undegraded":"2023-10-07T00:11:49.728391+0000","last_fullsized":"2023-10-07T00:11:49.728391+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:19:14.445816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:59.723120+0000","last_change":"2023-10-07T00:11:12.826373+0000","last_active":"2023-10-07T00:11:59.723120+0000","last_peered":"2023-10-07T00:11:59.723120+0000","last_clean":"2023-10-07T00:11:59.723120+0000","last_became_active":"2023-10-07T00:11:12.826017+0000","last_became_peered":"2023-10-07T00:11:12.826017+0000","last_unstale":"2023-10-07T00:11:59.723120+0000","last_undegraded":"2023-10-07T00:11:59.723120+0000","last_fullsized":"2023-10-07T00:11:59.723120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:52:03.101632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733607+0000","last_change":"2023-10-07T00:11:13.830879+0000","last_active":"2023-10-07T00:11:49.733607+0000","last_peered":"2023-10-07T00:11:49.733607+0000","last_clean":"2023-10-07T00:11:49.733607+0000","last_became_active":"2023-10-07T00:11:13.830571+0000","last_became_peered":"2023-10-07T00:11:13.830571+0000","last_unstale":"2023-10-07T00:11:49.733607+0000","last_undegraded":"2023-10-07T00:11:49.733607+0000","last_fullsized":"2023-10-07T00:11:49.733607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:36.703499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726148+0000","last_change":"2023-10-07T00:11:12.833952+0000","last_active":"2023-10-07T00:11:49.726148+0000","last_peered":"2023-10-07T00:11:49.726148+0000","last_clean":"2023-10-07T00:11:49.726148+0000","last_became_active":"2023-10-07T00:11:12.833545+0000","last_became_peered":"2023-10-07T00:11:12.833545+0000","last_unstale":"2023-10-07T00:11:49.726148+0000","last_undegraded":"2023-10-07T00:11:49.726148+0000","last_fullsized":"2023-10-07T00:11:49.726148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:28:12.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726081+0000","last_change":"2023-10-07T00:11:13.843758+0000","last_active":"2023-10-07T00:11:49.726081+0000","last_peered":"2023-10-07T00:11:49.726081+0000","last_clean":"2023-10-07T00:11:49.726081+0000","last_became_active":"2023-10-07T00:11:13.843443+0000","last_became_peered":"2023-10-07T00:11:13.843443+0000","last_unstale":"2023-10-07T00:11:49.726081+0000","last_undegraded":"2023-10-07T00:11:49.726081+0000","last_fullsized":"2023-10-07T00:11:49.726081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:07:28.610304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729780+0000","last_change":"2023-10-07T00:11:12.833043+0000","last_active":"2023-10-07T00:11:49.729780+0000","last_peered":"2023-10-07T00:11:49.729780+0000","last_clean":"2023-10-07T00:11:49.729780+0000","last_became_active":"2023-10-07T00:11:12.832632+0000","last_became_peered":"2023-10-07T00:11:12.832632+0000","last_unstale":"2023-10-07T00:11:49.729780+0000","last_undegraded":"2023-10-07T00:11:49.729780+0000","last_fullsized":"2023-10-07T00:11:49.729780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:14:25.148603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733719+0000","last_change":"2023-10-07T00:11:13.831129+0000","last_active":"2023-10-07T00:11:49.733719+0000","last_peered":"2023-10-07T00:11:49.733719+0000","last_clean":"2023-10-07T00:11:49.733719+0000","last_became_active":"2023-10-07T00:11:13.830365+0000","last_became_peered":"2023-10-07T00:11:13.830365+0000","last_unstale":"2023-10-07T00:11:49.733719+0000","last_undegraded":"2023-10-07T00:11:49.733719+0000","last_fullsized":"2023-10-07T00:11:49.733719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:22:00.580441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:59.792743+0000","last_change":"2023-10-07T00:11:50.782182+0000","last_active":"2023-10-07T00:11:59.792743+0000","last_peered":"2023-10-07T00:11:59.792743+0000","last_clean":"2023-10-07T00:11:59.792743+0000","last_became_active":"2023-10-07T00:11:50.774767+0000","last_became_peered":"2023-10-07T00:11:50.774767+0000","last_unstale":"2023-10-07T00:11:59.792743+0000","last_undegraded":"2023-10-07T00:11:59.792743+0000","last_fullsized":"2023-10-07T00:11:59.792743+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:28:39.403496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56440,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":93,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":56440,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726786+0000","last_change":"2023-10-07T00:11:13.832332+0000","last_active":"2023-10-07T00:11:49.726786+0000","last_peered":"2023-10-07T00:11:49.726786+0000","last_clean":"2023-10-07T00:11:49.726786+0000","last_became_active":"2023-10-07T00:11:13.832000+0000","last_became_peered":"2023-10-07T00:11:13.832000+0000","last_unstale":"2023-10-07T00:11:49.726786+0000","last_undegraded":"2023-10-07T00:11:49.726786+0000","last_fullsized":"2023-10-07T00:11:49.726786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:39.913331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733497+0000","last_change":"2023-10-07T00:11:12.839399+0000","last_active":"2023-10-07T00:11:49.733497+0000","last_peered":"2023-10-07T00:11:49.733497+0000","last_clean":"2023-10-07T00:11:49.733497+0000","last_became_active":"2023-10-07T00:11:12.838997+0000","last_became_peered":"2023-10-07T00:11:12.838997+0000","last_unstale":"2023-10-07T00:11:49.733497+0000","last_undegraded":"2023-10-07T00:11:49.733497+0000","last_fullsized":"2023-10-07T00:11:49.733497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:11.194224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729147+0000","last_change":"2023-10-07T00:11:13.830832+0000","last_active":"2023-10-07T00:11:49.729147+0000","last_peered":"2023-10-07T00:11:49.729147+0000","last_clean":"2023-10-07T00:11:49.729147+0000","last_became_active":"2023-10-07T00:11:13.830373+0000","last_became_peered":"2023-10-07T00:11:13.830373+0000","last_unstale":"2023-10-07T00:11:49.729147+0000","last_undegraded":"2023-10-07T00:11:49.729147+0000","last_fullsized":"2023-10-07T00:11:49.729147+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:08.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729861+0000","last_change":"2023-10-07T00:11:12.834543+0000","last_active":"2023-10-07T00:11:49.729861+0000","last_peered":"2023-10-07T00:11:49.729861+0000","last_clean":"2023-10-07T00:11:49.729861+0000","last_became_active":"2023-10-07T00:11:12.834213+0000","last_became_peered":"2023-10-07T00:11:12.834213+0000","last_unstale":"2023-10-07T00:11:49.729861+0000","last_undegraded":"2023-10-07T00:11:49.729861+0000","last_fullsized":"2023-10-07T00:11:49.729861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:57:35.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725727+0000","last_change":"2023-10-07T00:11:13.830645+0000","last_active":"2023-10-07T00:11:49.725727+0000","last_peered":"2023-10-07T00:11:49.725727+0000","last_clean":"2023-10-07T00:11:49.725727+0000","last_became_active":"2023-10-07T00:11:13.830331+0000","last_became_peered":"2023-10-07T00:11:13.830331+0000","last_unstale":"2023-10-07T00:11:49.725727+0000","last_undegraded":"2023-10-07T00:11:49.725727+0000","last_fullsized":"2023-10-07T00:11:49.725727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:19:55.226177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:58.721320+0000","last_change":"2023-10-07T00:11:12.830062+0000","last_active":"2023-10-07T00:11:58.721320+0000","last_peered":"2023-10-07T00:11:58.721320+0000","last_clean":"2023-10-07T00:11:58.721320+0000","last_became_active":"2023-10-07T00:11:12.829734+0000","last_became_peered":"2023-10-07T00:11:12.829734+0000","last_unstale":"2023-10-07T00:11:58.721320+0000","last_undegraded":"2023-10-07T00:11:58.721320+0000","last_fullsized":"2023-10-07T00:11:58.721320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:59.658154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725476+0000","last_change":"2023-10-07T00:11:13.840915+0000","last_active":"2023-10-07T00:11:49.725476+0000","last_peered":"2023-10-07T00:11:49.725476+0000","last_clean":"2023-10-07T00:11:49.725476+0000","last_became_active":"2023-10-07T00:11:13.840584+0000","last_became_peered":"2023-10-07T00:11:13.840584+0000","last_unstale":"2023-10-07T00:11:49.725476+0000","last_undegraded":"2023-10-07T00:11:49.725476+0000","last_fullsized":"2023-10-07T00:11:49.725476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:27:58.672800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726440+0000","last_change":"2023-10-07T00:11:12.829034+0000","last_active":"2023-10-07T00:11:49.726440+0000","last_peered":"2023-10-07T00:11:49.726440+0000","last_clean":"2023-10-07T00:11:49.726440+0000","last_became_active":"2023-10-07T00:11:12.828671+0000","last_became_peered":"2023-10-07T00:11:12.828671+0000","last_unstale":"2023-10-07T00:11:49.726440+0000","last_undegraded":"2023-10-07T00:11:49.726440+0000","last_fullsized":"2023-10-07T00:11:49.726440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:09:14.203804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.730639+0000","last_change":"2023-10-07T00:11:13.843029+0000","last_active":"2023-10-07T00:11:49.730639+0000","last_peered":"2023-10-07T00:11:49.730639+0000","last_clean":"2023-10-07T00:11:49.730639+0000","last_became_active":"2023-10-07T00:11:13.842714+0000","last_became_peered":"2023-10-07T00:11:13.842714+0000","last_unstale":"2023-10-07T00:11:49.730639+0000","last_undegraded":"2023-10-07T00:11:49.730639+0000","last_fullsized":"2023-10-07T00:11:49.730639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:46.147059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.727162+0000","last_change":"2023-10-07T00:11:12.830887+0000","last_active":"2023-10-07T00:11:49.727162+0000","last_peered":"2023-10-07T00:11:49.727162+0000","last_clean":"2023-10-07T00:11:49.727162+0000","last_became_active":"2023-10-07T00:11:12.830500+0000","last_became_peered":"2023-10-07T00:11:12.830500+0000","last_unstale":"2023-10-07T00:11:49.727162+0000","last_undegraded":"2023-10-07T00:11:49.727162+0000","last_fullsized":"2023-10-07T00:11:49.727162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:39.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729316+0000","last_change":"2023-10-07T00:11:13.838823+0000","last_active":"2023-10-07T00:11:49.729316+0000","last_peered":"2023-10-07T00:11:49.729316+0000","last_clean":"2023-10-07T00:11:49.729316+0000","last_became_active":"2023-10-07T00:11:13.838491+0000","last_became_peered":"2023-10-07T00:11:13.838491+0000","last_unstale":"2023-10-07T00:11:49.729316+0000","last_undegraded":"2023-10-07T00:11:49.729316+0000","last_fullsized":"2023-10-07T00:11:49.729316+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:29:31.340686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728495+0000","last_change":"2023-10-07T00:11:12.838303+0000","last_active":"2023-10-07T00:11:49.728495+0000","last_peered":"2023-10-07T00:11:49.728495+0000","last_clean":"2023-10-07T00:11:49.728495+0000","last_became_active":"2023-10-07T00:11:12.837891+0000","last_became_peered":"2023-10-07T00:11:12.837891+0000","last_unstale":"2023-10-07T00:11:49.728495+0000","last_undegraded":"2023-10-07T00:11:49.728495+0000","last_fullsized":"2023-10-07T00:11:49.728495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:56.957653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736806+0000","last_change":"2023-10-07T00:11:13.840109+0000","last_active":"2023-10-07T00:11:49.736806+0000","last_peered":"2023-10-07T00:11:49.736806+0000","last_clean":"2023-10-07T00:11:49.736806+0000","last_became_active":"2023-10-07T00:11:13.839767+0000","last_became_peered":"2023-10-07T00:11:13.839767+0000","last_unstale":"2023-10-07T00:11:49.736806+0000","last_undegraded":"2023-10-07T00:11:49.736806+0000","last_fullsized":"2023-10-07T00:11:49.736806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:24.236839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:59.750252+0000","last_change":"2023-10-07T00:11:12.837365+0000","last_active":"2023-10-07T00:11:59.750252+0000","last_peered":"2023-10-07T00:11:59.750252+0000","last_clean":"2023-10-07T00:11:59.750252+0000","last_became_active":"2023-10-07T00:11:12.836992+0000","last_became_peered":"2023-10-07T00:11:12.836992+0000","last_unstale":"2023-10-07T00:11:59.750252+0000","last_undegraded":"2023-10-07T00:11:59.750252+0000","last_fullsized":"2023-10-07T00:11:59.750252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:24:09.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736802+0000","last_change":"2023-10-07T00:11:13.851151+0000","last_active":"2023-10-07T00:11:49.736802+0000","last_peered":"2023-10-07T00:11:49.736802+0000","last_clean":"2023-10-07T00:11:49.736802+0000","last_became_active":"2023-10-07T00:11:13.850807+0000","last_became_peered":"2023-10-07T00:11:13.850807+0000","last_unstale":"2023-10-07T00:11:49.736802+0000","last_undegraded":"2023-10-07T00:11:49.736802+0000","last_fullsized":"2023-10-07T00:11:49.736802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:17:42.857720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729564+0000","last_change":"2023-10-07T00:11:13.844143+0000","last_active":"2023-10-07T00:11:49.729564+0000","last_peered":"2023-10-07T00:11:49.729564+0000","last_clean":"2023-10-07T00:11:49.729564+0000","last_became_active":"2023-10-07T00:11:13.843633+0000","last_became_peered":"2023-10-07T00:11:13.843633+0000","last_unstale":"2023-10-07T00:11:49.729564+0000","last_undegraded":"2023-10-07T00:11:49.729564+0000","last_fullsized":"2023-10-07T00:11:49.729564+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:42:20.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:00.723937+0000","last_change":"2023-10-07T00:11:12.836076+0000","last_active":"2023-10-07T00:12:00.723937+0000","last_peered":"2023-10-07T00:12:00.723937+0000","last_clean":"2023-10-07T00:12:00.723937+0000","last_became_active":"2023-10-07T00:11:12.835709+0000","last_became_peered":"2023-10-07T00:11:12.835709+0000","last_unstale":"2023-10-07T00:12:00.723937+0000","last_undegraded":"2023-10-07T00:12:00.723937+0000","last_fullsized":"2023-10-07T00:12:00.723937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.096103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.741475+0000","last_change":"2023-10-07T00:11:50.738891+0000","last_active":"2023-10-07T00:11:50.741475+0000","last_peered":"2023-10-07T00:11:50.741475+0000","last_clean":"2023-10-07T00:11:50.741475+0000","last_became_active":"2023-10-07T00:11:50.738516+0000","last_became_peered":"2023-10-07T00:11:50.738516+0000","last_unstale":"2023-10-07T00:11:50.741475+0000","last_undegraded":"2023-10-07T00:11:50.741475+0000","last_fullsized":"2023-10-07T00:11:50.741475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:22:10.840002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734497+0000","last_change":"2023-10-07T00:11:12.839717+0000","last_active":"2023-10-07T00:11:49.734497+0000","last_peered":"2023-10-07T00:11:49.734497+0000","last_clean":"2023-10-07T00:11:49.734497+0000","last_became_active":"2023-10-07T00:11:12.839287+0000","last_became_peered":"2023-10-07T00:11:12.839287+0000","last_unstale":"2023-10-07T00:11:49.734497+0000","last_undegraded":"2023-10-07T00:11:49.734497+0000","last_fullsized":"2023-10-07T00:11:49.734497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:11.170207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":313,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725653+0000","last_change":"2023-10-07T00:09:53.652919+0000","last_active":"2023-10-07T00:11:49.725653+0000","last_peered":"2023-10-07T00:11:49.725653+0000","last_clean":"2023-10-07T00:11:49.725653+0000","last_became_active":"2023-10-07T00:09:53.652407+0000","last_became_peered":"2023-10-07T00:09:53.652407+0000","last_unstale":"2023-10-07T00:11:49.725653+0000","last_undegraded":"2023-10-07T00:11:49.725653+0000","last_fullsized":"2023-10-07T00:11:49.725653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_clean_scrub_stamp":"2023-10-07T00:06:22.557862+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:33:55.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728682+0000","last_change":"2023-10-07T00:11:13.830797+0000","last_active":"2023-10-07T00:11:49.728682+0000","last_peered":"2023-10-07T00:11:49.728682+0000","last_clean":"2023-10-07T00:11:49.728682+0000","last_became_active":"2023-10-07T00:11:13.830467+0000","last_became_peered":"2023-10-07T00:11:13.830467+0000","last_unstale":"2023-10-07T00:11:49.728682+0000","last_undegraded":"2023-10-07T00:11:49.728682+0000","last_fullsized":"2023-10-07T00:11:49.728682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:48.545184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726436+0000","last_change":"2023-10-07T00:11:12.836000+0000","last_active":"2023-10-07T00:11:49.726436+0000","last_peered":"2023-10-07T00:11:49.726436+0000","last_clean":"2023-10-07T00:11:49.726436+0000","last_became_active":"2023-10-07T00:11:12.835588+0000","last_became_peered":"2023-10-07T00:11:12.835588+0000","last_unstale":"2023-10-07T00:11:49.726436+0000","last_undegraded":"2023-10-07T00:11:49.726436+0000","last_fullsized":"2023-10-07T00:11:49.726436+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:55:54.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.750173+0000","last_change":"2023-10-07T00:11:50.749694+0000","last_active":"2023-10-07T00:11:50.750173+0000","last_peered":"2023-10-07T00:11:50.750173+0000","last_clean":"2023-10-07T00:11:50.750173+0000","last_became_active":"2023-10-07T00:11:50.740568+0000","last_became_peered":"2023-10-07T00:11:50.740568+0000","last_unstale":"2023-10-07T00:11:50.750173+0000","last_undegraded":"2023-10-07T00:11:50.750173+0000","last_fullsized":"2023-10-07T00:11:50.750173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:19:31.414655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729321+0000","last_change":"2023-10-07T00:11:13.828373+0000","last_active":"2023-10-07T00:11:49.729321+0000","last_peered":"2023-10-07T00:11:49.729321+0000","last_clean":"2023-10-07T00:11:49.729321+0000","last_became_active":"2023-10-07T00:11:13.827999+0000","last_became_peered":"2023-10-07T00:11:13.827999+0000","last_unstale":"2023-10-07T00:11:49.729321+0000","last_undegraded":"2023-10-07T00:11:49.729321+0000","last_fullsized":"2023-10-07T00:11:49.729321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:43.551348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'10","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.757226+0000","last_change":"2023-10-07T00:11:50.757226+0000","last_active":"2023-10-07T00:11:50.757226+0000","last_peered":"2023-10-07T00:11:50.757226+0000","last_clean":"2023-10-07T00:11:50.757226+0000","last_became_active":"2023-10-07T00:11:50.742238+0000","last_became_peered":"2023-10-07T00:11:50.742238+0000","last_unstale":"2023-10-07T00:11:50.757226+0000","last_undegraded":"2023-10-07T00:11:50.757226+0000","last_fullsized":"2023-10-07T00:11:50.757226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:26:20.609537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731386+0000","last_change":"2023-10-07T00:11:13.838814+0000","last_active":"2023-10-07T00:11:49.731386+0000","last_peered":"2023-10-07T00:11:49.731386+0000","last_clean":"2023-10-07T00:11:49.731386+0000","last_became_active":"2023-10-07T00:11:13.838468+0000","last_became_peered":"2023-10-07T00:11:13.838468+0000","last_unstale":"2023-10-07T00:11:49.731386+0000","last_undegraded":"2023-10-07T00:11:49.731386+0000","last_fullsized":"2023-10-07T00:11:49.731386+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:29:38.944450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734231+0000","last_change":"2023-10-07T00:11:12.837042+0000","last_active":"2023-10-07T00:11:49.734231+0000","last_peered":"2023-10-07T00:11:49.734231+0000","last_clean":"2023-10-07T00:11:49.734231+0000","last_became_active":"2023-10-07T00:11:12.836605+0000","last_became_peered":"2023-10-07T00:11:12.836605+0000","last_unstale":"2023-10-07T00:11:49.734231+0000","last_undegraded":"2023-10-07T00:11:49.734231+0000","last_fullsized":"2023-10-07T00:11:49.734231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:30:13.684063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725560+0000","last_change":"2023-10-07T00:11:13.840778+0000","last_active":"2023-10-07T00:11:49.725560+0000","last_peered":"2023-10-07T00:11:49.725560+0000","last_clean":"2023-10-07T00:11:49.725560+0000","last_became_active":"2023-10-07T00:11:13.840472+0000","last_became_peered":"2023-10-07T00:11:13.840472+0000","last_unstale":"2023-10-07T00:11:49.725560+0000","last_undegraded":"2023-10-07T00:11:49.725560+0000","last_fullsized":"2023-10-07T00:11:49.725560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:59.088416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732547+0000","last_change":"2023-10-07T00:11:12.838534+0000","last_active":"2023-10-07T00:11:49.732547+0000","last_peered":"2023-10-07T00:11:49.732547+0000","last_clean":"2023-10-07T00:11:49.732547+0000","last_became_active":"2023-10-07T00:11:12.838220+0000","last_became_peered":"2023-10-07T00:11:12.838220+0000","last_unstale":"2023-10-07T00:11:49.732547+0000","last_undegraded":"2023-10-07T00:11:49.732547+0000","last_fullsized":"2023-10-07T00:11:49.732547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:16:47.170815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726799+0000","last_change":"2023-10-07T00:11:13.831506+0000","last_active":"2023-10-07T00:11:49.726799+0000","last_peered":"2023-10-07T00:11:49.726799+0000","last_clean":"2023-10-07T00:11:49.726799+0000","last_became_active":"2023-10-07T00:11:13.831093+0000","last_became_peered":"2023-10-07T00:11:13.831093+0000","last_unstale":"2023-10-07T00:11:49.726799+0000","last_undegraded":"2023-10-07T00:11:49.726799+0000","last_fullsized":"2023-10-07T00:11:49.726799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:02.749470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731114+0000","last_change":"2023-10-07T00:11:12.841662+0000","last_active":"2023-10-07T00:11:49.731114+0000","last_peered":"2023-10-07T00:11:49.731114+0000","last_clean":"2023-10-07T00:11:49.731114+0000","last_became_active":"2023-10-07T00:11:12.841207+0000","last_became_peered":"2023-10-07T00:11:12.841207+0000","last_unstale":"2023-10-07T00:11:49.731114+0000","last_undegraded":"2023-10-07T00:11:49.731114+0000","last_fullsized":"2023-10-07T00:11:49.731114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:10.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729148+0000","last_change":"2023-10-07T00:11:13.844943+0000","last_active":"2023-10-07T00:11:49.729148+0000","last_peered":"2023-10-07T00:11:49.729148+0000","last_clean":"2023-10-07T00:11:49.729148+0000","last_became_active":"2023-10-07T00:11:13.844387+0000","last_became_peered":"2023-10-07T00:11:13.844387+0000","last_unstale":"2023-10-07T00:11:49.729148+0000","last_undegraded":"2023-10-07T00:11:49.729148+0000","last_fullsized":"2023-10-07T00:11:49.729148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:35.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733150+0000","last_change":"2023-10-07T00:11:12.838191+0000","last_active":"2023-10-07T00:11:49.733150+0000","last_peered":"2023-10-07T00:11:49.733150+0000","last_clean":"2023-10-07T00:11:49.733150+0000","last_became_active":"2023-10-07T00:11:12.837821+0000","last_became_peered":"2023-10-07T00:11:12.837821+0000","last_unstale":"2023-10-07T00:11:49.733150+0000","last_undegraded":"2023-10-07T00:11:49.733150+0000","last_fullsized":"2023-10-07T00:11:49.733150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:16:38.519554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732773+0000","last_change":"2023-10-07T00:11:13.841478+0000","last_active":"2023-10-07T00:11:49.732773+0000","last_peered":"2023-10-07T00:11:49.732773+0000","last_clean":"2023-10-07T00:11:49.732773+0000","last_became_active":"2023-10-07T00:11:13.841085+0000","last_became_peered":"2023-10-07T00:11:13.841085+0000","last_unstale":"2023-10-07T00:11:49.732773+0000","last_undegraded":"2023-10-07T00:11:49.732773+0000","last_fullsized":"2023-10-07T00:11:49.732773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:54:03.100980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726585+0000","last_change":"2023-10-07T00:11:12.831175+0000","last_active":"2023-10-07T00:11:49.726585+0000","last_peered":"2023-10-07T00:11:49.726585+0000","last_clean":"2023-10-07T00:11:49.726585+0000","last_became_active":"2023-10-07T00:11:12.830859+0000","last_became_peered":"2023-10-07T00:11:12.830859+0000","last_unstale":"2023-10-07T00:11:49.726585+0000","last_undegraded":"2023-10-07T00:11:49.726585+0000","last_fullsized":"2023-10-07T00:11:49.726585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:07.072334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725853+0000","last_change":"2023-10-07T00:11:13.834163+0000","last_active":"2023-10-07T00:11:49.725853+0000","last_peered":"2023-10-07T00:11:49.725853+0000","last_clean":"2023-10-07T00:11:49.725853+0000","last_became_active":"2023-10-07T00:11:13.833807+0000","last_became_peered":"2023-10-07T00:11:13.833807+0000","last_unstale":"2023-10-07T00:11:49.725853+0000","last_undegraded":"2023-10-07T00:11:49.725853+0000","last_fullsized":"2023-10-07T00:11:49.725853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:12:18.606936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:58.722176+0000","last_change":"2023-10-07T00:11:12.835598+0000","last_active":"2023-10-07T00:11:58.722176+0000","last_peered":"2023-10-07T00:11:58.722176+0000","last_clean":"2023-10-07T00:11:58.722176+0000","last_became_active":"2023-10-07T00:11:12.835295+0000","last_became_peered":"2023-10-07T00:11:12.835295+0000","last_unstale":"2023-10-07T00:11:58.722176+0000","last_undegraded":"2023-10-07T00:11:58.722176+0000","last_fullsized":"2023-10-07T00:11:58.722176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:40:52.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726471+0000","last_change":"2023-10-07T00:11:13.837918+0000","last_active":"2023-10-07T00:11:49.726471+0000","last_peered":"2023-10-07T00:11:49.726471+0000","last_clean":"2023-10-07T00:11:49.726471+0000","last_became_active":"2023-10-07T00:11:13.834284+0000","last_became_peered":"2023-10-07T00:11:13.834284+0000","last_unstale":"2023-10-07T00:11:49.726471+0000","last_undegraded":"2023-10-07T00:11:49.726471+0000","last_fullsized":"2023-10-07T00:11:49.726471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:49:47.081395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729507+0000","last_change":"2023-10-07T00:11:12.839362+0000","last_active":"2023-10-07T00:11:49.729507+0000","last_peered":"2023-10-07T00:11:49.729507+0000","last_clean":"2023-10-07T00:11:49.729507+0000","last_became_active":"2023-10-07T00:11:12.838902+0000","last_became_peered":"2023-10-07T00:11:12.838902+0000","last_unstale":"2023-10-07T00:11:49.729507+0000","last_undegraded":"2023-10-07T00:11:49.729507+0000","last_fullsized":"2023-10-07T00:11:49.729507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:05:34.649556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725841+0000","last_change":"2023-10-07T00:11:13.839356+0000","last_active":"2023-10-07T00:11:49.725841+0000","last_peered":"2023-10-07T00:11:49.725841+0000","last_clean":"2023-10-07T00:11:49.725841+0000","last_became_active":"2023-10-07T00:11:13.838936+0000","last_became_peered":"2023-10-07T00:11:13.838936+0000","last_unstale":"2023-10-07T00:11:49.725841+0000","last_undegraded":"2023-10-07T00:11:49.725841+0000","last_fullsized":"2023-10-07T00:11:49.725841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:02.860174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728045+0000","last_change":"2023-10-07T00:11:12.839966+0000","last_active":"2023-10-07T00:11:49.728045+0000","last_peered":"2023-10-07T00:11:49.728045+0000","last_clean":"2023-10-07T00:11:49.728045+0000","last_became_active":"2023-10-07T00:11:12.839505+0000","last_became_peered":"2023-10-07T00:11:12.839505+0000","last_unstale":"2023-10-07T00:11:49.728045+0000","last_undegraded":"2023-10-07T00:11:49.728045+0000","last_fullsized":"2023-10-07T00:11:49.728045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:45:50.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726038+0000","last_change":"2023-10-07T00:11:13.839478+0000","last_active":"2023-10-07T00:11:49.726038+0000","last_peered":"2023-10-07T00:11:49.726038+0000","last_clean":"2023-10-07T00:11:49.726038+0000","last_became_active":"2023-10-07T00:11:13.839097+0000","last_became_peered":"2023-10-07T00:11:13.839097+0000","last_unstale":"2023-10-07T00:11:49.726038+0000","last_undegraded":"2023-10-07T00:11:49.726038+0000","last_fullsized":"2023-10-07T00:11:49.726038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:55.668486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729255+0000","last_change":"2023-10-07T00:11:13.839518+0000","last_active":"2023-10-07T00:11:49.729255+0000","last_peered":"2023-10-07T00:11:49.729255+0000","last_clean":"2023-10-07T00:11:49.729255+0000","last_became_active":"2023-10-07T00:11:13.839189+0000","last_became_peered":"2023-10-07T00:11:13.839189+0000","last_unstale":"2023-10-07T00:11:49.729255+0000","last_undegraded":"2023-10-07T00:11:49.729255+0000","last_fullsized":"2023-10-07T00:11:49.729255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:30:34.647955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.738694+0000","last_change":"2023-10-07T00:11:50.738694+0000","last_active":"2023-10-07T00:11:50.738694+0000","last_peered":"2023-10-07T00:11:50.738694+0000","last_clean":"2023-10-07T00:11:50.738694+0000","last_became_active":"2023-10-07T00:11:50.738045+0000","last_became_peered":"2023-10-07T00:11:50.738045+0000","last_unstale":"2023-10-07T00:11:50.738694+0000","last_undegraded":"2023-10-07T00:11:50.738694+0000","last_fullsized":"2023-10-07T00:11:50.738694+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:50.348821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733021+0000","last_change":"2023-10-07T00:11:13.841371+0000","last_active":"2023-10-07T00:11:49.733021+0000","last_peered":"2023-10-07T00:11:49.733021+0000","last_clean":"2023-10-07T00:11:49.733021+0000","last_became_active":"2023-10-07T00:11:13.840986+0000","last_became_peered":"2023-10-07T00:11:13.840986+0000","last_unstale":"2023-10-07T00:11:49.733021+0000","last_undegraded":"2023-10-07T00:11:49.733021+0000","last_fullsized":"2023-10-07T00:11:49.733021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:49.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725518+0000","last_change":"2023-10-07T00:11:13.844865+0000","last_active":"2023-10-07T00:11:49.725518+0000","last_peered":"2023-10-07T00:11:49.725518+0000","last_clean":"2023-10-07T00:11:49.725518+0000","last_became_active":"2023-10-07T00:11:13.844495+0000","last_became_peered":"2023-10-07T00:11:13.844495+0000","last_unstale":"2023-10-07T00:11:49.725518+0000","last_undegraded":"2023-10-07T00:11:49.725518+0000","last_fullsized":"2023-10-07T00:11:49.725518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:00:29.862865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729329+0000","last_change":"2023-10-07T00:11:13.841126+0000","last_active":"2023-10-07T00:11:49.729329+0000","last_peered":"2023-10-07T00:11:49.729329+0000","last_clean":"2023-10-07T00:11:49.729329+0000","last_became_active":"2023-10-07T00:11:13.840748+0000","last_became_peered":"2023-10-07T00:11:13.840748+0000","last_unstale":"2023-10-07T00:11:49.729329+0000","last_undegraded":"2023-10-07T00:11:49.729329+0000","last_fullsized":"2023-10-07T00:11:49.729329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:55.444456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729091+0000","last_change":"2023-10-07T00:11:13.840320+0000","last_active":"2023-10-07T00:11:49.729091+0000","last_peered":"2023-10-07T00:11:49.729091+0000","last_clean":"2023-10-07T00:11:49.729091+0000","last_became_active":"2023-10-07T00:11:13.839993+0000","last_became_peered":"2023-10-07T00:11:13.839993+0000","last_unstale":"2023-10-07T00:11:49.729091+0000","last_undegraded":"2023-10-07T00:11:49.729091+0000","last_fullsized":"2023-10-07T00:11:49.729091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:29:39.843550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733438+0000","last_change":"2023-10-07T00:11:13.830436+0000","last_active":"2023-10-07T00:11:49.733438+0000","last_peered":"2023-10-07T00:11:49.733438+0000","last_clean":"2023-10-07T00:11:49.733438+0000","last_became_active":"2023-10-07T00:11:13.827974+0000","last_became_peered":"2023-10-07T00:11:13.827974+0000","last_unstale":"2023-10-07T00:11:49.733438+0000","last_undegraded":"2023-10-07T00:11:49.733438+0000","last_fullsized":"2023-10-07T00:11:49.733438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:46.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731293+0000","last_change":"2023-10-07T00:11:13.833929+0000","last_active":"2023-10-07T00:11:49.731293+0000","last_peered":"2023-10-07T00:11:49.731293+0000","last_clean":"2023-10-07T00:11:49.731293+0000","last_became_active":"2023-10-07T00:11:13.833539+0000","last_became_peered":"2023-10-07T00:11:13.833539+0000","last_unstale":"2023-10-07T00:11:49.731293+0000","last_undegraded":"2023-10-07T00:11:49.731293+0000","last_fullsized":"2023-10-07T00:11:49.731293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:46:04.981559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729467+0000","last_change":"2023-10-07T00:11:13.837959+0000","last_active":"2023-10-07T00:11:49.729467+0000","last_peered":"2023-10-07T00:11:49.729467+0000","last_clean":"2023-10-07T00:11:49.729467+0000","last_became_active":"2023-10-07T00:11:13.837650+0000","last_became_peered":"2023-10-07T00:11:13.837650+0000","last_unstale":"2023-10-07T00:11:49.729467+0000","last_undegraded":"2023-10-07T00:11:49.729467+0000","last_fullsized":"2023-10-07T00:11:49.729467+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:41.068847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.730958+0000","last_change":"2023-10-07T00:11:13.847348+0000","last_active":"2023-10-07T00:11:49.730958+0000","last_peered":"2023-10-07T00:11:49.730958+0000","last_clean":"2023-10-07T00:11:49.730958+0000","last_became_active":"2023-10-07T00:11:13.846988+0000","last_became_peered":"2023-10-07T00:11:13.846988+0000","last_unstale":"2023-10-07T00:11:49.730958+0000","last_undegraded":"2023-10-07T00:11:49.730958+0000","last_fullsized":"2023-10-07T00:11:49.730958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.960128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733355+0000","last_change":"2023-10-07T00:11:13.831801+0000","last_active":"2023-10-07T00:11:49.733355+0000","last_peered":"2023-10-07T00:11:49.733355+0000","last_clean":"2023-10-07T00:11:49.733355+0000","last_became_active":"2023-10-07T00:11:13.831497+0000","last_became_peered":"2023-10-07T00:11:13.831497+0000","last_unstale":"2023-10-07T00:11:49.733355+0000","last_undegraded":"2023-10-07T00:11:49.733355+0000","last_fullsized":"2023-10-07T00:11:49.733355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:43.802252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728956+0000","last_change":"2023-10-07T00:11:13.841423+0000","last_active":"2023-10-07T00:11:49.728956+0000","last_peered":"2023-10-07T00:11:49.728956+0000","last_clean":"2023-10-07T00:11:49.728956+0000","last_became_active":"2023-10-07T00:11:13.841115+0000","last_became_peered":"2023-10-07T00:11:13.841115+0000","last_unstale":"2023-10-07T00:11:49.728956+0000","last_undegraded":"2023-10-07T00:11:49.728956+0000","last_fullsized":"2023-10-07T00:11:49.728956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:32.355577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729323+0000","last_change":"2023-10-07T00:11:13.840162+0000","last_active":"2023-10-07T00:11:49.729323+0000","last_peered":"2023-10-07T00:11:49.729323+0000","last_clean":"2023-10-07T00:11:49.729323+0000","last_became_active":"2023-10-07T00:11:13.839760+0000","last_became_peered":"2023-10-07T00:11:13.839760+0000","last_unstale":"2023-10-07T00:11:49.729323+0000","last_undegraded":"2023-10-07T00:11:49.729323+0000","last_fullsized":"2023-10-07T00:11:49.729323+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.727027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248175,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63252,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":431,"num_read_kb":287,"num_write":231,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":57564,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":189756,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":460230,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.751}]},{"osd":5,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.64100000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.88300000000000001}]},{"osd":7,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.92100000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.86399999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.996}]}]},{"osd":10,"up_from":73,"seq":313532612637,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":1107593,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.496},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":1.161,"15min":1.161},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98099999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95099999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.81100000000000005,"15min":0.78300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":6.9649999999999999,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.86199999999999999,"15min":0.82599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":9.3580000000000005,"5min":9.3580000000000005,"15min":9.3580000000000005},"last":0.67900000000000005}]},{"osd":4,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88600000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0229999999999999,"5min":1.226,"15min":1.226},"last":0.73899999999999999}]},{"osd":5,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83799999999999997,"15min":0.84599999999999997},"min":{"1min":0.60699999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.96799999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.878},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.046,"5min":1.29,"15min":1.29},"last":0.90300000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.754},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.91600000000000004,"15min":0.93400000000000005},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.016,"5min":1.242,"15min":1.242},"last":0.76600000000000001}]},{"osd":7,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56499999999999995}]},{"osd":8,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.96399999999999997,"15min":0.97899999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0840000000000001,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.105,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96699999999999997}]},{"osd":9,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1,"15min":1.002},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96799999999999997,"15min":0.97199999999999998},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.93300000000000005}]},{"osd":11,"last update":"Sat Oct 7 00:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.995}]}]},{"osd":9,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":460048,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95999999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0580000000000001,"5min":1.149,"15min":1.149},"last":0.66200000000000003}]},{"osd":2,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.71299999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86599999999999999,"5min":1.137,"15min":1.137},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.57599999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.745},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.627}]},{"osd":4,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.59899999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.89700000000000002,"15min":0.90900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.962,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.876,"15min":0.878},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.079,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.03,"5min":2.214,"15min":2.214},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.90700000000000003,"15min":0.91900000000000004},"min":{"1min":0.50900000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96999999999999997,"15min":0.97099999999999997},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1179999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.70099999999999996}]},{"osd":8,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96599999999999997,"15min":0.97699999999999998},"min":{"1min":0.58999999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.98999999999999999,"15min":0.998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.78700000000000003}]},{"osd":10,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.751,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.016,"5min":0.97399999999999998,"15min":0.96699999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.90800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":8,"up_from":60,"seq":257698037800,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":460314,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88900000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.47999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.89800000000000002,"5min":1.117,"15min":1.117},"last":0.57099999999999995}]},{"osd":1,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.59899999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95899999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.747}]},{"osd":2,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.96299999999999997}]},{"osd":3,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.073,"15min":1.073},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.877,"5min":1.498,"15min":1.498},"last":1.0349999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.438,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.84299999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90400000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93799999999999994,"5min":1.389,"15min":1.389},"last":1.0069999999999999}]},{"osd":7,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.85499999999999998},"min":{"1min":0.63600000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.087},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.90200000000000002}]},{"osd":9,"last update":"Sat Oct 7 00:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1779999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.042,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.98899999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.69999999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.89700000000000002},"min":{"1min":0.71899999999999997,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2030000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.137}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299436,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":1052618,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77600000000000002,"5min":1.149,"15min":1.149},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59899999999999998}]},{"osd":2,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0249999999999999,"5min":1.163,"15min":1.163},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.749},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88200000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.74399999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0529999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96399999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82299999999999995}]},{"osd":4,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89200000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0780000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.80000000000000004},"min":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.028,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.891,"15min":1.891},"last":0.80600000000000005}]},{"osd":6,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0780000000000001,"5min":1.147,"15min":1.147},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.177,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71399999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.81899999999999995,"15min":0.80500000000000005},"min":{"1min":0.66300000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.89000000000000001}]},{"osd":9,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.875,"15min":0.873},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.236,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.84099999999999997}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.208,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.92700000000000005,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0980000000000001,"5min":1.919,"15min":1.919},"last":0.871}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462962,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":459771,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60099999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74199999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.35099999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.53400000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0880000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.498}]},{"osd":2,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76800000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.372}]},{"osd":4,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.325,"15min":1.325},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.153,"5min":1.405,"15min":1.405},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":1.208,"15min":1.208},"last":0.746},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97799999999999998,"5min":1.292,"15min":1.292},"last":0.65300000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:11:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.84299999999999997},"min":{"1min":0.58999999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98499999999999999,"5min":1.419,"15min":1.419},"last":0.624},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84199999999999997,"15min":0.83399999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.96099999999999997,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.51400000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.877,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89000000000000001,"15min":0.89500000000000002},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0089999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.70399999999999996}]},{"osd":9,"last update":"Sat Oct 7 00:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.93100000000000005,"15min":0.95099999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1419999999999999,"5min":1.409,"15min":1.409},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0049999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.40899999999999997}]},{"osd":10,"last update":"Sat Oct 7 00:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92600000000000005,"15min":0.93400000000000005},"min":{"1min":0.69999999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0589999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.26,"5min":1.0640000000000001,"15min":1.0309999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.64100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":517857,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88300000000000001,"5min":1.018,"15min":1.018},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90900000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.68899999999999995}]},{"osd":2,"last update":"Sat Oct 7 00:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.65700000000000003,"15min":0.57899999999999996},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.093},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65100000000000002,"15min":0.60499999999999998},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90600000000000003,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.91100000000000003}]},{"osd":3,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.70699999999999996,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.874},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.72499999999999998}]},{"osd":4,"last update":"Sat Oct 7 00:11:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.53200000000000003,"15min":0.49399999999999999},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.51200000000000001},"min":{"1min":0.41899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.79200000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.74199999999999999,"15min":0.68700000000000006},"min":{"1min":0.56499999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.163},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.67300000000000004},"min":{"1min":0.68700000000000006,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.0289999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0349999999999999,"5min":1.107,"15min":1.107},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.503,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Sat Oct 7 00:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69699999999999995,"15min":0.68000000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.0089999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.998}]},{"osd":9,"last update":"Sat Oct 7 00:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.749,"5min":0.503,"15min":0.503},"max":{"1min":1.036,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":1.0820000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.85999999999999999,"15min":0.84999999999999998},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.872,"15min":0.85799999999999998},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.1479999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":460831,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 00:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.502,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97599999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.62}]},{"osd":2,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88400000000000001,"5min":1.024,"15min":1.024},"last":0.81899999999999995}]},{"osd":3,"last update":"Sat Oct 7 00:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54900000000000004}]},{"osd":4,"last update":"Sat Oct 7 00:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97499999999999998,"5min":1.113,"15min":1.113},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64300000000000002,"15min":0.621},"min":{"1min":0.502,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0629999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.77200000000000002,"15min":0.73199999999999998},"min":{"1min":0.55800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":0.874}]},{"osd":6,"last update":"Sat Oct 7 00:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64700000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.60999999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.754},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.78600000000000003}]},{"osd":9,"last update":"Sat Oct 7 00:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.874,"15min":0.88800000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2769999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.097,"5min":1.284,"15min":1.284},"last":0.96199999999999997}]},{"osd":10,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.95799999999999996,"15min":0.92800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":1},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.71399999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.94399999999999995}]},{"osd":11,"last update":"Sat Oct 7 00:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.98599999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":460276,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97399999999999998,"5min":1.048,"15min":1.048},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Oct 7 00:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.66800000000000004,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.97399999999999998,"5min":1.006,"15min":1.006},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.61099999999999999},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79000000000000004}]},{"osd":3,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.91200000000000003,"5min":1.022,"15min":1.022},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Oct 7 00:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.48599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.002}]},{"osd":5,"last update":"Sat Oct 7 00:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.62,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0760000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Oct 7 00:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.60099999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98299999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90100000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Oct 7 00:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.81200000000000006},"min":{"1min":0.60099999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91200000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.63700000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.46700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.872},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.83299999999999996}]},{"osd":9,"last update":"Sat Oct 7 00:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.72399999999999998,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1479999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.80600000000000005,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0700000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.84299999999999997}]},{"osd":10,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.84199999999999997,"15min":0.82599999999999996},"min":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.91300000000000003,"15min":0.89400000000000002},"min":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":459271,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.41699999999999998},"min":{"1min":0.32800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.438},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.48599999999999999,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.48299999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88900000000000001,"5min":1.042,"15min":1.042},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.67100000000000004,"15min":0.621},"min":{"1min":0.51300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.83399999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":1.284,"15min":1.284},"last":0.61299999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.53100000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72399999999999998,"15min":0.68799999999999994},"min":{"1min":0.59799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0660000000000001,"5min":1.169,"15min":1.169},"last":0.98799999999999999}]},{"osd":5,"last update":"Sat Oct 7 00:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.745,"15min":0.70499999999999996},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0569999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.55500000000000005,"5min":0.442,"15min":0.442},"max":{"1min":1.175,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.64400000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0920000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.71799999999999997,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.69399999999999995}]},{"osd":7,"last update":"Sat Oct 7 00:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.755,"15min":0.73299999999999998},"min":{"1min":0.55800000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.014}]},{"osd":8,"last update":"Sat Oct 7 00:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.89400000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.052,"5min":1.103,"15min":1.103},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.746}]},{"osd":9,"last update":"Sat Oct 7 00:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90200000000000002,"15min":0.90800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.198,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.038},{"interface":"front","average":{"1min":0.87,"5min":0.878,"15min":0.88},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.79400000000000004}]},{"osd":10,"last update":"Sat Oct 7 00:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.94899999999999995,"15min":0.96599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.171,"5min":1.272,"15min":1.272},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91500000000000004,"15min":0.90900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0780000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888125,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":515793,"data_compressed":14696,"data_compressed_allocated":20480,"data_compressed_original":69632,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56100000000000005,"15min":0.54300000000000004},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.47499999999999998},"min":{"1min":0.378,"5min":0.308,"15min":0.308},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.54700000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97599999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Sat Oct 7 00:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.52400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.88400000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69899999999999995,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96699999999999997,"5min":1.04,"15min":1.04},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.70499999999999996},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.0549999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.71699999999999997,"15min":0.69499999999999995},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0309999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70299999999999996,"15min":0.69199999999999995},"min":{"1min":0.52000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.98599999999999999}]},{"osd":7,"last update":"Sat Oct 7 00:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0960000000000001,"5min":1.139,"15min":1.139},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72199999999999998,"15min":0.69999999999999996},"min":{"1min":0.59899999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96899999999999997,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.1060000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.006},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.67400000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.024}]},{"osd":9,"last update":"Sat Oct 7 00:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88600000000000001,"15min":0.88400000000000001},"min":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.153,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84599999999999997,"15min":0.84999999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0600000000000001,"5min":1.101,"15min":1.101},"last":1.169}]},{"osd":10,"last update":"Sat Oct 7 00:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.86099999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.1870000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724599,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":1052296,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63500000000000001,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":4.633},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":1.147,"15min":1.147},"last":0.502}]},{"osd":1,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.746,"15min":0.81699999999999995},"min":{"1min":0.52600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.88600000000000001,"5min":5.96,"15min":5.96},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.67000000000000004,"15min":0.626},"min":{"1min":0.55500000000000005,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59199999999999997}]},{"osd":2,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.36499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78300000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.44500000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":1.052,"15min":1.052},"last":4.7060000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88900000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70999999999999996,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.997,"5min":1.093,"15min":1.093},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.80500000000000005,"15min":0.91100000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.875,"5min":5.9100000000000001,"15min":5.9100000000000001},"last":0.627}]},{"osd":6,"last update":"Sat Oct 7 00:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.50700000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.90300000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Sat Oct 7 00:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.78200000000000003,"15min":0.77000000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99099999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72599999999999998}]},{"osd":8,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56799999999999995}]},{"osd":9,"last update":"Sat Oct 7 00:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85299999999999998,"15min":0.85899999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.302,"15min":1.302},"last":4.6609999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.89100000000000001,"15min":0.89400000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1200000000000001,"5min":1.208,"15min":1.208},"last":0.53500000000000003}]},{"osd":10,"last update":"Sat Oct 7 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88600000000000001,"15min":0.89200000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":57140,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T00:12:05.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-07T00:12:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:07.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:06 smithi005 ceph-mon[129406]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:12:07.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:06 smithi005 ceph-mon[129406]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 4.7 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-07T00:12:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:06 smithi088 ceph-mon[103111]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:12:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:06 smithi088 ceph-mon[103111]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 4.7 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-07T00:12:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:06 smithi112 ceph-mon[133548]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:12:07.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:06 smithi112 ceph-mon[133548]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 4.7 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-07T00:12:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 -- 172.21.15.5:0/631492988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc10b4e0 msgr2=0x7f93bc10d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/631492988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc10b4e0 0x7f93bc10d9a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f93b400b0a0 tx=0x7f93b400b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 -- 172.21.15.5:0/631492988 shutdown_connections 2023-10-07T00:12:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/631492988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc10b4e0 0x7f93bc10d9a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/631492988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc1020b0 0x7f93bc102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/631492988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93bc1029d0 0x7f93bc10aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 -- 172.21.15.5:0/631492988 >> 172.21.15.5:0/631492988 conn(0x7f93bc0fb920 msgr2=0x7f93bc0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 -- 172.21.15.5:0/631492988 shutdown_connections 2023-10-07T00:12:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.143+0000 7f93c2bc5700 1 -- 172.21.15.5:0/631492988 wait complete. 2023-10-07T00:12:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.144+0000 7f93c2bc5700 1 Processor -- start 2023-10-07T00:12:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.145+0000 7f93c2bc5700 1 -- start start 2023-10-07T00:12:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.145+0000 7f93c2bc5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc1020b0 0x7f93bc197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.145+0000 7f93c2bc5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc1029d0 0x7f93bc197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.145+0000 7f93c2bc5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93bc10b4e0 0x7f93bc19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.145+0000 7f93c2bc5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc19bff0 con 0x7f93bc1020b0 2023-10-07T00:12:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.145+0000 7f93c2bc5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc19c160 con 0x7f93bc10b4e0 2023-10-07T00:12:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.145+0000 7f93c2bc5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc19c320 con 0x7f93bc1029d0 2023-10-07T00:12:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc1020b0 0x7f93bc197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc1020b0 0x7f93bc197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55742/0 (socket says 172.21.15.5:55742) 2023-10-07T00:12:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 -- 172.21.15.5:0/4093187446 learned_addr learned my addr 172.21.15.5:0/4093187446 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c1162700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93bc10b4e0 0x7f93bc19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93bbfff700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc1029d0 0x7f93bc197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 -- 172.21.15.5:0/4093187446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc1029d0 msgr2=0x7f93bc197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc1029d0 0x7f93bc197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 -- 172.21.15.5:0/4093187446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93bc10b4e0 msgr2=0x7f93bc19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93bc10b4e0 0x7f93bc19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 -- 172.21.15.5:0/4093187446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4009d00 con 0x7f93bc1020b0 2023-10-07T00:12:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c1162700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93bc10b4e0 0x7f93bc19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93c0961700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc1020b0 0x7f93bc197030 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93b000e9a0 tx=0x7f93b000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.146+0000 7f93b9ffb700 1 -- 172.21.15.5:0/4093187446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0009790 con 0x7f93bc1020b0 2023-10-07T00:12:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.147+0000 7f93b9ffb700 1 -- 172.21.15.5:0/4093187446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93b000cbd0 con 0x7f93bc1020b0 2023-10-07T00:12:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.147+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc19c600 con 0x7f93bc1020b0 2023-10-07T00:12:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.147+0000 7f93b9ffb700 1 -- 172.21.15.5:0/4093187446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0018680 con 0x7f93bc1020b0 2023-10-07T00:12:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.147+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc1a3e60 con 0x7f93bc1020b0 2023-10-07T00:12:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.148+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc04ebb0 con 0x7f93bc1020b0 2023-10-07T00:12:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.150+0000 7f93b9ffb700 1 -- 172.21.15.5:0/4093187446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f93b000cd40 con 0x7f93bc1020b0 2023-10-07T00:12:08.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.151+0000 7f93b9ffb700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93ac0a1510 0x7f93ac0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:08.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.151+0000 7f93b9ffb700 1 -- 172.21.15.5:0/4093187446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f93b0014070 con 0x7f93bc1020b0 2023-10-07T00:12:08.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.151+0000 7f93bbfff700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93ac0a1510 0x7f93ac0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:08.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.152+0000 7f93bbfff700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93ac0a1510 0x7f93ac0a39d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93a8005e90 tx=0x7f93a8005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.155+0000 7f93b9ffb700 1 -- 172.21.15.5:0/4093187446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f93b0052100 con 0x7f93bc1020b0 2023-10-07T00:12:08.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.359+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93bc0008d0 con 0x7f93ac0a1510 2023-10-07T00:12:08.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.370+0000 7f93b9ffb700 1 -- 172.21.15.5:0/4093187446 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340250 (secure 0 0 0) 0x7f93bc0008d0 con 0x7f93ac0a1510 2023-10-07T00:12:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.375+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93ac0a1510 msgr2=0x7f93ac0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.375+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93ac0a1510 0x7f93ac0a39d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93a8005e90 tx=0x7f93a8005d00 comp rx=0 tx=0).stop 2023-10-07T00:12:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.375+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc1020b0 msgr2=0x7f93bc197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.375+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc1020b0 0x7f93bc197030 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93b000e9a0 tx=0x7f93b000ed60 comp rx=0 tx=0).stop 2023-10-07T00:12:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.375+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 shutdown_connections 2023-10-07T00:12:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.376+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93ac0a1510 0x7f93ac0a39d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.376+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93bc10b4e0 0x7f93bc19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.376+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc1020b0 0x7f93bc197030 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.376+0000 7f93c2bc5700 1 --2- 172.21.15.5:0/4093187446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc1029d0 0x7f93bc197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.376+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 >> 172.21.15.5:0/4093187446 conn(0x7f93bc0fb920 msgr2=0x7f93bc10d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.376+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 shutdown_connections 2023-10-07T00:12:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:08.376+0000 7f93c2bc5700 1 -- 172.21.15.5:0/4093187446 wait complete. 2023-10-07T00:12:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-07T00:12:08.929 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2023-10-07T00:12:07.656268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653866,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":606,"num_read_kb":420,"num_write":414,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1238300,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335996,"kb_used_data":11732,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605828,"statfs":{"total":1151940427776,"available":1151596367872,"internally_reserved":0,"allocated":12013568,"data_stored":7466898,"data_compressed":186885,"data_compressed_allocated":245760,"data_compressed_original":2019328,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":54,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003332"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729502+0000","last_change":"2023-10-07T00:11:13.845315+0000","last_active":"2023-10-07T00:11:49.729502+0000","last_peered":"2023-10-07T00:11:49.729502+0000","last_clean":"2023-10-07T00:11:49.729502+0000","last_became_active":"2023-10-07T00:11:13.844330+0000","last_became_peered":"2023-10-07T00:11:13.844330+0000","last_unstale":"2023-10-07T00:11:49.729502+0000","last_undegraded":"2023-10-07T00:11:49.729502+0000","last_fullsized":"2023-10-07T00:11:49.729502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:26.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725619+0000","last_change":"2023-10-07T00:11:13.842602+0000","last_active":"2023-10-07T00:11:49.725619+0000","last_peered":"2023-10-07T00:11:49.725619+0000","last_clean":"2023-10-07T00:11:49.725619+0000","last_became_active":"2023-10-07T00:11:13.842296+0000","last_became_peered":"2023-10-07T00:11:13.842296+0000","last_unstale":"2023-10-07T00:11:49.725619+0000","last_undegraded":"2023-10-07T00:11:49.725619+0000","last_fullsized":"2023-10-07T00:11:49.725619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:51.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725522+0000","last_change":"2023-10-07T00:11:13.850567+0000","last_active":"2023-10-07T00:11:49.725522+0000","last_peered":"2023-10-07T00:11:49.725522+0000","last_clean":"2023-10-07T00:11:49.725522+0000","last_became_active":"2023-10-07T00:11:13.850212+0000","last_became_peered":"2023-10-07T00:11:13.850212+0000","last_unstale":"2023-10-07T00:11:49.725522+0000","last_undegraded":"2023-10-07T00:11:49.725522+0000","last_fullsized":"2023-10-07T00:11:49.725522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:51.539752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734525+0000","last_change":"2023-10-07T00:11:13.839742+0000","last_active":"2023-10-07T00:11:49.734525+0000","last_peered":"2023-10-07T00:11:49.734525+0000","last_clean":"2023-10-07T00:11:49.734525+0000","last_became_active":"2023-10-07T00:11:13.839041+0000","last_became_peered":"2023-10-07T00:11:13.839041+0000","last_unstale":"2023-10-07T00:11:49.734525+0000","last_undegraded":"2023-10-07T00:11:49.734525+0000","last_fullsized":"2023-10-07T00:11:49.734525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:59.241248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726468+0000","last_change":"2023-10-07T00:11:13.834839+0000","last_active":"2023-10-07T00:11:49.726468+0000","last_peered":"2023-10-07T00:11:49.726468+0000","last_clean":"2023-10-07T00:11:49.726468+0000","last_became_active":"2023-10-07T00:11:13.834529+0000","last_became_peered":"2023-10-07T00:11:13.834529+0000","last_unstale":"2023-10-07T00:11:49.726468+0000","last_undegraded":"2023-10-07T00:11:49.726468+0000","last_fullsized":"2023-10-07T00:11:49.726468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:23.831424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736591+0000","last_change":"2023-10-07T00:11:13.835102+0000","last_active":"2023-10-07T00:11:49.736591+0000","last_peered":"2023-10-07T00:11:49.736591+0000","last_clean":"2023-10-07T00:11:49.736591+0000","last_became_active":"2023-10-07T00:11:13.834781+0000","last_became_peered":"2023-10-07T00:11:13.834781+0000","last_unstale":"2023-10-07T00:11:49.736591+0000","last_undegraded":"2023-10-07T00:11:49.736591+0000","last_fullsized":"2023-10-07T00:11:49.736591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:16:55.912464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.781822+0000","last_change":"2023-10-07T00:11:50.781822+0000","last_active":"2023-10-07T00:11:50.781822+0000","last_peered":"2023-10-07T00:11:50.781822+0000","last_clean":"2023-10-07T00:11:50.781822+0000","last_became_active":"2023-10-07T00:11:50.781261+0000","last_became_peered":"2023-10-07T00:11:50.781261+0000","last_unstale":"2023-10-07T00:11:50.781822+0000","last_undegraded":"2023-10-07T00:11:50.781822+0000","last_fullsized":"2023-10-07T00:11:50.781822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:16.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731803+0000","last_change":"2023-10-07T00:11:13.842772+0000","last_active":"2023-10-07T00:11:49.731803+0000","last_peered":"2023-10-07T00:11:49.731803+0000","last_clean":"2023-10-07T00:11:49.731803+0000","last_became_active":"2023-10-07T00:11:13.841610+0000","last_became_peered":"2023-10-07T00:11:13.841610+0000","last_unstale":"2023-10-07T00:11:49.731803+0000","last_undegraded":"2023-10-07T00:11:49.731803+0000","last_fullsized":"2023-10-07T00:11:49.731803+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:04:51.988705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733744+0000","last_change":"2023-10-07T00:11:13.836990+0000","last_active":"2023-10-07T00:11:49.733744+0000","last_peered":"2023-10-07T00:11:49.733744+0000","last_clean":"2023-10-07T00:11:49.733744+0000","last_became_active":"2023-10-07T00:11:13.836699+0000","last_became_peered":"2023-10-07T00:11:13.836699+0000","last_unstale":"2023-10-07T00:11:49.733744+0000","last_undegraded":"2023-10-07T00:11:49.733744+0000","last_fullsized":"2023-10-07T00:11:49.733744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:18:20.450573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.736801+0000","last_change":"2023-10-07T00:11:50.736801+0000","last_active":"2023-10-07T00:11:50.736801+0000","last_peered":"2023-10-07T00:11:50.736801+0000","last_clean":"2023-10-07T00:11:50.736801+0000","last_became_active":"2023-10-07T00:11:50.736256+0000","last_became_peered":"2023-10-07T00:11:50.736256+0000","last_unstale":"2023-10-07T00:11:50.736801+0000","last_undegraded":"2023-10-07T00:11:50.736801+0000","last_fullsized":"2023-10-07T00:11:50.736801+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:35.622108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726373+0000","last_change":"2023-10-07T00:11:13.841699+0000","last_active":"2023-10-07T00:11:49.726373+0000","last_peered":"2023-10-07T00:11:49.726373+0000","last_clean":"2023-10-07T00:11:49.726373+0000","last_became_active":"2023-10-07T00:11:13.841295+0000","last_became_peered":"2023-10-07T00:11:13.841295+0000","last_unstale":"2023-10-07T00:11:49.726373+0000","last_undegraded":"2023-10-07T00:11:49.726373+0000","last_fullsized":"2023-10-07T00:11:49.726373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:24:56.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733949+0000","last_change":"2023-10-07T00:11:13.839951+0000","last_active":"2023-10-07T00:11:49.733949+0000","last_peered":"2023-10-07T00:11:49.733949+0000","last_clean":"2023-10-07T00:11:49.733949+0000","last_became_active":"2023-10-07T00:11:13.839473+0000","last_became_peered":"2023-10-07T00:11:13.839473+0000","last_unstale":"2023-10-07T00:11:49.733949+0000","last_undegraded":"2023-10-07T00:11:49.733949+0000","last_fullsized":"2023-10-07T00:11:49.733949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728867+0000","last_change":"2023-10-07T00:11:13.838714+0000","last_active":"2023-10-07T00:11:49.728867+0000","last_peered":"2023-10-07T00:11:49.728867+0000","last_clean":"2023-10-07T00:11:49.728867+0000","last_became_active":"2023-10-07T00:11:13.838222+0000","last_became_peered":"2023-10-07T00:11:13.838222+0000","last_unstale":"2023-10-07T00:11:49.728867+0000","last_undegraded":"2023-10-07T00:11:49.728867+0000","last_fullsized":"2023-10-07T00:11:49.728867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:11:43.194204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725360+0000","last_change":"2023-10-07T00:11:13.843075+0000","last_active":"2023-10-07T00:11:49.725360+0000","last_peered":"2023-10-07T00:11:49.725360+0000","last_clean":"2023-10-07T00:11:49.725360+0000","last_became_active":"2023-10-07T00:11:13.842742+0000","last_became_peered":"2023-10-07T00:11:13.842742+0000","last_unstale":"2023-10-07T00:11:49.725360+0000","last_undegraded":"2023-10-07T00:11:49.725360+0000","last_fullsized":"2023-10-07T00:11:49.725360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:53:12.713979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725271+0000","last_change":"2023-10-07T00:11:13.841635+0000","last_active":"2023-10-07T00:11:49.725271+0000","last_peered":"2023-10-07T00:11:49.725271+0000","last_clean":"2023-10-07T00:11:49.725271+0000","last_became_active":"2023-10-07T00:11:13.841291+0000","last_became_peered":"2023-10-07T00:11:13.841291+0000","last_unstale":"2023-10-07T00:11:49.725271+0000","last_undegraded":"2023-10-07T00:11:49.725271+0000","last_fullsized":"2023-10-07T00:11:49.725271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:48:38.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732543+0000","last_change":"2023-10-07T00:11:13.842365+0000","last_active":"2023-10-07T00:11:49.732543+0000","last_peered":"2023-10-07T00:11:49.732543+0000","last_clean":"2023-10-07T00:11:49.732543+0000","last_became_active":"2023-10-07T00:11:13.842057+0000","last_became_peered":"2023-10-07T00:11:13.842057+0000","last_unstale":"2023-10-07T00:11:49.732543+0000","last_undegraded":"2023-10-07T00:11:49.732543+0000","last_fullsized":"2023-10-07T00:11:49.732543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:36.575712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729600+0000","last_change":"2023-10-07T00:11:13.845746+0000","last_active":"2023-10-07T00:11:49.729600+0000","last_peered":"2023-10-07T00:11:49.729600+0000","last_clean":"2023-10-07T00:11:49.729600+0000","last_became_active":"2023-10-07T00:11:13.844828+0000","last_became_peered":"2023-10-07T00:11:13.844828+0000","last_unstale":"2023-10-07T00:11:49.729600+0000","last_undegraded":"2023-10-07T00:11:49.729600+0000","last_fullsized":"2023-10-07T00:11:49.729600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:34:00.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728722+0000","last_change":"2023-10-07T00:11:13.837749+0000","last_active":"2023-10-07T00:11:49.728722+0000","last_peered":"2023-10-07T00:11:49.728722+0000","last_clean":"2023-10-07T00:11:49.728722+0000","last_became_active":"2023-10-07T00:11:13.837400+0000","last_became_peered":"2023-10-07T00:11:13.837400+0000","last_unstale":"2023-10-07T00:11:49.728722+0000","last_undegraded":"2023-10-07T00:11:49.728722+0000","last_fullsized":"2023-10-07T00:11:49.728722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:40.190065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733555+0000","last_change":"2023-10-07T00:11:13.833086+0000","last_active":"2023-10-07T00:11:49.733555+0000","last_peered":"2023-10-07T00:11:49.733555+0000","last_clean":"2023-10-07T00:11:49.733555+0000","last_became_active":"2023-10-07T00:11:13.832748+0000","last_became_peered":"2023-10-07T00:11:13.832748+0000","last_unstale":"2023-10-07T00:11:49.733555+0000","last_undegraded":"2023-10-07T00:11:49.733555+0000","last_fullsized":"2023-10-07T00:11:49.733555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:29.176224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:02.753887+0000","last_change":"2023-10-07T00:11:12.835440+0000","last_active":"2023-10-07T00:12:02.753887+0000","last_peered":"2023-10-07T00:12:02.753887+0000","last_clean":"2023-10-07T00:12:02.753887+0000","last_became_active":"2023-10-07T00:11:12.835094+0000","last_became_peered":"2023-10-07T00:11:12.835094+0000","last_unstale":"2023-10-07T00:12:02.753887+0000","last_undegraded":"2023-10-07T00:12:02.753887+0000","last_fullsized":"2023-10-07T00:12:02.753887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:13.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731780+0000","last_change":"2023-10-07T00:11:13.847832+0000","last_active":"2023-10-07T00:11:49.731780+0000","last_peered":"2023-10-07T00:11:49.731780+0000","last_clean":"2023-10-07T00:11:49.731780+0000","last_became_active":"2023-10-07T00:11:13.847436+0000","last_became_peered":"2023-10-07T00:11:13.847436+0000","last_unstale":"2023-10-07T00:11:49.731780+0000","last_undegraded":"2023-10-07T00:11:49.731780+0000","last_fullsized":"2023-10-07T00:11:49.731780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:47:07.409132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732015+0000","last_change":"2023-10-07T00:11:12.842832+0000","last_active":"2023-10-07T00:11:49.732015+0000","last_peered":"2023-10-07T00:11:49.732015+0000","last_clean":"2023-10-07T00:11:49.732015+0000","last_became_active":"2023-10-07T00:11:12.842296+0000","last_became_peered":"2023-10-07T00:11:12.842296+0000","last_unstale":"2023-10-07T00:11:49.732015+0000","last_undegraded":"2023-10-07T00:11:49.732015+0000","last_fullsized":"2023-10-07T00:11:49.732015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:00.968303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726083+0000","last_change":"2023-10-07T00:11:13.851259+0000","last_active":"2023-10-07T00:11:49.726083+0000","last_peered":"2023-10-07T00:11:49.726083+0000","last_clean":"2023-10-07T00:11:49.726083+0000","last_became_active":"2023-10-07T00:11:13.850963+0000","last_became_peered":"2023-10-07T00:11:13.850963+0000","last_unstale":"2023-10-07T00:11:49.726083+0000","last_undegraded":"2023-10-07T00:11:49.726083+0000","last_fullsized":"2023-10-07T00:11:49.726083+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:52.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726990+0000","last_change":"2023-10-07T00:11:12.835286+0000","last_active":"2023-10-07T00:11:49.726990+0000","last_peered":"2023-10-07T00:11:49.726990+0000","last_clean":"2023-10-07T00:11:49.726990+0000","last_became_active":"2023-10-07T00:11:12.834890+0000","last_became_peered":"2023-10-07T00:11:12.834890+0000","last_unstale":"2023-10-07T00:11:49.726990+0000","last_undegraded":"2023-10-07T00:11:49.726990+0000","last_fullsized":"2023-10-07T00:11:49.726990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:06:05.225849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732721+0000","last_change":"2023-10-07T00:11:13.831174+0000","last_active":"2023-10-07T00:11:49.732721+0000","last_peered":"2023-10-07T00:11:49.732721+0000","last_clean":"2023-10-07T00:11:49.732721+0000","last_became_active":"2023-10-07T00:11:13.830868+0000","last_became_peered":"2023-10-07T00:11:13.830868+0000","last_unstale":"2023-10-07T00:11:49.732721+0000","last_undegraded":"2023-10-07T00:11:49.732721+0000","last_fullsized":"2023-10-07T00:11:49.732721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:20.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726737+0000","last_change":"2023-10-07T00:11:12.835740+0000","last_active":"2023-10-07T00:11:49.726737+0000","last_peered":"2023-10-07T00:11:49.726737+0000","last_clean":"2023-10-07T00:11:49.726737+0000","last_became_active":"2023-10-07T00:11:12.835035+0000","last_became_peered":"2023-10-07T00:11:12.835035+0000","last_unstale":"2023-10-07T00:11:49.726737+0000","last_undegraded":"2023-10-07T00:11:49.726737+0000","last_fullsized":"2023-10-07T00:11:49.726737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:36:07.447748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729611+0000","last_change":"2023-10-07T00:11:13.847940+0000","last_active":"2023-10-07T00:11:49.729611+0000","last_peered":"2023-10-07T00:11:49.729611+0000","last_clean":"2023-10-07T00:11:49.729611+0000","last_became_active":"2023-10-07T00:11:13.847595+0000","last_became_peered":"2023-10-07T00:11:13.847595+0000","last_unstale":"2023-10-07T00:11:49.729611+0000","last_undegraded":"2023-10-07T00:11:49.729611+0000","last_fullsized":"2023-10-07T00:11:49.729611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:28.004429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":83,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:02.761549+0000","last_change":"2023-10-07T00:11:50.743813+0000","last_active":"2023-10-07T00:12:02.761549+0000","last_peered":"2023-10-07T00:12:02.761549+0000","last_clean":"2023-10-07T00:12:02.761549+0000","last_became_active":"2023-10-07T00:11:50.739205+0000","last_became_peered":"2023-10-07T00:11:50.739205+0000","last_unstale":"2023-10-07T00:12:02.761549+0000","last_undegraded":"2023-10-07T00:12:02.761549+0000","last_fullsized":"2023-10-07T00:12:02.761549+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:26.630097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726681+0000","last_change":"2023-10-07T00:11:13.838732+0000","last_active":"2023-10-07T00:11:49.726681+0000","last_peered":"2023-10-07T00:11:49.726681+0000","last_clean":"2023-10-07T00:11:49.726681+0000","last_became_active":"2023-10-07T00:11:13.838408+0000","last_became_peered":"2023-10-07T00:11:13.838408+0000","last_unstale":"2023-10-07T00:11:49.726681+0000","last_undegraded":"2023-10-07T00:11:49.726681+0000","last_fullsized":"2023-10-07T00:11:49.726681+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:55:55.039399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736631+0000","last_change":"2023-10-07T00:11:12.831778+0000","last_active":"2023-10-07T00:11:49.736631+0000","last_peered":"2023-10-07T00:11:49.736631+0000","last_clean":"2023-10-07T00:11:49.736631+0000","last_became_active":"2023-10-07T00:11:12.831479+0000","last_became_peered":"2023-10-07T00:11:12.831479+0000","last_unstale":"2023-10-07T00:11:49.736631+0000","last_undegraded":"2023-10-07T00:11:49.736631+0000","last_fullsized":"2023-10-07T00:11:49.736631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:12:57.994585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.745021+0000","last_change":"2023-10-07T00:11:50.745021+0000","last_active":"2023-10-07T00:11:50.745021+0000","last_peered":"2023-10-07T00:11:50.745021+0000","last_clean":"2023-10-07T00:11:50.745021+0000","last_became_active":"2023-10-07T00:11:50.744570+0000","last_became_peered":"2023-10-07T00:11:50.744570+0000","last_unstale":"2023-10-07T00:11:50.745021+0000","last_undegraded":"2023-10-07T00:11:50.745021+0000","last_fullsized":"2023-10-07T00:11:50.745021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:54.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728874+0000","last_change":"2023-10-07T00:11:12.825556+0000","last_active":"2023-10-07T00:11:49.728874+0000","last_peered":"2023-10-07T00:11:49.728874+0000","last_clean":"2023-10-07T00:11:49.728874+0000","last_became_active":"2023-10-07T00:11:12.825189+0000","last_became_peered":"2023-10-07T00:11:12.825189+0000","last_unstale":"2023-10-07T00:11:49.728874+0000","last_undegraded":"2023-10-07T00:11:49.728874+0000","last_fullsized":"2023-10-07T00:11:49.728874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:20:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.782913+0000","last_change":"2023-10-07T00:11:50.781935+0000","last_active":"2023-10-07T00:11:50.782913+0000","last_peered":"2023-10-07T00:11:50.782913+0000","last_clean":"2023-10-07T00:11:50.782913+0000","last_became_active":"2023-10-07T00:11:50.781541+0000","last_became_peered":"2023-10-07T00:11:50.781541+0000","last_unstale":"2023-10-07T00:11:50.782913+0000","last_undegraded":"2023-10-07T00:11:50.782913+0000","last_fullsized":"2023-10-07T00:11:50.782913+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:29:18.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729367+0000","last_change":"2023-10-07T00:11:12.835239+0000","last_active":"2023-10-07T00:11:49.729367+0000","last_peered":"2023-10-07T00:11:49.729367+0000","last_clean":"2023-10-07T00:11:49.729367+0000","last_became_active":"2023-10-07T00:11:12.834912+0000","last_became_peered":"2023-10-07T00:11:12.834912+0000","last_unstale":"2023-10-07T00:11:49.729367+0000","last_undegraded":"2023-10-07T00:11:49.729367+0000","last_fullsized":"2023-10-07T00:11:49.729367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:32:44.097208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728391+0000","last_change":"2023-10-07T00:11:13.837642+0000","last_active":"2023-10-07T00:11:49.728391+0000","last_peered":"2023-10-07T00:11:49.728391+0000","last_clean":"2023-10-07T00:11:49.728391+0000","last_became_active":"2023-10-07T00:11:13.837291+0000","last_became_peered":"2023-10-07T00:11:13.837291+0000","last_unstale":"2023-10-07T00:11:49.728391+0000","last_undegraded":"2023-10-07T00:11:49.728391+0000","last_fullsized":"2023-10-07T00:11:49.728391+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:19:14.445816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":111,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:04.731734+0000","last_change":"2023-10-07T00:11:12.826373+0000","last_active":"2023-10-07T00:12:04.731734+0000","last_peered":"2023-10-07T00:12:04.731734+0000","last_clean":"2023-10-07T00:12:04.731734+0000","last_became_active":"2023-10-07T00:11:12.826017+0000","last_became_peered":"2023-10-07T00:11:12.826017+0000","last_unstale":"2023-10-07T00:12:04.731734+0000","last_undegraded":"2023-10-07T00:12:04.731734+0000","last_fullsized":"2023-10-07T00:12:04.731734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:52:03.101632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733607+0000","last_change":"2023-10-07T00:11:13.830879+0000","last_active":"2023-10-07T00:11:49.733607+0000","last_peered":"2023-10-07T00:11:49.733607+0000","last_clean":"2023-10-07T00:11:49.733607+0000","last_became_active":"2023-10-07T00:11:13.830571+0000","last_became_peered":"2023-10-07T00:11:13.830571+0000","last_unstale":"2023-10-07T00:11:49.733607+0000","last_undegraded":"2023-10-07T00:11:49.733607+0000","last_fullsized":"2023-10-07T00:11:49.733607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:36.703499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726148+0000","last_change":"2023-10-07T00:11:12.833952+0000","last_active":"2023-10-07T00:11:49.726148+0000","last_peered":"2023-10-07T00:11:49.726148+0000","last_clean":"2023-10-07T00:11:49.726148+0000","last_became_active":"2023-10-07T00:11:12.833545+0000","last_became_peered":"2023-10-07T00:11:12.833545+0000","last_unstale":"2023-10-07T00:11:49.726148+0000","last_undegraded":"2023-10-07T00:11:49.726148+0000","last_fullsized":"2023-10-07T00:11:49.726148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:28:12.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726081+0000","last_change":"2023-10-07T00:11:13.843758+0000","last_active":"2023-10-07T00:11:49.726081+0000","last_peered":"2023-10-07T00:11:49.726081+0000","last_clean":"2023-10-07T00:11:49.726081+0000","last_became_active":"2023-10-07T00:11:13.843443+0000","last_became_peered":"2023-10-07T00:11:13.843443+0000","last_unstale":"2023-10-07T00:11:49.726081+0000","last_undegraded":"2023-10-07T00:11:49.726081+0000","last_fullsized":"2023-10-07T00:11:49.726081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:07:28.610304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729780+0000","last_change":"2023-10-07T00:11:12.833043+0000","last_active":"2023-10-07T00:11:49.729780+0000","last_peered":"2023-10-07T00:11:49.729780+0000","last_clean":"2023-10-07T00:11:49.729780+0000","last_became_active":"2023-10-07T00:11:12.832632+0000","last_became_peered":"2023-10-07T00:11:12.832632+0000","last_unstale":"2023-10-07T00:11:49.729780+0000","last_undegraded":"2023-10-07T00:11:49.729780+0000","last_fullsized":"2023-10-07T00:11:49.729780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:14:25.148603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733719+0000","last_change":"2023-10-07T00:11:13.831129+0000","last_active":"2023-10-07T00:11:49.733719+0000","last_peered":"2023-10-07T00:11:49.733719+0000","last_clean":"2023-10-07T00:11:49.733719+0000","last_became_active":"2023-10-07T00:11:13.830365+0000","last_became_peered":"2023-10-07T00:11:13.830365+0000","last_unstale":"2023-10-07T00:11:49.733719+0000","last_undegraded":"2023-10-07T00:11:49.733719+0000","last_fullsized":"2023-10-07T00:11:49.733719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:22:00.580441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":164,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:04.802290+0000","last_change":"2023-10-07T00:11:50.782182+0000","last_active":"2023-10-07T00:12:04.802290+0000","last_peered":"2023-10-07T00:12:04.802290+0000","last_clean":"2023-10-07T00:12:04.802290+0000","last_became_active":"2023-10-07T00:11:50.774767+0000","last_became_peered":"2023-10-07T00:11:50.774767+0000","last_unstale":"2023-10-07T00:12:04.802290+0000","last_undegraded":"2023-10-07T00:12:04.802290+0000","last_fullsized":"2023-10-07T00:12:04.802290+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:28:39.403496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56440,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":89,"num_read_kb":98,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":56440,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726786+0000","last_change":"2023-10-07T00:11:13.832332+0000","last_active":"2023-10-07T00:11:49.726786+0000","last_peered":"2023-10-07T00:11:49.726786+0000","last_clean":"2023-10-07T00:11:49.726786+0000","last_became_active":"2023-10-07T00:11:13.832000+0000","last_became_peered":"2023-10-07T00:11:13.832000+0000","last_unstale":"2023-10-07T00:11:49.726786+0000","last_undegraded":"2023-10-07T00:11:49.726786+0000","last_fullsized":"2023-10-07T00:11:49.726786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:39.913331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733497+0000","last_change":"2023-10-07T00:11:12.839399+0000","last_active":"2023-10-07T00:11:49.733497+0000","last_peered":"2023-10-07T00:11:49.733497+0000","last_clean":"2023-10-07T00:11:49.733497+0000","last_became_active":"2023-10-07T00:11:12.838997+0000","last_became_peered":"2023-10-07T00:11:12.838997+0000","last_unstale":"2023-10-07T00:11:49.733497+0000","last_undegraded":"2023-10-07T00:11:49.733497+0000","last_fullsized":"2023-10-07T00:11:49.733497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:11.194224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729147+0000","last_change":"2023-10-07T00:11:13.830832+0000","last_active":"2023-10-07T00:11:49.729147+0000","last_peered":"2023-10-07T00:11:49.729147+0000","last_clean":"2023-10-07T00:11:49.729147+0000","last_became_active":"2023-10-07T00:11:13.830373+0000","last_became_peered":"2023-10-07T00:11:13.830373+0000","last_unstale":"2023-10-07T00:11:49.729147+0000","last_undegraded":"2023-10-07T00:11:49.729147+0000","last_fullsized":"2023-10-07T00:11:49.729147+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:08.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729861+0000","last_change":"2023-10-07T00:11:12.834543+0000","last_active":"2023-10-07T00:11:49.729861+0000","last_peered":"2023-10-07T00:11:49.729861+0000","last_clean":"2023-10-07T00:11:49.729861+0000","last_became_active":"2023-10-07T00:11:12.834213+0000","last_became_peered":"2023-10-07T00:11:12.834213+0000","last_unstale":"2023-10-07T00:11:49.729861+0000","last_undegraded":"2023-10-07T00:11:49.729861+0000","last_fullsized":"2023-10-07T00:11:49.729861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:57:35.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725727+0000","last_change":"2023-10-07T00:11:13.830645+0000","last_active":"2023-10-07T00:11:49.725727+0000","last_peered":"2023-10-07T00:11:49.725727+0000","last_clean":"2023-10-07T00:11:49.725727+0000","last_became_active":"2023-10-07T00:11:13.830331+0000","last_became_peered":"2023-10-07T00:11:13.830331+0000","last_unstale":"2023-10-07T00:11:49.725727+0000","last_undegraded":"2023-10-07T00:11:49.725727+0000","last_fullsized":"2023-10-07T00:11:49.725727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:19:55.226177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:03.729939+0000","last_change":"2023-10-07T00:11:12.830062+0000","last_active":"2023-10-07T00:12:03.729939+0000","last_peered":"2023-10-07T00:12:03.729939+0000","last_clean":"2023-10-07T00:12:03.729939+0000","last_became_active":"2023-10-07T00:11:12.829734+0000","last_became_peered":"2023-10-07T00:11:12.829734+0000","last_unstale":"2023-10-07T00:12:03.729939+0000","last_undegraded":"2023-10-07T00:12:03.729939+0000","last_fullsized":"2023-10-07T00:12:03.729939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:59.658154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725476+0000","last_change":"2023-10-07T00:11:13.840915+0000","last_active":"2023-10-07T00:11:49.725476+0000","last_peered":"2023-10-07T00:11:49.725476+0000","last_clean":"2023-10-07T00:11:49.725476+0000","last_became_active":"2023-10-07T00:11:13.840584+0000","last_became_peered":"2023-10-07T00:11:13.840584+0000","last_unstale":"2023-10-07T00:11:49.725476+0000","last_undegraded":"2023-10-07T00:11:49.725476+0000","last_fullsized":"2023-10-07T00:11:49.725476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:27:58.672800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726440+0000","last_change":"2023-10-07T00:11:12.829034+0000","last_active":"2023-10-07T00:11:49.726440+0000","last_peered":"2023-10-07T00:11:49.726440+0000","last_clean":"2023-10-07T00:11:49.726440+0000","last_became_active":"2023-10-07T00:11:12.828671+0000","last_became_peered":"2023-10-07T00:11:12.828671+0000","last_unstale":"2023-10-07T00:11:49.726440+0000","last_undegraded":"2023-10-07T00:11:49.726440+0000","last_fullsized":"2023-10-07T00:11:49.726440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:09:14.203804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.730639+0000","last_change":"2023-10-07T00:11:13.843029+0000","last_active":"2023-10-07T00:11:49.730639+0000","last_peered":"2023-10-07T00:11:49.730639+0000","last_clean":"2023-10-07T00:11:49.730639+0000","last_became_active":"2023-10-07T00:11:13.842714+0000","last_became_peered":"2023-10-07T00:11:13.842714+0000","last_unstale":"2023-10-07T00:11:49.730639+0000","last_undegraded":"2023-10-07T00:11:49.730639+0000","last_fullsized":"2023-10-07T00:11:49.730639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:46.147059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.727162+0000","last_change":"2023-10-07T00:11:12.830887+0000","last_active":"2023-10-07T00:11:49.727162+0000","last_peered":"2023-10-07T00:11:49.727162+0000","last_clean":"2023-10-07T00:11:49.727162+0000","last_became_active":"2023-10-07T00:11:12.830500+0000","last_became_peered":"2023-10-07T00:11:12.830500+0000","last_unstale":"2023-10-07T00:11:49.727162+0000","last_undegraded":"2023-10-07T00:11:49.727162+0000","last_fullsized":"2023-10-07T00:11:49.727162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:39.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729316+0000","last_change":"2023-10-07T00:11:13.838823+0000","last_active":"2023-10-07T00:11:49.729316+0000","last_peered":"2023-10-07T00:11:49.729316+0000","last_clean":"2023-10-07T00:11:49.729316+0000","last_became_active":"2023-10-07T00:11:13.838491+0000","last_became_peered":"2023-10-07T00:11:13.838491+0000","last_unstale":"2023-10-07T00:11:49.729316+0000","last_undegraded":"2023-10-07T00:11:49.729316+0000","last_fullsized":"2023-10-07T00:11:49.729316+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:29:31.340686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728495+0000","last_change":"2023-10-07T00:11:12.838303+0000","last_active":"2023-10-07T00:11:49.728495+0000","last_peered":"2023-10-07T00:11:49.728495+0000","last_clean":"2023-10-07T00:11:49.728495+0000","last_became_active":"2023-10-07T00:11:12.837891+0000","last_became_peered":"2023-10-07T00:11:12.837891+0000","last_unstale":"2023-10-07T00:11:49.728495+0000","last_undegraded":"2023-10-07T00:11:49.728495+0000","last_fullsized":"2023-10-07T00:11:49.728495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:56.957653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736806+0000","last_change":"2023-10-07T00:11:13.840109+0000","last_active":"2023-10-07T00:11:49.736806+0000","last_peered":"2023-10-07T00:11:49.736806+0000","last_clean":"2023-10-07T00:11:49.736806+0000","last_became_active":"2023-10-07T00:11:13.839767+0000","last_became_peered":"2023-10-07T00:11:13.839767+0000","last_unstale":"2023-10-07T00:11:49.736806+0000","last_undegraded":"2023-10-07T00:11:49.736806+0000","last_fullsized":"2023-10-07T00:11:49.736806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:24.236839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:04.757241+0000","last_change":"2023-10-07T00:11:12.837365+0000","last_active":"2023-10-07T00:12:04.757241+0000","last_peered":"2023-10-07T00:12:04.757241+0000","last_clean":"2023-10-07T00:12:04.757241+0000","last_became_active":"2023-10-07T00:11:12.836992+0000","last_became_peered":"2023-10-07T00:11:12.836992+0000","last_unstale":"2023-10-07T00:12:04.757241+0000","last_undegraded":"2023-10-07T00:12:04.757241+0000","last_fullsized":"2023-10-07T00:12:04.757241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:24:09.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736802+0000","last_change":"2023-10-07T00:11:13.851151+0000","last_active":"2023-10-07T00:11:49.736802+0000","last_peered":"2023-10-07T00:11:49.736802+0000","last_clean":"2023-10-07T00:11:49.736802+0000","last_became_active":"2023-10-07T00:11:13.850807+0000","last_became_peered":"2023-10-07T00:11:13.850807+0000","last_unstale":"2023-10-07T00:11:49.736802+0000","last_undegraded":"2023-10-07T00:11:49.736802+0000","last_fullsized":"2023-10-07T00:11:49.736802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:17:42.857720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729564+0000","last_change":"2023-10-07T00:11:13.844143+0000","last_active":"2023-10-07T00:11:49.729564+0000","last_peered":"2023-10-07T00:11:49.729564+0000","last_clean":"2023-10-07T00:11:49.729564+0000","last_became_active":"2023-10-07T00:11:13.843633+0000","last_became_peered":"2023-10-07T00:11:13.843633+0000","last_unstale":"2023-10-07T00:11:49.729564+0000","last_undegraded":"2023-10-07T00:11:49.729564+0000","last_fullsized":"2023-10-07T00:11:49.729564+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:42:20.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:04.730791+0000","last_change":"2023-10-07T00:11:12.836076+0000","last_active":"2023-10-07T00:12:04.730791+0000","last_peered":"2023-10-07T00:12:04.730791+0000","last_clean":"2023-10-07T00:12:04.730791+0000","last_became_active":"2023-10-07T00:11:12.835709+0000","last_became_peered":"2023-10-07T00:11:12.835709+0000","last_unstale":"2023-10-07T00:12:04.730791+0000","last_undegraded":"2023-10-07T00:12:04.730791+0000","last_fullsized":"2023-10-07T00:12:04.730791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.096103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.741475+0000","last_change":"2023-10-07T00:11:50.738891+0000","last_active":"2023-10-07T00:11:50.741475+0000","last_peered":"2023-10-07T00:11:50.741475+0000","last_clean":"2023-10-07T00:11:50.741475+0000","last_became_active":"2023-10-07T00:11:50.738516+0000","last_became_peered":"2023-10-07T00:11:50.738516+0000","last_unstale":"2023-10-07T00:11:50.741475+0000","last_undegraded":"2023-10-07T00:11:50.741475+0000","last_fullsized":"2023-10-07T00:11:50.741475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:22:10.840002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734497+0000","last_change":"2023-10-07T00:11:12.839717+0000","last_active":"2023-10-07T00:11:49.734497+0000","last_peered":"2023-10-07T00:11:49.734497+0000","last_clean":"2023-10-07T00:11:49.734497+0000","last_became_active":"2023-10-07T00:11:12.839287+0000","last_became_peered":"2023-10-07T00:11:12.839287+0000","last_unstale":"2023-10-07T00:11:49.734497+0000","last_undegraded":"2023-10-07T00:11:49.734497+0000","last_fullsized":"2023-10-07T00:11:49.734497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:11.170207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":313,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725653+0000","last_change":"2023-10-07T00:09:53.652919+0000","last_active":"2023-10-07T00:11:49.725653+0000","last_peered":"2023-10-07T00:11:49.725653+0000","last_clean":"2023-10-07T00:11:49.725653+0000","last_became_active":"2023-10-07T00:09:53.652407+0000","last_became_peered":"2023-10-07T00:09:53.652407+0000","last_unstale":"2023-10-07T00:11:49.725653+0000","last_undegraded":"2023-10-07T00:11:49.725653+0000","last_fullsized":"2023-10-07T00:11:49.725653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_clean_scrub_stamp":"2023-10-07T00:06:22.557862+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:33:55.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728682+0000","last_change":"2023-10-07T00:11:13.830797+0000","last_active":"2023-10-07T00:11:49.728682+0000","last_peered":"2023-10-07T00:11:49.728682+0000","last_clean":"2023-10-07T00:11:49.728682+0000","last_became_active":"2023-10-07T00:11:13.830467+0000","last_became_peered":"2023-10-07T00:11:13.830467+0000","last_unstale":"2023-10-07T00:11:49.728682+0000","last_undegraded":"2023-10-07T00:11:49.728682+0000","last_fullsized":"2023-10-07T00:11:49.728682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:48.545184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726436+0000","last_change":"2023-10-07T00:11:12.836000+0000","last_active":"2023-10-07T00:11:49.726436+0000","last_peered":"2023-10-07T00:11:49.726436+0000","last_clean":"2023-10-07T00:11:49.726436+0000","last_became_active":"2023-10-07T00:11:12.835588+0000","last_became_peered":"2023-10-07T00:11:12.835588+0000","last_unstale":"2023-10-07T00:11:49.726436+0000","last_undegraded":"2023-10-07T00:11:49.726436+0000","last_fullsized":"2023-10-07T00:11:49.726436+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:55:54.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.750173+0000","last_change":"2023-10-07T00:11:50.749694+0000","last_active":"2023-10-07T00:11:50.750173+0000","last_peered":"2023-10-07T00:11:50.750173+0000","last_clean":"2023-10-07T00:11:50.750173+0000","last_became_active":"2023-10-07T00:11:50.740568+0000","last_became_peered":"2023-10-07T00:11:50.740568+0000","last_unstale":"2023-10-07T00:11:50.750173+0000","last_undegraded":"2023-10-07T00:11:50.750173+0000","last_fullsized":"2023-10-07T00:11:50.750173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:19:31.414655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729321+0000","last_change":"2023-10-07T00:11:13.828373+0000","last_active":"2023-10-07T00:11:49.729321+0000","last_peered":"2023-10-07T00:11:49.729321+0000","last_clean":"2023-10-07T00:11:49.729321+0000","last_became_active":"2023-10-07T00:11:13.827999+0000","last_became_peered":"2023-10-07T00:11:13.827999+0000","last_unstale":"2023-10-07T00:11:49.729321+0000","last_undegraded":"2023-10-07T00:11:49.729321+0000","last_fullsized":"2023-10-07T00:11:49.729321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:43.551348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'10","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.757226+0000","last_change":"2023-10-07T00:11:50.757226+0000","last_active":"2023-10-07T00:11:50.757226+0000","last_peered":"2023-10-07T00:11:50.757226+0000","last_clean":"2023-10-07T00:11:50.757226+0000","last_became_active":"2023-10-07T00:11:50.742238+0000","last_became_peered":"2023-10-07T00:11:50.742238+0000","last_unstale":"2023-10-07T00:11:50.757226+0000","last_undegraded":"2023-10-07T00:11:50.757226+0000","last_fullsized":"2023-10-07T00:11:50.757226+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:26:20.609537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731386+0000","last_change":"2023-10-07T00:11:13.838814+0000","last_active":"2023-10-07T00:11:49.731386+0000","last_peered":"2023-10-07T00:11:49.731386+0000","last_clean":"2023-10-07T00:11:49.731386+0000","last_became_active":"2023-10-07T00:11:13.838468+0000","last_became_peered":"2023-10-07T00:11:13.838468+0000","last_unstale":"2023-10-07T00:11:49.731386+0000","last_undegraded":"2023-10-07T00:11:49.731386+0000","last_fullsized":"2023-10-07T00:11:49.731386+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:29:38.944450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734231+0000","last_change":"2023-10-07T00:11:12.837042+0000","last_active":"2023-10-07T00:11:49.734231+0000","last_peered":"2023-10-07T00:11:49.734231+0000","last_clean":"2023-10-07T00:11:49.734231+0000","last_became_active":"2023-10-07T00:11:12.836605+0000","last_became_peered":"2023-10-07T00:11:12.836605+0000","last_unstale":"2023-10-07T00:11:49.734231+0000","last_undegraded":"2023-10-07T00:11:49.734231+0000","last_fullsized":"2023-10-07T00:11:49.734231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:30:13.684063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725560+0000","last_change":"2023-10-07T00:11:13.840778+0000","last_active":"2023-10-07T00:11:49.725560+0000","last_peered":"2023-10-07T00:11:49.725560+0000","last_clean":"2023-10-07T00:11:49.725560+0000","last_became_active":"2023-10-07T00:11:13.840472+0000","last_became_peered":"2023-10-07T00:11:13.840472+0000","last_unstale":"2023-10-07T00:11:49.725560+0000","last_undegraded":"2023-10-07T00:11:49.725560+0000","last_fullsized":"2023-10-07T00:11:49.725560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:59.088416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732547+0000","last_change":"2023-10-07T00:11:12.838534+0000","last_active":"2023-10-07T00:11:49.732547+0000","last_peered":"2023-10-07T00:11:49.732547+0000","last_clean":"2023-10-07T00:11:49.732547+0000","last_became_active":"2023-10-07T00:11:12.838220+0000","last_became_peered":"2023-10-07T00:11:12.838220+0000","last_unstale":"2023-10-07T00:11:49.732547+0000","last_undegraded":"2023-10-07T00:11:49.732547+0000","last_fullsized":"2023-10-07T00:11:49.732547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:16:47.170815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726799+0000","last_change":"2023-10-07T00:11:13.831506+0000","last_active":"2023-10-07T00:11:49.726799+0000","last_peered":"2023-10-07T00:11:49.726799+0000","last_clean":"2023-10-07T00:11:49.726799+0000","last_became_active":"2023-10-07T00:11:13.831093+0000","last_became_peered":"2023-10-07T00:11:13.831093+0000","last_unstale":"2023-10-07T00:11:49.726799+0000","last_undegraded":"2023-10-07T00:11:49.726799+0000","last_fullsized":"2023-10-07T00:11:49.726799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:02.749470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731114+0000","last_change":"2023-10-07T00:11:12.841662+0000","last_active":"2023-10-07T00:11:49.731114+0000","last_peered":"2023-10-07T00:11:49.731114+0000","last_clean":"2023-10-07T00:11:49.731114+0000","last_became_active":"2023-10-07T00:11:12.841207+0000","last_became_peered":"2023-10-07T00:11:12.841207+0000","last_unstale":"2023-10-07T00:11:49.731114+0000","last_undegraded":"2023-10-07T00:11:49.731114+0000","last_fullsized":"2023-10-07T00:11:49.731114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:10.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729148+0000","last_change":"2023-10-07T00:11:13.844943+0000","last_active":"2023-10-07T00:11:49.729148+0000","last_peered":"2023-10-07T00:11:49.729148+0000","last_clean":"2023-10-07T00:11:49.729148+0000","last_became_active":"2023-10-07T00:11:13.844387+0000","last_became_peered":"2023-10-07T00:11:13.844387+0000","last_unstale":"2023-10-07T00:11:49.729148+0000","last_undegraded":"2023-10-07T00:11:49.729148+0000","last_fullsized":"2023-10-07T00:11:49.729148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:35.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733150+0000","last_change":"2023-10-07T00:11:12.838191+0000","last_active":"2023-10-07T00:11:49.733150+0000","last_peered":"2023-10-07T00:11:49.733150+0000","last_clean":"2023-10-07T00:11:49.733150+0000","last_became_active":"2023-10-07T00:11:12.837821+0000","last_became_peered":"2023-10-07T00:11:12.837821+0000","last_unstale":"2023-10-07T00:11:49.733150+0000","last_undegraded":"2023-10-07T00:11:49.733150+0000","last_fullsized":"2023-10-07T00:11:49.733150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:16:38.519554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732773+0000","last_change":"2023-10-07T00:11:13.841478+0000","last_active":"2023-10-07T00:11:49.732773+0000","last_peered":"2023-10-07T00:11:49.732773+0000","last_clean":"2023-10-07T00:11:49.732773+0000","last_became_active":"2023-10-07T00:11:13.841085+0000","last_became_peered":"2023-10-07T00:11:13.841085+0000","last_unstale":"2023-10-07T00:11:49.732773+0000","last_undegraded":"2023-10-07T00:11:49.732773+0000","last_fullsized":"2023-10-07T00:11:49.732773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:54:03.100980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726585+0000","last_change":"2023-10-07T00:11:12.831175+0000","last_active":"2023-10-07T00:11:49.726585+0000","last_peered":"2023-10-07T00:11:49.726585+0000","last_clean":"2023-10-07T00:11:49.726585+0000","last_became_active":"2023-10-07T00:11:12.830859+0000","last_became_peered":"2023-10-07T00:11:12.830859+0000","last_unstale":"2023-10-07T00:11:49.726585+0000","last_undegraded":"2023-10-07T00:11:49.726585+0000","last_fullsized":"2023-10-07T00:11:49.726585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:07.072334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725853+0000","last_change":"2023-10-07T00:11:13.834163+0000","last_active":"2023-10-07T00:11:49.725853+0000","last_peered":"2023-10-07T00:11:49.725853+0000","last_clean":"2023-10-07T00:11:49.725853+0000","last_became_active":"2023-10-07T00:11:13.833807+0000","last_became_peered":"2023-10-07T00:11:13.833807+0000","last_unstale":"2023-10-07T00:11:49.725853+0000","last_undegraded":"2023-10-07T00:11:49.725853+0000","last_fullsized":"2023-10-07T00:11:49.725853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:12:18.606936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:03.730604+0000","last_change":"2023-10-07T00:11:12.835598+0000","last_active":"2023-10-07T00:12:03.730604+0000","last_peered":"2023-10-07T00:12:03.730604+0000","last_clean":"2023-10-07T00:12:03.730604+0000","last_became_active":"2023-10-07T00:11:12.835295+0000","last_became_peered":"2023-10-07T00:11:12.835295+0000","last_unstale":"2023-10-07T00:12:03.730604+0000","last_undegraded":"2023-10-07T00:12:03.730604+0000","last_fullsized":"2023-10-07T00:12:03.730604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:40:52.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726471+0000","last_change":"2023-10-07T00:11:13.837918+0000","last_active":"2023-10-07T00:11:49.726471+0000","last_peered":"2023-10-07T00:11:49.726471+0000","last_clean":"2023-10-07T00:11:49.726471+0000","last_became_active":"2023-10-07T00:11:13.834284+0000","last_became_peered":"2023-10-07T00:11:13.834284+0000","last_unstale":"2023-10-07T00:11:49.726471+0000","last_undegraded":"2023-10-07T00:11:49.726471+0000","last_fullsized":"2023-10-07T00:11:49.726471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:49:47.081395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729507+0000","last_change":"2023-10-07T00:11:12.839362+0000","last_active":"2023-10-07T00:11:49.729507+0000","last_peered":"2023-10-07T00:11:49.729507+0000","last_clean":"2023-10-07T00:11:49.729507+0000","last_became_active":"2023-10-07T00:11:12.838902+0000","last_became_peered":"2023-10-07T00:11:12.838902+0000","last_unstale":"2023-10-07T00:11:49.729507+0000","last_undegraded":"2023-10-07T00:11:49.729507+0000","last_fullsized":"2023-10-07T00:11:49.729507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:05:34.649556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725841+0000","last_change":"2023-10-07T00:11:13.839356+0000","last_active":"2023-10-07T00:11:49.725841+0000","last_peered":"2023-10-07T00:11:49.725841+0000","last_clean":"2023-10-07T00:11:49.725841+0000","last_became_active":"2023-10-07T00:11:13.838936+0000","last_became_peered":"2023-10-07T00:11:13.838936+0000","last_unstale":"2023-10-07T00:11:49.725841+0000","last_undegraded":"2023-10-07T00:11:49.725841+0000","last_fullsized":"2023-10-07T00:11:49.725841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:02.860174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728045+0000","last_change":"2023-10-07T00:11:12.839966+0000","last_active":"2023-10-07T00:11:49.728045+0000","last_peered":"2023-10-07T00:11:49.728045+0000","last_clean":"2023-10-07T00:11:49.728045+0000","last_became_active":"2023-10-07T00:11:12.839505+0000","last_became_peered":"2023-10-07T00:11:12.839505+0000","last_unstale":"2023-10-07T00:11:49.728045+0000","last_undegraded":"2023-10-07T00:11:49.728045+0000","last_fullsized":"2023-10-07T00:11:49.728045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:45:50.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726038+0000","last_change":"2023-10-07T00:11:13.839478+0000","last_active":"2023-10-07T00:11:49.726038+0000","last_peered":"2023-10-07T00:11:49.726038+0000","last_clean":"2023-10-07T00:11:49.726038+0000","last_became_active":"2023-10-07T00:11:13.839097+0000","last_became_peered":"2023-10-07T00:11:13.839097+0000","last_unstale":"2023-10-07T00:11:49.726038+0000","last_undegraded":"2023-10-07T00:11:49.726038+0000","last_fullsized":"2023-10-07T00:11:49.726038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:55.668486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729255+0000","last_change":"2023-10-07T00:11:13.839518+0000","last_active":"2023-10-07T00:11:49.729255+0000","last_peered":"2023-10-07T00:11:49.729255+0000","last_clean":"2023-10-07T00:11:49.729255+0000","last_became_active":"2023-10-07T00:11:13.839189+0000","last_became_peered":"2023-10-07T00:11:13.839189+0000","last_unstale":"2023-10-07T00:11:49.729255+0000","last_undegraded":"2023-10-07T00:11:49.729255+0000","last_fullsized":"2023-10-07T00:11:49.729255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:30:34.647955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.738694+0000","last_change":"2023-10-07T00:11:50.738694+0000","last_active":"2023-10-07T00:11:50.738694+0000","last_peered":"2023-10-07T00:11:50.738694+0000","last_clean":"2023-10-07T00:11:50.738694+0000","last_became_active":"2023-10-07T00:11:50.738045+0000","last_became_peered":"2023-10-07T00:11:50.738045+0000","last_unstale":"2023-10-07T00:11:50.738694+0000","last_undegraded":"2023-10-07T00:11:50.738694+0000","last_fullsized":"2023-10-07T00:11:50.738694+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:50.348821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733021+0000","last_change":"2023-10-07T00:11:13.841371+0000","last_active":"2023-10-07T00:11:49.733021+0000","last_peered":"2023-10-07T00:11:49.733021+0000","last_clean":"2023-10-07T00:11:49.733021+0000","last_became_active":"2023-10-07T00:11:13.840986+0000","last_became_peered":"2023-10-07T00:11:13.840986+0000","last_unstale":"2023-10-07T00:11:49.733021+0000","last_undegraded":"2023-10-07T00:11:49.733021+0000","last_fullsized":"2023-10-07T00:11:49.733021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:49.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.725518+0000","last_change":"2023-10-07T00:11:13.844865+0000","last_active":"2023-10-07T00:11:49.725518+0000","last_peered":"2023-10-07T00:11:49.725518+0000","last_clean":"2023-10-07T00:11:49.725518+0000","last_became_active":"2023-10-07T00:11:13.844495+0000","last_became_peered":"2023-10-07T00:11:13.844495+0000","last_unstale":"2023-10-07T00:11:49.725518+0000","last_undegraded":"2023-10-07T00:11:49.725518+0000","last_fullsized":"2023-10-07T00:11:49.725518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:00:29.862865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729329+0000","last_change":"2023-10-07T00:11:13.841126+0000","last_active":"2023-10-07T00:11:49.729329+0000","last_peered":"2023-10-07T00:11:49.729329+0000","last_clean":"2023-10-07T00:11:49.729329+0000","last_became_active":"2023-10-07T00:11:13.840748+0000","last_became_peered":"2023-10-07T00:11:13.840748+0000","last_unstale":"2023-10-07T00:11:49.729329+0000","last_undegraded":"2023-10-07T00:11:49.729329+0000","last_fullsized":"2023-10-07T00:11:49.729329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:55.444456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729091+0000","last_change":"2023-10-07T00:11:13.840320+0000","last_active":"2023-10-07T00:11:49.729091+0000","last_peered":"2023-10-07T00:11:49.729091+0000","last_clean":"2023-10-07T00:11:49.729091+0000","last_became_active":"2023-10-07T00:11:13.839993+0000","last_became_peered":"2023-10-07T00:11:13.839993+0000","last_unstale":"2023-10-07T00:11:49.729091+0000","last_undegraded":"2023-10-07T00:11:49.729091+0000","last_fullsized":"2023-10-07T00:11:49.729091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:29:39.843550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733438+0000","last_change":"2023-10-07T00:11:13.830436+0000","last_active":"2023-10-07T00:11:49.733438+0000","last_peered":"2023-10-07T00:11:49.733438+0000","last_clean":"2023-10-07T00:11:49.733438+0000","last_became_active":"2023-10-07T00:11:13.827974+0000","last_became_peered":"2023-10-07T00:11:13.827974+0000","last_unstale":"2023-10-07T00:11:49.733438+0000","last_undegraded":"2023-10-07T00:11:49.733438+0000","last_fullsized":"2023-10-07T00:11:49.733438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:46.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731293+0000","last_change":"2023-10-07T00:11:13.833929+0000","last_active":"2023-10-07T00:11:49.731293+0000","last_peered":"2023-10-07T00:11:49.731293+0000","last_clean":"2023-10-07T00:11:49.731293+0000","last_became_active":"2023-10-07T00:11:13.833539+0000","last_became_peered":"2023-10-07T00:11:13.833539+0000","last_unstale":"2023-10-07T00:11:49.731293+0000","last_undegraded":"2023-10-07T00:11:49.731293+0000","last_fullsized":"2023-10-07T00:11:49.731293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:46:04.981559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729467+0000","last_change":"2023-10-07T00:11:13.837959+0000","last_active":"2023-10-07T00:11:49.729467+0000","last_peered":"2023-10-07T00:11:49.729467+0000","last_clean":"2023-10-07T00:11:49.729467+0000","last_became_active":"2023-10-07T00:11:13.837650+0000","last_became_peered":"2023-10-07T00:11:13.837650+0000","last_unstale":"2023-10-07T00:11:49.729467+0000","last_undegraded":"2023-10-07T00:11:49.729467+0000","last_fullsized":"2023-10-07T00:11:49.729467+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:41.068847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.730958+0000","last_change":"2023-10-07T00:11:13.847348+0000","last_active":"2023-10-07T00:11:49.730958+0000","last_peered":"2023-10-07T00:11:49.730958+0000","last_clean":"2023-10-07T00:11:49.730958+0000","last_became_active":"2023-10-07T00:11:13.846988+0000","last_became_peered":"2023-10-07T00:11:13.846988+0000","last_unstale":"2023-10-07T00:11:49.730958+0000","last_undegraded":"2023-10-07T00:11:49.730958+0000","last_fullsized":"2023-10-07T00:11:49.730958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.960128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733355+0000","last_change":"2023-10-07T00:11:13.831801+0000","last_active":"2023-10-07T00:11:49.733355+0000","last_peered":"2023-10-07T00:11:49.733355+0000","last_clean":"2023-10-07T00:11:49.733355+0000","last_became_active":"2023-10-07T00:11:13.831497+0000","last_became_peered":"2023-10-07T00:11:13.831497+0000","last_unstale":"2023-10-07T00:11:49.733355+0000","last_undegraded":"2023-10-07T00:11:49.733355+0000","last_fullsized":"2023-10-07T00:11:49.733355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:43.802252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728956+0000","last_change":"2023-10-07T00:11:13.841423+0000","last_active":"2023-10-07T00:11:49.728956+0000","last_peered":"2023-10-07T00:11:49.728956+0000","last_clean":"2023-10-07T00:11:49.728956+0000","last_became_active":"2023-10-07T00:11:13.841115+0000","last_became_peered":"2023-10-07T00:11:13.841115+0000","last_unstale":"2023-10-07T00:11:49.728956+0000","last_undegraded":"2023-10-07T00:11:49.728956+0000","last_fullsized":"2023-10-07T00:11:49.728956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:32.355577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729323+0000","last_change":"2023-10-07T00:11:13.840162+0000","last_active":"2023-10-07T00:11:49.729323+0000","last_peered":"2023-10-07T00:11:49.729323+0000","last_clean":"2023-10-07T00:11:49.729323+0000","last_became_active":"2023-10-07T00:11:13.839760+0000","last_became_peered":"2023-10-07T00:11:13.839760+0000","last_unstale":"2023-10-07T00:11:49.729323+0000","last_undegraded":"2023-10-07T00:11:49.729323+0000","last_fullsized":"2023-10-07T00:11:49.729323+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.727027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248175,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63252,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":480,"num_read_kb":311,"num_write":231,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":57564,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":189756,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351002,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":460230,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":1.024},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.871}]},{"osd":2,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.92800000000000005}]},{"osd":5,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.97099999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.115},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.0369999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":9,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.0900000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.0149999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612638,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":1107593,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":1.161,"15min":1.161},"last":0.58799999999999997}]},{"osd":2,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98099999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.754},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95099999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.62}]},{"osd":3,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.81100000000000005,"15min":0.78300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":6.9649999999999999,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.86199999999999999,"15min":0.82599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":9.3580000000000005,"5min":9.3580000000000005,"15min":9.3580000000000005},"last":0.77400000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88600000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0229999999999999,"5min":1.226,"15min":1.226},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83799999999999997,"15min":0.84599999999999997},"min":{"1min":0.60699999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.96799999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.878},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.046,"5min":1.29,"15min":1.29},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.91600000000000004,"15min":0.93400000000000005},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.016,"5min":1.242,"15min":1.242},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56499999999999995}]},{"osd":8,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.96399999999999997,"15min":0.97899999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0840000000000001,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.105,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.82099999999999995}]},{"osd":9,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1,"15min":1.002},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96799999999999997,"15min":0.97199999999999998},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.84399999999999997}]},{"osd":11,"last update":"Sat Oct 7 00:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.871}]}]},{"osd":9,"up_from":68,"seq":292057776163,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":460048,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.67400000000000004}]},{"osd":1,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95999999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0580000000000001,"5min":1.149,"15min":1.149},"last":0.71099999999999997}]},{"osd":2,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.71299999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86599999999999999,"5min":1.137,"15min":1.137},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.57599999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.89300000000000002}]},{"osd":3,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.59899999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.89700000000000002,"15min":0.90900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.962,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.876,"15min":0.878},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.079,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.03,"5min":2.214,"15min":2.214},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.90700000000000003,"15min":0.91900000000000004},"min":{"1min":0.50900000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96999999999999997,"15min":0.97099999999999997},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1179999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.74199999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96599999999999997,"15min":0.97699999999999998},"min":{"1min":0.58999999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.98999999999999999,"15min":0.998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.91300000000000003}]},{"osd":10,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.751,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.97399999999999998,"15min":0.96699999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.876}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":8,"up_from":60,"seq":257698037801,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":460314,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88900000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.47999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.89800000000000002,"5min":1.117,"15min":1.117},"last":1.147}]},{"osd":1,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.749},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.59899999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95899999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.073,"15min":1.073},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.877,"5min":1.498,"15min":1.498},"last":0.89600000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.438,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":1.095},{"interface":"front","average":{"1min":0.628,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.97999999999999998}]},{"osd":6,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90400000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93799999999999994,"5min":1.389,"15min":1.389},"last":1.2310000000000001}]},{"osd":7,"last update":"Sat Oct 7 00:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.85499999999999998},"min":{"1min":0.63600000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.071}]},{"osd":9,"last update":"Sat Oct 7 00:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1779999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.042,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.133}]},{"osd":10,"last update":"Sat Oct 7 00:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.69999999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.052},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.89700000000000002},"min":{"1min":0.71899999999999997,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2030000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.304}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299437,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":1052618,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77600000000000002,"5min":1.149,"15min":1.149},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0249999999999999,"5min":1.163,"15min":1.163},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.749},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88200000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.94599999999999995}]},{"osd":3,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0529999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96399999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.747}]},{"osd":4,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89200000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0780000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.623}]},{"osd":5,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.80000000000000004},"min":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.028,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.891,"15min":1.891},"last":1.0609999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0780000000000001,"5min":1.147,"15min":1.147},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.177,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.67600000000000005}]},{"osd":8,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.80100000000000005},"min":{"1min":0.72999999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0089999999999999,"5min":1.252,"15min":1.252},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.84099999999999997,"15min":0.81299999999999994},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1639999999999999,"5min":1.234,"15min":1.234},"last":0.96899999999999997}]},{"osd":9,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.875,"15min":0.873},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.236,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.032}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.208,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.92700000000000005,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0980000000000001,"5min":1.919,"15min":1.919},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]}]},{"osd":6,"up_from":47,"seq":201863462963,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":459771,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60099999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74199999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.53400000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0880000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76800000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.84599999999999997}]},{"osd":3,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98999999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.92200000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.325,"15min":1.325},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.153,"5min":1.405,"15min":1.405},"last":0.873}]},{"osd":5,"last update":"Sat Oct 7 00:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":1.208,"15min":1.208},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97799999999999998,"5min":1.292,"15min":1.292},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Oct 7 00:11:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.84299999999999997},"min":{"1min":0.58999999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98499999999999999,"5min":1.419,"15min":1.419},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84199999999999997,"15min":0.83399999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.96099999999999997,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.69899999999999995}]},{"osd":8,"last update":"Sat Oct 7 00:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.877,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89000000000000001,"15min":0.89500000000000002},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0089999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.63300000000000001}]},{"osd":9,"last update":"Sat Oct 7 00:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.93100000000000005,"15min":0.95099999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1419999999999999,"5min":1.409,"15min":1.409},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0049999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.73799999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92600000000000005,"15min":0.93400000000000005},"min":{"1min":0.69999999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0589999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.26,"5min":1.0640000000000001,"15min":1.0309999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":517857,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.32700000000000001},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":3.851,"5min":3.851,"15min":3.851},"last":0.63100000000000001}]},{"osd":2,"last update":"Sat Oct 7 00:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.65700000000000003,"15min":0.57899999999999996},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65100000000000002,"15min":0.60499999999999998},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90600000000000003,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.90600000000000003}]},{"osd":3,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.70699999999999996,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.58199999999999996}]},{"osd":4,"last update":"Sat Oct 7 00:11:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.53200000000000003,"15min":0.49399999999999999},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.51200000000000001},"min":{"1min":0.41899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.80900000000000005}]},{"osd":5,"last update":"Sat Oct 7 00:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.74199999999999999,"15min":0.68700000000000006},"min":{"1min":0.56499999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.67300000000000004},"min":{"1min":0.68700000000000006,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.98599999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:11:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0349999999999999,"5min":1.107,"15min":1.107},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.503,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Oct 7 00:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69699999999999995,"15min":0.68000000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.022}]},{"osd":8,"last update":"Sat Oct 7 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.88100000000000001,"15min":0.84499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.79500000000000004,"15min":0.76900000000000002},"min":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.86199999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.749,"5min":0.503,"15min":0.503},"max":{"1min":1.036,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":1.002}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.85999999999999999,"15min":0.84999999999999998},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.872,"15min":0.85799999999999998},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.101}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":460831,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 00:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.502,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97599999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.746}]},{"osd":2,"last update":"Sat Oct 7 00:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88400000000000001,"5min":1.024,"15min":1.024},"last":0.78000000000000003}]},{"osd":3,"last update":"Sat Oct 7 00:09:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.432}]},{"osd":4,"last update":"Sat Oct 7 00:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97499999999999998,"5min":1.113,"15min":1.113},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64300000000000002,"15min":0.621},"min":{"1min":0.502,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0629999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.627},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.77200000000000002,"15min":0.73199999999999998},"min":{"1min":0.55800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":0.875}]},{"osd":6,"last update":"Sat Oct 7 00:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.51100000000000001}]},{"osd":7,"last update":"Sat Oct 7 00:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.60999999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.85599999999999998}]},{"osd":9,"last update":"Sat Oct 7 00:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.874,"15min":0.88800000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2769999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.097,"5min":1.284,"15min":1.284},"last":0.49099999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.95799999999999996,"15min":0.92800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.71399999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.67700000000000005}]},{"osd":11,"last update":"Sat Oct 7 00:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.79200000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":460276,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.439},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97399999999999998,"5min":1.048,"15min":1.048},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.66800000000000004,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.97399999999999998,"5min":1.006,"15min":1.006},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.61099999999999999},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.69199999999999995}]},{"osd":3,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.48199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.0189999999999999,"5min":1.022,"15min":1.022},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.63800000000000001},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47199999999999998}]},{"osd":4,"last update":"Sat Oct 7 00:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.48599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.002}]},{"osd":5,"last update":"Sat Oct 7 00:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.62,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0760000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Sat Oct 7 00:11:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.60099999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98299999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90100000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Sat Oct 7 00:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.81200000000000006},"min":{"1min":0.60099999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91200000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.53900000000000003}]},{"osd":8,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.51000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.54800000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1240000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81699999999999995}]},{"osd":9,"last update":"Sat Oct 7 00:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.72399999999999998,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1479999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.80600000000000005,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0700000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.80500000000000005}]},{"osd":10,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.84199999999999997,"15min":0.82599999999999996},"min":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.91300000000000003,"15min":0.89400000000000002},"min":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.94699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":459271,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.41699999999999998},"min":{"1min":0.32800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.438},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.48599999999999999,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.48299999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88900000000000001,"5min":1.042,"15min":1.042},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.67100000000000004,"15min":0.621},"min":{"1min":0.51300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.83399999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":1.284,"15min":1.284},"last":0.61299999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.53100000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72399999999999998,"15min":0.68799999999999994},"min":{"1min":0.59799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0660000000000001,"5min":1.169,"15min":1.169},"last":0.98799999999999999}]},{"osd":5,"last update":"Sat Oct 7 00:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.745,"15min":0.70499999999999996},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0569999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.55500000000000005,"5min":0.442,"15min":0.442},"max":{"1min":1.175,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.64400000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0920000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.71799999999999997,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.69399999999999995}]},{"osd":7,"last update":"Sat Oct 7 00:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.755,"15min":0.73299999999999998},"min":{"1min":0.55800000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.014}]},{"osd":8,"last update":"Sat Oct 7 00:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.89400000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.052,"5min":1.103,"15min":1.103},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.746}]},{"osd":9,"last update":"Sat Oct 7 00:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90200000000000002,"15min":0.90800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.198,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.038},{"interface":"front","average":{"1min":0.87,"5min":0.878,"15min":0.88},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.79400000000000004}]},{"osd":10,"last update":"Sat Oct 7 00:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.94899999999999995,"15min":0.96599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.171,"5min":1.272,"15min":1.272},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91500000000000004,"15min":0.90900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0780000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888126,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":515793,"data_compressed":14696,"data_compressed_allocated":20480,"data_compressed_original":69632,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56100000000000005,"15min":0.54300000000000004},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.47499999999999998},"min":{"1min":0.378,"5min":0.308,"15min":0.308},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.435}]},{"osd":2,"last update":"Sat Oct 7 00:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.54700000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97599999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.123}]},{"osd":3,"last update":"Sat Oct 7 00:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.52400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.79500000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69899999999999995,"15min":0.68100000000000005},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96699999999999997,"5min":1.04,"15min":1.04},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.70499999999999996},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.0549999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.0669999999999999}]},{"osd":6,"last update":"Sat Oct 7 00:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.71699999999999997,"15min":0.69499999999999995},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0309999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70299999999999996,"15min":0.69199999999999995},"min":{"1min":0.52000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.88800000000000001}]},{"osd":7,"last update":"Sat Oct 7 00:11:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0960000000000001,"5min":1.139,"15min":1.139},"last":0.746},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72199999999999998,"15min":0.69999999999999996},"min":{"1min":0.59899999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96899999999999997,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.98399999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.3759999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.67400000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.70199999999999996}]},{"osd":9,"last update":"Sat Oct 7 00:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88600000000000001,"15min":0.88400000000000001},"min":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.153,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84599999999999997,"15min":0.84999999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0600000000000001,"5min":1.101,"15min":1.101},"last":0.84799999999999998}]},{"osd":10,"last update":"Sat Oct 7 00:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.86099999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.181},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.77600000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":5,"up_from":39,"seq":167503724600,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":1052296,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63500000000000001,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":1.147,"15min":1.147},"last":0.51900000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.746,"15min":0.81699999999999995},"min":{"1min":0.52600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.88600000000000001,"5min":5.96,"15min":5.96},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.67000000000000004,"15min":0.626},"min":{"1min":0.55500000000000005,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.84899999999999998}]},{"osd":2,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.36499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78300000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.496},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.44500000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":1.052,"15min":1.052},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88900000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.623}]},{"osd":4,"last update":"Sat Oct 7 00:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70999999999999996,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.997,"5min":1.093,"15min":1.093},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.80500000000000005,"15min":0.91100000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.875,"5min":5.9100000000000001,"15min":5.9100000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.50700000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.90300000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Sat Oct 7 00:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.78200000000000003,"15min":0.77000000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99099999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.95699999999999996}]},{"osd":8,"last update":"Sat Oct 7 00:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82799999999999996}]},{"osd":9,"last update":"Sat Oct 7 00:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85299999999999998,"15min":0.85899999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.302,"15min":1.302},"last":0.87},{"interface":"front","average":{"1min":0.874,"5min":0.89100000000000001,"15min":0.89400000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1200000000000001,"5min":1.208,"15min":1.208},"last":0.93100000000000005}]},{"osd":10,"last update":"Sat Oct 7 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88600000000000001,"15min":0.89200000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.91600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":57140,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T00:12:08.938 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-07T00:12:08.938 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-07T00:12:08.938 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-07T00:12:08.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-07T00:12:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:08 smithi005 ceph-mon[129406]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:08 smithi088 ceph-mon[103111]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:08 smithi112 ceph-mon[133548]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:10.070 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:09 smithi005 ceph-mon[129406]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:12:10.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:09 smithi088 ceph-mon[103111]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:12:10.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:09 smithi112 ceph-mon[133548]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:12:10.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:10 smithi005 ceph-mon[129406]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-07T00:12:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 -- 172.21.15.5:0/1557070860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238100f80 msgr2=0x7f4238101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 --2- 172.21.15.5:0/1557070860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238100f80 0x7f4238101400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f422c0099c0 tx=0x7f422c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 -- 172.21.15.5:0/1557070860 shutdown_connections 2023-10-07T00:12:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 --2- 172.21.15.5:0/1557070860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4238101940 0x7f423810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 --2- 172.21.15.5:0/1557070860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4238106f90 0x7f4238107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 --2- 172.21.15.5:0/1557070860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238100f80 0x7f4238101400 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 -- 172.21.15.5:0/1557070860 >> 172.21.15.5:0/1557070860 conn(0x7f42380780a0 msgr2=0x7f42380784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 -- 172.21.15.5:0/1557070860 shutdown_connections 2023-10-07T00:12:11.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.184+0000 7f423d012700 1 -- 172.21.15.5:0/1557070860 wait complete. 2023-10-07T00:12:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.185+0000 7f423d012700 1 Processor -- start 2023-10-07T00:12:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.185+0000 7f423d012700 1 -- start start 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f423d012700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4238100f80 0x7f42380731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f423d012700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4238101940 0x7f42380736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f423d012700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238106f90 0x7f42381a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f423d012700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4238073fe0 con 0x7f4238106f90 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f423d012700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42381a55e0 con 0x7f4238100f80 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f423d012700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42381a5750 con 0x7f4238101940 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f4236d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4238100f80 0x7f42380731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f423759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238106f90 0x7f42381a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f4236d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4238100f80 0x7f42380731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:41042/0 (socket says 172.21.15.5:41042) 2023-10-07T00:12:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f4236d9d700 1 -- 172.21.15.5:0/632958473 learned_addr learned my addr 172.21.15.5:0/632958473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.186+0000 7f423659c700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4238101940 0x7f42380736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f423759e700 1 -- 172.21.15.5:0/632958473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4238101940 msgr2=0x7f42380736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f423759e700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4238101940 0x7f42380736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f423759e700 1 -- 172.21.15.5:0/632958473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4238100f80 msgr2=0x7f42380731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f423759e700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4238100f80 0x7f42380731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f423759e700 1 -- 172.21.15.5:0/632958473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0095f0 con 0x7f4238106f90 2023-10-07T00:12:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f423759e700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238106f90 0x7f42381a50a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4230007f10 tx=0x7f423000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:11.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f421ffff700 1 -- 172.21.15.5:0/632958473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230004db0 con 0x7f4238106f90 2023-10-07T00:12:11.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42381a59d0 con 0x7f4238106f90 2023-10-07T00:12:11.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f421ffff700 1 -- 172.21.15.5:0/632958473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f423000f040 con 0x7f4238106f90 2023-10-07T00:12:11.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.187+0000 7f421ffff700 1 -- 172.21.15.5:0/632958473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230005850 con 0x7f4238106f90 2023-10-07T00:12:11.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.188+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42381a5ef0 con 0x7f4238106f90 2023-10-07T00:12:11.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.189+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423804ebb0 con 0x7f4238106f90 2023-10-07T00:12:11.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.191+0000 7f421ffff700 1 -- 172.21.15.5:0/632958473 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f423000db20 con 0x7f4238106f90 2023-10-07T00:12:11.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.192+0000 7f421ffff700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42200a1510 0x7f42200a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:11.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.192+0000 7f421ffff700 1 -- 172.21.15.5:0/632958473 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f42300cce70 con 0x7f4238106f90 2023-10-07T00:12:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.192+0000 7f4236d9d700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42200a1510 0x7f42200a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.193+0000 7f4236d9d700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42200a1510 0x7f42200a39d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4228005950 tx=0x7f422800b500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.195+0000 7f421ffff700 1 -- 172.21.15.5:0/632958473 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f42300962f0 con 0x7f4238106f90 2023-10-07T00:12:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:10 smithi088 ceph-mon[103111]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-07T00:12:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:10 smithi112 ceph-mon[133548]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-07T00:12:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.448+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f42380746e0 con 0x7f4238106f90 2023-10-07T00:12:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.449+0000 7f421ffff700 1 -- 172.21.15.5:0/632958473 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4230023080 con 0x7f4238106f90 2023-10-07T00:12:11.450 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:11.450 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42200a1510 msgr2=0x7f42200a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42200a1510 0x7f42200a39d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4228005950 tx=0x7f422800b500 comp rx=0 tx=0).stop 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238106f90 msgr2=0x7f42381a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238106f90 0x7f42381a50a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4230007f10 tx=0x7f423000d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 shutdown_connections 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42200a1510 0x7f42200a39d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4238106f90 0x7f42381a50a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4238100f80 0x7f42380731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 --2- 172.21.15.5:0/632958473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4238101940 0x7f42380736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 >> 172.21.15.5:0/632958473 conn(0x7f42380780a0 msgr2=0x7f42380ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.451+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 shutdown_connections 2023-10-07T00:12:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:11.452+0000 7f423d012700 1 -- 172.21.15.5:0/632958473 wait complete. 2023-10-07T00:12:11.956 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-07T00:12:11.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:12.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:11 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/632958473' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-07T00:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 -- 172.21.15.5:0/3225661117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33541021a0 msgr2=0x7f3354102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3225661117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33541021a0 0x7f3354102600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33440099c0 tx=0x7f3344009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 -- 172.21.15.5:0/3225661117 shutdown_connections 2023-10-07T00:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3225661117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3354102b40 0x7f33541093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3225661117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3354100fb0 0x7f33541013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3225661117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33541021a0 0x7f3354102600 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 -- 172.21.15.5:0/3225661117 >> 172.21.15.5:0/3225661117 conn(0x7f33540fc520 msgr2=0x7f33540fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 -- 172.21.15.5:0/3225661117 shutdown_connections 2023-10-07T00:12:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.163+0000 7f335b7ff700 1 -- 172.21.15.5:0/3225661117 wait complete. 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.164+0000 7f335b7ff700 1 Processor -- start 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335b7ff700 1 -- start start 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335b7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3354100fb0 0x7f3354198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335b7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33541021a0 0x7f3354199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335b7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3354102b40 0x7f33541a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335b7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33541a0950 con 0x7f3354102b40 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335b7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33541a0a90 con 0x7f33541021a0 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335b7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33541a0c20 con 0x7f3354100fb0 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f3359d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3354102b40 0x7f33541a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3354100fb0 0x7f3354198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3354100fb0 0x7f3354198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:57188/0 (socket says 172.21.15.5:57188) 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f335959b700 1 -- 172.21.15.5:0/3393785415 learned_addr learned my addr 172.21.15.5:0/3393785415 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.165+0000 7f3358d9a700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33541021a0 0x7f3354199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f3359d9c700 1 -- 172.21.15.5:0/3393785415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3354100fb0 msgr2=0x7f3354198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f3359d9c700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3354100fb0 0x7f3354198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f3359d9c700 1 -- 172.21.15.5:0/3393785415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33541021a0 msgr2=0x7f3354199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f3359d9c700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33541021a0 0x7f3354199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f3359d9c700 1 -- 172.21.15.5:0/3393785415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440095f0 con 0x7f3354102b40 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f3359d9c700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3354102b40 0x7f33541a0380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f334c007f10 tx=0x7f334c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f334a7fc700 1 -- 172.21.15.5:0/3393785415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c004db0 con 0x7f3354102b40 2023-10-07T00:12:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f334a7fc700 1 -- 172.21.15.5:0/3393785415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334c00f040 con 0x7f3354102b40 2023-10-07T00:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33541a0f00 con 0x7f3354102b40 2023-10-07T00:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f334a7fc700 1 -- 172.21.15.5:0/3393785415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c005960 con 0x7f3354102b40 2023-10-07T00:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.166+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33541a1330 con 0x7f3354102b40 2023-10-07T00:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.167+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33541934b0 con 0x7f3354102b40 2023-10-07T00:12:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.169+0000 7f334a7fc700 1 -- 172.21.15.5:0/3393785415 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f334c00db20 con 0x7f3354102b40 2023-10-07T00:12:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.171+0000 7f334a7fc700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33400a1510 0x7f33400a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.171+0000 7f334a7fc700 1 -- 172.21.15.5:0/3393785415 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f334c0cc6e0 con 0x7f3354102b40 2023-10-07T00:12:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.171+0000 7f335959b700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33400a1510 0x7f33400a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:12.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.172+0000 7f335959b700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33400a1510 0x7f33400a39d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f335000ace0 tx=0x7f335000a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.174+0000 7f334a7fc700 1 -- 172.21.15.5:0/3393785415 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f334c04f100 con 0x7f3354102b40 2023-10-07T00:12:12.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:11 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/632958473' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-07T00:12:12.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:11 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/632958473' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-07T00:12:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.387+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f335410c910 con 0x7f3354102b40 2023-10-07T00:12:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.388+0000 7f334a7fc700 1 -- 172.21.15.5:0/3393785415 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f334c095b60 con 0x7f3354102b40 2023-10-07T00:12:12.390 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:12.390 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33400a1510 msgr2=0x7f33400a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33400a1510 0x7f33400a39d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f335000ace0 tx=0x7f335000a430 comp rx=0 tx=0).stop 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3354102b40 msgr2=0x7f33541a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3354102b40 0x7f33541a0380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f334c007f10 tx=0x7f334c00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 shutdown_connections 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33400a1510 0x7f33400a39d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3354102b40 0x7f33541a0380 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3354100fb0 0x7f3354198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 --2- 172.21.15.5:0/3393785415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33541021a0 0x7f3354199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 >> 172.21.15.5:0/3393785415 conn(0x7f33540fc520 msgr2=0x7f3354107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 shutdown_connections 2023-10-07T00:12:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.391+0000 7f335b7ff700 1 -- 172.21.15.5:0/3393785415 wait complete. 2023-10-07T00:12:12.413 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:12:12.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:12:12.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 -- 172.21.15.5:0/1999273562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 msgr2=0x7f8e5c102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 --2- 172.21.15.5:0/1999273562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 0x7f8e5c102610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8e500099c0 tx=0x7f8e50009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 -- 172.21.15.5:0/1999273562 shutdown_connections 2023-10-07T00:12:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 --2- 172.21.15.5:0/1999273562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e5c102b50 0x7f8e5c109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 --2- 172.21.15.5:0/1999273562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5c100fc0 0x7f8e5c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 --2- 172.21.15.5:0/1999273562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 0x7f8e5c102610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 -- 172.21.15.5:0/1999273562 >> 172.21.15.5:0/1999273562 conn(0x7f8e5c0fc530 msgr2=0x7f8e5c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 -- 172.21.15.5:0/1999273562 shutdown_connections 2023-10-07T00:12:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.617+0000 7f8e623ff700 1 -- 172.21.15.5:0/1999273562 wait complete. 2023-10-07T00:12:12.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.618+0000 7f8e623ff700 1 Processor -- start 2023-10-07T00:12:12.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.618+0000 7f8e623ff700 1 -- start start 2023-10-07T00:12:12.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e623ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e5c100fc0 0x7f8e5c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e623ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 0x7f8e5c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e623ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5c102b50 0x7f8e5c1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e623ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1a0950 con 0x7f8e5c1021b0 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e623ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1a0a90 con 0x7f8e5c102b50 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e623ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1a0c20 con 0x7f8e5c100fc0 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 0x7f8e5c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 0x7f8e5c199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34550/0 (socket says 172.21.15.5:34550) 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5b7fe700 1 -- 172.21.15.5:0/842988768 learned_addr learned my addr 172.21.15.5:0/842988768 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5bfff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e5c100fc0 0x7f8e5c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:12.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e6099c700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5c102b50 0x7f8e5c1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5b7fe700 1 -- 172.21.15.5:0/842988768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e5c100fc0 msgr2=0x7f8e5c198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5b7fe700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e5c100fc0 0x7f8e5c198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5b7fe700 1 -- 172.21.15.5:0/842988768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5c102b50 msgr2=0x7f8e5c1a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5b7fe700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5c102b50 0x7f8e5c1a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.619+0000 7f8e5b7fe700 1 -- 172.21.15.5:0/842988768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500095f0 con 0x7f8e5c1021b0 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.620+0000 7f8e5b7fe700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 0x7f8e5c199310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8e50000c00 tx=0x7f8e5000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.620+0000 7f8e597fa700 1 -- 172.21.15.5:0/842988768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5001d070 con 0x7f8e5c1021b0 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.620+0000 7f8e597fa700 1 -- 172.21.15.5:0/842988768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5000fdc0 con 0x7f8e5c1021b0 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.620+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c1a0ea0 con 0x7f8e5c1021b0 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.620+0000 7f8e597fa700 1 -- 172.21.15.5:0/842988768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e500173f0 con 0x7f8e5c1021b0 2023-10-07T00:12:12.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.620+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c1a1260 con 0x7f8e5c1021b0 2023-10-07T00:12:12.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.621+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c10c6e0 con 0x7f8e5c1021b0 2023-10-07T00:12:12.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.623+0000 7f8e597fa700 1 -- 172.21.15.5:0/842988768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f8e50022470 con 0x7f8e5c1021b0 2023-10-07T00:12:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.625+0000 7f8e597fa700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8e440a1510 0x7f8e440a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.625+0000 7f8e597fa700 1 -- 172.21.15.5:0/842988768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8e500cdf50 con 0x7f8e5c1021b0 2023-10-07T00:12:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.625+0000 7f8e5bfff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8e440a1510 0x7f8e440a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.626+0000 7f8e5bfff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8e440a1510 0x7f8e440a39d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c102010 tx=0x7f8e4c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:12.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.629+0000 7f8e597fa700 1 -- 172.21.15.5:0/842988768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8e5005d100 con 0x7f8e5c1021b0 2023-10-07T00:12:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.842+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e5c1a1510 con 0x7f8e5c1021b0 2023-10-07T00:12:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.842+0000 7f8e597fa700 1 -- 172.21.15.5:0/842988768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e50097580 con 0x7f8e5c1021b0 2023-10-07T00:12:12.843 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:12:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.844+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8e440a1510 msgr2=0x7f8e440a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.844+0000 7f8e623ff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8e440a1510 0x7f8e440a39d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c102010 tx=0x7f8e4c00b410 comp rx=0 tx=0).stop 2023-10-07T00:12:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 msgr2=0x7f8e5c199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 0x7f8e5c199310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8e50000c00 tx=0x7f8e5000fa00 comp rx=0 tx=0).stop 2023-10-07T00:12:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 shutdown_connections 2023-10-07T00:12:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8e440a1510 0x7f8e440a39d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5c102b50 0x7f8e5c1a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e5c100fc0 0x7f8e5c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 --2- 172.21.15.5:0/842988768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e5c1021b0 0x7f8e5c199310 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 >> 172.21.15.5:0/842988768 conn(0x7f8e5c0fc530 msgr2=0x7f8e5c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 shutdown_connections 2023-10-07T00:12:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:12.845+0000 7f8e623ff700 1 -- 172.21.15.5:0/842988768 wait complete. 2023-10-07T00:12:12.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:12:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 -- 172.21.15.5:0/2114289463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8100fc0 msgr2=0x7f2ed81013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/2114289463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8100fc0 0x7f2ed81013e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40099c0 tx=0x7f2ed4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 -- 172.21.15.5:0/2114289463 shutdown_connections 2023-10-07T00:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/2114289463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed8102b50 0x7f2ed8109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/2114289463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8100fc0 0x7f2ed81013e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/2114289463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ed81021b0 0x7f2ed8102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 -- 172.21.15.5:0/2114289463 >> 172.21.15.5:0/2114289463 conn(0x7f2ed80fc530 msgr2=0x7f2ed80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 -- 172.21.15.5:0/2114289463 shutdown_connections 2023-10-07T00:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.070+0000 7f2ee07ff700 1 -- 172.21.15.5:0/2114289463 wait complete. 2023-10-07T00:12:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.071+0000 7f2ee07ff700 1 Processor -- start 2023-10-07T00:12:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.071+0000 7f2ee07ff700 1 -- start start 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.071+0000 7f2ee07ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ed8100fc0 0x7f2ed8074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.071+0000 7f2ee07ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed81021b0 0x7f2ed80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.071+0000 7f2ee07ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8102b50 0x7f2ed80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.071+0000 7f2ee07ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8073f80 con 0x7f2ed8102b50 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.071+0000 7f2ee07ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80740f0 con 0x7f2ed81021b0 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.071+0000 7f2ee07ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81a0cd0 con 0x7f2ed8100fc0 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8102b50 0x7f2ed80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8102b50 0x7f2ed80737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34572/0 (socket says 172.21.15.5:34572) 2023-10-07T00:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 -- 172.21.15.5:0/1319503148 learned_addr learned my addr 172.21.15.5:0/1319503148 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2ede59b700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ed8100fc0 0x7f2ed8074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eddd9a700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed81021b0 0x7f2ed80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 -- 172.21.15.5:0/1319503148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ed8100fc0 msgr2=0x7f2ed8074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ed8100fc0 0x7f2ed8074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 -- 172.21.15.5:0/1319503148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed81021b0 msgr2=0x7f2ed80732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed81021b0 0x7f2ed80732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 -- 172.21.15.5:0/1319503148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40095f0 con 0x7f2ed8102b50 2023-10-07T00:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eddd9a700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed81021b0 0x7f2ed80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.072+0000 7f2eded9c700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8102b50 0x7f2ed80737e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000b970 tx=0x7f2ed000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.073+0000 7f2ecf7fe700 1 -- 172.21.15.5:0/1319503148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000c930 con 0x7f2ed8102b50 2023-10-07T00:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.073+0000 7f2ecf7fe700 1 -- 172.21.15.5:0/1319503148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ed0014440 con 0x7f2ed8102b50 2023-10-07T00:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.073+0000 7f2ecf7fe700 1 -- 172.21.15.5:0/1319503148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00075d0 con 0x7f2ed8102b50 2023-10-07T00:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.073+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed81a0fb0 con 0x7f2ed8102b50 2023-10-07T00:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.073+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed81a13e0 con 0x7f2ed8102b50 2023-10-07T00:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.074+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8107f70 con 0x7f2ed8102b50 2023-10-07T00:12:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.076+0000 7f2ecf7fe700 1 -- 172.21.15.5:0/1319503148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f2ed00145b0 con 0x7f2ed8102b50 2023-10-07T00:12:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.077+0000 7f2ecf7fe700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2ec40a1590 0x7f2ec40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.077+0000 7f2ecf7fe700 1 -- 172.21.15.5:0/1319503148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2ed0006e40 con 0x7f2ed8102b50 2023-10-07T00:12:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.077+0000 7f2ede59b700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2ec40a1590 0x7f2ec40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.078+0000 7f2ede59b700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2ec40a1590 0x7f2ec40a3a50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4006010 tx=0x7f2ed4005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.081+0000 7f2ecf7fe700 1 -- 172.21.15.5:0/1319503148 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2ed0095bb0 con 0x7f2ed8102b50 2023-10-07T00:12:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:12 smithi005 ceph-mon[129406]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-10-07T00:12:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:12 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3393785415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:12 smithi088 ceph-mon[103111]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-10-07T00:12:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:12 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3393785415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:12 smithi112 ceph-mon[133548]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-10-07T00:12:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:12 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3393785415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.296+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ed810c9e0 con 0x7f2ed8102b50 2023-10-07T00:12:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.296+0000 7f2ecf7fe700 1 -- 172.21.15.5:0/1319503148 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ed00991d0 con 0x7f2ed8102b50 2023-10-07T00:12:13.298 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:12:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.298+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2ec40a1590 msgr2=0x7f2ec40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.298+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2ec40a1590 0x7f2ec40a3a50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4006010 tx=0x7f2ed4005e80 comp rx=0 tx=0).stop 2023-10-07T00:12:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.298+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8102b50 msgr2=0x7f2ed80737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.298+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8102b50 0x7f2ed80737e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000b970 tx=0x7f2ed000bc80 comp rx=0 tx=0).stop 2023-10-07T00:12:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.299+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 shutdown_connections 2023-10-07T00:12:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.299+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2ec40a1590 0x7f2ec40a3a50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.299+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ed8102b50 0x7f2ed80737e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.299+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ed8100fc0 0x7f2ed8074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.299+0000 7f2ee07ff700 1 --2- 172.21.15.5:0/1319503148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed81021b0 0x7f2ed80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.299+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 >> 172.21.15.5:0/1319503148 conn(0x7f2ed80fc530 msgr2=0x7f2ed80fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.299+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 shutdown_connections 2023-10-07T00:12:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.299+0000 7f2ee07ff700 1 -- 172.21.15.5:0/1319503148 wait complete. 2023-10-07T00:12:13.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:12:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 -- 172.21.15.5:0/3154141811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d01021b0 msgr2=0x7fb2d0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/3154141811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d01021b0 0x7fb2d0102610 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40099c0 tx=0x7fb2c4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 -- 172.21.15.5:0/3154141811 shutdown_connections 2023-10-07T00:12:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/3154141811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d0102b50 0x7fb2d0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/3154141811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2d0100fc0 0x7fb2d01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/3154141811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d01021b0 0x7fb2d0102610 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 -- 172.21.15.5:0/3154141811 >> 172.21.15.5:0/3154141811 conn(0x7fb2d00fc530 msgr2=0x7fb2d00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 -- 172.21.15.5:0/3154141811 shutdown_connections 2023-10-07T00:12:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.523+0000 7fb2d4dff700 1 -- 172.21.15.5:0/3154141811 wait complete. 2023-10-07T00:12:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.524+0000 7fb2d4dff700 1 Processor -- start 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.524+0000 7fb2d4dff700 1 -- start start 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2d4dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2d0100fc0 0x7fb2d0198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2d4dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01021b0 0x7fb2d0199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2d4dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d0102b50 0x7fb2d01a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2d4dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d01a09a0 con 0x7fb2d0102b50 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2d4dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d01a0ae0 con 0x7fb2d0100fc0 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2d4dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d01a0c70 con 0x7fb2d01021b0 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ced9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d0102b50 0x7fb2d01a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ced9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d0102b50 0x7fb2d01a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34592/0 (socket says 172.21.15.5:34592) 2023-10-07T00:12:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ced9d700 1 -- 172.21.15.5:0/177520946 learned_addr learned my addr 172.21.15.5:0/177520946 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ce59c700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2d0100fc0 0x7fb2d0198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2cdd9b700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01021b0 0x7fb2d0199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ced9d700 1 -- 172.21.15.5:0/177520946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01021b0 msgr2=0x7fb2d0199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ced9d700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01021b0 0x7fb2d0199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ced9d700 1 -- 172.21.15.5:0/177520946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2d0100fc0 msgr2=0x7fb2d0198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ced9d700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2d0100fc0 0x7fb2d0198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.525+0000 7fb2ced9d700 1 -- 172.21.15.5:0/177520946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c40095f0 con 0x7fb2d0102b50 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.526+0000 7fb2ced9d700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d0102b50 0x7fb2d01a03d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8007ee0 tx=0x7fb2c800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.526+0000 7fb2bf7fe700 1 -- 172.21.15.5:0/177520946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8017070 con 0x7fb2d0102b50 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.526+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d01a0f50 con 0x7fb2d0102b50 2023-10-07T00:12:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.526+0000 7fb2bf7fe700 1 -- 172.21.15.5:0/177520946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2c800f040 con 0x7fb2d0102b50 2023-10-07T00:12:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.526+0000 7fb2bf7fe700 1 -- 172.21.15.5:0/177520946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8005570 con 0x7fb2d0102b50 2023-10-07T00:12:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.526+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d01a1380 con 0x7fb2d0102b50 2023-10-07T00:12:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.527+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d010c6e0 con 0x7fb2d0102b50 2023-10-07T00:12:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.529+0000 7fb2bf7fe700 1 -- 172.21.15.5:0/177520946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb2c800db20 con 0x7fb2d0102b50 2023-10-07T00:12:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.530+0000 7fb2bf7fe700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb2b80a1510 0x7fb2b80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.530+0000 7fb2bf7fe700 1 -- 172.21.15.5:0/177520946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb2c80cc670 con 0x7fb2d0102b50 2023-10-07T00:12:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.531+0000 7fb2ce59c700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb2b80a1510 0x7fb2b80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.531+0000 7fb2ce59c700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb2b80a1510 0x7fb2b80a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0102010 tx=0x7fb2c000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:13.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.534+0000 7fb2bf7fe700 1 -- 172.21.15.5:0/177520946 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2c8095af0 con 0x7fb2d0102b50 2023-10-07T00:12:13.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.744+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2d01a1570 con 0x7fb2d0102b50 2023-10-07T00:12:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.745+0000 7fb2bf7fe700 1 -- 172.21.15.5:0/177520946 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2c8099110 con 0x7fb2d0102b50 2023-10-07T00:12:13.746 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:12:13.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb2b80a1510 msgr2=0x7fb2b80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb2b80a1510 0x7fb2b80a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0102010 tx=0x7fb2c000b410 comp rx=0 tx=0).stop 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d0102b50 msgr2=0x7fb2d01a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d0102b50 0x7fb2d01a03d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8007ee0 tx=0x7fb2c800d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 shutdown_connections 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb2b80a1510 0x7fb2b80a39d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d0102b50 0x7fb2d01a03d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2d0100fc0 0x7fb2d0198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 --2- 172.21.15.5:0/177520946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01021b0 0x7fb2d0199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 >> 172.21.15.5:0/177520946 conn(0x7fb2d00fc530 msgr2=0x7fb2d00fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 shutdown_connections 2023-10-07T00:12:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.747+0000 7fb2d4dff700 1 -- 172.21.15.5:0/177520946 wait complete. 2023-10-07T00:12:13.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:12:13.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1207828109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c64102b40 msgr2=0x7f6c641093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1207828109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c64102b40 0x7f6c641093f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00b0d0 tx=0x7f6c5c00b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1207828109 shutdown_connections 2023-10-07T00:12:13.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1207828109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c64102b40 0x7f6c641093f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1207828109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c64100fb0 0x7f6c641013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1207828109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c641021a0 0x7f6c64102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1207828109 >> 172.21.15.5:0/1207828109 conn(0x7f6c640fc520 msgr2=0x7f6c640fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:13.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1207828109 shutdown_connections 2023-10-07T00:12:13.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.972+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1207828109 wait complete. 2023-10-07T00:12:13.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.973+0000 7f6c6b5ff700 1 Processor -- start 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c6b5ff700 1 -- start start 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c6b5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c64100fb0 0x7f6c64198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c6b5ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c641021a0 0x7f6c64199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c6b5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c64102b40 0x7f6c641a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c6b5ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c641a09d0 con 0x7f6c641021a0 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c6b5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c641a0b10 con 0x7f6c64100fb0 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c6b5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c641a0ca0 con 0x7f6c64102b40 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c68b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c641021a0 0x7f6c64199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c68b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c641021a0 0x7f6c64199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34604/0 (socket says 172.21.15.5:34604) 2023-10-07T00:12:13.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.974+0000 7f6c68b9a700 1 -- 172.21.15.5:0/1983267247 learned_addr learned my addr 172.21.15.5:0/1983267247 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:13.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c6939b700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c64100fb0 0x7f6c64198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c68b9a700 1 -- 172.21.15.5:0/1983267247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c64102b40 msgr2=0x7f6c641a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c69b9c700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c64102b40 0x7f6c641a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c68b9a700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c64102b40 0x7f6c641a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c68b9a700 1 -- 172.21.15.5:0/1983267247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c64100fb0 msgr2=0x7f6c64198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c68b9a700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c64100fb0 0x7f6c64198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c68b9a700 1 -- 172.21.15.5:0/1983267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c009d00 con 0x7f6c641021a0 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c69b9c700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c64102b40 0x7f6c641a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c68b9a700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c641021a0 0x7f6c64199390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400d950 tx=0x7f6c5400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c5a7fc700 1 -- 172.21.15.5:0/1983267247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54009940 con 0x7f6c641021a0 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c5a7fc700 1 -- 172.21.15.5:0/1983267247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c54010460 con 0x7f6c641021a0 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c641a0f80 con 0x7f6c641021a0 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.975+0000 7f6c5a7fc700 1 -- 172.21.15.5:0/1983267247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5400f620 con 0x7f6c641021a0 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.976+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c641a1400 con 0x7f6c641021a0 2023-10-07T00:12:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.977+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6410c6d0 con 0x7f6c641021a0 2023-10-07T00:12:13.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.979+0000 7f6c5a7fc700 1 -- 172.21.15.5:0/1983267247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f6c540105d0 con 0x7f6c641021a0 2023-10-07T00:12:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.980+0000 7f6c5a7fc700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c500a1590 0x7f6c500a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.980+0000 7f6c5a7fc700 1 -- 172.21.15.5:0/1983267247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6c540ccd40 con 0x7f6c641021a0 2023-10-07T00:12:13.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.980+0000 7f6c6939b700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c500a1590 0x7f6c500a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.981+0000 7f6c6939b700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c500a1590 0x7f6c500a3a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c64102000 tx=0x7f6c6000a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:13.984+0000 7f6c5a7fc700 1 -- 172.21.15.5:0/1983267247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c540961c0 con 0x7f6c641021a0 2023-10-07T00:12:14.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:13 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/842988768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:13 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1319503148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:13 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/177520946' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:13 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/842988768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:13 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1319503148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:13 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/177520946' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.242+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c641a15f0 con 0x7f6c641021a0 2023-10-07T00:12:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.243+0000 7f6c5a7fc700 1 -- 172.21.15.5:0/1983267247 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7f6c54016090 con 0x7f6c641021a0 2023-10-07T00:12:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:14.244 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c500a1590 msgr2=0x7f6c500a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c500a1590 0x7f6c500a3a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c64102000 tx=0x7f6c6000a3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c641021a0 msgr2=0x7f6c64199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c641021a0 0x7f6c64199390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400d950 tx=0x7f6c5400dc60 comp rx=0 tx=0).stop 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 shutdown_connections 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6c500a1590 0x7f6c500a3a50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c64102b40 0x7f6c641a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c64100fb0 0x7f6c64198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 --2- 172.21.15.5:0/1983267247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c641021a0 0x7f6c64199390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 >> 172.21.15.5:0/1983267247 conn(0x7f6c640fc520 msgr2=0x7f6c641079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.245+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 shutdown_connections 2023-10-07T00:12:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.246+0000 7f6c6b5ff700 1 -- 172.21.15.5:0/1983267247 wait complete. 2023-10-07T00:12:14.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:13 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/842988768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:13 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1319503148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:13 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/177520946' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:12:14.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 -- 172.21.15.5:0/3001223014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92501021a0 msgr2=0x7f9250102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 --2- 172.21.15.5:0/3001223014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92501021a0 0x7f9250102600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f92400099c0 tx=0x7f9240009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 -- 172.21.15.5:0/3001223014 shutdown_connections 2023-10-07T00:12:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 --2- 172.21.15.5:0/3001223014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250102b40 0x7f92501093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 --2- 172.21.15.5:0/3001223014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9250100fb0 0x7f92501013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 --2- 172.21.15.5:0/3001223014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92501021a0 0x7f9250102600 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 -- 172.21.15.5:0/3001223014 >> 172.21.15.5:0/3001223014 conn(0x7f92500fc520 msgr2=0x7f92500fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 -- 172.21.15.5:0/3001223014 shutdown_connections 2023-10-07T00:12:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.467+0000 7f9257bff700 1 -- 172.21.15.5:0/3001223014 wait complete. 2023-10-07T00:12:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.468+0000 7f9257bff700 1 Processor -- start 2023-10-07T00:12:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.468+0000 7f9257bff700 1 -- start start 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.468+0000 7f9257bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250100fb0 0x7f9250074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.468+0000 7f9257bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92501021a0 0x7f92500732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.468+0000 7f9257bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9250102b40 0x7f92500737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.468+0000 7f9257bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9250073f80 con 0x7f9250102b40 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.468+0000 7f9257bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500740f0 con 0x7f92501021a0 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.468+0000 7f9257bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92501a0c40 con 0x7f9250100fb0 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925619c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9250102b40 0x7f92500737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925619c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9250102b40 0x7f92500737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34620/0 (socket says 172.21.15.5:34620) 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925619c700 1 -- 172.21.15.5:0/4212091767 learned_addr learned my addr 172.21.15.5:0/4212091767 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925599b700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250100fb0 0x7f9250074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925519a700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92501021a0 0x7f92500732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925619c700 1 -- 172.21.15.5:0/4212091767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250100fb0 msgr2=0x7f9250074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925619c700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250100fb0 0x7f9250074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925619c700 1 -- 172.21.15.5:0/4212091767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92501021a0 msgr2=0x7f92500732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925619c700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92501021a0 0x7f92500732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925619c700 1 -- 172.21.15.5:0/4212091767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400095f0 con 0x7f9250102b40 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925519a700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92501021a0 0x7f92500732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.469+0000 7f925599b700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250100fb0 0x7f9250074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.470+0000 7f925619c700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9250102b40 0x7f92500737e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9248007ee0 tx=0x7f924800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.470+0000 7f9246ffd700 1 -- 172.21.15.5:0/4212091767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248017070 con 0x7f9250102b40 2023-10-07T00:12:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.470+0000 7f9246ffd700 1 -- 172.21.15.5:0/4212091767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f924800f040 con 0x7f9250102b40 2023-10-07T00:12:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.470+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92501a0f20 con 0x7f9250102b40 2023-10-07T00:12:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.470+0000 7f9246ffd700 1 -- 172.21.15.5:0/4212091767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248005710 con 0x7f9250102b40 2023-10-07T00:12:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.470+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92501a13a0 con 0x7f9250102b40 2023-10-07T00:12:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.471+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925010c6c0 con 0x7f9250102b40 2023-10-07T00:12:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.473+0000 7f9246ffd700 1 -- 172.21.15.5:0/4212091767 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f9248005870 con 0x7f9250102b40 2023-10-07T00:12:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.475+0000 7f9246ffd700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f923c0a1590 0x7f923c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.475+0000 7f9246ffd700 1 -- 172.21.15.5:0/4212091767 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f92480cc750 con 0x7f9250102b40 2023-10-07T00:12:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.475+0000 7f925599b700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f923c0a1590 0x7f923c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:14.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.476+0000 7f925599b700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f923c0a1590 0x7f923c0a3a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f924c005950 tx=0x7f924c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:14.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.479+0000 7f9246ffd700 1 -- 172.21.15.5:0/4212091767 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9248095bd0 con 0x7f9250102b40 2023-10-07T00:12:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.697+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9250107f60 con 0x7f9250102b40 2023-10-07T00:12:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.698+0000 7f9246ffd700 1 -- 172.21.15.5:0/4212091767 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f92480991f0 con 0x7f9250102b40 2023-10-07T00:12:14.700 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:14.700 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f923c0a1590 msgr2=0x7f923c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f923c0a1590 0x7f923c0a3a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f924c005950 tx=0x7f924c0058e0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9250102b40 msgr2=0x7f92500737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9250102b40 0x7f92500737e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9248007ee0 tx=0x7f924800d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 shutdown_connections 2023-10-07T00:12:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f923c0a1590 0x7f923c0a3a50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9250102b40 0x7f92500737e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250100fb0 0x7f9250074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 --2- 172.21.15.5:0/4212091767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92501021a0 0x7f92500732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 >> 172.21.15.5:0/4212091767 conn(0x7f92500fc520 msgr2=0x7f92500fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 shutdown_connections 2023-10-07T00:12:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.701+0000 7f9257bff700 1 -- 172.21.15.5:0/4212091767 wait complete. 2023-10-07T00:12:14.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:12:14.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:12:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.928+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/2503007660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c8100fc0 msgr2=0x7fa7c81013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.928+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/2503007660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c8100fc0 0x7fa7c81013e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80099c0 tx=0x7fa7b8009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.929+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/2503007660 shutdown_connections 2023-10-07T00:12:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.929+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/2503007660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c8102b50 0x7fa7c8109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.929+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/2503007660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c8100fc0 0x7fa7c81013e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.929+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/2503007660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c81021b0 0x7fa7c8102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.929+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/2503007660 >> 172.21.15.5:0/2503007660 conn(0x7fa7c80fc530 msgr2=0x7fa7c80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:14.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.929+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/2503007660 shutdown_connections 2023-10-07T00:12:14.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.929+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/2503007660 wait complete. 2023-10-07T00:12:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7ce1ff700 1 Processor -- start 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7ce1ff700 1 -- start start 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7ce1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8100fc0 0x7fa7c8196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7ce1ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c81021b0 0x7fa7c8197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7ce1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c8102b50 0x7fa7c819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7ce1ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c819e760 con 0x7fa7c81021b0 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7ce1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c819e8a0 con 0x7fa7c8102b50 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7ce1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c819ea30 con 0x7fa7c8100fc0 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7c6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c81021b0 0x7fa7c8197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7c6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c81021b0 0x7fa7c8197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34648/0 (socket says 172.21.15.5:34648) 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7c6ffd700 1 -- 172.21.15.5:0/1744748162 learned_addr learned my addr 172.21.15.5:0/1744748162 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.930+0000 7fa7c7fff700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c8102b50 0x7fa7c819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c77fe700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8100fc0 0x7fa7c8196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c6ffd700 1 -- 172.21.15.5:0/1744748162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8100fc0 msgr2=0x7fa7c8196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c6ffd700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8100fc0 0x7fa7c8196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c6ffd700 1 -- 172.21.15.5:0/1744748162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c8102b50 msgr2=0x7fa7c819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c6ffd700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c8102b50 0x7fa7c819e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c6ffd700 1 -- 172.21.15.5:0/1744748162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80095f0 con 0x7fa7c81021b0 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c7fff700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c8102b50 0x7fa7c819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c6ffd700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c81021b0 0x7fa7c8197120 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00c9b0 tx=0x7fa7bc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c4ff9700 1 -- 172.21.15.5:0/1744748162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc007b00 con 0x7fa7c81021b0 2023-10-07T00:12:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c4ff9700 1 -- 172.21.15.5:0/1744748162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7bc007c60 con 0x7fa7c81021b0 2023-10-07T00:12:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7c4ff9700 1 -- 172.21.15.5:0/1744748162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc018660 con 0x7fa7c81021b0 2023-10-07T00:12:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c819ed10 con 0x7fa7c81021b0 2023-10-07T00:12:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.931+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c819f1d0 con 0x7fa7c81021b0 2023-10-07T00:12:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.932+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c810c750 con 0x7fa7c81021b0 2023-10-07T00:12:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.934+0000 7fa7c4ff9700 1 -- 172.21.15.5:0/1744748162 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa7bc00f450 con 0x7fa7c81021b0 2023-10-07T00:12:14.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.937+0000 7fa7c4ff9700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:14.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.937+0000 7fa7c4ff9700 1 -- 172.21.15.5:0/1744748162 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa7bc0ccef0 con 0x7fa7c81021b0 2023-10-07T00:12:14.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.937+0000 7fa7c77fe700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:14.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.937+0000 7fa7c77fe700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8000c00 tx=0x7fa7b8005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:14.941+0000 7fa7c4ff9700 1 -- 172.21.15.5:0/1744748162 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa7bc096370 con 0x7fa7c81021b0 2023-10-07T00:12:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:14 smithi005 ceph-mon[129406]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:14 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1983267247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:14 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4212091767' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.153+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7c8107ec0 con 0x7fa7c81021b0 2023-10-07T00:12:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.154+0000 7fa7c4ff9700 1 -- 172.21.15.5:0/1744748162 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7bc099990 con 0x7fa7c81021b0 2023-10-07T00:12:15.156 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:12:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 msgr2=0x7fa7b00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8000c00 tx=0x7fa7b8005c00 comp rx=0 tx=0).stop 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c81021b0 msgr2=0x7fa7c8197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c81021b0 0x7fa7c8197120 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00c9b0 tx=0x7fa7bc00cd70 comp rx=0 tx=0).stop 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 shutdown_connections 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7b00a1590 0x7fa7b00a3a50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7c8102b50 0x7fa7c819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8100fc0 0x7fa7c8196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 --2- 172.21.15.5:0/1744748162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7c81021b0 0x7fa7c8197120 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 >> 172.21.15.5:0/1744748162 conn(0x7fa7c80fc530 msgr2=0x7fa7c80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 shutdown_connections 2023-10-07T00:12:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.156+0000 7fa7ce1ff700 1 -- 172.21.15.5:0/1744748162 wait complete. 2023-10-07T00:12:15.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:12:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:14 smithi088 ceph-mon[103111]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:14 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1983267247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:14 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4212091767' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:14 smithi112 ceph-mon[133548]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:14 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1983267247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:14 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4212091767' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 -- 172.21.15.5:0/1153616098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86441021b0 msgr2=0x7f8644102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 --2- 172.21.15.5:0/1153616098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86441021b0 0x7f8644102610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f86380099c0 tx=0x7f8638009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 -- 172.21.15.5:0/1153616098 shutdown_connections 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 --2- 172.21.15.5:0/1153616098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8644102b50 0x7f8644109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 --2- 172.21.15.5:0/1153616098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8644100fc0 0x7f86441013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 --2- 172.21.15.5:0/1153616098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86441021b0 0x7f8644102610 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 -- 172.21.15.5:0/1153616098 >> 172.21.15.5:0/1153616098 conn(0x7f86440fc530 msgr2=0x7f86440fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 -- 172.21.15.5:0/1153616098 shutdown_connections 2023-10-07T00:12:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.382+0000 7f8649fff700 1 -- 172.21.15.5:0/1153616098 wait complete. 2023-10-07T00:12:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.383+0000 7f8649fff700 1 Processor -- start 2023-10-07T00:12:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.383+0000 7f8649fff700 1 -- start start 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8649fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8644100fc0 0x7f8644198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8649fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86441021b0 0x7f8644199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8649fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8644102b50 0x7f86441a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8649fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441a0980 con 0x7f8644102b50 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8649fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441a0ac0 con 0x7f8644100fc0 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8649fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441a0c50 con 0x7f86441021b0 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8643fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8644102b50 0x7f86441a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8643fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8644102b50 0x7f86441a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34664/0 (socket says 172.21.15.5:34664) 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8642ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86441021b0 0x7f8644199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8643fff700 1 -- 172.21.15.5:0/1063377605 learned_addr learned my addr 172.21.15.5:0/1063377605 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f86437fe700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8644100fc0 0x7f8644198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8643fff700 1 -- 172.21.15.5:0/1063377605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86441021b0 msgr2=0x7f8644199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8643fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86441021b0 0x7f8644199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8643fff700 1 -- 172.21.15.5:0/1063377605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8644100fc0 msgr2=0x7f8644198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8643fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8644100fc0 0x7f8644198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.384+0000 7f8643fff700 1 -- 172.21.15.5:0/1063377605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380095f0 con 0x7f8644102b50 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.385+0000 7f8643fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8644102b50 0x7f86441a03b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f863c007ee0 tx=0x7f863c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.385+0000 7f8640ff9700 1 -- 172.21.15.5:0/1063377605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c017070 con 0x7f8644102b50 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.385+0000 7f8640ff9700 1 -- 172.21.15.5:0/1063377605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f863c00f040 con 0x7f8644102b50 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.385+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86441a0f30 con 0x7f8644102b50 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.385+0000 7f8640ff9700 1 -- 172.21.15.5:0/1063377605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c005710 con 0x7f8644102b50 2023-10-07T00:12:15.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.385+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86441a13b0 con 0x7f8644102b50 2023-10-07T00:12:15.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.386+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86441934d0 con 0x7f8644102b50 2023-10-07T00:12:15.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.388+0000 7f8640ff9700 1 -- 172.21.15.5:0/1063377605 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f863c005870 con 0x7f8644102b50 2023-10-07T00:12:15.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.390+0000 7f8640ff9700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f862c0a1590 0x7f862c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:15.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.390+0000 7f8640ff9700 1 -- 172.21.15.5:0/1063377605 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f863c0cc680 con 0x7f8644102b50 2023-10-07T00:12:15.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.390+0000 7f86437fe700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f862c0a1590 0x7f862c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:15.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.390+0000 7f86437fe700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f862c0a1590 0x7f862c0a3a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8644102010 tx=0x7f8634009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.393+0000 7f8640ff9700 1 -- 172.21.15.5:0/1063377605 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f863c095b00 con 0x7f8644102b50 2023-10-07T00:12:15.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.606+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f864410c900 con 0x7f8644102b50 2023-10-07T00:12:15.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.606+0000 7f8640ff9700 1 -- 172.21.15.5:0/1063377605 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f863c099120 con 0x7f8644102b50 2023-10-07T00:12:15.607 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:12:15.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.608+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f862c0a1590 msgr2=0x7f862c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.608+0000 7f8649fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f862c0a1590 0x7f862c0a3a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8644102010 tx=0x7f8634009260 comp rx=0 tx=0).stop 2023-10-07T00:12:15.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.608+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8644102b50 msgr2=0x7f86441a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.608+0000 7f8649fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8644102b50 0x7f86441a03b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f863c007ee0 tx=0x7f863c00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.608+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 shutdown_connections 2023-10-07T00:12:15.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.609+0000 7f8649fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f862c0a1590 0x7f862c0a3a50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.609+0000 7f8649fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8644102b50 0x7f86441a03b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.609+0000 7f8649fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8644100fc0 0x7f8644198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.609+0000 7f8649fff700 1 --2- 172.21.15.5:0/1063377605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86441021b0 0x7f8644199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.609+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 >> 172.21.15.5:0/1063377605 conn(0x7f86440fc530 msgr2=0x7f8644107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.609+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 shutdown_connections 2023-10-07T00:12:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.609+0000 7f8649fff700 1 -- 172.21.15.5:0/1063377605 wait complete. 2023-10-07T00:12:15.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:12:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 -- 172.21.15.5:0/1223074570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 msgr2=0x7fdf801013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 --2- 172.21.15.5:0/1223074570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 0x7fdf801013e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0099c0 tx=0x7fdf7c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 -- 172.21.15.5:0/1223074570 shutdown_connections 2023-10-07T00:12:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 --2- 172.21.15.5:0/1223074570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80102b50 0x7fdf80109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 --2- 172.21.15.5:0/1223074570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 0x7fdf801013e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 --2- 172.21.15.5:0/1223074570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf801021b0 0x7fdf80102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 -- 172.21.15.5:0/1223074570 >> 172.21.15.5:0/1223074570 conn(0x7fdf800fc530 msgr2=0x7fdf800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 -- 172.21.15.5:0/1223074570 shutdown_connections 2023-10-07T00:12:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.835+0000 7fdf87bff700 1 -- 172.21.15.5:0/1223074570 wait complete. 2023-10-07T00:12:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.836+0000 7fdf87bff700 1 Processor -- start 2023-10-07T00:12:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.836+0000 7fdf87bff700 1 -- start start 2023-10-07T00:12:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf87bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 0x7fdf80196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf87bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf801021b0 0x7fdf80197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf87bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf80102b50 0x7fdf8019e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf87bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8019e740 con 0x7fdf80100fc0 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf87bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8019e880 con 0x7fdf80102b50 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf87bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8019ea10 con 0x7fdf801021b0 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf8599b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 0x7fdf80196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf8599b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 0x7fdf80196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34688/0 (socket says 172.21.15.5:34688) 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf8599b700 1 -- 172.21.15.5:0/2195138630 learned_addr learned my addr 172.21.15.5:0/2195138630 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf8619c700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf80102b50 0x7fdf8019e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf8519a700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf801021b0 0x7fdf80197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf8599b700 1 -- 172.21.15.5:0/2195138630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf801021b0 msgr2=0x7fdf80197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.837+0000 7fdf8599b700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf801021b0 0x7fdf80197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf8599b700 1 -- 172.21.15.5:0/2195138630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf80102b50 msgr2=0x7fdf8019e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf8599b700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf80102b50 0x7fdf8019e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf8599b700 1 -- 172.21.15.5:0/2195138630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0095f0 con 0x7fdf80100fc0 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf8599b700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 0x7fdf80196bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009f50 tx=0x7fdf7c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf76ffd700 1 -- 172.21.15.5:0/2195138630 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c01d070 con 0x7fdf80100fc0 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8019ec90 con 0x7fdf80100fc0 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf76ffd700 1 -- 172.21.15.5:0/2195138630 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf7c00bda0 con 0x7fdf80100fc0 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf76ffd700 1 -- 172.21.15.5:0/2195138630 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c022c80 con 0x7fdf80100fc0 2023-10-07T00:12:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.838+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8019f140 con 0x7fdf80100fc0 2023-10-07T00:12:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.839+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf80107fa0 con 0x7fdf80100fc0 2023-10-07T00:12:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.841+0000 7fdf76ffd700 1 -- 172.21.15.5:0/2195138630 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fdf7c003f40 con 0x7fdf80100fc0 2023-10-07T00:12:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.843+0000 7fdf76ffd700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf6c0a1510 0x7fdf6c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.843+0000 7fdf76ffd700 1 -- 172.21.15.5:0/2195138630 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdf7c0ce430 con 0x7fdf80100fc0 2023-10-07T00:12:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.843+0000 7fdf8519a700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf6c0a1510 0x7fdf6c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.843+0000 7fdf8519a700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf6c0a1510 0x7fdf6c0a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdf70005950 tx=0x7fdf700058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:15.846+0000 7fdf76ffd700 1 -- 172.21.15.5:0/2195138630 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf7c097940 con 0x7fdf80100fc0 2023-10-07T00:12:16.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.056+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf8002d050 con 0x7fdf80100fc0 2023-10-07T00:12:16.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.056+0000 7fdf76ffd700 1 -- 172.21.15.5:0/2195138630 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf7c022470 con 0x7fdf80100fc0 2023-10-07T00:12:16.057 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:12:16.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf6c0a1510 msgr2=0x7fdf6c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf6c0a1510 0x7fdf6c0a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdf70005950 tx=0x7fdf700058e0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 msgr2=0x7fdf80196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 0x7fdf80196bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009f50 tx=0x7fdf7c003a50 comp rx=0 tx=0).stop 2023-10-07T00:12:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 shutdown_connections 2023-10-07T00:12:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdf6c0a1510 0x7fdf6c0a39d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf80102b50 0x7fdf8019e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf80100fc0 0x7fdf80196bc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 --2- 172.21.15.5:0/2195138630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf801021b0 0x7fdf80197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 >> 172.21.15.5:0/2195138630 conn(0x7fdf800fc530 msgr2=0x7fdf800fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 shutdown_connections 2023-10-07T00:12:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.059+0000 7fdf87bff700 1 -- 172.21.15.5:0/2195138630 wait complete. 2023-10-07T00:12:16.077 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:15 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1744748162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:16.077 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:15 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1063377605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:16.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:12:16.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:15 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1744748162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:16.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:15 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1063377605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:16.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:15 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1744748162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:16.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:15 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1063377605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.280+0000 7fd66cbff700 1 -- 172.21.15.5:0/104762189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 msgr2=0x7fd6681013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.280+0000 7fd66cbff700 1 --2- 172.21.15.5:0/104762189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 0x7fd6681013e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd6580099c0 tx=0x7fd658009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.280+0000 7fd66cbff700 1 -- 172.21.15.5:0/104762189 shutdown_connections 2023-10-07T00:12:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.280+0000 7fd66cbff700 1 --2- 172.21.15.5:0/104762189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd668102b50 0x7fd668109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.280+0000 7fd66cbff700 1 --2- 172.21.15.5:0/104762189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 0x7fd6681013e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.280+0000 7fd66cbff700 1 --2- 172.21.15.5:0/104762189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6681021b0 0x7fd668102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.280+0000 7fd66cbff700 1 -- 172.21.15.5:0/104762189 >> 172.21.15.5:0/104762189 conn(0x7fd6680fc530 msgr2=0x7fd6680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:16.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.281+0000 7fd66cbff700 1 -- 172.21.15.5:0/104762189 shutdown_connections 2023-10-07T00:12:16.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.281+0000 7fd66cbff700 1 -- 172.21.15.5:0/104762189 wait complete. 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.281+0000 7fd66cbff700 1 Processor -- start 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66cbff700 1 -- start start 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66cbff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 0x7fd668198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66cbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6681021b0 0x7fd668199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66cbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd668102b50 0x7fd6681a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66cbff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6681a0980 con 0x7fd668100fc0 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66cbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6681a0ac0 con 0x7fd6681021b0 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66cbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6681a0c50 con 0x7fd668102b50 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 0x7fd668198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 0x7fd668198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34700/0 (socket says 172.21.15.5:34700) 2023-10-07T00:12:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.282+0000 7fd66659c700 1 -- 172.21.15.5:0/36826656 learned_addr learned my addr 172.21.15.5:0/36826656 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd66659c700 1 -- 172.21.15.5:0/36826656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd668102b50 msgr2=0x7fd6681a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd66659c700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd668102b50 0x7fd6681a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd66659c700 1 -- 172.21.15.5:0/36826656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6681021b0 msgr2=0x7fd668199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd665d9b700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6681021b0 0x7fd668199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd66659c700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6681021b0 0x7fd668199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd66659c700 1 -- 172.21.15.5:0/36826656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580095f0 con 0x7fd668100fc0 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd665d9b700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6681021b0 0x7fd668199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd66659c700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 0x7fd668198e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd658000c00 tx=0x7fd65800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd6577fe700 1 -- 172.21.15.5:0/36826656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65801d070 con 0x7fd668100fc0 2023-10-07T00:12:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd6577fe700 1 -- 172.21.15.5:0/36826656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd658022900 con 0x7fd668100fc0 2023-10-07T00:12:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6681a0ed0 con 0x7fd668100fc0 2023-10-07T00:12:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd6577fe700 1 -- 172.21.15.5:0/36826656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658017630 con 0x7fd668100fc0 2023-10-07T00:12:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.283+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6681a1290 con 0x7fd668100fc0 2023-10-07T00:12:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.284+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6681934c0 con 0x7fd668100fc0 2023-10-07T00:12:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.286+0000 7fd6577fe700 1 -- 172.21.15.5:0/36826656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fd658022a70 con 0x7fd668100fc0 2023-10-07T00:12:16.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.288+0000 7fd6577fe700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6500a1510 0x7fd6500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:16.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.288+0000 7fd6577fe700 1 -- 172.21.15.5:0/36826656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd6580ce020 con 0x7fd668100fc0 2023-10-07T00:12:16.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.288+0000 7fd665d9b700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6500a1510 0x7fd6500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:16.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.288+0000 7fd665d9b700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6500a1510 0x7fd6500a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009be0 tx=0x7fd65c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:16.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.290+0000 7fd6577fe700 1 -- 172.21.15.5:0/36826656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd658097590 con 0x7fd668100fc0 2023-10-07T00:12:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.547+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd66802d1c0 con 0x7fd668100fc0 2023-10-07T00:12:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.547+0000 7fd6577fe700 1 -- 172.21.15.5:0/36826656 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7fd658095e60 con 0x7fd668100fc0 2023-10-07T00:12:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:16.549 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:12:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6500a1510 msgr2=0x7fd6500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6500a1510 0x7fd6500a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009be0 tx=0x7fd65c009260 comp rx=0 tx=0).stop 2023-10-07T00:12:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 msgr2=0x7fd668198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 0x7fd668198e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd658000c00 tx=0x7fd65800fab0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 shutdown_connections 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6500a1510 0x7fd6500a39d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd668102b50 0x7fd6681a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd668100fc0 0x7fd668198e00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 --2- 172.21.15.5:0/36826656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6681021b0 0x7fd668199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 >> 172.21.15.5:0/36826656 conn(0x7fd6680fc530 msgr2=0x7fd668107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 shutdown_connections 2023-10-07T00:12:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.550+0000 7fd66cbff700 1 -- 172.21.15.5:0/36826656 wait complete. 2023-10-07T00:12:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:12:16.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.780+0000 7f3bf7fff700 1 -- 172.21.15.5:0/324747582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 msgr2=0x7f3bf01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.780+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/324747582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 0x7f3bf01013e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0099c0 tx=0x7f3bec009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.781+0000 7f3bf7fff700 1 -- 172.21.15.5:0/324747582 shutdown_connections 2023-10-07T00:12:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.781+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/324747582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf0102b50 0x7f3bf0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.781+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/324747582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 0x7f3bf01013e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.781+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/324747582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf01021b0 0x7f3bf0102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.781+0000 7f3bf7fff700 1 -- 172.21.15.5:0/324747582 >> 172.21.15.5:0/324747582 conn(0x7f3bf00fc530 msgr2=0x7f3bf00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.781+0000 7f3bf7fff700 1 -- 172.21.15.5:0/324747582 shutdown_connections 2023-10-07T00:12:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.781+0000 7f3bf7fff700 1 -- 172.21.15.5:0/324747582 wait complete. 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.782+0000 7f3bf7fff700 1 Processor -- start 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.782+0000 7f3bf7fff700 1 -- start start 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.782+0000 7f3bf7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 0x7f3bf0074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.782+0000 7f3bf7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf01021b0 0x7f3bf00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.782+0000 7f3bf7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf0102b50 0x7f3bf00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.782+0000 7f3bf7fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0073f80 con 0x7f3bf0100fc0 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.782+0000 7f3bf7fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00740f0 con 0x7f3bf01021b0 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.782+0000 7f3bf7fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01a0c80 con 0x7f3bf0102b50 2023-10-07T00:12:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 0x7f3bf0074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 0x7f3bf0074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34716/0 (socket says 172.21.15.5:34716) 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 -- 172.21.15.5:0/3282901369 learned_addr learned my addr 172.21.15.5:0/3282901369 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf559a700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf01021b0 0x7f3bf00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf659c700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf0102b50 0x7f3bf00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 -- 172.21.15.5:0/3282901369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf0102b50 msgr2=0x7f3bf00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf0102b50 0x7f3bf00737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 -- 172.21.15.5:0/3282901369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf01021b0 msgr2=0x7f3bf00732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf01021b0 0x7f3bf00732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 -- 172.21.15.5:0/3282901369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0095f0 con 0x7f3bf0100fc0 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.783+0000 7f3bf5d9b700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 0x7f3bf0074c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3bec000c00 tx=0x7f3bec00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.784+0000 7f3be6ffd700 1 -- 172.21.15.5:0/3282901369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec01d070 con 0x7f3bf0100fc0 2023-10-07T00:12:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.784+0000 7f3be6ffd700 1 -- 172.21.15.5:0/3282901369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bec00bcf0 con 0x7f3bf0100fc0 2023-10-07T00:12:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.784+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf01a0f00 con 0x7f3bf0100fc0 2023-10-07T00:12:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.784+0000 7f3be6ffd700 1 -- 172.21.15.5:0/3282901369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0173f0 con 0x7f3bf0100fc0 2023-10-07T00:12:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.784+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf01a12c0 con 0x7f3bf0100fc0 2023-10-07T00:12:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.785+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0107fa0 con 0x7f3bf0100fc0 2023-10-07T00:12:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.787+0000 7f3be6ffd700 1 -- 172.21.15.5:0/3282901369 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f3bec022470 con 0x7f3bf0100fc0 2023-10-07T00:12:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.788+0000 7f3be6ffd700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3bdc0a1590 0x7f3bdc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.789+0000 7f3be6ffd700 1 -- 172.21.15.5:0/3282901369 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3bec0ce070 con 0x7f3bf0100fc0 2023-10-07T00:12:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.789+0000 7f3bf559a700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3bdc0a1590 0x7f3bdc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.789+0000 7f3bf559a700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3bdc0a1590 0x7f3bdc0a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009c60 tx=0x7f3be0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:16.794+0000 7f3be6ffd700 1 -- 172.21.15.5:0/3282901369 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3bec0975e0 con 0x7f3bf0100fc0 2023-10-07T00:12:16.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:16 smithi005 ceph-mon[129406]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-07T00:12:16.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:16 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2195138630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:16.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:16 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/36826656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:16.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:16 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:12:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.018+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bf010c8a0 con 0x7f3bf0100fc0 2023-10-07T00:12:17.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.020+0000 7f3be6ffd700 1 -- 172.21.15.5:0/3282901369 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f3bec09ac00 con 0x7f3bf0100fc0 2023-10-07T00:12:17.021 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3bdc0a1590 msgr2=0x7f3bdc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3bdc0a1590 0x7f3bdc0a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009c60 tx=0x7f3be0009260 comp rx=0 tx=0).stop 2023-10-07T00:12:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 msgr2=0x7f3bf0074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 0x7f3bf0074c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3bec000c00 tx=0x7f3bec00fa00 comp rx=0 tx=0).stop 2023-10-07T00:12:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 shutdown_connections 2023-10-07T00:12:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3bdc0a1590 0x7f3bdc0a3a50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf0102b50 0x7f3bf00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf0100fc0 0x7f3bf0074c60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 --2- 172.21.15.5:0/3282901369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bf01021b0 0x7f3bf00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 >> 172.21.15.5:0/3282901369 conn(0x7f3bf00fc530 msgr2=0x7f3bf00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 shutdown_connections 2023-10-07T00:12:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.023+0000 7f3bf7fff700 1 -- 172.21.15.5:0/3282901369 wait complete. 2023-10-07T00:12:17.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:12:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:16 smithi088 ceph-mon[103111]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-07T00:12:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:16 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2195138630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:16 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/36826656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:17.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:16 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:12:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:16 smithi112 ceph-mon[133548]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-07T00:12:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:16 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2195138630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:17.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:16 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/36826656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:17.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:16 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:12:17.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 -- 172.21.15.5:0/1146817763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5268100fb0 msgr2=0x7f52681013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 --2- 172.21.15.5:0/1146817763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5268100fb0 0x7f52681013d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f52580099c0 tx=0x7f5258009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 -- 172.21.15.5:0/1146817763 shutdown_connections 2023-10-07T00:12:17.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 --2- 172.21.15.5:0/1146817763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5268102b40 0x7f52681093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 --2- 172.21.15.5:0/1146817763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5268100fb0 0x7f52681013d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 --2- 172.21.15.5:0/1146817763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52681021a0 0x7f5268102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 -- 172.21.15.5:0/1146817763 >> 172.21.15.5:0/1146817763 conn(0x7f52680fc520 msgr2=0x7f52680fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 -- 172.21.15.5:0/1146817763 shutdown_connections 2023-10-07T00:12:17.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.275+0000 7f526dbff700 1 -- 172.21.15.5:0/1146817763 wait complete. 2023-10-07T00:12:17.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.276+0000 7f526dbff700 1 Processor -- start 2023-10-07T00:12:17.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f526dbff700 1 -- start start 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f526dbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5268100fb0 0x7f5268196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f526dbff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52681021a0 0x7f5268197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f526dbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5268102b40 0x7f526819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f526dbff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526819e780 con 0x7f52681021a0 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f526dbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526819e8f0 con 0x7f5268102b40 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f526dbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526819eab0 con 0x7f5268100fb0 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f525ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52681021a0 0x7f5268197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f52677fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5268100fb0 0x7f5268196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f52677fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5268100fb0 0x7f5268196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:57388/0 (socket says 172.21.15.5:57388) 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f52677fe700 1 -- 172.21.15.5:0/3719716009 learned_addr learned my addr 172.21.15.5:0/3719716009 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.277+0000 7f525ffff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52681021a0 0x7f5268197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34738/0 (socket says 172.21.15.5:34738) 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f5267fff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5268102b40 0x7f526819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f525ffff700 1 -- 172.21.15.5:0/3719716009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5268100fb0 msgr2=0x7f5268196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f525ffff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5268100fb0 0x7f5268196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f525ffff700 1 -- 172.21.15.5:0/3719716009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5268102b40 msgr2=0x7f526819e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f525ffff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5268102b40 0x7f526819e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f525ffff700 1 -- 172.21.15.5:0/3719716009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580095f0 con 0x7f52681021a0 2023-10-07T00:12:17.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f52677fe700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5268100fb0 0x7f5268196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:17.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f525ffff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52681021a0 0x7f5268197180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f525000e9f0 tx=0x7f525000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:17.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f52657fa700 1 -- 172.21.15.5:0/3719716009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000eee0 con 0x7f52681021a0 2023-10-07T00:12:17.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f52657fa700 1 -- 172.21.15.5:0/3719716009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f525000cbd0 con 0x7f52681021a0 2023-10-07T00:12:17.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f52657fa700 1 -- 172.21.15.5:0/3719716009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250018680 con 0x7f52681021a0 2023-10-07T00:12:17.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.278+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526819ed90 con 0x7f52681021a0 2023-10-07T00:12:17.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.279+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526819f190 con 0x7f52681021a0 2023-10-07T00:12:17.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.279+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526810c670 con 0x7f52681021a0 2023-10-07T00:12:17.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.281+0000 7f52657fa700 1 -- 172.21.15.5:0/3719716009 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f525000cd40 con 0x7f52681021a0 2023-10-07T00:12:17.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.283+0000 7f52657fa700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f52540a1510 0x7f52540a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.283+0000 7f52657fa700 1 -- 172.21.15.5:0/3719716009 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5250014070 con 0x7f52681021a0 2023-10-07T00:12:17.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.283+0000 7f52677fe700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f52540a1510 0x7f52540a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.284+0000 7f52677fe700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f52540a1510 0x7f52540a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5258005cd0 tx=0x7f5258005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:17.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.285+0000 7f52657fa700 1 -- 172.21.15.5:0/3719716009 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5250096930 con 0x7f52681021a0 2023-10-07T00:12:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.566+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5268107fb0 con 0x7f52681021a0 2023-10-07T00:12:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.567+0000 7f52657fa700 1 -- 172.21.15.5:0/3719716009 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7f5250099f50 con 0x7f52681021a0 2023-10-07T00:12:17.568 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:17.568 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:12:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f52540a1510 msgr2=0x7f52540a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f52540a1510 0x7f52540a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5258005cd0 tx=0x7f5258005c60 comp rx=0 tx=0).stop 2023-10-07T00:12:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52681021a0 msgr2=0x7f5268197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52681021a0 0x7f5268197180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f525000e9f0 tx=0x7f525000ed00 comp rx=0 tx=0).stop 2023-10-07T00:12:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 shutdown_connections 2023-10-07T00:12:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f52540a1510 0x7f52540a39d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5268102b40 0x7f526819e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5268100fb0 0x7f5268196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.569+0000 7f526dbff700 1 --2- 172.21.15.5:0/3719716009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52681021a0 0x7f5268197180 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.570+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 >> 172.21.15.5:0/3719716009 conn(0x7f52680fc520 msgr2=0x7f52680fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.570+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 shutdown_connections 2023-10-07T00:12:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.570+0000 7f526dbff700 1 -- 172.21.15.5:0/3719716009 wait complete. 2023-10-07T00:12:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:12:17.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-07T00:11:13.365038+0000', 'modified': '2023-10-07T00:11:20.652397+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24611, 'mds_1': 24574, 'mds_2': 24566, 'mds_3': 24553, 'mds_4': 14682}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14607': {'gid': 14607, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6837/3650932338', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6836', 'nonce': 3650932338}, {'type': 'v1', 'addr': '172.21.15.5:6837', 'nonce': 3650932338}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14682': {'gid': 14682, 'name': 'g', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.5:6839/2286789609', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6838', 'nonce': 2286789609}, {'type': 'v1', 'addr': '172.21.15.5:6839', 'nonce': 2286789609}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24460': {'gid': 24460, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6833/2184532481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6832', 'nonce': 2184532481}, {'type': 'v1', 'addr': '172.21.15.112:6833', 'nonce': 2184532481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24502': {'gid': 24502, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.88:6835/987389810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 987389810}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 987389810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6835/1364284217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 1364284217}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 1364284217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24532': {'gid': 24532, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6837/963373716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 963373716}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 963373716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24553': {'gid': 24553, 'name': 'i', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.112:6839/1437328815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 1437328815}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 1437328815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24566': {'gid': 24566, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.88:6837/3467169858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6836', 'nonce': 3467169858}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 3467169858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24574': {'gid': 24574, 'name': 'a', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.5:6841/3808461894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6840', 'nonce': 3808461894}, {'type': 'v1', 'addr': '172.21.15.5:6841', 'nonce': 3808461894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24611': {'gid': 24611, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6839/4013876185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6838', 'nonce': 4013876185}, {'type': 'v1', 'addr': '172.21.15.88:6839', 'nonce': 4013876185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-07T00:12:17.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-07T00:12:17.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2023-10-07T00:12:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1419235416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc0ff890 msgr2=0x7f4bcc0ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1419235416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc0ff890 0x7f4bcc0ffcb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80099c0 tx=0x7f4bc8009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1419235416 shutdown_connections 2023-10-07T00:12:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1419235416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bcc100bb0 0x7f4bcc101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1419235416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc0ff890 0x7f4bcc0ffcb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1419235416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc1001f0 0x7f4bcc100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1419235416 >> 172.21.15.5:0/1419235416 conn(0x7f4bcc0fb450 msgr2=0x7f4bcc0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1419235416 shutdown_connections 2023-10-07T00:12:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.810+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1419235416 wait complete. 2023-10-07T00:12:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd3bff700 1 Processor -- start 2023-10-07T00:12:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd3bff700 1 -- start start 2023-10-07T00:12:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd3bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bcc0ff890 0x7f4bcc198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd3bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc1001f0 0x7f4bcc199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd3bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc100bb0 0x7f4bcc1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd3bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1a0950 con 0x7f4bcc1001f0 2023-10-07T00:12:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd3bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1a0a90 con 0x7f4bcc0ff890 2023-10-07T00:12:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd3bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1a0c20 con 0x7f4bcc100bb0 2023-10-07T00:12:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bcc0ff890 0x7f4bcc198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bcc0ff890 0x7f4bcc198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:48724/0 (socket says 172.21.15.5:48724) 2023-10-07T00:12:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.812+0000 7f4bd199b700 1 -- 172.21.15.5:0/1778808355 learned_addr learned my addr 172.21.15.5:0/1778808355 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.813+0000 7f4bd119a700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc1001f0 0x7f4bcc199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.813+0000 7f4bd219c700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc100bb0 0x7f4bcc1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.813+0000 7f4bd199b700 1 -- 172.21.15.5:0/1778808355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc100bb0 msgr2=0x7f4bcc1a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.813+0000 7f4bd199b700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc100bb0 0x7f4bcc1a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.813+0000 7f4bd199b700 1 -- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc1001f0 msgr2=0x7f4bcc199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.813+0000 7f4bd199b700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc1001f0 0x7f4bcc199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.813+0000 7f4bd199b700 1 -- 172.21.15.5:0/1778808355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc80095f0 con 0x7f4bcc0ff890 2023-10-07T00:12:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.813+0000 7f4bd199b700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bcc0ff890 0x7f4bcc198dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000c00 tx=0x7f4bc800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:17.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.815+0000 7f4bc2ffd700 1 -- 172.21.15.5:0/1778808355 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc801d070 con 0x7f4bcc0ff890 2023-10-07T00:12:17.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.815+0000 7f4bc2ffd700 1 -- 172.21.15.5:0/1778808355 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bc800fdc0 con 0x7f4bcc0ff890 2023-10-07T00:12:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.815+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1778808355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc1a0ea0 con 0x7f4bcc0ff890 2023-10-07T00:12:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.815+0000 7f4bc2ffd700 1 -- 172.21.15.5:0/1778808355 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8004ae0 con 0x7f4bcc0ff890 2023-10-07T00:12:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.815+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1778808355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc1a1260 con 0x7f4bcc0ff890 2023-10-07T00:12:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.819+0000 7f4bc2ffd700 1 -- 172.21.15.5:0/1778808355 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f4bc8004c40 con 0x7f4bcc0ff890 2023-10-07T00:12:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.820+0000 7f4bc2ffd700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bb80a1590 0x7f4bb80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.821+0000 7f4bc2ffd700 1 -- 172.21.15.5:0/1778808355 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4bc80cdc90 con 0x7f4bcc0ff890 2023-10-07T00:12:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.821+0000 7f4bd119a700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bb80a1590 0x7f4bb80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.821+0000 7f4be74c0b80 1 Processor -- start 2023-10-07T00:12:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.821+0000 7f4bd119a700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bb80a1590 0x7f4bb80a3a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc007c60 tx=0x7f4bbc0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.821+0000 7f4be74c0b80 1 -- start start 2023-10-07T00:12:17.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x56485414d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414db70 0x56485414e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414ea10 0x56485414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648540b5410 con 0x56485414d210 2023-10-07T00:12:17.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648540a6bd0 con 0x56485414ea10 2023-10-07T00:12:17.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648540a44f0 con 0x56485414db70 2023-10-07T00:12:17.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd199b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x56485414d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd199b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x56485414d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34758/0 (socket says 172.21.15.5:34758) 2023-10-07T00:12:17.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd199b700 1 -- 172.21.15.5:0/2673607573 learned_addr learned my addr 172.21.15.5:0/2673607573 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:17.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd119a700 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414db70 0x56485414e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd219c700 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414ea10 0x56485414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd199b700 1 -- 172.21.15.5:0/2673607573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414db70 msgr2=0x56485414e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd199b700 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414db70 0x56485414e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd199b700 1 -- 172.21.15.5:0/2673607573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414ea10 msgr2=0x56485414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.822+0000 7f4bd199b700 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414ea10 0x56485414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.823+0000 7f4bd199b700 1 -- 172.21.15.5:0/2673607573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564853ecad90 con 0x56485414d210 2023-10-07T00:12:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.823+0000 7f4bd219c700 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414ea10 0x56485414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.823+0000 7f4bd199b700 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x56485414d630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4bc809adf0 tx=0x7f4bc809a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb98df8fd49b136d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:17.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.823+0000 7f4bb7fff700 1 -- 172.21.15.5:0/2673607573 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc809b560 con 0x56485414d210 2023-10-07T00:12:17.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.823+0000 7f4bb7fff700 1 -- 172.21.15.5:0/2673607573 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bc809ae60 con 0x56485414d210 2023-10-07T00:12:17.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.823+0000 7f4bb7fff700 1 -- 172.21.15.5:0/2673607573 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc809a350 con 0x56485414d210 2023-10-07T00:12:17.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2673607573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 msgr2=0x56485414d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x56485414d630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4bc809adf0 tx=0x7f4bc809a9a0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2673607573 shutdown_connections 2023-10-07T00:12:17.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414ea10 0x56485414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x56485414d630 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2673607573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414db70 0x56485414e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2673607573 >> 172.21.15.5:0/2673607573 conn(0x5648540c1210 msgr2=0x5648541480f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2673607573 shutdown_connections 2023-10-07T00:12:17.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2673607573 wait complete. 2023-10-07T00:12:17.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.824+0000 7f4be74c0b80 1 -- start start 2023-10-07T00:12:17.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4be74c0b80 1 Processor -- start 2023-10-07T00:12:17.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414d210 0x564854156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414db70 0x5648541571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 0x56485415e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485409fde0 con 0x56485414db70 2023-10-07T00:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485403c6c0 con 0x56485414d210 2023-10-07T00:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485403c360 con 0x56485414ea10 2023-10-07T00:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4be74c0b80 10 client.0 _ll_register_callbacks cb 0x564853e997b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4bd119a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414db70 0x5648541571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4bd119a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414db70 0x5648541571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34772/0 (socket says 172.21.15.5:34772) 2023-10-07T00:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4bd119a700 1 -- 172.21.15.5:0/2132800965 learned_addr learned my addr 172.21.15.5:0/2132800965 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.825+0000 7f4bd219c700 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 0x56485415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bd199b700 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414d210 0x564854156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bd119a700 1 -- 172.21.15.5:0/2132800965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 msgr2=0x56485415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bd119a700 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 0x56485415e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bd119a700 1 -- 172.21.15.5:0/2132800965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414d210 msgr2=0x564854156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bd119a700 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414d210 0x564854156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bd119a700 1 -- 172.21.15.5:0/2132800965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc1a1260 con 0x56485414db70 2023-10-07T00:12:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bd199b700 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414d210 0x564854156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bd119a700 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414db70 0x5648541571f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0116f0 tx=0x7f4bbc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7d1c1ccb8db9c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bb57fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bb57fa700 1 -- 172.21.15.5:0/2132800965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc010ee0 con 0x56485414db70 2023-10-07T00:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bb57fa700 1 -- 172.21.15.5:0/2132800965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4bbc017070 con 0x56485414db70 2023-10-07T00:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2132800965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56485413fec0 con 0x56485414db70 2023-10-07T00:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.826+0000 7f4bb57fa700 1 -- 172.21.15.5:0/2132800965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bbc011e70 con 0x56485414db70 2023-10-07T00:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4be74c0b80 10 client.15108 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2132800965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564853eb3c10 con 0x56485414db70 2023-10-07T00:12:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4bb57fa700 1 -- 172.21.15.5:0/2132800965 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56485413fec0 con 0x56485414db70 2023-10-07T00:12:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4bb57fa700 1 -- 172.21.15.5:0/2132800965 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4bbc01f430 con 0x56485414db70 2023-10-07T00:12:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4be74c0b80 10 client.15108 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4be74c0b80 10 client.15108 resolve_mds: resolved name 'g' to daemon mds.g 2023-10-07T00:12:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4be74c0b80 20 client.15108 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x564854162930 0x564854161390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4be74c0b80 4 client.15108 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2132800965 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564854098dc0 con 0x564854162930 2023-10-07T00:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.827+0000 7f4bd199b700 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x564854162930 0x564854161390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.828+0000 7f4bb57fa700 10 client.15108 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.828+0000 7f4bd199b700 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x564854162930 0x564854161390 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b1321f5fde9c52 server_cookie=2f2897b9e760bd70 in_seq=0 out_seq=0 2023-10-07T00:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4bb57fa700 1 -- 172.21.15.5:0/2132800965 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564854098dc0 con 0x564854162930 2023-10-07T00:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4bb57fa700 10 client.15108 handle_command_reply: tid=0 2023-10-07T00:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 client.15108 shutdown 2023-10-07T00:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2132800965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414db70 msgr2=0x5648541571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414db70 0x5648541571f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0116f0 tx=0x7f4bbc0047c0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2132800965 shutdown_connections 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 0x56485415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x564854162930 0x564854161390 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414d210 0x564854156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/2132800965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414db70 0x5648541571f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4bb57fa700 0 client.15108 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2132800965 >> 172.21.15.5:0/2132800965 conn(0x5648540c1210 msgr2=0x564854147f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2132800965 shutdown_connections 2023-10-07T00:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.829+0000 7f4be74c0b80 1 -- 172.21.15.5:0/2132800965 wait complete. 2023-10-07T00:12:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.830+0000 7f4be74c0b80 20 client.15108 trim_cache size 0 max 16384 2023-10-07T00:12:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.851+0000 7f4be74c0b80 1 Processor -- start 2023-10-07T00:12:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.851+0000 7f4be74c0b80 1 -- start start 2023-10-07T00:12:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414d210 0x5648541559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414ea10 0x56485415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564853f208d0 con 0x56485414ea10 2023-10-07T00:12:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648540464d0 con 0x56485414db70 2023-10-07T00:12:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564853f2cde0 con 0x56485414d210 2023-10-07T00:12:17.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd219c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414ea10 0x56485415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd199b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414d210 0x5648541559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd119a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd199b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414d210 0x5648541559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:57440/0 (socket says 172.21.15.5:57440) 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd199b700 1 -- 172.21.15.5:0/53782104 learned_addr learned my addr 172.21.15.5:0/53782104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd199b700 1 -- 172.21.15.5:0/53782104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 msgr2=0x56485415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd199b700 1 --2- 172.21.15.5:0/53782104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd199b700 1 -- 172.21.15.5:0/53782104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414ea10 msgr2=0x56485415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd199b700 1 --2- 172.21.15.5:0/53782104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414ea10 0x56485415ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.852+0000 7f4bd199b700 1 -- 172.21.15.5:0/53782104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564853ef1200 con 0x56485414d210 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.853+0000 7f4bd199b700 1 --2- 172.21.15.5:0/53782104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414d210 0x5648541559a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800be50 tx=0x7f4bc8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5638a17ce703042c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.853+0000 7f4bc0bff700 1 -- 172.21.15.5:0/53782104 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80a10e0 con 0x56485414d210 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.853+0000 7f4bc0bff700 1 -- 172.21.15.5:0/53782104 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bc809efb0 con 0x56485414d210 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.853+0000 7f4bc0bff700 1 -- 172.21.15.5:0/53782104 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc809a5b0 con 0x56485414d210 2023-10-07T00:12:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.853+0000 7f4be74c0b80 1 -- 172.21.15.5:0/53782104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414d210 msgr2=0x5648541559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.853+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/53782104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414d210 0x5648541559a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800be50 tx=0x7f4bc8009310 comp rx=0 tx=0).stop 2023-10-07T00:12:17.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 -- 172.21.15.5:0/53782104 shutdown_connections 2023-10-07T00:12:17.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/53782104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414ea10 0x56485415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/53782104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414d210 0x5648541559a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/53782104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 -- 172.21.15.5:0/53782104 >> 172.21.15.5:0/53782104 conn(0x5648540c1210 msgr2=0x56485416b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 -- 172.21.15.5:0/53782104 shutdown_connections 2023-10-07T00:12:17.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 -- 172.21.15.5:0/53782104 wait complete. 2023-10-07T00:12:17.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 -- start start 2023-10-07T00:12:17.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.854+0000 7f4be74c0b80 1 Processor -- start 2023-10-07T00:12:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x564854161b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4be74c0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 0x56485415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485415de00 con 0x56485414d210 2023-10-07T00:12:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485415df70 con 0x56485414db70 2023-10-07T00:12:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4be74c0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485415e130 con 0x56485414ea10 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4be74c0b80 10 client.0 _ll_register_callbacks cb 0x564853e997b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x564854161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x564854161b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34786/0 (socket says 172.21.15.5:34786) 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 -- 172.21.15.5:0/3194628570 learned_addr learned my addr 172.21.15.5:0/3194628570 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd119a700 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd219c700 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 0x56485415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 -- 172.21.15.5:0/3194628570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 msgr2=0x56485415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 0x56485415d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 -- 172.21.15.5:0/3194628570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 msgr2=0x56485415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 -- 172.21.15.5:0/3194628570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564853ecad90 con 0x56485414d210 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd119a700 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bd199b700 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x564854161b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80991b0 tx=0x7f4bc8005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6501078cb92ac3f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.855+0000 7f4bb57fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4bb57fa700 1 -- 172.21.15.5:0/3194628570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80a10e0 con 0x56485414d210 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4bb57fa700 1 -- 172.21.15.5:0/3194628570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4bc809d030 con 0x56485414d210 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 1 -- 172.21.15.5:0/3194628570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bc809ae60 con 0x56485414d210 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4bb57fa700 1 -- 172.21.15.5:0/3194628570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bc809a560 con 0x56485414d210 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 10 client.15114 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 1 -- 172.21.15.5:0/3194628570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564853ec9260 con 0x56485414d210 2023-10-07T00:12:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4bb57fa700 1 -- 172.21.15.5:0/3194628570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bc809ae60 con 0x56485414d210 2023-10-07T00:12:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4bb57fa700 1 -- 172.21.15.5:0/3194628570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4bc80cbc60 con 0x56485414d210 2023-10-07T00:12:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 10 client.15114 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 10 client.15114 resolve_mds: resolved name 'g' to daemon mds.g 2023-10-07T00:12:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 20 client.15114 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x5648541baa60 0x5648541b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 4 client.15114 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.856+0000 7f4be74c0b80 1 -- 172.21.15.5:0/3194628570 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564854098ae0 con 0x5648541baa60 2023-10-07T00:12:17.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.857+0000 7f4bd119a700 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x5648541baa60 0x5648541b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:17.864 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:17 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3282901369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:17.864 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:17 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3719716009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.857+0000 7f4bb57fa700 10 client.15114 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:12:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.857+0000 7f4bd119a700 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x5648541baa60 0x5648541b6fb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3e26bef44aeb133a server_cookie=b9a95f0156960691 in_seq=0 out_seq=0 2023-10-07T00:12:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4bb57fa700 1 -- 172.21.15.5:0/3194628570 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x564854098ae0 con 0x5648541baa60 2023-10-07T00:12:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4bb57fa700 10 client.15114 handle_command_reply: tid=0 2023-10-07T00:12:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 client.15114 shutdown 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 -- 172.21.15.5:0/3194628570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 msgr2=0x564854161b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x564854161b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80991b0 tx=0x7f4bc8005ea0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 -- 172.21.15.5:0/3194628570 shutdown_connections 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56485414ea10 0x56485415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56485414d210 0x564854161b00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x5648541baa60 0x5648541b6fb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 --2- 172.21.15.5:0/3194628570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56485414db70 0x56485415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 -- 172.21.15.5:0/3194628570 >> 172.21.15.5:0/3194628570 conn(0x5648540c1210 msgr2=0x5648541559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4bb57fa700 0 client.15114 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 -- 172.21.15.5:0/3194628570 shutdown_connections 2023-10-07T00:12:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 1 -- 172.21.15.5:0/3194628570 wait complete. 2023-10-07T00:12:17.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.858+0000 7f4be74c0b80 20 client.15114 trim_cache size 0 max 16384 2023-10-07T00:12:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:17.867 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:17.867 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 4, 2023-10-07T00:12:17.867 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 14682, 2023-10-07T00:12:17.867 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:17.867 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:17.867 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:17.868 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 58.215310238999997, 2023-10-07T00:12:17.868 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:17.868 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:17.868 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:17.868 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 77.513470275000003 2023-10-07T00:12:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:17.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bb80a1590 msgr2=0x7f4bb80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bb80a1590 0x7f4bb80a3a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc007c60 tx=0x7f4bbc0073d0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1778808355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bcc0ff890 msgr2=0x7f4bcc198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:17.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bcc0ff890 0x7f4bcc198dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000c00 tx=0x7f4bc800fa00 comp rx=0 tx=0).stop 2023-10-07T00:12:17.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1778808355 shutdown_connections 2023-10-07T00:12:17.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bb80a1590 0x7f4bb80a3a50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc100bb0 0x7f4bcc1a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bcc0ff890 0x7f4bcc198dd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 --2- 172.21.15.5:0/1778808355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc1001f0 0x7f4bcc199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:17.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1778808355 >> 172.21.15.5:0/1778808355 conn(0x7f4bcc0fb450 msgr2=0x7f4bcc0fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:17.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1778808355 shutdown_connections 2023-10-07T00:12:17.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:17.859+0000 7f4bd3bff700 1 -- 172.21.15.5:0/1778808355 wait complete. 2023-10-07T00:12:17.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-07T00:12:18.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 -- 172.21.15.5:0/882131330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0104370 msgr2=0x7feff0106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 --2- 172.21.15.5:0/882131330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0104370 0x7feff0106760 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009990 tx=0x7fefe4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 -- 172.21.15.5:0/882131330 shutdown_connections 2023-10-07T00:12:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 --2- 172.21.15.5:0/882131330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff0106ca0 0x7feff0109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 --2- 172.21.15.5:0/882131330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feff0101a40 0x7feff0103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 --2- 172.21.15.5:0/882131330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0104370 0x7feff0106760 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 -- 172.21.15.5:0/882131330 >> 172.21.15.5:0/882131330 conn(0x7feff00fb410 msgr2=0x7feff00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 -- 172.21.15.5:0/882131330 shutdown_connections 2023-10-07T00:12:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.100+0000 7feff5fff700 1 -- 172.21.15.5:0/882131330 wait complete. 2023-10-07T00:12:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.101+0000 7feff5fff700 1 Processor -- start 2023-10-07T00:12:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.101+0000 7feff5fff700 1 -- start start 2023-10-07T00:12:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7feff5fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0101a40 0x7feff0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7feff5fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff0104370 0x7feff01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7feff5fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feff0106ca0 0x7feff01a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7feff5fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff01a0930 con 0x7feff0101a40 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7feff5fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff01a0a70 con 0x7feff0106ca0 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7feff5fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff01a0c00 con 0x7feff0104370 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0101a40 0x7feff0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0101a40 0x7feff0198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34802/0 (socket says 172.21.15.5:34802) 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefef7fe700 1 -- 172.21.15.5:0/2720711381 learned_addr learned my addr 172.21.15.5:0/2720711381 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefeeffd700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff0104370 0x7feff01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefeffff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feff0106ca0 0x7feff01a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefef7fe700 1 -- 172.21.15.5:0/2720711381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff0104370 msgr2=0x7feff01992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefef7fe700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff0104370 0x7feff01992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefef7fe700 1 -- 172.21.15.5:0/2720711381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feff0106ca0 msgr2=0x7feff01a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefef7fe700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feff0106ca0 0x7feff01a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.102+0000 7fefef7fe700 1 -- 172.21.15.5:0/2720711381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40095f0 con 0x7feff0101a40 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.103+0000 7fefef7fe700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0101a40 0x7feff0198db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fefe000e9a0 tx=0x7fefe000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.103+0000 7fefecff9700 1 -- 172.21.15.5:0/2720711381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0009790 con 0x7feff0101a40 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.103+0000 7fefecff9700 1 -- 172.21.15.5:0/2720711381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefe0010430 con 0x7feff0101a40 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.103+0000 7feff5fff700 1 -- 172.21.15.5:0/2720711381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff01a0ee0 con 0x7feff0101a40 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.103+0000 7fefecff9700 1 -- 172.21.15.5:0/2720711381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000cea0 con 0x7feff0101a40 2023-10-07T00:12:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.103+0000 7feff5fff700 1 -- 172.21.15.5:0/2720711381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff01a1300 con 0x7feff0101a40 2023-10-07T00:12:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.108+0000 7fefecff9700 1 -- 172.21.15.5:0/2720711381 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fefe00105a0 con 0x7feff0101a40 2023-10-07T00:12:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.109+0000 7ff009a04b80 1 Processor -- start 2023-10-07T00:12:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7ff009a04b80 1 -- start start 2023-10-07T00:12:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7fefecff9700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fefd80a1510 0x7fefd80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532210 0x55ddba532630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 0x55ddba533430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba533e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7ff009a04b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba49a410 con 0x55ddba533a10 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7ff009a04b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba48bbd0 con 0x55ddba532210 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7ff009a04b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba4894f0 con 0x55ddba532b70 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7fefecff9700 1 -- 172.21.15.5:0/2720711381 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fefe0014070 con 0x7feff0101a40 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7fefef7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532210 0x55ddba532630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7fefeffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba533e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7fefef7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532210 0x55ddba532630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:48790/0 (socket says 172.21.15.5:48790) 2023-10-07T00:12:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7fefef7fe700 1 -- 172.21.15.5:0/4222925971 learned_addr learned my addr 172.21.15.5:0/4222925971 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7fefeffff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fefd80a1510 0x7fefd80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.110+0000 7fefeeffd700 1 --2- 172.21.15.5:0/4222925971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 0x55ddba533430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.111+0000 7fefef7fe700 1 -- 172.21.15.5:0/4222925971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 msgr2=0x55ddba533430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.111+0000 7fefef7fe700 1 --2- 172.21.15.5:0/4222925971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 0x55ddba533430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.111+0000 7fefef7fe700 1 -- 172.21.15.5:0/4222925971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 msgr2=0x55ddba533e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.111+0000 7fefef7fe700 1 --2- 172.21.15.5:0/4222925971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba533e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.111+0000 7fefef7fe700 1 -- 172.21.15.5:0/4222925971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddba2afd90 con 0x55ddba532210 2023-10-07T00:12:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.111+0000 7fefeffff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fefd80a1510 0x7fefd80a39d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009550 tx=0x7fefe8006040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.111+0000 7fefef7fe700 1 --2- 172.21.15.5:0/4222925971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532210 0x55ddba532630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefe0010bf0 tx=0x7fefe0099b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9fc45ad3a96668f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.111+0000 7fefd5ffb700 1 -- 172.21.15.5:0/4222925971 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe009e120 con 0x55ddba532210 2023-10-07T00:12:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7fefd5ffb700 1 -- 172.21.15.5:0/4222925971 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefe009a8e0 con 0x55ddba532210 2023-10-07T00:12:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7fefd5ffb700 1 -- 172.21.15.5:0/4222925971 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00cac20 con 0x55ddba532210 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 -- 172.21.15.5:0/4222925971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532210 msgr2=0x55ddba532630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 --2- 172.21.15.5:0/4222925971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532210 0x55ddba532630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefe0010bf0 tx=0x7fefe0099b40 comp rx=0 tx=0).stop 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 -- 172.21.15.5:0/4222925971 shutdown_connections 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 --2- 172.21.15.5:0/4222925971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba533e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 --2- 172.21.15.5:0/4222925971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532210 0x55ddba532630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 --2- 172.21.15.5:0/4222925971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 0x55ddba533430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 -- 172.21.15.5:0/4222925971 >> 172.21.15.5:0/4222925971 conn(0x55ddba4a6210 msgr2=0x55ddba52d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 -- 172.21.15.5:0/4222925971 shutdown_connections 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.112+0000 7ff009a04b80 1 -- 172.21.15.5:0/4222925971 wait complete. 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.113+0000 7ff009a04b80 1 -- start start 2023-10-07T00:12:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.113+0000 7ff009a04b80 1 Processor -- start 2023-10-07T00:12:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532210 0x55ddba53bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba543460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7ff009a04b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba484de0 con 0x55ddba533a10 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7ff009a04b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba4216c0 con 0x55ddba532b70 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7ff009a04b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba421360 con 0x55ddba532210 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7ff009a04b80 10 client.0 _ll_register_callbacks cb 0x55ddba27e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7fefeeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7fefeffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba543460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7fefeffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba543460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34826/0 (socket says 172.21.15.5:34826) 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7fefeeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:48794/0 (socket says 172.21.15.5:48794) 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7fefeffff700 1 -- 172.21.15.5:0/1838170158 learned_addr learned my addr 172.21.15.5:0/1838170158 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7fefef7fe700 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532210 0x55ddba53bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7fefeffff700 1 -- 172.21.15.5:0/1838170158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532210 msgr2=0x55ddba53bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.114+0000 7fefeffff700 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532210 0x55ddba53bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.115+0000 7fefeffff700 1 -- 172.21.15.5:0/1838170158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 msgr2=0x55ddba53c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.115+0000 7fefeffff700 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.115+0000 7fefeffff700 1 -- 172.21.15.5:0/1838170158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff01a1300 con 0x55ddba533a10 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.115+0000 7fefeffff700 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba543460 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fefe801ae30 tx=0x7fefe8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fd42e3ea71c227 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.115+0000 7fefceffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.115+0000 7fefceffd700 1 -- 172.21.15.5:0/1838170158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe800e030 con 0x55ddba533a10 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.115+0000 7fefceffd700 1 -- 172.21.15.5:0/1838170158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fefe801bd80 con 0x55ddba533a10 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.115+0000 7ff009a04b80 1 -- 172.21.15.5:0/1838170158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddba524ec0 con 0x55ddba533a10 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.116+0000 7fefceffd700 1 -- 172.21.15.5:0/1838170158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefe8025450 con 0x55ddba533a10 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.116+0000 7ff009a04b80 10 client.15126 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.116+0000 7ff009a04b80 1 -- 172.21.15.5:0/1838170158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ddba298c10 con 0x55ddba533a10 2023-10-07T00:12:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.116+0000 7fefceffd700 1 -- 172.21.15.5:0/1838170158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ddba524ec0 con 0x55ddba533a10 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.117+0000 7fefceffd700 1 -- 172.21.15.5:0/1838170158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fefe8023070 con 0x55ddba533a10 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.117+0000 7ff009a04b80 10 client.15126 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.117+0000 7ff009a04b80 10 client.15126 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.117+0000 7ff009a04b80 20 client.15126 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.117+0000 7ff009a04b80 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55ddba547b40 0x55ddba5465b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.117+0000 7ff009a04b80 4 client.15126 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.117+0000 7ff009a04b80 1 -- 172.21.15.5:0/1838170158 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddba47ddc0 con 0x55ddba547b40 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.117+0000 7fefef7fe700 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55ddba547b40 0x55ddba5465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.118+0000 7fefef7fe700 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55ddba547b40 0x55ddba5465b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=47a21f832afe74f1 server_cookie=28075a55555a47ed in_seq=0 out_seq=0 2023-10-07T00:12:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.118+0000 7fefceffd700 10 client.15126 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7fefceffd700 1 -- 172.21.15.5:0/1838170158 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ddba47ddc0 con 0x55ddba547b40 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7fefceffd700 10 client.15126 handle_command_reply: tid=0 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 client.15126 shutdown 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 -- 172.21.15.5:0/1838170158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 msgr2=0x55ddba543460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba543460 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fefe801ae30 tx=0x7fefe8009920 comp rx=0 tx=0).stop 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 -- 172.21.15.5:0/1838170158 shutdown_connections 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55ddba547b40 0x55ddba5465b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba533a10 0x55ddba543460 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532210 0x55ddba53bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 --2- 172.21.15.5:0/1838170158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 -- 172.21.15.5:0/1838170158 >> 172.21.15.5:0/1838170158 conn(0x55ddba4a6210 msgr2=0x55ddba52cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7fefceffd700 0 client.15126 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:12:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 -- 172.21.15.5:0/1838170158 shutdown_connections 2023-10-07T00:12:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 1 -- 172.21.15.5:0/1838170158 wait complete. 2023-10-07T00:12:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.119+0000 7ff009a04b80 20 client.15126 trim_cache size 0 max 16384 2023-10-07T00:12:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.158+0000 7ff009a04b80 1 Processor -- start 2023-10-07T00:12:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.158+0000 7ff009a04b80 1 -- start start 2023-10-07T00:12:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.158+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba52bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.158+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 0x55ddba543420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba533a10 0x55ddba536920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7ff009a04b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba3058d0 con 0x55ddba532210 2023-10-07T00:12:18.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7ff009a04b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba480ed0 con 0x55ddba533a10 2023-10-07T00:12:18.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7ff009a04b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba42b4d0 con 0x55ddba532b70 2023-10-07T00:12:18.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba52bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba52bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34838/0 (socket says 172.21.15.5:34838) 2023-10-07T00:12:18.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefeffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba533a10 0x55ddba536920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefef7fe700 1 -- 172.21.15.5:0/4093985654 learned_addr learned my addr 172.21.15.5:0/4093985654 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefeeffd700 1 --2- 172.21.15.5:0/4093985654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 0x55ddba543420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefef7fe700 1 -- 172.21.15.5:0/4093985654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 msgr2=0x55ddba543420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefef7fe700 1 --2- 172.21.15.5:0/4093985654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 0x55ddba543420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefef7fe700 1 -- 172.21.15.5:0/4093985654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba533a10 msgr2=0x55ddba536920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefef7fe700 1 --2- 172.21.15.5:0/4093985654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba533a10 0x55ddba536920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.159+0000 7fefef7fe700 1 -- 172.21.15.5:0/4093985654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddba2d6200 con 0x55ddba532210 2023-10-07T00:12:18.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.160+0000 7fefef7fe700 1 --2- 172.21.15.5:0/4093985654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba52bb70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fefe00966e0 tx=0x7fefe0010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4d2ed5c1476c98 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.160+0000 7fefd67fc700 1 -- 172.21.15.5:0/4093985654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0098580 con 0x55ddba532210 2023-10-07T00:12:18.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.160+0000 7fefd67fc700 1 -- 172.21.15.5:0/4093985654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefe00cac20 con 0x55ddba532210 2023-10-07T00:12:18.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.160+0000 7fefd67fc700 1 -- 172.21.15.5:0/4093985654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0099910 con 0x55ddba532210 2023-10-07T00:12:18.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 -- 172.21.15.5:0/4093985654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 msgr2=0x55ddba52bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 --2- 172.21.15.5:0/4093985654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba52bb70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fefe00966e0 tx=0x7fefe0010b80 comp rx=0 tx=0).stop 2023-10-07T00:12:18.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 -- 172.21.15.5:0/4093985654 shutdown_connections 2023-10-07T00:12:18.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 --2- 172.21.15.5:0/4093985654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba533a10 0x55ddba536920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 --2- 172.21.15.5:0/4093985654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba52bb70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 --2- 172.21.15.5:0/4093985654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba532b70 0x55ddba543420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 -- 172.21.15.5:0/4093985654 >> 172.21.15.5:0/4093985654 conn(0x55ddba4a6210 msgr2=0x55ddba53abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 -- 172.21.15.5:0/4093985654 shutdown_connections 2023-10-07T00:12:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 -- 172.21.15.5:0/4093985654 wait complete. 2023-10-07T00:12:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 -- start start 2023-10-07T00:12:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.161+0000 7ff009a04b80 1 Processor -- start 2023-10-07T00:12:18.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba53d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7ff009a04b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba533a10 0x55ddba542840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7ff009a04b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba542d80 con 0x55ddba532210 2023-10-07T00:12:18.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7ff009a04b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba542ef0 con 0x55ddba532b70 2023-10-07T00:12:18.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7ff009a04b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddba5430b0 con 0x55ddba533a10 2023-10-07T00:12:18.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7ff009a04b80 10 client.0 _ll_register_callbacks cb 0x7fefe8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:18.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7fefef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba53d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7fefef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba53d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34840/0 (socket says 172.21.15.5:34840) 2023-10-07T00:12:18.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7fefef7fe700 1 -- 172.21.15.5:0/2282407185 learned_addr learned my addr 172.21.15.5:0/2282407185 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7fefeffff700 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba533a10 0x55ddba542840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.162+0000 7fefeeffd700 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefef7fe700 1 -- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba533a10 msgr2=0x55ddba542840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefef7fe700 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba533a10 0x55ddba542840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefef7fe700 1 -- 172.21.15.5:0/2282407185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 msgr2=0x55ddba53db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefef7fe700 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefef7fe700 1 -- 172.21.15.5:0/2282407185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddba2afd90 con 0x55ddba532210 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefeffff700 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba533a10 0x55ddba542840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefef7fe700 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba53d640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fefe001e000 tx=0x7fefe00caa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd8c238380cd51d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefceffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefceffd700 1 -- 172.21.15.5:0/2282407185 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0099b40 con 0x55ddba532210 2023-10-07T00:12:18.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefceffd700 1 -- 172.21.15.5:0/2282407185 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fefe00b82c0 con 0x55ddba532210 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7ff009a04b80 1 -- 172.21.15.5:0/2282407185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefe009a8e0 con 0x55ddba532210 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7fefceffd700 1 -- 172.21.15.5:0/2282407185 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefe00b8480 con 0x55ddba532210 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7ff009a04b80 10 client.15132 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.163+0000 7ff009a04b80 1 -- 172.21.15.5:0/2282407185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ddba2ae260 con 0x55ddba532210 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7fefceffd700 1 -- 172.21.15.5:0/2282407185 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefe009a8e0 con 0x55ddba532210 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7fefceffd700 1 -- 172.21.15.5:0/2282407185 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fefe0019b90 con 0x55ddba532210 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7ff009a04b80 10 client.15132 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7ff009a04b80 10 client.15132 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7ff009a04b80 20 client.15132 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7ff009a04b80 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55ddba59fa10 0x55ddba59bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7ff009a04b80 4 client.15132 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7ff009a04b80 1 -- 172.21.15.5:0/2282407185 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ddba47dae0 con 0x55ddba59fa10 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.164+0000 7fefeeffd700 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55ddba59fa10 0x55ddba59bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7fefeeffd700 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55ddba59fa10 0x55ddba59bf10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5efeffb372902c6d server_cookie=10a64f36ea9c5da1 in_seq=0 out_seq=0 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7fefceffd700 10 client.15132 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7fefceffd700 1 -- 172.21.15.5:0/2282407185 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ddba47dae0 con 0x55ddba59fa10 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7fefceffd700 10 client.15132 handle_command_reply: tid=0 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 client.15132 shutdown 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 -- 172.21.15.5:0/2282407185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 msgr2=0x55ddba53d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba53d640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fefe001e000 tx=0x7fefe00caa50 comp rx=0 tx=0).stop 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 -- 172.21.15.5:0/2282407185 shutdown_connections 2023-10-07T00:12:18.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55ddba59fa10 0x55ddba59bf10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ddba533a10 0x55ddba542840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddba532210 0x55ddba53d640 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 --2- 172.21.15.5:0/2282407185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ddba532b70 0x55ddba53db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 -- 172.21.15.5:0/2282407185 >> 172.21.15.5:0/2282407185 conn(0x55ddba4a6210 msgr2=0x55ddba52bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7fefceffd700 0 client.15132 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.165+0000 7ff009a04b80 1 -- 172.21.15.5:0/2282407185 shutdown_connections 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.166+0000 7ff009a04b80 1 -- 172.21.15.5:0/2282407185 wait complete. 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.166+0000 7ff009a04b80 20 client.15132 trim_cache size 0 max 16384 2023-10-07T00:12:18.176 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 3, 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24553, 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 58.831367409000002, 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:18.177 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 80.787114420999998 2023-10-07T00:12:18.178 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.166+0000 7feff5fff700 1 -- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fefd80a1510 msgr2=0x7fefd80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.166+0000 7feff5fff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fefd80a1510 0x7fefd80a39d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009550 tx=0x7fefe8006040 comp rx=0 tx=0).stop 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 -- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0101a40 msgr2=0x7feff0198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0101a40 0x7feff0198db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fefe000e9a0 tx=0x7fefe000ecb0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 -- 172.21.15.5:0/2720711381 shutdown_connections 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fefd80a1510 0x7fefd80a39d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feff0106ca0 0x7feff01a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff0101a40 0x7feff0198db0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 --2- 172.21.15.5:0/2720711381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff0104370 0x7feff01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 -- 172.21.15.5:0/2720711381 >> 172.21.15.5:0/2720711381 conn(0x7feff00fb410 msgr2=0x7feff01000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 -- 172.21.15.5:0/2720711381 shutdown_connections 2023-10-07T00:12:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.167+0000 7feff5fff700 1 -- 172.21.15.5:0/2720711381 wait complete. 2023-10-07T00:12:18.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-07T00:12:18.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:17 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3282901369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:18.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:17 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3719716009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:18.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:17 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3282901369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:18.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:17 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3719716009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 -- 172.21.15.5:0/834093302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 msgr2=0x7f97dc103eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 --2- 172.21.15.5:0/834093302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 0x7f97dc103eb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009990 tx=0x7f97d8009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 -- 172.21.15.5:0/834093302 shutdown_connections 2023-10-07T00:12:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 --2- 172.21.15.5:0/834093302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97dc106d20 0x7f97dc109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 --2- 172.21.15.5:0/834093302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 0x7f97dc103eb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 --2- 172.21.15.5:0/834093302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97dc1043f0 0x7f97dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 -- 172.21.15.5:0/834093302 >> 172.21.15.5:0/834093302 conn(0x7f97dc0fb410 msgr2=0x7f97dc0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 -- 172.21.15.5:0/834093302 shutdown_connections 2023-10-07T00:12:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.401+0000 7f97e33ff700 1 -- 172.21.15.5:0/834093302 wait complete. 2023-10-07T00:12:18.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.402+0000 7f97e33ff700 1 Processor -- start 2023-10-07T00:12:18.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.402+0000 7f97e33ff700 1 -- start start 2023-10-07T00:12:18.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.402+0000 7f97e33ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 0x7f97dc198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e33ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97dc1043f0 0x7f97dc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e33ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97dc106d20 0x7f97dc1a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e33ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1a0900 con 0x7f97dc101ac0 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e33ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1a0a70 con 0x7f97dc106d20 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e33ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1a0c30 con 0x7f97dc1043f0 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e119b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 0x7f97dc198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e119b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 0x7f97dc198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34852/0 (socket says 172.21.15.5:34852) 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e119b700 1 -- 172.21.15.5:0/1379491817 learned_addr learned my addr 172.21.15.5:0/1379491817 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e099a700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97dc1043f0 0x7f97dc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e199c700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97dc106d20 0x7f97dc1a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e119b700 1 -- 172.21.15.5:0/1379491817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97dc1043f0 msgr2=0x7f97dc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e119b700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97dc1043f0 0x7f97dc199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e119b700 1 -- 172.21.15.5:0/1379491817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97dc106d20 msgr2=0x7f97dc1a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e119b700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97dc106d20 0x7f97dc1a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.403+0000 7f97e119b700 1 -- 172.21.15.5:0/1379491817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80095f0 con 0x7f97dc101ac0 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.404+0000 7f97e119b700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 0x7f97dc198dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f97d80098e0 tx=0x7f97d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.404+0000 7f97d27fc700 1 -- 172.21.15.5:0/1379491817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d801d070 con 0x7f97dc101ac0 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.404+0000 7f97d27fc700 1 -- 172.21.15.5:0/1379491817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97d800be30 con 0x7f97dc101ac0 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.404+0000 7f97e33ff700 1 -- 172.21.15.5:0/1379491817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc1a0eb0 con 0x7f97dc101ac0 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.404+0000 7f97d27fc700 1 -- 172.21.15.5:0/1379491817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8022db0 con 0x7f97dc101ac0 2023-10-07T00:12:18.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.404+0000 7f97e33ff700 1 -- 172.21.15.5:0/1379491817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc1a1220 con 0x7f97dc101ac0 2023-10-07T00:12:18.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.407+0000 7f97d27fc700 1 -- 172.21.15.5:0/1379491817 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f97d8022470 con 0x7f97dc101ac0 2023-10-07T00:12:18.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97f6d0eb80 1 Processor -- start 2023-10-07T00:12:18.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97d27fc700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f97c80a1510 0x7f97c80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97f6d0eb80 1 -- start start 2023-10-07T00:12:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97d27fc700 1 -- 172.21.15.5:0/1379491817 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f97d80ce550 con 0x7f97dc101ac0 2023-10-07T00:12:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97e199c700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f97c80a1510 0x7f97c80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0dfd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0dfe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0dfee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0d65410 con 0x55f1d0dfdb70 2023-10-07T00:12:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0d56bd0 con 0x55f1d0dfd210 2023-10-07T00:12:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.409+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0d544f0 con 0x55f1d0dfea10 2023-10-07T00:12:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e099a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0dfe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0dfd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0dfd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:48824/0 (socket says 172.21.15.5:48824) 2023-10-07T00:12:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e119b700 1 -- 172.21.15.5:0/3467581548 learned_addr learned my addr 172.21.15.5:0/3467581548 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e099a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0dfe430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34858/0 (socket says 172.21.15.5:34858) 2023-10-07T00:12:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e199c700 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0dfee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e199c700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f97c80a1510 0x7f97c80a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f97d4003f60 tx=0x7f97d4009100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e119b700 1 -- 172.21.15.5:0/3467581548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 msgr2=0x55f1d0dfee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e119b700 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0dfee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e119b700 1 -- 172.21.15.5:0/3467581548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 msgr2=0x55f1d0dfe430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e119b700 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0dfe430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e119b700 1 -- 172.21.15.5:0/3467581548 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1d0b7ad90 con 0x55f1d0dfd210 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.410+0000 7f97e099a700 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0dfe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.411+0000 7f97e119b700 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0dfd630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97d802aff0 tx=0x7f97d8005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d0e5d2e7ff1aba server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.411+0000 7f97c77fe700 1 -- 172.21.15.5:0/3467581548 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d809be20 con 0x55f1d0dfd210 2023-10-07T00:12:18.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.411+0000 7f97c77fe700 1 -- 172.21.15.5:0/3467581548 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97d809b720 con 0x55f1d0dfd210 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.411+0000 7f97c77fe700 1 -- 172.21.15.5:0/3467581548 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80ce0d0 con 0x55f1d0dfd210 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/3467581548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 msgr2=0x55f1d0dfd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0dfd630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97d802aff0 tx=0x7f97d8005a00 comp rx=0 tx=0).stop 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/3467581548 shutdown_connections 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0dfee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0dfd630 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/3467581548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0dfe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/3467581548 >> 172.21.15.5:0/3467581548 conn(0x55f1d0d71210 msgr2=0x55f1d0df80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/3467581548 shutdown_connections 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/3467581548 wait complete. 2023-10-07T00:12:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.412+0000 7f97f6d0eb80 1 -- start start 2023-10-07T00:12:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97f6d0eb80 1 Processor -- start 2023-10-07T00:12:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfd210 0x55f1d0e06ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e071e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfea10 0x55f1d0e0e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0d4fde0 con 0x55f1d0dfd210 2023-10-07T00:12:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0cec6c0 con 0x55f1d0dfea10 2023-10-07T00:12:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0cec360 con 0x55f1d0dfdb70 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97f6d0eb80 10 client.0 _ll_register_callbacks cb 0x55f1d0b497b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97e119b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfd210 0x55f1d0e06ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97e099a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97e119b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfd210 0x55f1d0e06ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34868/0 (socket says 172.21.15.5:34868) 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.413+0000 7f97e119b700 1 -- 172.21.15.5:0/1175266505 learned_addr learned my addr 172.21.15.5:0/1175266505 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97e199c700 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfea10 0x55f1d0e0e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97e119b700 1 -- 172.21.15.5:0/1175266505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfdb70 msgr2=0x55f1d0e071e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97e119b700 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e071e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97e119b700 1 -- 172.21.15.5:0/1175266505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfea10 msgr2=0x55f1d0e0e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97e119b700 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfea10 0x55f1d0e0e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97e119b700 1 -- 172.21.15.5:0/1175266505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc0098e0 con 0x55f1d0dfd210 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97e119b700 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfd210 0x55f1d0e06ca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f97d809b6b0 tx=0x7f97d80862c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bbb4017d623cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1175266505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d809be20 con 0x55f1d0dfd210 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1175266505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f97d809f870 con 0x55f1d0dfd210 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.414+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1175266505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1d0defec0 con 0x55f1d0dfd210 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1175266505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97d809ae20 con 0x55f1d0dfd210 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97f6d0eb80 10 client.15144 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1175266505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f97dc1a1220 con 0x55f1d0dfd210 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1175266505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f1d0defec0 con 0x55f1d0dfd210 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1175266505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f97d80b9cb0 con 0x55f1d0dfd210 2023-10-07T00:12:18.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97f6d0eb80 10 client.15144 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97f6d0eb80 10 client.15144 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97f6d0eb80 20 client.15144 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55f1d0e12250 0x55f1d0e11150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97f6d0eb80 4 client.15144 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.415+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1175266505 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1d0d48dc0 con 0x55f1d0e12250 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.416+0000 7f97e099a700 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55f1d0e12250 0x55f1d0e11150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.416+0000 7f97e099a700 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55f1d0e12250 0x55f1d0e11150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5867629e758bf98 server_cookie=ba67043598f1a601 in_seq=0 out_seq=0 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.416+0000 7f97c4ff9700 10 client.15144 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1175266505 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f1d0d48dc0 con 0x55f1d0e12250 2023-10-07T00:12:18.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97c4ff9700 10 client.15144 handle_command_reply: tid=0 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 client.15144 shutdown 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1175266505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfd210 msgr2=0x55f1d0e06ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfd210 0x55f1d0e06ca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f97d809b6b0 tx=0x7f97d80862c0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1175266505 shutdown_connections 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55f1d0e12250 0x55f1d0e11150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfea10 0x55f1d0e0e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfd210 0x55f1d0e06ca0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1175266505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e071e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97c4ff9700 0 client.15144 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1175266505 >> 172.21.15.5:0/1175266505 conn(0x55f1d0d71210 msgr2=0x55f1d0df7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1175266505 shutdown_connections 2023-10-07T00:12:18.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.417+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1175266505 wait complete. 2023-10-07T00:12:18.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.418+0000 7f97f6d0eb80 20 client.15144 trim_cache size 0 max 16384 2023-10-07T00:12:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.436+0000 7f97f6d0eb80 1 Processor -- start 2023-10-07T00:12:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.436+0000 7f97f6d0eb80 1 -- start start 2023-10-07T00:12:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.436+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e11150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.436+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.436+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0df7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.436+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0bd08d0 con 0x55f1d0dfdb70 2023-10-07T00:12:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.436+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0d4bed0 con 0x55f1d0dfd210 2023-10-07T00:12:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.436+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0cf64d0 con 0x55f1d0dfea10 2023-10-07T00:12:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e099a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e11150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e099a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34870/0 (socket says 172.21.15.5:34870) 2023-10-07T00:12:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e099a700 1 -- 172.21.15.5:0/444570527 learned_addr learned my addr 172.21.15.5:0/444570527 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e199c700 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0df7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e119b700 1 -- 172.21.15.5:0/444570527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 msgr2=0x55f1d0df7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e119b700 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0df7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e119b700 1 -- 172.21.15.5:0/444570527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 msgr2=0x55f1d0e0e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e119b700 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e119b700 1 -- 172.21.15.5:0/444570527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1d0b63c10 con 0x55f1d0dfd210 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.437+0000 7f97e099a700 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.438+0000 7f97e119b700 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e11150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97d80cbdc0 tx=0x7f97d8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc5e665541ce8dc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.438+0000 7f97c7fff700 1 -- 172.21.15.5:0/444570527 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d809be20 con 0x55f1d0dfd210 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.438+0000 7f97c7fff700 1 -- 172.21.15.5:0/444570527 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97d809ae20 con 0x55f1d0dfd210 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.438+0000 7f97c7fff700 1 -- 172.21.15.5:0/444570527 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80a37f0 con 0x55f1d0dfd210 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/444570527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 msgr2=0x55f1d0e11150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e11150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97d80cbdc0 tx=0x7f97d8000bc0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/444570527 shutdown_connections 2023-10-07T00:12:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0df7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e11150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/444570527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/444570527 >> 172.21.15.5:0/444570527 conn(0x55f1d0d71210 msgr2=0x55f1d0e1abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/444570527 shutdown_connections 2023-10-07T00:12:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/444570527 wait complete. 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 -- start start 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.439+0000 7f97f6d0eb80 1 Processor -- start 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e0a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97f6d0eb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0e0d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0e0de20 con 0x55f1d0dfdb70 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0e0df90 con 0x55f1d0dfd210 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97f6d0eb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1d0e0e150 con 0x55f1d0dfea10 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97f6d0eb80 10 client.0 _ll_register_callbacks cb 0x7f97cc009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97e099a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97e099a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34882/0 (socket says 172.21.15.5:34882) 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97e099a700 1 -- 172.21.15.5:0/1532822748 learned_addr learned my addr 172.21.15.5:0/1532822748 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97e119b700 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e0a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.440+0000 7f97e199c700 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0e0d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97e099a700 1 -- 172.21.15.5:0/1532822748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 msgr2=0x55f1d0e0d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97e099a700 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0e0d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97e099a700 1 -- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 msgr2=0x55f1d0e0a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97e099a700 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e0a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97e099a700 1 -- 172.21.15.5:0/1532822748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc004040 con 0x55f1d0dfdb70 2023-10-07T00:12:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97e119b700 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e0a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97e099a700 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0a8c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f97cc005d90 tx=0x7f97cc009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78411f6d95e9e1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1532822748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc017070 con 0x55f1d0dfdb70 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1532822748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f97cc021c00 con 0x55f1d0dfdb70 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1532822748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97d809b720 con 0x55f1d0dfdb70 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.441+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1532822748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97cc0122e0 con 0x55f1d0dfdb70 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97f6d0eb80 10 client.15150 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1532822748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f97dc1a1220 con 0x55f1d0dfdb70 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1532822748 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97d809b720 con 0x55f1d0dfdb70 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1532822748 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f97cc012560 con 0x55f1d0dfdb70 2023-10-07T00:12:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97f6d0eb80 10 client.15150 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97f6d0eb80 10 client.15150 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97f6d0eb80 20 client.15150 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55f1d0e6a990 0x55f1d0e66e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97f6d0eb80 4 client.15150 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.442+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1532822748 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f1d0d48ae0 con 0x55f1d0e6a990 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.443+0000 7f97e119b700 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55f1d0e6a990 0x55f1d0e66e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.443+0000 7f97e119b700 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55f1d0e6a990 0x55f1d0e66e60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ac26972b828b158 server_cookie=4a784b5295525055 in_seq=0 out_seq=0 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.443+0000 7f97c4ff9700 10 client.15150 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.443+0000 7f97c4ff9700 1 -- 172.21.15.5:0/1532822748 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55f1d0d48ae0 con 0x55f1d0e6a990 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.443+0000 7f97c4ff9700 10 client.15150 handle_command_reply: tid=0 2023-10-07T00:12:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.443+0000 7f97f6d0eb80 1 client.15150 shutdown 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1532822748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 msgr2=0x55f1d0e0a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0a8c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f97cc005d90 tx=0x7f97cc009ed0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1532822748 shutdown_connections 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55f1d0e6a990 0x55f1d0e66e60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1d0dfea10 0x55f1d0e0d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f1d0dfd210 0x55f1d0e0a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 --2- 172.21.15.5:0/1532822748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1d0dfdb70 0x55f1d0e0a8c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1532822748 >> 172.21.15.5:0/1532822748 conn(0x55f1d0d71210 msgr2=0x55f1d0df7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97c4ff9700 0 client.15150 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1532822748 shutdown_connections 2023-10-07T00:12:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 1 -- 172.21.15.5:0/1532822748 wait complete. 2023-10-07T00:12:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.444+0000 7f97f6d0eb80 20 client.15150 trim_cache size 0 max 16384 2023-10-07T00:12:18.452 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2023-10-07T00:12:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24566, 2023-10-07T00:12:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 60.117452256, 2023-10-07T00:12:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 84.188264993999994 2023-10-07T00:12:18.453 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 -- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f97c80a1510 msgr2=0x7f97c80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f97c80a1510 0x7f97c80a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f97d4003f60 tx=0x7f97d4009100 comp rx=0 tx=0).stop 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 -- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 msgr2=0x7f97dc198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 0x7f97dc198dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f97d80098e0 tx=0x7f97d8004730 comp rx=0 tx=0).stop 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 -- 172.21.15.5:0/1379491817 shutdown_connections 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f97c80a1510 0x7f97c80a39d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97dc106d20 0x7f97dc1a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc101ac0 0x7f97dc198dc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 --2- 172.21.15.5:0/1379491817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97dc1043f0 0x7f97dc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 -- 172.21.15.5:0/1379491817 >> 172.21.15.5:0/1379491817 conn(0x7f97dc0fb410 msgr2=0x7f97dc100140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 -- 172.21.15.5:0/1379491817 shutdown_connections 2023-10-07T00:12:18.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.445+0000 7f97e33ff700 1 -- 172.21.15.5:0/1379491817 wait complete. 2023-10-07T00:12:18.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T00:12:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 -- 172.21.15.5:0/2496608326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 msgr2=0x7fd5d4109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/2496608326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 0x7fd5d4109110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00b0a0 tx=0x7fd5cc00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 -- 172.21.15.5:0/2496608326 shutdown_connections 2023-10-07T00:12:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/2496608326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 0x7fd5d4109110 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/2496608326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5d4101ac0 0x7fd5d4103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/2496608326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d41043f0 0x7fd5d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 -- 172.21.15.5:0/2496608326 >> 172.21.15.5:0/2496608326 conn(0x7fd5d40fb410 msgr2=0x7fd5d40fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 -- 172.21.15.5:0/2496608326 shutdown_connections 2023-10-07T00:12:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.679+0000 7fd5d89ff700 1 -- 172.21.15.5:0/2496608326 wait complete. 2023-10-07T00:12:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.680+0000 7fd5d89ff700 1 Processor -- start 2023-10-07T00:12:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.680+0000 7fd5d89ff700 1 -- start start 2023-10-07T00:12:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d89ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d4101ac0 0x7fd5d4101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d89ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5d41043f0 0x7fd5d40ffa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d89ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 0x7fd5d40fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d89ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4100750 con 0x7fd5d4106d20 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d89ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d41008c0 con 0x7fd5d41043f0 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d89ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d41a0cb0 con 0x7fd5d4101ac0 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 0x7fd5d40fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d4101ac0 0x7fd5d4101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 0x7fd5d40fffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34898/0 (socket says 172.21.15.5:34898) 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d4101ac0 0x7fd5d4101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:57566/0 (socket says 172.21.15.5:57566) 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/537674087 learned_addr learned my addr 172.21.15.5:0/537674087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5d41043f0 0x7fd5d40ffa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d259c700 1 -- 172.21.15.5:0/537674087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5d41043f0 msgr2=0x7fd5d40ffa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d259c700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5d41043f0 0x7fd5d40ffa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d259c700 1 -- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 msgr2=0x7fd5d40fffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d259c700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 0x7fd5d40fffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d259c700 1 -- 172.21.15.5:0/537674087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc009d00 con 0x7fd5d4101ac0 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5d41043f0 0x7fd5d40ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.681+0000 7fd5d2d9d700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 0x7fd5d40fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.682+0000 7fd5d259c700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d4101ac0 0x7fd5d4101430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e9f0 tx=0x7fd5c400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.682+0000 7fd5c37fe700 1 -- 172.21.15.5:0/537674087 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400eee0 con 0x7fd5d4101ac0 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.682+0000 7fd5c37fe700 1 -- 172.21.15.5:0/537674087 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5c400cbd0 con 0x7fd5d4101ac0 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.682+0000 7fd5c37fe700 1 -- 172.21.15.5:0/537674087 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4018680 con 0x7fd5d4101ac0 2023-10-07T00:12:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.682+0000 7fd5d89ff700 1 -- 172.21.15.5:0/537674087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d41a0f90 con 0x7fd5d4101ac0 2023-10-07T00:12:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.682+0000 7fd5d89ff700 1 -- 172.21.15.5:0/537674087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d41a1350 con 0x7fd5d4101ac0 2023-10-07T00:12:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.687+0000 7fd5ec3c1b80 1 Processor -- start 2023-10-07T00:12:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.687+0000 7fd5ec3c1b80 1 -- start start 2023-10-07T00:12:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.687+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308726a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.687+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x56308726b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308726be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630871d2410 con 0x56308726a210 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630871c3bd0 con 0x56308726ab70 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630871c14f0 con 0x56308726ba10 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308726a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308726a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34910/0 (socket says 172.21.15.5:34910) 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/1065550473 learned_addr learned my addr 172.21.15.5:0/1065550473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/1065550473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308726be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/1065550473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 msgr2=0x56308726be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d2d9d700 1 --2- 172.21.15.5:0/1065550473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308726be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/1065550473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 msgr2=0x56308726b430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:12:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d2d9d700 1 --2- 172.21.15.5:0/1065550473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x56308726b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5c37fe700 1 -- 172.21.15.5:0/537674087 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fd5c400cd40 con 0x7fd5d4101ac0 2023-10-07T00:12:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.688+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/1065550473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563086fe7d90 con 0x56308726a210 2023-10-07T00:12:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.689+0000 7fd5d2d9d700 1 --2- 172.21.15.5:0/1065550473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308726a630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc006070 tx=0x7fd5cc009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13eb42df253a094 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.689+0000 7fd5c0ff9700 1 -- 172.21.15.5:0/1065550473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00e040 con 0x56308726a210 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.689+0000 7fd5c0ff9700 1 -- 172.21.15.5:0/1065550473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5cc0076e0 con 0x56308726a210 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.689+0000 7fd5c0ff9700 1 -- 172.21.15.5:0/1065550473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0052a0 con 0x56308726a210 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1065550473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 msgr2=0x56308726a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1065550473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308726a630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc006070 tx=0x7fd5cc009c40 comp rx=0 tx=0).stop 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1065550473 shutdown_connections 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1065550473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308726be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1065550473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308726a630 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1065550473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x56308726b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1065550473 >> 172.21.15.5:0/1065550473 conn(0x5630871de210 msgr2=0x5630872650f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1065550473 shutdown_connections 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1065550473 wait complete. 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5c37fe700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5bc0a1420 0x7fd5bc0a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5c37fe700 1 -- 172.21.15.5:0/537674087 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd5c4014070 con 0x7fd5d4101ac0 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.690+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5bc0a1420 0x7fd5bc0a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.691+0000 7fd5ec3c1b80 1 -- start start 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.691+0000 7fd5ec3c1b80 1 Processor -- start 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.691+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5bc0a1420 0x7fd5bc0a38e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x56308726b1f0 tx=0x7fd5c8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.691+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x563087273fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.691+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087274500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.691+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308727b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630871bcde0 con 0x56308726a210 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630871596c0 con 0x56308726ab70 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x563087159360 con 0x56308726ba10 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5ec3c1b80 10 client.0 _ll_register_callbacks cb 0x563086fb67b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x563087273fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308727b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x563087273fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34912/0 (socket says 172.21.15.5:34912) 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d259c700 1 -- 172.21.15.5:0/1906451251 learned_addr learned my addr 172.21.15.5:0/1906451251 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087274500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/1906451251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 msgr2=0x563087274500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d2d9d700 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087274500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/1906451251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 msgr2=0x563087273fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d2d9d700 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x563087273fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/1906451251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d4109d00 con 0x56308726ba10 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d259c700 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x563087273fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.692+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087274500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5d2d9d700 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308727b540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00d010 tx=0x7fd5cc0094f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc5b8645c863093 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/1906451251 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00e070 con 0x56308726ba10 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1906451251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56308725cec0 con 0x56308726ba10 2023-10-07T00:12:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/1906451251 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd5cc00bdc0 con 0x56308726ba10 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/1906451251 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5cc003a00 con 0x56308726ba10 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5ec3c1b80 10 client.24988 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1906451251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563086fd0c10 con 0x56308726ba10 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.693+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/1906451251 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56308725cec0 con 0x56308726ba10 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.694+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/1906451251 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd5cc00b0d0 con 0x56308726ba10 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.694+0000 7fd5ec3c1b80 10 client.24988 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.694+0000 7fd5ec3c1b80 10 client.24988 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.694+0000 7fd5ec3c1b80 20 client.24988 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.694+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x56308727f6e0 0x56308727e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.694+0000 7fd5ec3c1b80 4 client.24988 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.694+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1906451251 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630871b5dc0 con 0x56308727f6e0 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.694+0000 7fd5d259c700 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x56308727f6e0 0x56308727e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.695+0000 7fd5b9ffb700 10 client.24988 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.695+0000 7fd5d259c700 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x56308727f6e0 0x56308727e470 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c729849650dc7223 server_cookie=3267772c03e4adb8 in_seq=0 out_seq=0 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.695+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/1906451251 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5630871b5dc0 con 0x56308727f6e0 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.695+0000 7fd5b9ffb700 10 client.24988 handle_command_reply: tid=0 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 client.24988 shutdown 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1906451251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 msgr2=0x56308727b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308727b540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00d010 tx=0x7fd5cc0094f0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1906451251 shutdown_connections 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x56308727f6e0 0x56308727e470 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x56308727b540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x563087273fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/1906451251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087274500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5b9ffb700 0 client.24988 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1906451251 >> 172.21.15.5:0/1906451251 conn(0x5630871de210 msgr2=0x563087264f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1906451251 shutdown_connections 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/1906451251 wait complete. 2023-10-07T00:12:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.696+0000 7fd5ec3c1b80 20 client.24988 trim_cache size 0 max 16384 2023-10-07T00:12:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.716+0000 7fd5ec3c1b80 1 Processor -- start 2023-10-07T00:12:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.716+0000 7fd5ec3c1b80 1 -- start start 2023-10-07T00:12:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726a210 0x563087271e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x56308727b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726ba10 0x56308726e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308703d8d0 con 0x56308726ba10 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630872642b0 con 0x56308726ab70 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x563087272a70 con 0x56308726a210 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726ba10 0x56308726e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726a210 0x563087271e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726ba10 0x56308726e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34916/0 (socket says 172.21.15.5:34916) 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d2d9d700 1 -- 172.21.15.5:0/3560403990 learned_addr learned my addr 172.21.15.5:0/3560403990 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/3560403990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x56308727b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d259c700 1 -- 172.21.15.5:0/3560403990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 msgr2=0x56308727b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d259c700 1 --2- 172.21.15.5:0/3560403990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x56308727b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d259c700 1 -- 172.21.15.5:0/3560403990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726ba10 msgr2=0x56308726e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d259c700 1 --2- 172.21.15.5:0/3560403990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726ba10 0x56308726e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.717+0000 7fd5d259c700 1 -- 172.21.15.5:0/3560403990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56308700e200 con 0x56308726a210 2023-10-07T00:12:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.718+0000 7fd5d259c700 1 --2- 172.21.15.5:0/3560403990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726a210 0x563087271e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40a20b0 tx=0x7fd5c4099c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e995674ef918feb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.718+0000 7fd5c17fa700 1 -- 172.21.15.5:0/3560403990 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40b1020 con 0x56308726a210 2023-10-07T00:12:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.718+0000 7fd5c17fa700 1 -- 172.21.15.5:0/3560403990 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5c409e170 con 0x56308726a210 2023-10-07T00:12:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.718+0000 7fd5c17fa700 1 -- 172.21.15.5:0/3560403990 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4098680 con 0x56308726a210 2023-10-07T00:12:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3560403990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726a210 msgr2=0x563087271e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3560403990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726a210 0x563087271e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40a20b0 tx=0x7fd5c4099c50 comp rx=0 tx=0).stop 2023-10-07T00:12:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3560403990 shutdown_connections 2023-10-07T00:12:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3560403990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726ba10 0x56308726e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3560403990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726a210 0x563087271e60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3560403990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x56308727b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3560403990 >> 172.21.15.5:0/3560403990 conn(0x5630871de210 msgr2=0x563087272c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3560403990 shutdown_connections 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3560403990 wait complete. 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 -- start start 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.719+0000 7fd5ec3c1b80 1 Processor -- start 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308727b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087277c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5ec3c1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x5630872781d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563087278710 con 0x56308726a210 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x563087278850 con 0x56308726ab70 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5ec3c1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630872d30d0 con 0x56308726ba10 2023-10-07T00:12:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5ec3c1b80 10 client.0 _ll_register_callbacks cb 0x7fd5cc009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308727b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308727b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34920/0 (socket says 172.21.15.5:34920) 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d259c700 1 -- 172.21.15.5:0/3643792952 learned_addr learned my addr 172.21.15.5:0/3643792952 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d2d9d700 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x5630872781d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087277c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d259c700 1 -- 172.21.15.5:0/3643792952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 msgr2=0x5630872781d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d259c700 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x5630872781d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d259c700 1 -- 172.21.15.5:0/3643792952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 msgr2=0x563087277c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.720+0000 7fd5d259c700 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087277c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5d259c700 1 -- 172.21.15.5:0/3643792952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d41a1350 con 0x56308726a210 2023-10-07T00:12:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5d259c700 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308727b1f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd5c409a1e0 tx=0x7fd5c4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346411ee5a1af37b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/3643792952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40b1070 con 0x56308726a210 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/3643792952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd5c409e3a0 con 0x56308726a210 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3643792952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5cc0076e0 con 0x56308726a210 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/3643792952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5c40b82b0 con 0x56308726a210 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5ec3c1b80 10 client.15168 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3643792952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563086fe6260 con 0x56308726a210 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.721+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/3643792952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5cc0076e0 con 0x56308726a210 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/3643792952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd5c40992d0 con 0x56308726a210 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5ec3c1b80 10 client.15168 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5ec3c1b80 10 client.15168 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5ec3c1b80 20 client.15168 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x5630872d8090 0x5630872d4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5ec3c1b80 4 client.15168 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3643792952 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5630871b5ae0 con 0x5630872d8090 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x5630872d8090 0x5630872d4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5d1d9b700 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x5630872d8090 0x5630872d4540 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78e9c5d513d0f2d7 server_cookie=b5072e7e80e0f2f2 in_seq=0 out_seq=0 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.722+0000 7fd5b9ffb700 10 client.15168 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5b9ffb700 1 -- 172.21.15.5:0/3643792952 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5630871b5ae0 con 0x5630872d8090 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5b9ffb700 10 client.15168 handle_command_reply: tid=0 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 client.15168 shutdown 2023-10-07T00:12:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3643792952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 msgr2=0x56308727b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308727b1f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd5c409a1e0 tx=0x7fd5c4009f50 comp rx=0 tx=0).stop 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3643792952 shutdown_connections 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x5630872d8090 0x5630872d4540 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56308726ba10 0x5630872781d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56308726a210 0x56308727b1f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 --2- 172.21.15.5:0/3643792952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56308726ab70 0x563087277c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3643792952 >> 172.21.15.5:0/3643792952 conn(0x5630871de210 msgr2=0x563087271e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5b9ffb700 0 client.15168 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3643792952 shutdown_connections 2023-10-07T00:12:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 1 -- 172.21.15.5:0/3643792952 wait complete. 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.723+0000 7fd5ec3c1b80 20 client.15168 trim_cache size 0 max 16384 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24574, 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:18.731 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 61.407786289999997, 2023-10-07T00:12:18.732 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:18.732 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:18.732 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:18.732 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 75.236739335999999 2023-10-07T00:12:18.732 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 -- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5bc0a1420 msgr2=0x7fd5bc0a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5bc0a1420 0x7fd5bc0a38e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x56308726b1f0 tx=0x7fd5c8009260 comp rx=0 tx=0).stop 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 -- 172.21.15.5:0/537674087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d4101ac0 msgr2=0x7fd5d4101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d4101ac0 0x7fd5d4101430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e9f0 tx=0x7fd5c400ed00 comp rx=0 tx=0).stop 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 -- 172.21.15.5:0/537674087 shutdown_connections 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5bc0a1420 0x7fd5bc0a38e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d4106d20 0x7fd5d40fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d4101ac0 0x7fd5d4101430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 --2- 172.21.15.5:0/537674087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5d41043f0 0x7fd5d40ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 -- 172.21.15.5:0/537674087 >> 172.21.15.5:0/537674087 conn(0x7fd5d40fb410 msgr2=0x7fd5d4102730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 -- 172.21.15.5:0/537674087 shutdown_connections 2023-10-07T00:12:18.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.724+0000 7fd5d89ff700 1 -- 172.21.15.5:0/537674087 wait complete. 2023-10-07T00:12:18.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 -- 172.21.15.5:0/1192100245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b81021b0 msgr2=0x7f38b8102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 --2- 172.21.15.5:0/1192100245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b81021b0 0x7f38b8102610 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0099c0 tx=0x7f38ac009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 -- 172.21.15.5:0/1192100245 shutdown_connections 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 --2- 172.21.15.5:0/1192100245 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38b8102b50 0x7f38b8109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 --2- 172.21.15.5:0/1192100245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38b8100fc0 0x7f38b81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 --2- 172.21.15.5:0/1192100245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b81021b0 0x7f38b8102610 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 -- 172.21.15.5:0/1192100245 >> 172.21.15.5:0/1192100245 conn(0x7f38b80fc530 msgr2=0x7f38b80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 -- 172.21.15.5:0/1192100245 shutdown_connections 2023-10-07T00:12:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.952+0000 7f38be3ff700 1 -- 172.21.15.5:0/1192100245 wait complete. 2023-10-07T00:12:18.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.953+0000 7f38be3ff700 1 Processor -- start 2023-10-07T00:12:18.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38be3ff700 1 -- start start 2023-10-07T00:12:18.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38be3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b8100fc0 0x7f38b8196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38be3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38b81021b0 0x7f38b8197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38be3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38b8102b50 0x7f38b819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38be3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b819e760 con 0x7f38b8100fc0 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38be3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b819e8d0 con 0x7f38b8102b50 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38be3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b819ea90 con 0x7f38b81021b0 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b8100fc0 0x7f38b8196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b8100fc0 0x7f38b8196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34932/0 (socket says 172.21.15.5:34932) 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b7fff700 1 -- 172.21.15.5:0/2434234001 learned_addr learned my addr 172.21.15.5:0/2434234001 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b77fe700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38b81021b0 0x7f38b8197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38bc99c700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38b8102b50 0x7f38b819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b7fff700 1 -- 172.21.15.5:0/2434234001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38b81021b0 msgr2=0x7f38b8197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b7fff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38b81021b0 0x7f38b8197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b7fff700 1 -- 172.21.15.5:0/2434234001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38b8102b50 msgr2=0x7f38b819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b7fff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38b8102b50 0x7f38b819e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.954+0000 7f38b7fff700 1 -- 172.21.15.5:0/2434234001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0095f0 con 0x7f38b8100fc0 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.955+0000 7f38b7fff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b8100fc0 0x7f38b8196c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f38a800e970 tx=0x7f38a800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.955+0000 7f38b57fa700 1 -- 172.21.15.5:0/2434234001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8009790 con 0x7f38b8100fc0 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.955+0000 7f38be3ff700 1 -- 172.21.15.5:0/2434234001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b819ed70 con 0x7f38b8100fc0 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.955+0000 7f38b57fa700 1 -- 172.21.15.5:0/2434234001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38a800c7e0 con 0x7f38b8100fc0 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.955+0000 7f38b57fa700 1 -- 172.21.15.5:0/2434234001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8003bd0 con 0x7f38b8100fc0 2023-10-07T00:12:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.955+0000 7f38be3ff700 1 -- 172.21.15.5:0/2434234001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b819f210 con 0x7f38b8100fc0 2023-10-07T00:12:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.960+0000 7f38b57fa700 1 -- 172.21.15.5:0/2434234001 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f38a800c950 con 0x7f38b8100fc0 2023-10-07T00:12:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.961+0000 7f38d1d3bb80 1 Processor -- start 2023-10-07T00:12:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.961+0000 7f38d1d3bb80 1 -- start start 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.961+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b3c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.961+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b3d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.961+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b3de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.961+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9aa4410 con 0x5627c9b3cb70 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.961+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9a95bd0 con 0x5627c9b3da10 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.961+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9a934f0 con 0x5627c9b3c210 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b3d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b3d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34944/0 (socket says 172.21.15.5:34944) 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38bc99c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b3c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38b7fff700 1 -- 172.21.15.5:0/4051864737 learned_addr learned my addr 172.21.15.5:0/4051864737 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38b77fe700 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b3de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38bc99c700 1 -- 172.21.15.5:0/4051864737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 msgr2=0x5627c9b3de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38bc99c700 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b3de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38bc99c700 1 -- 172.21.15.5:0/4051864737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 msgr2=0x5627c9b3d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38bc99c700 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b3d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38bc99c700 1 -- 172.21.15.5:0/4051864737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627c98b9d90 con 0x5627c9b3c210 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38b7fff700 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b3d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38b57fa700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38a00a1510 0x7f38a00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.962+0000 7f38bc99c700 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b3c630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38b0011580 tx=0x7f38b0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69135a3846c47036 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.963+0000 7f38b57fa700 1 -- 172.21.15.5:0/2434234001 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f38a8014070 con 0x7f38b8100fc0 2023-10-07T00:12:18.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.963+0000 7f38b7fff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38a00a1510 0x7f38a00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.963+0000 7f389e7fc700 1 -- 172.21.15.5:0/4051864737 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b000e040 con 0x5627c9b3c210 2023-10-07T00:12:18.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.963+0000 7f389e7fc700 1 -- 172.21.15.5:0/4051864737 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38b000f040 con 0x5627c9b3c210 2023-10-07T00:12:18.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.963+0000 7f389e7fc700 1 -- 172.21.15.5:0/4051864737 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0004320 con 0x5627c9b3c210 2023-10-07T00:12:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.963+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/4051864737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 msgr2=0x5627c9b3c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.963+0000 7f38b7fff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38a00a1510 0x7f38a00a39d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38a80cd190 tx=0x7f38a80d09a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.963+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b3c630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38b0011580 tx=0x7f38b0009920 comp rx=0 tx=0).stop 2023-10-07T00:12:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/4051864737 shutdown_connections 2023-10-07T00:12:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b3de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b3c630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/4051864737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b3d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/4051864737 >> 172.21.15.5:0/4051864737 conn(0x5627c9ab0210 msgr2=0x5627c9b370f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/4051864737 shutdown_connections 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/4051864737 wait complete. 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 -- start start 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.964+0000 7f38d1d3bb80 1 Processor -- start 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3c210 0x5627c9b4a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3cb70 0x5627c9b4a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3da10 0x5627c9b51920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9a8ede0 con 0x5627c9b3da10 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9a2b6c0 con 0x5627c9b3c210 2023-10-07T00:12:18.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9a2b360 con 0x5627c9b3cb70 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38d1d3bb80 10 client.0 _ll_register_callbacks cb 0x5627c98887b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38bc99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3da10 0x5627c9b51920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3cb70 0x5627c9b4a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3cb70 0x5627c9b4a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:57656/0 (socket says 172.21.15.5:57656) 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38bc99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3da10 0x5627c9b51920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34950/0 (socket says 172.21.15.5:34950) 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38b77fe700 1 -- 172.21.15.5:0/52215433 learned_addr learned my addr 172.21.15.5:0/52215433 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38bc99c700 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3c210 0x5627c9b4a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.965+0000 7f38b77fe700 1 -- 172.21.15.5:0/52215433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3c210 msgr2=0x5627c9b4a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38b77fe700 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3c210 0x5627c9b4a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38b77fe700 1 -- 172.21.15.5:0/52215433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3da10 msgr2=0x5627c9b51920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38b77fe700 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3da10 0x5627c9b51920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38b77fe700 1 -- 172.21.15.5:0/52215433 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b819f210 con 0x5627c9b3cb70 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38bc99c700 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3da10 0x5627c9b51920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38b77fe700 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3cb70 0x5627c9b4a8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f38ac006010 tx=0x7f38ac005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0546b65ab5fc47e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38977fe700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38977fe700 1 -- 172.21.15.5:0/52215433 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac003760 con 0x5627c9b3cb70 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/52215433 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627c9b2eec0 con 0x5627c9b3cb70 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38977fe700 1 -- 172.21.15.5:0/52215433 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f38ac0038c0 con 0x5627c9b3cb70 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38977fe700 1 -- 172.21.15.5:0/52215433 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38ac003a80 con 0x5627c9b3cb70 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38d1d3bb80 10 client.25006 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.966+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/52215433 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f38b0011230 con 0x5627c9b3cb70 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38977fe700 1 -- 172.21.15.5:0/52215433 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38ac033080 con 0x5627c9b3cb70 2023-10-07T00:12:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38977fe700 1 -- 172.21.15.5:0/52215433 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f38ac02d030 con 0x5627c9b3cb70 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38d1d3bb80 10 client.25006 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38d1d3bb80 10 client.25006 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38d1d3bb80 20 client.25006 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5627c9b55f20 0x5627c9b54a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38d1d3bb80 4 client.25006 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/52215433 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627c9a87dc0 con 0x5627c9b55f20 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.967+0000 7f38bc99c700 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5627c9b55f20 0x5627c9b54a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.968+0000 7f38bc99c700 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5627c9b55f20 0x5627c9b54a20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ce343dc656c34fe server_cookie=b61384199e4003d3 in_seq=0 out_seq=0 2023-10-07T00:12:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.968+0000 7f38977fe700 10 client.25006 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:12:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.968+0000 7f38977fe700 1 -- 172.21.15.5:0/52215433 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627c9a87dc0 con 0x5627c9b55f20 2023-10-07T00:12:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.968+0000 7f38977fe700 10 client.25006 handle_command_reply: tid=0 2023-10-07T00:12:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.968+0000 7f38d1d3bb80 1 client.25006 shutdown 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/52215433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3cb70 msgr2=0x5627c9b4a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3cb70 0x5627c9b4a8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f38ac006010 tx=0x7f38ac005270 comp rx=0 tx=0).stop 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/52215433 shutdown_connections 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5627c9b55f20 0x5627c9b54a20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3da10 0x5627c9b51920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3c210 0x5627c9b4a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/52215433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3cb70 0x5627c9b4a8e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38977fe700 0 client.25006 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:12:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/52215433 >> 172.21.15.5:0/52215433 conn(0x5627c9ab0210 msgr2=0x5627c9b36f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/52215433 shutdown_connections 2023-10-07T00:12:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/52215433 wait complete. 2023-10-07T00:12:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.969+0000 7f38d1d3bb80 20 client.25006 trim_cache size 0 max 16384 2023-10-07T00:12:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38d1d3bb80 1 Processor -- start 2023-10-07T00:12:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38d1d3bb80 1 -- start start 2023-10-07T00:12:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b44c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b35b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c990f8d0 con 0x5627c9b3cb70 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9a87dc0 con 0x5627c9b3da10 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9a8aed0 con 0x5627c9b3c210 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.987+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34960/0 (socket says 172.21.15.5:34960) 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38b77fe700 1 -- 172.21.15.5:0/2847249854 learned_addr learned my addr 172.21.15.5:0/2847249854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38bc99c700 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b44c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38bc99c700 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b35b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38b77fe700 1 -- 172.21.15.5:0/2847249854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 msgr2=0x5627c9b44c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38b77fe700 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b44c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38b77fe700 1 -- 172.21.15.5:0/2847249854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 msgr2=0x5627c9b35b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38b77fe700 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b35b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38b77fe700 1 -- 172.21.15.5:0/2847249854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627c98a2c10 con 0x5627c9b3cb70 2023-10-07T00:12:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38bc99c700 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b35b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f38b77fe700 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b518e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00a010 tx=0x7f38ac001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1767192185a9c1d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f389effd700 1 -- 172.21.15.5:0/2847249854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac005570 con 0x5627c9b3cb70 2023-10-07T00:12:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f389effd700 1 -- 172.21.15.5:0/2847249854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5627c9b2eec0 con 0x5627c9b3cb70 2023-10-07T00:12:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.988+0000 7f389effd700 1 -- 172.21.15.5:0/2847249854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0039c0 con 0x5627c9b3cb70 2023-10-07T00:12:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/2847249854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 msgr2=0x5627c9b518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b518e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00a010 tx=0x7f38ac001e50 comp rx=0 tx=0).stop 2023-10-07T00:12:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/2847249854 shutdown_connections 2023-10-07T00:12:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b35b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b44c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/2847249854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b518e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/2847249854 >> 172.21.15.5:0/2847249854 conn(0x5627c9ab0210 msgr2=0x5627c9b5e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/2847249854 shutdown_connections 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/2847249854 wait complete. 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.989+0000 7f38d1d3bb80 1 -- start start 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38d1d3bb80 1 Processor -- start 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b4d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b4dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38d1d3bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b50ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9b511e0 con 0x5627c9b3cb70 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9b51350 con 0x5627c9b3da10 2023-10-07T00:12:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38d1d3bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c9b51510 con 0x5627c9b3c210 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38d1d3bb80 10 client.0 _ll_register_callbacks cb 0x7f38ac00baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b4dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38bc99c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b4d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b4dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34962/0 (socket says 172.21.15.5:34962) 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38b77fe700 1 -- 172.21.15.5:0/1600687281 learned_addr learned my addr 172.21.15.5:0/1600687281 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.990+0000 7f38bc99c700 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b50ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38b77fe700 1 -- 172.21.15.5:0/1600687281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 msgr2=0x5627c9b4d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38b77fe700 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b4d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38b77fe700 1 -- 172.21.15.5:0/1600687281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 msgr2=0x5627c9b50ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38b77fe700 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b50ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38b77fe700 1 -- 172.21.15.5:0/1600687281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b0011230 con 0x5627c9b3cb70 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38b77fe700 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b4dc80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00fb10 tx=0x7f38ac009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40eed740fd5b501 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38977fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38977fe700 1 -- 172.21.15.5:0/1600687281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac005570 con 0x5627c9b3cb70 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/1600687281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f38b000f040 con 0x5627c9b3cb70 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38977fe700 1 -- 172.21.15.5:0/1600687281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f38ac003970 con 0x5627c9b3cb70 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38977fe700 1 -- 172.21.15.5:0/1600687281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38ac005c40 con 0x5627c9b3cb70 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38d1d3bb80 10 client.15186 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.991+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/1600687281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5627c98e0200 con 0x5627c9b3cb70 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38977fe700 1 -- 172.21.15.5:0/1600687281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38ac048020 con 0x5627c9b3cb70 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38977fe700 1 -- 172.21.15.5:0/1600687281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f38ac042020 con 0x5627c9b3cb70 2023-10-07T00:12:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38d1d3bb80 10 client.15186 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38d1d3bb80 10 client.15186 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38d1d3bb80 20 client.15186 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5627c9badce0 0x5627c9baa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38d1d3bb80 4 client.15186 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/1600687281 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5627c9a87ae0 con 0x5627c9badce0 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.992+0000 7f38bc99c700 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5627c9badce0 0x5627c9baa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38bc99c700 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5627c9badce0 0x5627c9baa170 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e68d4cf8733f27f5 server_cookie=41e428074c707135 in_seq=0 out_seq=0 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38977fe700 10 client.15186 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38977fe700 1 -- 172.21.15.5:0/1600687281 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5627c9a87ae0 con 0x5627c9badce0 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38977fe700 10 client.15186 handle_command_reply: tid=0 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 client.15186 shutdown 2023-10-07T00:12:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/1600687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 msgr2=0x5627c9b4dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b4dc80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00fb10 tx=0x7f38ac009510 comp rx=0 tx=0).stop 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/1600687281 shutdown_connections 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5627c9badce0 0x5627c9baa170 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5627c9b3da10 0x5627c9b50ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c9b3c210 0x5627c9b4d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38977fe700 0 client.15186 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 --2- 172.21.15.5:0/1600687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627c9b3cb70 0x5627c9b4dc80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.993+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/1600687281 >> 172.21.15.5:0/1600687281 conn(0x5627c9ab0210 msgr2=0x5627c9b44c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/1600687281 shutdown_connections 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38d1d3bb80 1 -- 172.21.15.5:0/1600687281 wait complete. 2023-10-07T00:12:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38d1d3bb80 20 client.15186 trim_cache size 0 max 16384 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24611, 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 65.158751289999998, 2023-10-07T00:12:19.001 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:19.002 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 72.373697469000007 2023-10-07T00:12:19.002 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:19.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 -- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38a00a1510 msgr2=0x7f38a00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38a00a1510 0x7f38a00a39d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38a80cd190 tx=0x7f38a80d09a0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 -- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b8100fc0 msgr2=0x7f38b8196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b8100fc0 0x7f38b8196c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f38a800e970 tx=0x7f38a800ec80 comp rx=0 tx=0).stop 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 -- 172.21.15.5:0/2434234001 shutdown_connections 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38a00a1510 0x7f38a00a39d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38b8102b50 0x7f38b819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b8100fc0 0x7f38b8196c20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 --2- 172.21.15.5:0/2434234001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38b81021b0 0x7f38b8197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.994+0000 7f38be3ff700 1 -- 172.21.15.5:0/2434234001 >> 172.21.15.5:0/2434234001 conn(0x7f38b80fc530 msgr2=0x7f38b80fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.995+0000 7f38be3ff700 1 -- 172.21.15.5:0/2434234001 shutdown_connections 2023-10-07T00:12:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:18.995+0000 7f38be3ff700 1 -- 172.21.15.5:0/2434234001 wait complete. 2023-10-07T00:12:19.011 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:18 smithi005 ceph-mon[129406]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:19.014 INFO:tasks.cephadm:Setup complete, yielding 2023-10-07T00:12:19.014 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-07T00:12:19.021 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-10-07T00:12:19.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-07T00:12:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:18 smithi088 ceph-mon[103111]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:18 smithi112 ceph-mon[133548]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-07T00:12:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:20.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:20 smithi088 ceph-mon[103111]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:20.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:20 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:20 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:20 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:20 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:20 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:20 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:20 smithi112 ceph-mon[133548]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:20.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:20 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:20 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:20 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:20 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:20 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:20.998 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:20 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:20 smithi005 ceph-mon[129406]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:21.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:20 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 -- 172.21.15.5:0/672649837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 msgr2=0x7f00981025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 --2- 172.21.15.5:0/672649837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 0x7f00981025d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f00880099c0 tx=0x7f0088009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 -- 172.21.15.5:0/672649837 shutdown_connections 2023-10-07T00:12:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 --2- 172.21.15.5:0/672649837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0098102b10 0x7f00981093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 --2- 172.21.15.5:0/672649837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098100f70 0x7f0098101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 --2- 172.21.15.5:0/672649837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 0x7f00981025d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 -- 172.21.15.5:0/672649837 >> 172.21.15.5:0/672649837 conn(0x7f00980fc4d0 msgr2=0x7f00980fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 -- 172.21.15.5:0/672649837 shutdown_connections 2023-10-07T00:12:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.264+0000 7f009f45c700 1 -- 172.21.15.5:0/672649837 wait complete. 2023-10-07T00:12:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.265+0000 7f009f45c700 1 Processor -- start 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.265+0000 7f009f45c700 1 -- start start 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009f45c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0098100f70 0x7f0098198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009f45c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 0x7f00981992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009f45c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102b10 0x7f00981a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009f45c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00981a0900 con 0x7f0098102170 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009f45c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00981a0a40 con 0x7f0098102b10 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009f45c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00981a0c00 con 0x7f0098100f70 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009c9f7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 0x7f00981992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d1f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0098100f70 0x7f0098198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d1f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0098100f70 0x7f0098198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:57684/0 (socket says 172.21.15.5:57684) 2023-10-07T00:12:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009c9f7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 0x7f00981992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34972/0 (socket says 172.21.15.5:34972) 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d1f8700 1 -- 172.21.15.5:0/2694594538 learned_addr learned my addr 172.21.15.5:0/2694594538 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d9f9700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102b10 0x7f00981a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d1f8700 1 -- 172.21.15.5:0/2694594538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102b10 msgr2=0x7f00981a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d1f8700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102b10 0x7f00981a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d1f8700 1 -- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 msgr2=0x7f00981992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d1f8700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 0x7f00981992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.266+0000 7f009d1f8700 1 -- 172.21.15.5:0/2694594538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00880095f0 con 0x7f0098100f70 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.267+0000 7f009d9f9700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102b10 0x7f00981a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:21.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.267+0000 7f009c9f7700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 0x7f00981992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.267+0000 7f009d1f8700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0098100f70 0x7f0098198db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f009400d980 tx=0x7f009400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.267+0000 7f008e7fc700 1 -- 172.21.15.5:0/2694594538 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094004020 con 0x7f0098100f70 2023-10-07T00:12:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.267+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00981a0ee0 con 0x7f0098100f70 2023-10-07T00:12:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.267+0000 7f008e7fc700 1 -- 172.21.15.5:0/2694594538 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0094009730 con 0x7f0098100f70 2023-10-07T00:12:21.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.267+0000 7f008e7fc700 1 -- 172.21.15.5:0/2694594538 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00940039c0 con 0x7f0098100f70 2023-10-07T00:12:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.267+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00981a1300 con 0x7f0098100f70 2023-10-07T00:12:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.268+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0098193460 con 0x7f0098100f70 2023-10-07T00:12:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.270+0000 7f008e7fc700 1 -- 172.21.15.5:0/2694594538 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f00940098a0 con 0x7f0098100f70 2023-10-07T00:12:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.272+0000 7f008e7fc700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f00840a1590 0x7f00840a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.272+0000 7f008e7fc700 1 -- 172.21.15.5:0/2694594538 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f00940ccb50 con 0x7f0098100f70 2023-10-07T00:12:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.272+0000 7f009c9f7700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f00840a1590 0x7f00840a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.272+0000 7f009c9f7700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f00840a1590 0x7f00840a3a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0088000c00 tx=0x7f008801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.274+0000 7f008e7fc700 1 -- 172.21.15.5:0/2694594538 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0094096050 con 0x7f0098100f70 2023-10-07T00:12:21.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.503+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f009802d2d0 con 0x7f00840a1590 2023-10-07T00:12:21.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.504+0000 7f008e7fc700 1 -- 172.21.15.5:0/2694594538 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f009802d2d0 con 0x7f00840a1590 2023-10-07T00:12:21.505 INFO:teuthology.orchestra.run.smithi005.stdout:Backend: cephadm 2023-10-07T00:12:21.505 INFO:teuthology.orchestra.run.smithi005.stdout:Available: Yes 2023-10-07T00:12:21.505 INFO:teuthology.orchestra.run.smithi005.stdout:Paused: No 2023-10-07T00:12:21.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f00840a1590 msgr2=0x7f00840a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:21.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f00840a1590 0x7f00840a3a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0088000c00 tx=0x7f008801a040 comp rx=0 tx=0).stop 2023-10-07T00:12:21.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0098100f70 msgr2=0x7f0098198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:21.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0098100f70 0x7f0098198db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f009400d980 tx=0x7f009400dc90 comp rx=0 tx=0).stop 2023-10-07T00:12:21.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 shutdown_connections 2023-10-07T00:12:21.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f00840a1590 0x7f00840a3a50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102b10 0x7f00981a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0098100f70 0x7f0098198db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 --2- 172.21.15.5:0/2694594538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0098102170 0x7f00981992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:21.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 >> 172.21.15.5:0/2694594538 conn(0x7f00980fc4d0 msgr2=0x7f0098107b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:21.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 shutdown_connections 2023-10-07T00:12:21.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:21.506+0000 7f009f45c700 1 -- 172.21.15.5:0/2694594538 wait complete. 2023-10-07T00:12:21.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:12:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:12:21.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:12:21.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:12:21.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:21.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-07T00:12:21.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:12:21.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:12:21.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:12:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:22.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:22 smithi088 ceph-mon[103111]: from='client.25018 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:22.954 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:22 smithi088 ceph-mon[103111]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:22.969 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:22 smithi005 ceph-mon[129406]: from='client.25018 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:22.969 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:22 smithi005 ceph-mon[129406]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:22 smithi112 ceph-mon[133548]: from='client.25018 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:22.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:22 smithi112 ceph-mon[133548]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/4062474077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8104330 msgr2=0x7fd5e8106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/4062474077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8104330 0x7fd5e8106720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009990 tx=0x7fd5dc009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/4062474077 shutdown_connections 2023-10-07T00:12:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/4062474077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5e8106c60 0x7fd5e81090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/4062474077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e8101a00 0x7fd5e8103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/4062474077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8104330 0x7fd5e8106720 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/4062474077 >> 172.21.15.5:0/4062474077 conn(0x7fd5e80fb3f0 msgr2=0x7fd5e80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:24.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/4062474077 shutdown_connections 2023-10-07T00:12:24.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.092+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/4062474077 wait complete. 2023-10-07T00:12:24.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.093+0000 7fd5ed4ee700 1 Processor -- start 2023-10-07T00:12:24.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.093+0000 7fd5ed4ee700 1 -- start start 2023-10-07T00:12:24.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.093+0000 7fd5ed4ee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5e8101a00 0x7fd5e8101360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:24.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.093+0000 7fd5ed4ee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e8104330 0x7fd5e80ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:24.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.093+0000 7fd5ed4ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8106c60 0x7fd5e80ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:24.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.093+0000 7fd5ed4ee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e819a9b0 con 0x7fd5e8106c60 2023-10-07T00:12:24.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.093+0000 7fd5ed4ee700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8100430 con 0x7fd5e8101a00 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.093+0000 7fd5ed4ee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e81005f0 con 0x7fd5e8104330 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8106c60 0x7fd5e80ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8106c60 0x7fd5e80ffef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49256/0 (socket says 172.21.15.5:49256) 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 -- 172.21.15.5:0/3374379657 learned_addr learned my addr 172.21.15.5:0/3374379657 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e6ffd700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5e8101a00 0x7fd5e8101360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e67fc700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e8104330 0x7fd5e80ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 -- 172.21.15.5:0/3374379657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e8104330 msgr2=0x7fd5e80ff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e8104330 0x7fd5e80ff9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 -- 172.21.15.5:0/3374379657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5e8101a00 msgr2=0x7fd5e8101360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5e8101a00 0x7fd5e8101360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 -- 172.21.15.5:0/3374379657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0095f0 con 0x7fd5e8106c60 2023-10-07T00:12:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.094+0000 7fd5e77fe700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8106c60 0x7fd5e80ffef0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0007d40 tx=0x7fd5e000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.095+0000 7fd5cffff700 1 -- 172.21.15.5:0/3374379657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000ad40 con 0x7fd5e8106c60 2023-10-07T00:12:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.095+0000 7fd5cffff700 1 -- 172.21.15.5:0/3374379657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5e0007e90 con 0x7fd5e8106c60 2023-10-07T00:12:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.095+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e81a5380 con 0x7fd5e8106c60 2023-10-07T00:12:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.095+0000 7fd5cffff700 1 -- 172.21.15.5:0/3374379657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00115e0 con 0x7fd5e8106c60 2023-10-07T00:12:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.095+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e81a57f0 con 0x7fd5e8106c60 2023-10-07T00:12:24.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.096+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e80fcf70 con 0x7fd5e8106c60 2023-10-07T00:12:24.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.098+0000 7fd5cffff700 1 -- 172.21.15.5:0/3374379657 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fd5e0012420 con 0x7fd5e8106c60 2023-10-07T00:12:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.099+0000 7fd5cffff700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5d00a1590 0x7fd5d00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.099+0000 7fd5cffff700 1 -- 172.21.15.5:0/3374379657 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd5e00ccf90 con 0x7fd5e8106c60 2023-10-07T00:12:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.099+0000 7fd5e6ffd700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5d00a1590 0x7fd5d00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.100+0000 7fd5e6ffd700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5d00a1590 0x7fd5d00a3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8005950 tx=0x7fd5d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:24.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.104+0000 7fd5cffff700 1 -- 172.21.15.5:0/3374379657 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd5e0096520 con 0x7fd5e8106c60 2023-10-07T00:12:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.323+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5e802d160 con 0x7fd5d00a1590 2023-10-07T00:12:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.338+0000 7fd5cffff700 1 -- 172.21.15.5:0/3374379657 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fd5e802d160 con 0x7fd5d00a1590 2023-10-07T00:12:24.339 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-07T00:12:24.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.a smithi005 running (81s) 3s ago 80s 18.4M - 18.0.0-6616-g14d8d032 c754feb42fd5 0e22a82879af 2023-10-07T00:12:24.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.b smithi088 running (78s) 4s ago 77s 29.3M - 18.0.0-6616-g14d8d032 c754feb42fd5 f0e13dfd4af2 2023-10-07T00:12:24.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.c smithi112 running (93s) 4s ago 93s 18.2M - 18.0.0-6616-g14d8d032 c754feb42fd5 bf4fe1fa75b2 2023-10-07T00:12:24.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.d smithi005 running (102s) 3s ago 102s 16.9M - 18.0.0-6616-g14d8d032 c754feb42fd5 ac7b129c6370 2023-10-07T00:12:24.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.e smithi088 running (99s) 4s ago 99s 16.9M - 18.0.0-6616-g14d8d032 c754feb42fd5 d4c62ca4c39a 2023-10-07T00:12:24.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.f smithi112 running (96s) 4s ago 96s 17.1M - 18.0.0-6616-g14d8d032 c754feb42fd5 a5e84e130fed 2023-10-07T00:12:24.341 INFO:teuthology.orchestra.run.smithi005.stdout:mds.g smithi005 running (84s) 3s ago 83s 17.7M - 18.0.0-6616-g14d8d032 c754feb42fd5 70cfa902b18a 2023-10-07T00:12:24.341 INFO:teuthology.orchestra.run.smithi005.stdout:mds.h smithi088 running (90s) 4s ago 90s 17.9M - 18.0.0-6616-g14d8d032 c754feb42fd5 1c78d4b7670d 2023-10-07T00:12:24.341 INFO:teuthology.orchestra.run.smithi005.stdout:mds.i smithi112 running (87s) 4s ago 86s 17.7M - 18.0.0-6616-g14d8d032 c754feb42fd5 0f70f847a6da 2023-10-07T00:12:24.341 INFO:teuthology.orchestra.run.smithi005.stdout:mds.j smithi005 running (105s) 3s ago 105s 13.8M - 18.0.0-6616-g14d8d032 c754feb42fd5 51a4ef8ee1f1 2023-10-07T00:12:24.341 INFO:teuthology.orchestra.run.smithi005.stdout:mds.k smithi088 running (109s) 4s ago 108s 13.9M - 18.0.0-6616-g14d8d032 c754feb42fd5 33e1d80cd515 2023-10-07T00:12:24.341 INFO:teuthology.orchestra.run.smithi005.stdout:mds.l smithi112 running (112s) 4s ago 111s 17.0M - 18.0.0-6616-g14d8d032 c754feb42fd5 e47b9a5a427d 2023-10-07T00:12:24.342 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi005 *:9283,8765 running (9m) 3s ago 9m 527M - 18.0.0-6616-g14d8d032 c754feb42fd5 998a9cb206a1 2023-10-07T00:12:24.342 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi088 *:8443,8765 running (7m) 4s ago 7m 452M - 18.0.0-6616-g14d8d032 c754feb42fd5 bdb921b6a0c9 2023-10-07T00:12:24.342 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.z smithi112 *:8443,8765 running (7m) 4s ago 7m 452M - 18.0.0-6616-g14d8d032 c754feb42fd5 726069db9950 2023-10-07T00:12:24.342 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (9m) 3s ago 9m 99.1M 2048M 18.0.0-6616-g14d8d032 c754feb42fd5 cb6a74464855 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi088 running (7m) 4s ago 7m 64.0M 2048M 18.0.0-6616-g14d8d032 c754feb42fd5 9d76a1fc4d54 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi112 running (7m) 4s ago 7m 67.1M 2048M 18.0.0-6616-g14d8d032 c754feb42fd5 1532319904ac 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 3s ago 7m 68.7M 4318M 18.0.0-6616-g14d8d032 c754feb42fd5 62787fc40016 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi088 running (6m) 4s ago 6m 75.9M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 d1e465044d71 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi112 running (6m) 4s ago 6m 74.2M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 7af33f414c74 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (5m) 3s ago 5m 64.0M 4318M 18.0.0-6616-g14d8d032 c754feb42fd5 52357f24f90a 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi088 running (5m) 4s ago 5m 62.2M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 40d0a6269045 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi112 running (4m) 4s ago 4m 66.5M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 30fe14caf417 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi005 running (4m) 3s ago 4m 59.9M 4318M 18.0.0-6616-g14d8d032 c754feb42fd5 e9c58a739356 2023-10-07T00:12:24.343 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi088 running (3m) 4s ago 3m 64.8M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 c9c127706b28 2023-10-07T00:12:24.344 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 smithi112 running (3m) 4s ago 3m 61.0M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 3657dfb68bb1 2023-10-07T00:12:24.344 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 smithi005 running (3m) 3s ago 3m 60.8M 4318M 18.0.0-6616-g14d8d032 c754feb42fd5 a058e406fc69 2023-10-07T00:12:24.344 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 smithi088 running (2m) 4s ago 2m 63.3M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 17f1929613d4 2023-10-07T00:12:24.344 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 smithi112 running (2m) 4s ago 2m 53.2M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 0800a505304d 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.340+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5d00a1590 msgr2=0x7fd5d00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.340+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5d00a1590 0x7fd5d00a3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8005950 tx=0x7fd5d800b410 comp rx=0 tx=0).stop 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.340+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8106c60 msgr2=0x7fd5e80ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.340+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8106c60 0x7fd5e80ffef0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0007d40 tx=0x7fd5e000a340 comp rx=0 tx=0).stop 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.340+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 shutdown_connections 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.340+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd5d00a1590 0x7fd5d00a3a50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.340+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8106c60 0x7fd5e80ffef0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.341+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5e8101a00 0x7fd5e8101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.341+0000 7fd5ed4ee700 1 --2- 172.21.15.5:0/3374379657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e8104330 0x7fd5e80ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.341+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 >> 172.21.15.5:0/3374379657 conn(0x7fd5e80fb3f0 msgr2=0x7fd5e81026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.341+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 shutdown_connections 2023-10-07T00:12:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:24.341+0000 7fd5ed4ee700 1 -- 172.21.15.5:0/3374379657 wait complete. 2023-10-07T00:12:24.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-07T00:12:24.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:24 smithi088 ceph-mon[103111]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:24 smithi112 ceph-mon[133548]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:24 smithi005 ceph-mon[129406]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:25.942 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:25 smithi005 ceph-mon[129406]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:25.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:25 smithi088 ceph-mon[103111]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:25.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:25 smithi112 ceph-mon[133548]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:26.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:26 smithi088 ceph-mon[103111]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:26.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:26 smithi112 ceph-mon[133548]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 -- 172.21.15.5:0/451902729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102b10 msgr2=0x7f42301093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 --2- 172.21.15.5:0/451902729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102b10 0x7f42301093c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f422800b0d0 tx=0x7f422800b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 -- 172.21.15.5:0/451902729 shutdown_connections 2023-10-07T00:12:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 --2- 172.21.15.5:0/451902729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102b10 0x7f42301093c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 --2- 172.21.15.5:0/451902729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4230100f70 0x7f4230101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 --2- 172.21.15.5:0/451902729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4230102170 0x7f42301025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 -- 172.21.15.5:0/451902729 >> 172.21.15.5:0/451902729 conn(0x7f42300fc4d0 msgr2=0x7f42300fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 -- 172.21.15.5:0/451902729 shutdown_connections 2023-10-07T00:12:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.043+0000 7f4235ac2700 1 -- 172.21.15.5:0/451902729 wait complete. 2023-10-07T00:12:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.044+0000 7f4235ac2700 1 Processor -- start 2023-10-07T00:12:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.044+0000 7f4235ac2700 1 -- start start 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.044+0000 7f4235ac2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4230100f70 0x7f4230074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.044+0000 7f4235ac2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102170 0x7f42300732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.044+0000 7f4235ac2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4230102b10 0x7f42300737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.044+0000 7f4235ac2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4230073f60 con 0x7f4230102170 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.044+0000 7f4235ac2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300740d0 con 0x7f4230102b10 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f4235ac2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42301a0d70 con 0x7f4230100f70 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102170 0x7f42300732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102170 0x7f42300732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49280/0 (socket says 172.21.15.5:49280) 2023-10-07T00:12:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422effd700 1 -- 172.21.15.5:0/1365046145 learned_addr learned my addr 172.21.15.5:0/1365046145 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422f7fe700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4230100f70 0x7f4230074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422ffff700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4230102b10 0x7f42300737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422effd700 1 -- 172.21.15.5:0/1365046145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4230100f70 msgr2=0x7f4230074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422effd700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4230100f70 0x7f4230074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422effd700 1 -- 172.21.15.5:0/1365046145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4230102b10 msgr2=0x7f42300737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422effd700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4230102b10 0x7f42300737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.045+0000 7f422effd700 1 -- 172.21.15.5:0/1365046145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228009d00 con 0x7f4230102170 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.046+0000 7f422effd700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102170 0x7f42300732a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f422400d950 tx=0x7f422400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.046+0000 7f422cff9700 1 -- 172.21.15.5:0/1365046145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224009940 con 0x7f4230102170 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.046+0000 7f422cff9700 1 -- 172.21.15.5:0/1365046145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4224010460 con 0x7f4230102170 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.046+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42301a0ff0 con 0x7f4230102170 2023-10-07T00:12:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.046+0000 7f422cff9700 1 -- 172.21.15.5:0/1365046145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400f620 con 0x7f4230102170 2023-10-07T00:12:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.046+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42301a1540 con 0x7f4230102170 2023-10-07T00:12:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.047+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4230108570 con 0x7f4230102170 2023-10-07T00:12:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.049+0000 7f422cff9700 1 -- 172.21.15.5:0/1365046145 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f42240105d0 con 0x7f4230102170 2023-10-07T00:12:27.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.050+0000 7f422cff9700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42180a1510 0x7f42180a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:27.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.051+0000 7f422cff9700 1 -- 172.21.15.5:0/1365046145 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f42240ccd40 con 0x7f4230102170 2023-10-07T00:12:27.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.051+0000 7f422f7fe700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42180a1510 0x7f42180a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:27.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.051+0000 7f422f7fe700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42180a1510 0x7f42180a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4230101fd0 tx=0x7f4220009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.054+0000 7f422cff9700 1 -- 172.21.15.5:0/1365046145 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f42240961c0 con 0x7f4230102170 2023-10-07T00:12:27.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:26 smithi005 ceph-mon[129406]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:27.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.273+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f423002d2b0 con 0x7f42180a1510 2023-10-07T00:12:27.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.279+0000 7f422cff9700 1 -- 172.21.15.5:0/1365046145 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f423002d2b0 con 0x7f42180a1510 2023-10-07T00:12:27.281 INFO:teuthology.orchestra.run.smithi005.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-07T00:12:27.281 INFO:teuthology.orchestra.run.smithi005.stdout:mds.all 12/12 7s ago 118s smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l;count:12 2023-10-07T00:12:27.281 INFO:teuthology.orchestra.run.smithi005.stdout:mgr 3/3 7s ago 7m smithi005=x;smithi088=y;smithi112=z;count:3 2023-10-07T00:12:27.281 INFO:teuthology.orchestra.run.smithi005.stdout:mon 3/3 7s ago 7m smithi005:172.21.15.5=a;smithi088:172.21.15.88=b;smithi112:172.21.15.112=c;count:3 2023-10-07T00:12:27.281 INFO:teuthology.orchestra.run.smithi005.stdout:osd 12 7s ago - 2023-10-07T00:12:27.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42180a1510 msgr2=0x7f42180a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:27.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42180a1510 0x7f42180a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4230101fd0 tx=0x7f4220009190 comp rx=0 tx=0).stop 2023-10-07T00:12:27.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102170 msgr2=0x7f42300732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:27.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102170 0x7f42300732a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f422400d950 tx=0x7f422400dc60 comp rx=0 tx=0).stop 2023-10-07T00:12:27.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 shutdown_connections 2023-10-07T00:12:27.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f42180a1510 0x7f42180a39d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4230102b10 0x7f42300737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4230100f70 0x7f4230074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.281+0000 7f4235ac2700 1 --2- 172.21.15.5:0/1365046145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230102170 0x7f42300732a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.282+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 >> 172.21.15.5:0/1365046145 conn(0x7f42300fc4d0 msgr2=0x7f42301056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.282+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 shutdown_connections 2023-10-07T00:12:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:27.282+0000 7f4235ac2700 1 -- 172.21.15.5:0/1365046145 wait complete. 2023-10-07T00:12:27.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-07T00:12:28.462 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:28.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:28 smithi088 ceph-mon[103111]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:28.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:28 smithi088 ceph-mon[103111]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:28 smithi112 ceph-mon[133548]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:28 smithi112 ceph-mon[133548]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:29.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:28 smithi005 ceph-mon[129406]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:29.035 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:28 smithi005 ceph-mon[129406]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.976+0000 7feddc619700 1 -- 172.21.15.5:0/2825444989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4102b10 msgr2=0x7fedd41093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.976+0000 7feddc619700 1 --2- 172.21.15.5:0/2825444989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4102b10 0x7fedd41093c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00b0d0 tx=0x7fedcc00b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.977+0000 7feddc619700 1 -- 172.21.15.5:0/2825444989 shutdown_connections 2023-10-07T00:12:29.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.977+0000 7feddc619700 1 --2- 172.21.15.5:0/2825444989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4102b10 0x7fedd41093c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.977+0000 7feddc619700 1 --2- 172.21.15.5:0/2825444989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedd4100f70 0x7fedd4101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.977+0000 7feddc619700 1 --2- 172.21.15.5:0/2825444989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedd4102170 0x7fedd41025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.977+0000 7feddc619700 1 -- 172.21.15.5:0/2825444989 >> 172.21.15.5:0/2825444989 conn(0x7fedd40fc4d0 msgr2=0x7fedd40fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.977+0000 7feddc619700 1 -- 172.21.15.5:0/2825444989 shutdown_connections 2023-10-07T00:12:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.977+0000 7feddc619700 1 -- 172.21.15.5:0/2825444989 wait complete. 2023-10-07T00:12:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.978+0000 7feddc619700 1 Processor -- start 2023-10-07T00:12:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.978+0000 7feddc619700 1 -- start start 2023-10-07T00:12:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.978+0000 7feddc619700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4100f70 0x7fedd4198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.978+0000 7feddc619700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedd4102170 0x7fedd41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.978+0000 7feddc619700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedd4102b10 0x7fedd41a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.978+0000 7feddc619700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41a09f0 con 0x7fedd4100f70 2023-10-07T00:12:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.978+0000 7feddc619700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41a0b30 con 0x7fedd4102170 2023-10-07T00:12:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.978+0000 7feddc619700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41a0cc0 con 0x7fedd4102b10 2023-10-07T00:12:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4100f70 0x7fedd4198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4100f70 0x7fedd4198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49288/0 (socket says 172.21.15.5:49288) 2023-10-07T00:12:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 -- 172.21.15.5:0/4227213894 learned_addr learned my addr 172.21.15.5:0/4227213894 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7feddabb6700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedd4102b10 0x7fedd41a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedd9bb4700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedd4102170 0x7fedd41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 -- 172.21.15.5:0/4227213894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedd4102b10 msgr2=0x7fedd41a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedd4102b10 0x7fedd41a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 -- 172.21.15.5:0/4227213894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedd4102170 msgr2=0x7fedd41993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedd4102170 0x7fedd41993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 -- 172.21.15.5:0/4227213894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009d00 con 0x7fedd4100f70 2023-10-07T00:12:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.979+0000 7fedda3b5700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4100f70 0x7fedd4198e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fedd000d9b0 tx=0x7fedd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.980+0000 7fedcb7fe700 1 -- 172.21.15.5:0/4227213894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0004020 con 0x7fedd4100f70 2023-10-07T00:12:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.980+0000 7fedcb7fe700 1 -- 172.21.15.5:0/4227213894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedd0009730 con 0x7fedd4100f70 2023-10-07T00:12:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.980+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd41a0fa0 con 0x7fedd4100f70 2023-10-07T00:12:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.980+0000 7fedcb7fe700 1 -- 172.21.15.5:0/4227213894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00038c0 con 0x7fedd4100f70 2023-10-07T00:12:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.980+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd41a13b0 con 0x7fedd4100f70 2023-10-07T00:12:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.981+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd41933d0 con 0x7fedd4100f70 2023-10-07T00:12:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.983+0000 7fedcb7fe700 1 -- 172.21.15.5:0/4227213894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fedd00098a0 con 0x7fedd4100f70 2023-10-07T00:12:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.984+0000 7fedcb7fe700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fedc00a1510 0x7fedc00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.984+0000 7fedcb7fe700 1 -- 172.21.15.5:0/4227213894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fedd00ccae0 con 0x7fedd4100f70 2023-10-07T00:12:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.985+0000 7fedd9bb4700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fedc00a1510 0x7fedc00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.985+0000 7fedd9bb4700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fedc00a1510 0x7fedc00a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009c60 tx=0x7fedc4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:29.989+0000 7fedcb7fe700 1 -- 172.21.15.5:0/4227213894 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fedd0095f60 con 0x7fedd4100f70 2023-10-07T00:12:30.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.203+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fedd402d320 con 0x7fedc00a1510 2023-10-07T00:12:30.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.205+0000 7fedcb7fe700 1 -- 172.21.15.5:0/4227213894 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fedd402d320 con 0x7fedc00a1510 2023-10-07T00:12:30.206 INFO:teuthology.orchestra.run.smithi005.stdout:HOST ADDR LABELS STATUS 2023-10-07T00:12:30.206 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 172.21.15.5 2023-10-07T00:12:30.206 INFO:teuthology.orchestra.run.smithi005.stdout:smithi088 172.21.15.88 2023-10-07T00:12:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:smithi112 172.21.15.112 2023-10-07T00:12:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:3 hosts in cluster 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fedc00a1510 msgr2=0x7fedc00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fedc00a1510 0x7fedc00a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009c60 tx=0x7fedc4009260 comp rx=0 tx=0).stop 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4100f70 msgr2=0x7fedd4198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4100f70 0x7fedd4198e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fedd000d9b0 tx=0x7fedd000dcc0 comp rx=0 tx=0).stop 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 shutdown_connections 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fedc00a1510 0x7fedc00a39d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedd4102b10 0x7fedd41a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedd4100f70 0x7fedd4198e60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 --2- 172.21.15.5:0/4227213894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedd4102170 0x7fedd41993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:30.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 >> 172.21.15.5:0/4227213894 conn(0x7fedd40fc4d0 msgr2=0x7fedd4107b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:30.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 shutdown_connections 2023-10-07T00:12:30.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:30.207+0000 7feddc619700 1 -- 172.21.15.5:0/4227213894 wait complete. 2023-10-07T00:12:30.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-07T00:12:30.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:30 smithi088 ceph-mon[103111]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:30 smithi112 ceph-mon[133548]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:31.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:30 smithi005 ceph-mon[129406]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:31.488 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:31.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:31 smithi088 ceph-mon[103111]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:31.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:31 smithi112 ceph-mon[133548]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:32.042 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:31 smithi005 ceph-mon[129406]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:32.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:32 smithi088 ceph-mon[103111]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:32.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.992+0000 7fd61b6f9700 1 -- 172.21.15.5:0/543381034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614073910 msgr2=0x7fd614073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:32.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.992+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/543381034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614073910 0x7fd614073d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd604009990 tx=0x7fd604009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:32.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.993+0000 7fd61b6f9700 1 -- 172.21.15.5:0/543381034 shutdown_connections 2023-10-07T00:12:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.993+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/543381034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614108e40 0x7fd61410b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.993+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/543381034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd614074ee0 0x7fd614073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.993+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/543381034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614073910 0x7fd614073d90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.993+0000 7fd61b6f9700 1 -- 172.21.15.5:0/543381034 >> 172.21.15.5:0/543381034 conn(0x7fd6140fc4d0 msgr2=0x7fd6140fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.993+0000 7fd61b6f9700 1 -- 172.21.15.5:0/543381034 shutdown_connections 2023-10-07T00:12:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.993+0000 7fd61b6f9700 1 -- 172.21.15.5:0/543381034 wait complete. 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.994+0000 7fd61b6f9700 1 Processor -- start 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.994+0000 7fd61b6f9700 1 -- start start 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.994+0000 7fd61b6f9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd614073910 0x7fd614198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.994+0000 7fd61b6f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614074ee0 0x7fd6141992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.994+0000 7fd61b6f9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614108e40 0x7fd6141a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.994+0000 7fd61b6f9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6141a0900 con 0x7fd614074ee0 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.994+0000 7fd61b6f9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6141a0a40 con 0x7fd614073910 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.994+0000 7fd61b6f9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6141a0c00 con 0x7fd614108e40 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614074ee0 0x7fd6141992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614074ee0 0x7fd6141992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41468/0 (socket says 172.21.15.5:41468) 2023-10-07T00:12:32.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd619495700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd614073910 0x7fd614198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 -- 172.21.15.5:0/3894635024 learned_addr learned my addr 172.21.15.5:0/3894635024 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd619c96700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614108e40 0x7fd6141a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 -- 172.21.15.5:0/3894635024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614108e40 msgr2=0x7fd6141a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614108e40 0x7fd6141a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 -- 172.21.15.5:0/3894635024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd614073910 msgr2=0x7fd614198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd614073910 0x7fd614198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 -- 172.21.15.5:0/3894635024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6040095f0 con 0x7fd614074ee0 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.995+0000 7fd618c94700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614074ee0 0x7fd6141992f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c010 tx=0x7fd604004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.996+0000 7fd60a7fc700 1 -- 172.21.15.5:0/3894635024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60401d070 con 0x7fd614074ee0 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.996+0000 7fd60a7fc700 1 -- 172.21.15.5:0/3894635024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6040054c0 con 0x7fd614074ee0 2023-10-07T00:12:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.996+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6141a0e80 con 0x7fd614074ee0 2023-10-07T00:12:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.996+0000 7fd60a7fc700 1 -- 172.21.15.5:0/3894635024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604003ab0 con 0x7fd614074ee0 2023-10-07T00:12:33.001 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:32 smithi112 ceph-mon[133548]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.996+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6141a1230 con 0x7fd614074ee0 2023-10-07T00:12:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.997+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6141074f0 con 0x7fd614074ee0 2023-10-07T00:12:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:32.999+0000 7fd60a7fc700 1 -- 172.21.15.5:0/3894635024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fd6040047a0 con 0x7fd614074ee0 2023-10-07T00:12:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.000+0000 7fd60a7fc700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6000a1590 0x7fd6000a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.000+0000 7fd60a7fc700 1 -- 172.21.15.5:0/3894635024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd6040cde80 con 0x7fd614074ee0 2023-10-07T00:12:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.000+0000 7fd619495700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6000a1590 0x7fd6000a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.001+0000 7fd619495700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6000a1590 0x7fd6000a3a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd61419a290 tx=0x7fd61000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:33.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.004+0000 7fd60a7fc700 1 -- 172.21.15.5:0/3894635024 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd604097390 con 0x7fd614074ee0 2023-10-07T00:12:33.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:32 smithi005 ceph-mon[129406]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:33.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.221+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6140008d0 con 0x7fd6000a1590 2023-10-07T00:12:33.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.223+0000 7fd60a7fc700 1 -- 172.21.15.5:0/3894635024 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fd6140008d0 con 0x7fd6000a1590 2023-10-07T00:12:33.224 INFO:teuthology.orchestra.run.smithi005.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-07T00:12:33.224 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EW480DGN 447G No 3m ago Has a FileSystem, LVM detected 2023-10-07T00:12:33.225 INFO:teuthology.orchestra.run.smithi005.stdout:smithi088 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XD400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-07T00:12:33.225 INFO:teuthology.orchestra.run.smithi005.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-07T00:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.225+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6000a1590 msgr2=0x7fd6000a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.225+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6000a1590 0x7fd6000a3a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd61419a290 tx=0x7fd61000b410 comp rx=0 tx=0).stop 2023-10-07T00:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.225+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614074ee0 msgr2=0x7fd6141992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.225+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614074ee0 0x7fd6141992f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c010 tx=0x7fd604004730 comp rx=0 tx=0).stop 2023-10-07T00:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.226+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 shutdown_connections 2023-10-07T00:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.226+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd6000a1590 0x7fd6000a3a50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.226+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614108e40 0x7fd6141a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:33.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.226+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd614073910 0x7fd614198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:33.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.226+0000 7fd61b6f9700 1 --2- 172.21.15.5:0/3894635024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd614074ee0 0x7fd6141992f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:33.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.226+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 >> 172.21.15.5:0/3894635024 conn(0x7fd6140fc4d0 msgr2=0x7fd6140fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:33.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.226+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 shutdown_connections 2023-10-07T00:12:33.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:33.226+0000 7fd61b6f9700 1 -- 172.21.15.5:0/3894635024 wait complete. 2023-10-07T00:12:33.667 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-07T00:12:33.680 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-10-07T00:12:33.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-07T00:12:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:34.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:34 smithi005 ceph-mon[129406]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:34.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:34 smithi005 ceph-mon[129406]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:34.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:34 smithi088 ceph-mon[103111]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:34.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:34 smithi088 ceph-mon[103111]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:34 smithi112 ceph-mon[133548]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-07T00:12:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:34 smithi112 ceph-mon[133548]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 -- 172.21.15.5:0/4081436599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 msgr2=0x7fe4181093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/4081436599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 0x7fe4181093c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe41000b0d0 tx=0x7fe41000b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 -- 172.21.15.5:0/4081436599 shutdown_connections 2023-10-07T00:12:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/4081436599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 0x7fe4181093c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/4081436599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe418100f70 0x7fe418101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/4081436599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe418102170 0x7fe4181025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 -- 172.21.15.5:0/4081436599 >> 172.21.15.5:0/4081436599 conn(0x7fe4180fc4d0 msgr2=0x7fe4180fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 -- 172.21.15.5:0/4081436599 shutdown_connections 2023-10-07T00:12:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.833+0000 7fe41e8a1700 1 -- 172.21.15.5:0/4081436599 wait complete. 2023-10-07T00:12:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.834+0000 7fe41e8a1700 1 Processor -- start 2023-10-07T00:12:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.834+0000 7fe41e8a1700 1 -- start start 2023-10-07T00:12:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41e8a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe418100f70 0x7fe418198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41e8a1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe418102170 0x7fe4181993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41e8a1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 0x7fe4181a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41e8a1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4181a0a10 con 0x7fe418102b10 2023-10-07T00:12:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41e8a1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4181a0b50 con 0x7fe418102170 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41e8a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4181a0ce0 con 0x7fe418100f70 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41ce3e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 0x7fe4181a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41ce3e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 0x7fe4181a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41492/0 (socket says 172.21.15.5:41492) 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41ce3e700 1 -- 172.21.15.5:0/1421011188 learned_addr learned my addr 172.21.15.5:0/1421011188 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe4177fe700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe418102170 0x7fe4181993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe417fff700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe418100f70 0x7fe418198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41ce3e700 1 -- 172.21.15.5:0/1421011188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe418100f70 msgr2=0x7fe418198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41ce3e700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe418100f70 0x7fe418198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41ce3e700 1 -- 172.21.15.5:0/1421011188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe418102170 msgr2=0x7fe4181993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41ce3e700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe418102170 0x7fe4181993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe41ce3e700 1 -- 172.21.15.5:0/1421011188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410009d00 con 0x7fe418102b10 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.835+0000 7fe417fff700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe418100f70 0x7fe418198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.836+0000 7fe41ce3e700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 0x7fe4181a0440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe410009470 tx=0x7fe410009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.836+0000 7fe4157fa700 1 -- 172.21.15.5:0/1421011188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000e040 con 0x7fe418102b10 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.836+0000 7fe4157fa700 1 -- 172.21.15.5:0/1421011188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe410012e70 con 0x7fe418102b10 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.836+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4181a0f60 con 0x7fe418102b10 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.836+0000 7fe4157fa700 1 -- 172.21.15.5:0/1421011188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41001b450 con 0x7fe418102b10 2023-10-07T00:12:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.836+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4181a1320 con 0x7fe418102b10 2023-10-07T00:12:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.837+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe418193470 con 0x7fe418102b10 2023-10-07T00:12:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.839+0000 7fe4157fa700 1 -- 172.21.15.5:0/1421011188 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fe41001d480 con 0x7fe418102b10 2023-10-07T00:12:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.841+0000 7fe4157fa700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4000a1510 0x7fe4000a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.841+0000 7fe4157fa700 1 -- 172.21.15.5:0/1421011188 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe4100cf060 con 0x7fe418102b10 2023-10-07T00:12:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.841+0000 7fe417fff700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4000a1510 0x7fe4000a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:35.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.842+0000 7fe417fff700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4000a1510 0x7fe4000a39d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe408005fd0 tx=0x7fe408005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:35.843+0000 7fe4157fa700 1 -- 172.21.15.5:0/1421011188 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe410098690 con 0x7fe418102b10 2023-10-07T00:12:36.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.095+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4180009c0 con 0x7fe418102b10 2023-10-07T00:12:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.096+0000 7fe4157fa700 1 -- 172.21.15.5:0/1421011188 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2955 (secure 0 0 0) 0x7fe4180009c0 con 0x7fe418102b10 2023-10-07T00:12:36.097 INFO:teuthology.orchestra.run.smithi005.stdout:e26 2023-10-07T00:12:36.097 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 26 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-10-07T00:11:13.365038+0000 2023-10-07T00:12:36.098 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2023-10-07T00:11:20.652397+0000 2023-10-07T00:12:36.099 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2023-10-07T00:12:36.099 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2023-10-07T00:12:36.099 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 300 2023-10-07T00:12:36.099 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2023-10-07T00:12:36.099 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2023-10-07T00:12:36.099 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2023-10-07T00:12:36.099 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 0 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 5 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1,2,3,4 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=24611,1=24574,2=24566,3=24553,4=14682} 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2023-10-07T00:12:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 0 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b{0:24611} state up:active seq 3 addr [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c{0:24532} state up:standby-replay seq 1 addr [v2:172.21.15.112:6836/963373716,v1:172.21.15.112:6837/963373716] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a{1:24574} state up:active seq 5 addr [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.f{1:24514} state up:standby-replay seq 1 addr [v2:172.21.15.112:6834/1364284217,v1:172.21.15.112:6835/1364284217] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.h{2:24566} state up:active seq 8 addr [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.e{2:24502} state up:standby-replay seq 1 addr [v2:172.21.15.88:6834/987389810,v1:172.21.15.88:6835/987389810] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.i{3:24553} state up:active seq 7 addr [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.l{3:24460} state up:standby-replay seq 1 addr [v2:172.21.15.112:6832/2184532481,v1:172.21.15.112:6833/2184532481] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.g{4:14682} state up:active seq 6 addr [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d{4:14607} state up:standby-replay seq 1 addr [v2:172.21.15.5:6836/3650932338,v1:172.21.15.5:6837/3650932338] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.k{-1:14577} state up:standby seq 1 addr [v2:172.21.15.88:6832/1806621495,v1:172.21.15.88:6833/1806621495] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.102 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.j{-1:14595} state up:standby seq 1 addr [v2:172.21.15.5:6834/661622030,v1:172.21.15.5:6835/661622030] compat {c=[1],r=[1],i=[fff]}] 2023-10-07T00:12:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4000a1510 msgr2=0x7fe4000a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4000a1510 0x7fe4000a39d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe408005fd0 tx=0x7fe408005f00 comp rx=0 tx=0).stop 2023-10-07T00:12:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 msgr2=0x7fe4181a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 0x7fe4181a0440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe410009470 tx=0x7fe410009550 comp rx=0 tx=0).stop 2023-10-07T00:12:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 shutdown_connections 2023-10-07T00:12:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4000a1510 0x7fe4000a39d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe418102b10 0x7fe4181a0440 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe418100f70 0x7fe418198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 --2- 172.21.15.5:0/1421011188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe418102170 0x7fe4181993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 >> 172.21.15.5:0/1421011188 conn(0x7fe4180fc4d0 msgr2=0x7fe418107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 shutdown_connections 2023-10-07T00:12:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:36.098+0000 7fe41e8a1700 1 -- 172.21.15.5:0/1421011188 wait complete. 2023-10-07T00:12:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:12:36.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-07T00:12:36.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:36 smithi005 ceph-mon[129406]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:36.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:36 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1421011188' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-07T00:12:36.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:36 smithi088 ceph-mon[103111]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:36.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:36 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1421011188' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-07T00:12:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:36 smithi112 ceph-mon[133548]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:36.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:36 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1421011188' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-07T00:12:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 -- 172.21.15.5:0/3162577391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 msgr2=0x7f7f041093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 --2- 172.21.15.5:0/3162577391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 0x7f7f041093c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b0d0 tx=0x7f7efc00b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 -- 172.21.15.5:0/3162577391 shutdown_connections 2023-10-07T00:12:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 --2- 172.21.15.5:0/3162577391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 0x7f7f041093c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 --2- 172.21.15.5:0/3162577391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f04100f70 0x7f7f04101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 --2- 172.21.15.5:0/3162577391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f04102170 0x7f7f041025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 -- 172.21.15.5:0/3162577391 >> 172.21.15.5:0/3162577391 conn(0x7f7f040fc4d0 msgr2=0x7f7f040fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 -- 172.21.15.5:0/3162577391 shutdown_connections 2023-10-07T00:12:38.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.732+0000 7f7f0978d700 1 -- 172.21.15.5:0/3162577391 wait complete. 2023-10-07T00:12:38.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.733+0000 7f7f0978d700 1 Processor -- start 2023-10-07T00:12:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.733+0000 7f7f0978d700 1 -- start start 2023-10-07T00:12:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.733+0000 7f7f0978d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f04100f70 0x7f7f04198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.733+0000 7f7f0978d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f04102170 0x7f7f04199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.733+0000 7f7f0978d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 0x7f7f041a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.733+0000 7f7f0978d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f041a0aa0 con 0x7f7f04102b10 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.733+0000 7f7f0978d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f041a0be0 con 0x7f7f04100f70 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.733+0000 7f7f0978d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f041a0d70 con 0x7f7f04102170 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 0x7f7f041a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 0x7f7f041a04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41520/0 (socket says 172.21.15.5:41520) 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 -- 172.21.15.5:0/2342292740 learned_addr learned my addr 172.21.15.5:0/2342292740 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f027fc700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f04102170 0x7f7f04199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f02ffd700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f04100f70 0x7f7f04198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 -- 172.21.15.5:0/2342292740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f04102170 msgr2=0x7f7f04199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f04102170 0x7f7f04199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 -- 172.21.15.5:0/2342292740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f04100f70 msgr2=0x7f7f04198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f04100f70 0x7f7f04198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 -- 172.21.15.5:0/2342292740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc009d00 con 0x7f7f04102b10 2023-10-07T00:12:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f027fc700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f04102170 0x7f7f04199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f02ffd700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f04100f70 0x7f7f04198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.734+0000 7f7f037fe700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 0x7f7f041a04d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009470 tx=0x7f7efc009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.735+0000 7f7eebfff700 1 -- 172.21.15.5:0/2342292740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00e040 con 0x7f7f04102b10 2023-10-07T00:12:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.735+0000 7f7eebfff700 1 -- 172.21.15.5:0/2342292740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7efc012e70 con 0x7f7f04102b10 2023-10-07T00:12:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.735+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f041a0ff0 con 0x7f7f04102b10 2023-10-07T00:12:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.735+0000 7f7eebfff700 1 -- 172.21.15.5:0/2342292740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc01b450 con 0x7f7f04102b10 2023-10-07T00:12:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.735+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f041a1480 con 0x7f7f04102b10 2023-10-07T00:12:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.736+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04193500 con 0x7f7f04102b10 2023-10-07T00:12:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.738+0000 7f7eebfff700 1 -- 172.21.15.5:0/2342292740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f7efc01d480 con 0x7f7f04102b10 2023-10-07T00:12:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.739+0000 7f7eebfff700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7eec0a1510 0x7f7eec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.739+0000 7f7eebfff700 1 -- 172.21.15.5:0/2342292740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7efc0cf1a0 con 0x7f7f04102b10 2023-10-07T00:12:38.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.739+0000 7f7f02ffd700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7eec0a1510 0x7f7eec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:38.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.740+0000 7f7f02ffd700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7eec0a1510 0x7f7eec0a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7f04101fd0 tx=0x7f7ef4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:38.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.742+0000 7f7eebfff700 1 -- 172.21.15.5:0/2342292740 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7efc0986b0 con 0x7f7f04102b10 2023-10-07T00:12:38.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:38 smithi005 ceph-mon[129406]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:38.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:38 smithi088 ceph-mon[103111]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.953+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f7f0402d1f0 con 0x7f7f04102b10 2023-10-07T00:12:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.954+0000 7f7eebfff700 1 -- 172.21.15.5:0/2342292740 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5287 (secure 0 0 0) 0x7f7efc09bcd0 con 0x7f7f04102b10 2023-10-07T00:12:38.955 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 88 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-10-07T00:02:48.269587+0000 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2023-10-07T00:11:50.722865+0000 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:crush_version 26 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:full_ratio 0.95 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:backfillfull_ratio 0.9 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:nearfull_ratio 0.85 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:require_min_compat_client luminous 2023-10-07T00:12:38.956 INFO:teuthology.orchestra.run.smithi005.stdout:min_compat_client luminous 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:require_osd_release reef 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:stretch_mode_enabled false 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:max_osd 12 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6802/42244744,v1:172.21.15.5:6803/42244744] [v2:172.21.15.5:6804/42244744,v1:172.21.15.5:6805/42244744] exists,up 304d532a-fc49-46fd-917c-11a6a7e57a15 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6800/124757240,v1:172.21.15.88:6801/124757240] [v2:172.21.15.88:6802/124757240,v1:172.21.15.88:6803/124757240] exists,up 2b42a81d-5935-43e5-8c4f-743744701183 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/2199456889,v1:172.21.15.112:6801/2199456889] [v2:172.21.15.112:6802/2199456889,v1:172.21.15.112:6803/2199456889] exists,up 30a1f350-e80f-4763-8656-377a6d1df25f 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6810/2022754248,v1:172.21.15.5:6811/2022754248] [v2:172.21.15.5:6812/2022754248,v1:172.21.15.5:6813/2022754248] exists,up fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 up in weight 1 up_from 34 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6808/4020627890,v1:172.21.15.88:6809/4020627890] [v2:172.21.15.88:6810/4020627890,v1:172.21.15.88:6811/4020627890] exists,up b07843b0-41cf-41ce-8b9a-18d7ed18b507 2023-10-07T00:12:38.957 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 up in weight 1 up_from 39 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/2766325588,v1:172.21.15.112:6809/2766325588] [v2:172.21.15.112:6810/2766325588,v1:172.21.15.112:6811/2766325588] exists,up f42eebd0-36c3-4da8-84ae-a22714f37531 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 up in weight 1 up_from 47 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6818/4273879818,v1:172.21.15.5:6819/4273879818] [v2:172.21.15.5:6820/4273879818,v1:172.21.15.5:6821/4273879818] exists,up e925e93d-2647-46d2-9322-bd2c7e018774 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 up in weight 1 up_from 52 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6816/3620600284,v1:172.21.15.88:6817/3620600284] [v2:172.21.15.88:6818/3620600284,v1:172.21.15.88:6819/3620600284] exists,up 755b1bc2-edc1-4eb5-a496-7809d5c93c12 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 up in weight 1 up_from 60 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/857535520,v1:172.21.15.112:6817/857535520] [v2:172.21.15.112:6818/857535520,v1:172.21.15.112:6819/857535520] exists,up 0051cf8a-fe25-4699-a03e-4dad5450fd47 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6826/1378383866,v1:172.21.15.5:6827/1378383866] [v2:172.21.15.5:6828/1378383866,v1:172.21.15.5:6829/1378383866] exists,up c2411c33-6e83-4a69-8cd3-6f08472b288a 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 up in weight 1 up_from 73 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6824/4083736515,v1:172.21.15.88:6825/4083736515] [v2:172.21.15.88:6826/4083736515,v1:172.21.15.88:6827/4083736515] exists,up 23623dd7-34f4-471f-8c60-c99314accd66 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6824/4122527507,v1:172.21.15.112:6825/4122527507] [v2:172.21.15.112:6826/4122527507,v1:172.21.15.112:6827/4122527507] exists,up 44ce1587-7ab8-4271-b6b1-443ae111ab2c 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.5 [8,11] 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.6 [8,11] 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.14 [2,4] 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.1b [2,1] 2023-10-07T00:12:38.958 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.2 [3,9] 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.18 [3,9] 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.1b [4,8] 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.21 [4,7] 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.36 [4,9] 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.39 [5,6] 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3752148220 expires 2023-10-08T00:03:49.552201+0000 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3458915809 expires 2023-10-08T00:03:49.552201+0000 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/4185885324 expires 2023-10-08T00:03:49.552201+0000 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/968817192 expires 2023-10-08T00:03:49.552201+0000 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/2264485294 expires 2023-10-08T00:03:22.989140+0000 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/804878757 expires 2023-10-08T00:03:22.989140+0000 2023-10-07T00:12:38.959 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/2264485294 expires 2023-10-08T00:03:22.989140+0000 2023-10-07T00:12:38.960 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3863337165 expires 2023-10-08T00:03:22.989140+0000 2023-10-07T00:12:38.960 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/1918673890 expires 2023-10-08T00:03:22.989140+0000 2023-10-07T00:12:38.960 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/968817192 expires 2023-10-08T00:03:49.552201+0000 2023-10-07T00:12:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7eec0a1510 msgr2=0x7f7eec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7eec0a1510 0x7f7eec0a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7f04101fd0 tx=0x7f7ef4008040 comp rx=0 tx=0).stop 2023-10-07T00:12:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 msgr2=0x7f7f041a04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 0x7f7f041a04d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009470 tx=0x7f7efc009550 comp rx=0 tx=0).stop 2023-10-07T00:12:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 shutdown_connections 2023-10-07T00:12:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7eec0a1510 0x7f7eec0a39d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f04102b10 0x7f7f041a04d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f04100f70 0x7f7f04198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 --2- 172.21.15.5:0/2342292740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f04102170 0x7f7f04199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 >> 172.21.15.5:0/2342292740 conn(0x7f7f040fc4d0 msgr2=0x7f7f04107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 shutdown_connections 2023-10-07T00:12:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:38.957+0000 7f7f0978d700 1 -- 172.21.15.5:0/2342292740 wait complete. 2023-10-07T00:12:38.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:38 smithi112 ceph-mon[133548]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:39.427 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-07T00:12:39.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:39.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 -- 172.21.15.5:0/3478959352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4060108e80 msgr2=0x7f406010b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 --2- 172.21.15.5:0/3478959352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4060108e80 0x7f406010b2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f405800b0a0 tx=0x7f405800b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 -- 172.21.15.5:0/3478959352 shutdown_connections 2023-10-07T00:12:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 --2- 172.21.15.5:0/3478959352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4060108e80 0x7f406010b2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 --2- 172.21.15.5:0/3478959352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4060074e90 0x7f40600732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 --2- 172.21.15.5:0/3478959352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40600738b0 0x7f4060073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 -- 172.21.15.5:0/3478959352 >> 172.21.15.5:0/3478959352 conn(0x7f40600fc520 msgr2=0x7f40600fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 -- 172.21.15.5:0/3478959352 shutdown_connections 2023-10-07T00:12:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.666+0000 7f40663ff700 1 -- 172.21.15.5:0/3478959352 wait complete. 2023-10-07T00:12:39.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.667+0000 7f40663ff700 1 Processor -- start 2023-10-07T00:12:39.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.667+0000 7f40663ff700 1 -- start start 2023-10-07T00:12:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f40663ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40600738b0 0x7f4060198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f40663ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060074e90 0x7f40601993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f40663ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4060108e80 0x7f40601a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f40663ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a09f0 con 0x7f40600738b0 2023-10-07T00:12:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f40663ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a0b30 con 0x7f4060108e80 2023-10-07T00:12:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f40663ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a0cc0 con 0x7f4060074e90 2023-10-07T00:12:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40600738b0 0x7f4060198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40600738b0 0x7f4060198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41538/0 (socket says 172.21.15.5:41538) 2023-10-07T00:12:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405ffff700 1 -- 172.21.15.5:0/1631498028 learned_addr learned my addr 172.21.15.5:0/1631498028 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405f7fe700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060074e90 0x7f40601993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f406499c700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4060108e80 0x7f40601a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405ffff700 1 -- 172.21.15.5:0/1631498028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060074e90 msgr2=0x7f40601993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405ffff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060074e90 0x7f40601993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405ffff700 1 -- 172.21.15.5:0/1631498028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4060108e80 msgr2=0x7f40601a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405ffff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4060108e80 0x7f40601a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405ffff700 1 -- 172.21.15.5:0/1631498028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058009d00 con 0x7f40600738b0 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f406499c700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4060108e80 0x7f40601a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.668+0000 7f405f7fe700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060074e90 0x7f40601993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.669+0000 7f405ffff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40600738b0 0x7f4060198e70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f405000d980 tx=0x7f405000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.669+0000 7f405d7fa700 1 -- 172.21.15.5:0/1631498028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405000bb60 con 0x7f40600738b0 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.669+0000 7f405d7fa700 1 -- 172.21.15.5:0/1631498028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4050007640 con 0x7f40600738b0 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.669+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40601a0fa0 con 0x7f40600738b0 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.669+0000 7f405d7fa700 1 -- 172.21.15.5:0/1631498028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050004d60 con 0x7f40600738b0 2023-10-07T00:12:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.669+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40601a13c0 con 0x7f40600738b0 2023-10-07T00:12:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.670+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4060107580 con 0x7f40600738b0 2023-10-07T00:12:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.672+0000 7f405d7fa700 1 -- 172.21.15.5:0/1631498028 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f4050004020 con 0x7f40600738b0 2023-10-07T00:12:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.673+0000 7f405d7fa700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40480a1510 0x7f40480a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.674+0000 7f405d7fa700 1 -- 172.21.15.5:0/1631498028 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f40500ccda0 con 0x7f40600738b0 2023-10-07T00:12:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.674+0000 7f405f7fe700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40480a1510 0x7f40480a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.674+0000 7f405f7fe700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40480a1510 0x7f40480a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4054009cb0 tx=0x7f4054009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.678+0000 7f405d7fa700 1 -- 172.21.15.5:0/1631498028 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4050096220 con 0x7f40600738b0 2023-10-07T00:12:39.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.896+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f406010eae0 con 0x7f40600738b0 2023-10-07T00:12:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.898+0000 7f405d7fa700 1 -- 172.21.15.5:0/1631498028 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f4050016020 con 0x7f40600738b0 2023-10-07T00:12:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:39.899 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40480a1510 msgr2=0x7f40480a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40480a1510 0x7f40480a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4054009cb0 tx=0x7f4054009260 comp rx=0 tx=0).stop 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40600738b0 msgr2=0x7f4060198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40600738b0 0x7f4060198e70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f405000d980 tx=0x7f405000dd40 comp rx=0 tx=0).stop 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 shutdown_connections 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f40480a1510 0x7f40480a39d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4060108e80 0x7f40601a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40600738b0 0x7f4060198e70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 --2- 172.21.15.5:0/1631498028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060074e90 0x7f40601993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.900+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 >> 172.21.15.5:0/1631498028 conn(0x7f40600fc520 msgr2=0x7f40600fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.901+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 shutdown_connections 2023-10-07T00:12:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:39.901+0000 7f40663ff700 1 -- 172.21.15.5:0/1631498028 wait complete. 2023-10-07T00:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:12:39.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:12:39.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:39 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2342292740' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-07T00:12:39.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:39 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2342292740' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-07T00:12:39.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:39 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2342292740' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 -- 172.21.15.5:0/2788526727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080106d40 msgr2=0x7fa080109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 --2- 172.21.15.5:0/2788526727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080106d40 0x7fa080109130 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa07800b0a0 tx=0x7fa07800b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 -- 172.21.15.5:0/2788526727 shutdown_connections 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 --2- 172.21.15.5:0/2788526727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080106d40 0x7fa080109130 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 --2- 172.21.15.5:0/2788526727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080101ae0 0x7fa080103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 --2- 172.21.15.5:0/2788526727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa080104410 0x7fa080106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 -- 172.21.15.5:0/2788526727 >> 172.21.15.5:0/2788526727 conn(0x7fa0800fb450 msgr2=0x7fa0800fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 -- 172.21.15.5:0/2788526727 shutdown_connections 2023-10-07T00:12:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.126+0000 7fa0883ff700 1 -- 172.21.15.5:0/2788526727 wait complete. 2023-10-07T00:12:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.127+0000 7fa0883ff700 1 Processor -- start 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.127+0000 7fa0883ff700 1 -- start start 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa0883ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa080101ae0 0x7fa080198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa0883ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080104410 0x7fa080199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa0883ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080106d40 0x7fa0801a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa0883ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0801a0a40 con 0x7fa080104410 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa0883ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0801a0b80 con 0x7fa080101ae0 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa0883ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0801a0d10 con 0x7fa080106d40 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08599a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080104410 0x7fa080199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08599a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080104410 0x7fa080199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41560/0 (socket says 172.21.15.5:41560) 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08599a700 1 -- 172.21.15.5:0/3634912254 learned_addr learned my addr 172.21.15.5:0/3634912254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08699c700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080106d40 0x7fa0801a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08619b700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa080101ae0 0x7fa080198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08599a700 1 -- 172.21.15.5:0/3634912254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080106d40 msgr2=0x7fa0801a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08599a700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080106d40 0x7fa0801a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08599a700 1 -- 172.21.15.5:0/3634912254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa080101ae0 msgr2=0x7fa080198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08599a700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa080101ae0 0x7fa080198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.128+0000 7fa08599a700 1 -- 172.21.15.5:0/3634912254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078009d00 con 0x7fa080104410 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.129+0000 7fa08599a700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080104410 0x7fa080199400 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa07000d950 tx=0x7fa07000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.129+0000 7fa0777fe700 1 -- 172.21.15.5:0/3634912254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070009940 con 0x7fa080104410 2023-10-07T00:12:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.129+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0801a0ff0 con 0x7fa080104410 2023-10-07T00:12:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.129+0000 7fa0777fe700 1 -- 172.21.15.5:0/3634912254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa070010460 con 0x7fa080104410 2023-10-07T00:12:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.129+0000 7fa0777fe700 1 -- 172.21.15.5:0/3634912254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000f620 con 0x7fa080104410 2023-10-07T00:12:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.129+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0801a1470 con 0x7fa080104410 2023-10-07T00:12:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.130+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0801088c0 con 0x7fa080104410 2023-10-07T00:12:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.132+0000 7fa0777fe700 1 -- 172.21.15.5:0/3634912254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa0700105d0 con 0x7fa080104410 2023-10-07T00:12:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.134+0000 7fa0777fe700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa06c0a1510 0x7fa06c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.134+0000 7fa0777fe700 1 -- 172.21.15.5:0/3634912254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa0700ccd50 con 0x7fa080104410 2023-10-07T00:12:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.134+0000 7fa08619b700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa06c0a1510 0x7fa06c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:40.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.135+0000 7fa08619b700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa06c0a1510 0x7fa06c0a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa07c005950 tx=0x7fa07c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.139+0000 7fa0777fe700 1 -- 172.21.15.5:0/3634912254 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa0700961d0 con 0x7fa080104410 2023-10-07T00:12:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.347+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa08010c8c0 con 0x7fa080104410 2023-10-07T00:12:40.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.348+0000 7fa0777fe700 1 -- 172.21.15.5:0/3634912254 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0700160a0 con 0x7fa080104410 2023-10-07T00:12:40.349 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa06c0a1510 msgr2=0x7fa06c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa06c0a1510 0x7fa06c0a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa07c005950 tx=0x7fa07c0058e0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080104410 msgr2=0x7fa080199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080104410 0x7fa080199400 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa07000d950 tx=0x7fa07000dc60 comp rx=0 tx=0).stop 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 shutdown_connections 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa06c0a1510 0x7fa06c0a39d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa080106d40 0x7fa0801a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa080101ae0 0x7fa080198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 --2- 172.21.15.5:0/3634912254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa080104410 0x7fa080199400 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 >> 172.21.15.5:0/3634912254 conn(0x7fa0800fb450 msgr2=0x7fa080100160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 shutdown_connections 2023-10-07T00:12:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.350+0000 7fa0883ff700 1 -- 172.21.15.5:0/3634912254 wait complete. 2023-10-07T00:12:40.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:12:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.576+0000 7f58569ff700 1 -- 172.21.15.5:0/719874510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5850100fc0 msgr2=0x7f58501013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.576+0000 7f58569ff700 1 --2- 172.21.15.5:0/719874510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5850100fc0 0x7f58501013e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f58400099c0 tx=0x7f5840009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.577+0000 7f58569ff700 1 -- 172.21.15.5:0/719874510 shutdown_connections 2023-10-07T00:12:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.577+0000 7f58569ff700 1 --2- 172.21.15.5:0/719874510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850102b50 0x7f5850109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.577+0000 7f58569ff700 1 --2- 172.21.15.5:0/719874510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5850100fc0 0x7f58501013e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.577+0000 7f58569ff700 1 --2- 172.21.15.5:0/719874510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58501021b0 0x7f5850102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.577+0000 7f58569ff700 1 -- 172.21.15.5:0/719874510 >> 172.21.15.5:0/719874510 conn(0x7f58500fc530 msgr2=0x7f58500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.577+0000 7f58569ff700 1 -- 172.21.15.5:0/719874510 shutdown_connections 2023-10-07T00:12:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.577+0000 7f58569ff700 1 -- 172.21.15.5:0/719874510 wait complete. 2023-10-07T00:12:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f58569ff700 1 Processor -- start 2023-10-07T00:12:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f58569ff700 1 -- start start 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f58569ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850100fc0 0x7f5850198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f58569ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58501021b0 0x7f5850199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f58569ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5850102b50 0x7f58501a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f58569ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501a0970 con 0x7f58501021b0 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f58569ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501a0ab0 con 0x7f5850102b50 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f58569ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501a0c40 con 0x7f5850100fc0 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.578+0000 7f584f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58501021b0 0x7f5850199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58501021b0 0x7f5850199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41564/0 (socket says 172.21.15.5:41564) 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584f7fe700 1 -- 172.21.15.5:0/3821027135 learned_addr learned my addr 172.21.15.5:0/3821027135 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584ffff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850100fc0 0x7f5850198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f5854f9c700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5850102b50 0x7f58501a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584f7fe700 1 -- 172.21.15.5:0/3821027135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850100fc0 msgr2=0x7f5850198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584f7fe700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850100fc0 0x7f5850198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584f7fe700 1 -- 172.21.15.5:0/3821027135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5850102b50 msgr2=0x7f58501a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584f7fe700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5850102b50 0x7f58501a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584f7fe700 1 -- 172.21.15.5:0/3821027135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400095f0 con 0x7f58501021b0 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584f7fe700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58501021b0 0x7f5850199330 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f584400e9a0 tx=0x7f584400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.579+0000 7f584d7fa700 1 -- 172.21.15.5:0/3821027135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844009790 con 0x7f58501021b0 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.580+0000 7f584d7fa700 1 -- 172.21.15.5:0/3821027135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5844010430 con 0x7f58501021b0 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.580+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58501a0f20 con 0x7f58501021b0 2023-10-07T00:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.580+0000 7f584d7fa700 1 -- 172.21.15.5:0/3821027135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400cea0 con 0x7f58501021b0 2023-10-07T00:12:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.580+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58501a13a0 con 0x7f58501021b0 2023-10-07T00:12:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.581+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585010c6d0 con 0x7f58501021b0 2023-10-07T00:12:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.584+0000 7f584d7fa700 1 -- 172.21.15.5:0/3821027135 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f58440105a0 con 0x7f58501021b0 2023-10-07T00:12:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.585+0000 7f584d7fa700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58380a1510 0x7f58380a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.585+0000 7f584d7fa700 1 -- 172.21.15.5:0/3821027135 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5844014070 con 0x7f58501021b0 2023-10-07T00:12:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.586+0000 7f584ffff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58380a1510 0x7f58380a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.586+0000 7f584ffff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58380a1510 0x7f58380a39d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5840009990 tx=0x7f584000b9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.588+0000 7f584d7fa700 1 -- 172.21.15.5:0/3821027135 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5844096470 con 0x7f58501021b0 2023-10-07T00:12:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.800+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58501a1590 con 0x7f58501021b0 2023-10-07T00:12:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.800+0000 7f584d7fa700 1 -- 172.21.15.5:0/3821027135 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5844099a90 con 0x7f58501021b0 2023-10-07T00:12:40.802 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:12:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.802+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58380a1510 msgr2=0x7f58380a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.802+0000 7f58569ff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58380a1510 0x7f58380a39d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5840009990 tx=0x7f584000b9b0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.802+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58501021b0 msgr2=0x7f5850199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.802+0000 7f58569ff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58501021b0 0x7f5850199330 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f584400e9a0 tx=0x7f584400ecb0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.802+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 shutdown_connections 2023-10-07T00:12:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.803+0000 7f58569ff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f58380a1510 0x7f58380a39d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.803+0000 7f58569ff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5850102b50 0x7f58501a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.803+0000 7f58569ff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850100fc0 0x7f5850198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.803+0000 7f58569ff700 1 --2- 172.21.15.5:0/3821027135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58501021b0 0x7f5850199330 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:40.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.803+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 >> 172.21.15.5:0/3821027135 conn(0x7f58500fc530 msgr2=0x7f58500fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:40.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.803+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 shutdown_connections 2023-10-07T00:12:40.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:40.803+0000 7f58569ff700 1 -- 172.21.15.5:0/3821027135 wait complete. 2023-10-07T00:12:40.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:12:40.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:40 smithi088 ceph-mon[103111]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:40.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:40 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1631498028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:40.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:40 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3634912254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:40 smithi112 ceph-mon[133548]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:40 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1631498028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:40 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3634912254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.029+0000 7f6cbbdff700 1 -- 172.21.15.5:0/364079086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb41021b0 msgr2=0x7f6cb4102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.029+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/364079086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb41021b0 0x7f6cb4102610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40099c0 tx=0x7f6ca4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.029+0000 7f6cbbdff700 1 -- 172.21.15.5:0/364079086 shutdown_connections 2023-10-07T00:12:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.029+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/364079086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb4102b50 0x7f6cb4109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.029+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/364079086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb4100fc0 0x7f6cb41013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.029+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/364079086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb41021b0 0x7f6cb4102610 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.029+0000 7f6cbbdff700 1 -- 172.21.15.5:0/364079086 >> 172.21.15.5:0/364079086 conn(0x7f6cb40fc530 msgr2=0x7f6cb40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.030+0000 7f6cbbdff700 1 -- 172.21.15.5:0/364079086 shutdown_connections 2023-10-07T00:12:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.030+0000 7f6cbbdff700 1 -- 172.21.15.5:0/364079086 wait complete. 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.030+0000 7f6cbbdff700 1 Processor -- start 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cbbdff700 1 -- start start 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cbbdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb4100fc0 0x7f6cb4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cbbdff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb41021b0 0x7f6cb40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cbbdff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102b50 0x7f6cb40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cbbdff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4073f80 con 0x7f6cb4102b50 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cbbdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40740f0 con 0x7f6cb4100fc0 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cbbdff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41a0bb0 con 0x7f6cb41021b0 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cba39c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102b50 0x7f6cb40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cba39c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102b50 0x7f6cb40737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41580/0 (socket says 172.21.15.5:41580) 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cba39c700 1 -- 172.21.15.5:0/1176544611 learned_addr learned my addr 172.21.15.5:0/1176544611 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cb9b9b700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb4100fc0 0x7f6cb4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.031+0000 7f6cb939a700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb41021b0 0x7f6cb40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6cba39c700 1 -- 172.21.15.5:0/1176544611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb41021b0 msgr2=0x7f6cb40732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6cba39c700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb41021b0 0x7f6cb40732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6cba39c700 1 -- 172.21.15.5:0/1176544611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb4100fc0 msgr2=0x7f6cb4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6cba39c700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb4100fc0 0x7f6cb4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6cba39c700 1 -- 172.21.15.5:0/1176544611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40095f0 con 0x7f6cb4102b50 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6cba39c700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102b50 0x7f6cb40737e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6cac007d70 tx=0x7f6cac00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6caaffd700 1 -- 172.21.15.5:0/1176544611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac00ac90 con 0x7f6cb4102b50 2023-10-07T00:12:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6caaffd700 1 -- 172.21.15.5:0/1176544611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cac00adf0 con 0x7f6cb4102b50 2023-10-07T00:12:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb41a0e90 con 0x7f6cb4102b50 2023-10-07T00:12:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6caaffd700 1 -- 172.21.15.5:0/1176544611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0115e0 con 0x7f6cb4102b50 2023-10-07T00:12:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.032+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb41a1310 con 0x7f6cb4102b50 2023-10-07T00:12:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.033+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb4107f40 con 0x7f6cb4102b50 2023-10-07T00:12:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.035+0000 7f6caaffd700 1 -- 172.21.15.5:0/1176544611 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f6cac012420 con 0x7f6cb4102b50 2023-10-07T00:12:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.037+0000 7f6caaffd700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ca00a1590 0x7f6ca00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.037+0000 7f6caaffd700 1 -- 172.21.15.5:0/1176544611 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6cac0ccf00 con 0x7f6cb4102b50 2023-10-07T00:12:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.037+0000 7f6cb9b9b700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ca00a1590 0x7f6ca00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.038+0000 7f6cb9b9b700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ca00a1590 0x7f6ca00a3a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4102010 tx=0x7f6cb000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.041+0000 7f6caaffd700 1 -- 172.21.15.5:0/1176544611 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6cac0964f0 con 0x7f6cb4102b50 2023-10-07T00:12:41.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:40 smithi005 ceph-mon[129406]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:41.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:40 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1631498028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:40 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3634912254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:41.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.252+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cb410c900 con 0x7f6cb4102b50 2023-10-07T00:12:41.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.253+0000 7f6caaffd700 1 -- 172.21.15.5:0/1176544611 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cac099b10 con 0x7f6cb4102b50 2023-10-07T00:12:41.254 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:12:41.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ca00a1590 msgr2=0x7f6ca00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ca00a1590 0x7f6ca00a3a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4102010 tx=0x7f6cb000b410 comp rx=0 tx=0).stop 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102b50 msgr2=0x7f6cb40737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102b50 0x7f6cb40737e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6cac007d70 tx=0x7f6cac00a340 comp rx=0 tx=0).stop 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 shutdown_connections 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ca00a1590 0x7f6ca00a3a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102b50 0x7f6cb40737e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb4100fc0 0x7f6cb4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 --2- 172.21.15.5:0/1176544611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb41021b0 0x7f6cb40732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 >> 172.21.15.5:0/1176544611 conn(0x7f6cb40fc530 msgr2=0x7f6cb40fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 shutdown_connections 2023-10-07T00:12:41.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.255+0000 7f6cbbdff700 1 -- 172.21.15.5:0/1176544611 wait complete. 2023-10-07T00:12:41.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 -- 172.21.15.5:0/1243394617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac1021a0 msgr2=0x7fb3ac102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/1243394617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac1021a0 0x7fb3ac102600 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0099c0 tx=0x7fb39c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 -- 172.21.15.5:0/1243394617 shutdown_connections 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/1243394617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3ac102b40 0x7fb3ac1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/1243394617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac1013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/1243394617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac1021a0 0x7fb3ac102600 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 -- 172.21.15.5:0/1243394617 >> 172.21.15.5:0/1243394617 conn(0x7fb3ac0fc520 msgr2=0x7fb3ac0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 -- 172.21.15.5:0/1243394617 shutdown_connections 2023-10-07T00:12:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.477+0000 7fb3b39ff700 1 -- 172.21.15.5:0/1243394617 wait complete. 2023-10-07T00:12:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.478+0000 7fb3b39ff700 1 Processor -- start 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.478+0000 7fb3b39ff700 1 -- start start 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b39ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b39ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ac1021a0 0x7fb3ac1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b39ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac102b40 0x7fb3ac1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b39ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac1a08e0 con 0x7fb3ac102b40 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b39ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac1a0a50 con 0x7fb3ac100fb0 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b39ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac1a0c10 con 0x7fb3ac1021a0 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b1f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac102b40 0x7fb3ac1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b1f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac102b40 0x7fb3ac1a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41600/0 (socket says 172.21.15.5:41600) 2023-10-07T00:12:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b1f9c700 1 -- 172.21.15.5:0/2944169481 learned_addr learned my addr 172.21.15.5:0/2944169481 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b0f9a700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ac1021a0 0x7fb3ac1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b179b700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b1f9c700 1 -- 172.21.15.5:0/2944169481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ac1021a0 msgr2=0x7fb3ac1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b1f9c700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ac1021a0 0x7fb3ac1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b1f9c700 1 -- 172.21.15.5:0/2944169481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3ac100fb0 msgr2=0x7fb3ac198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b1f9c700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.479+0000 7fb3b1f9c700 1 -- 172.21.15.5:0/2944169481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0095f0 con 0x7fb3ac102b40 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.480+0000 7fb3b1f9c700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac102b40 0x7fb3ac1a0310 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4007d70 tx=0x7fb3a400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.480+0000 7fb3a27fc700 1 -- 172.21.15.5:0/2944169481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a400ac90 con 0x7fb3ac102b40 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.480+0000 7fb3a27fc700 1 -- 172.21.15.5:0/2944169481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3a400adf0 con 0x7fb3ac102b40 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.480+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ac1a0ef0 con 0x7fb3ac102b40 2023-10-07T00:12:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.480+0000 7fb3a27fc700 1 -- 172.21.15.5:0/2944169481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40115e0 con 0x7fb3ac102b40 2023-10-07T00:12:41.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.480+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ac1a1310 con 0x7fb3ac102b40 2023-10-07T00:12:41.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.481+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ac1934b0 con 0x7fb3ac102b40 2023-10-07T00:12:41.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.483+0000 7fb3a27fc700 1 -- 172.21.15.5:0/2944169481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb3a4012420 con 0x7fb3ac102b40 2023-10-07T00:12:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.485+0000 7fb3a27fc700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb3980a1590 0x7fb3980a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.485+0000 7fb3a27fc700 1 -- 172.21.15.5:0/2944169481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb3a40ccf80 con 0x7fb3ac102b40 2023-10-07T00:12:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.485+0000 7fb3b179b700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb3980a1590 0x7fb3980a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.485+0000 7fb3b179b700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb3980a1590 0x7fb3980a3a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac19a270 tx=0x7fb3a800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.488+0000 7fb3a27fc700 1 -- 172.21.15.5:0/2944169481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb3a4096510 con 0x7fb3ac102b40 2023-10-07T00:12:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.751+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3ac10c6c0 con 0x7fb3ac102b40 2023-10-07T00:12:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.752+0000 7fb3a27fc700 1 -- 172.21.15.5:0/2944169481 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7fb3a4099b30 con 0x7fb3ac102b40 2023-10-07T00:12:41.753 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:41.753 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:12:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb3980a1590 msgr2=0x7fb3980a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb3980a1590 0x7fb3980a3a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac19a270 tx=0x7fb3a800b410 comp rx=0 tx=0).stop 2023-10-07T00:12:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac102b40 msgr2=0x7fb3ac1a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac102b40 0x7fb3ac1a0310 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4007d70 tx=0x7fb3a400a340 comp rx=0 tx=0).stop 2023-10-07T00:12:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 shutdown_connections 2023-10-07T00:12:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb3980a1590 0x7fb3980a3a50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac102b40 0x7fb3ac1a0310 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 --2- 172.21.15.5:0/2944169481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ac1021a0 0x7fb3ac1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.754+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 >> 172.21.15.5:0/2944169481 conn(0x7fb3ac0fc520 msgr2=0x7fb3ac107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.755+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 shutdown_connections 2023-10-07T00:12:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.755+0000 7fb3b39ff700 1 -- 172.21.15.5:0/2944169481 wait complete. 2023-10-07T00:12:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:12:41.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:41.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:41 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3821027135' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:41.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:41 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1176544611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:41.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 -- 172.21.15.5:0/4159184365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028101a40 msgr2=0x7f9028103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4159184365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028101a40 0x7f9028103e30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9018009990 tx=0x7f9018009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 -- 172.21.15.5:0/4159184365 shutdown_connections 2023-10-07T00:12:41.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4159184365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9028106ca0 0x7f9028109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4159184365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028101a40 0x7f9028103e30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4159184365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9028104370 0x7f9028106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 -- 172.21.15.5:0/4159184365 >> 172.21.15.5:0/4159184365 conn(0x7f90280fb410 msgr2=0x7f90280fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:41.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 -- 172.21.15.5:0/4159184365 shutdown_connections 2023-10-07T00:12:41.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.982+0000 7f902d9ff700 1 -- 172.21.15.5:0/4159184365 wait complete. 2023-10-07T00:12:41.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.983+0000 7f902d9ff700 1 Processor -- start 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.983+0000 7f902d9ff700 1 -- start start 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f902d9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9028101a40 0x7f9028198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f902d9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028104370 0x7f9028199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f902d9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9028106ca0 0x7f90281a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f902d9ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90281a0950 con 0x7f9028104370 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f902d9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90281a0a90 con 0x7f9028106ca0 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f902d9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90281a0c20 con 0x7f9028101a40 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028104370 0x7f9028199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f9026ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9028101a40 0x7f9028198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028104370 0x7f9028199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58550/0 (socket says 172.21.15.5:58550) 2023-10-07T00:12:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90267fc700 1 -- 172.21.15.5:0/4069765892 learned_addr learned my addr 172.21.15.5:0/4069765892 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:41.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90277fe700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9028106ca0 0x7f90281a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90267fc700 1 -- 172.21.15.5:0/4069765892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9028101a40 msgr2=0x7f9028198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90267fc700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9028101a40 0x7f9028198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90267fc700 1 -- 172.21.15.5:0/4069765892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9028106ca0 msgr2=0x7f90281a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:41.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90267fc700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9028106ca0 0x7f90281a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:41.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.984+0000 7f90267fc700 1 -- 172.21.15.5:0/4069765892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90180095f0 con 0x7f9028104370 2023-10-07T00:12:41.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.985+0000 7f90267fc700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028104370 0x7f9028199310 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f901c00d950 tx=0x7f901c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.985+0000 7f902c9fd700 1 -- 172.21.15.5:0/4069765892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00f890 con 0x7f9028104370 2023-10-07T00:12:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.985+0000 7f902c9fd700 1 -- 172.21.15.5:0/4069765892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f901c00fe80 con 0x7f9028104370 2023-10-07T00:12:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.985+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90281a0f00 con 0x7f9028104370 2023-10-07T00:12:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.985+0000 7f902c9fd700 1 -- 172.21.15.5:0/4069765892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00e3b0 con 0x7f9028104370 2023-10-07T00:12:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.985+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90281a1380 con 0x7f9028104370 2023-10-07T00:12:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.986+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9028108820 con 0x7f9028104370 2023-10-07T00:12:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.988+0000 7f902c9fd700 1 -- 172.21.15.5:0/4069765892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f901c010460 con 0x7f9028104370 2023-10-07T00:12:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.989+0000 7f902c9fd700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90100a1510 0x7f90100a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.990+0000 7f902c9fd700 1 -- 172.21.15.5:0/4069765892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f901c0ccc40 con 0x7f9028104370 2023-10-07T00:12:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.990+0000 7f9026ffd700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90100a1510 0x7f90100a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.990+0000 7f9026ffd700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90100a1510 0x7f90100a39d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9018006010 tx=0x7f901800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:41.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:41.993+0000 7f902c9fd700 1 -- 172.21.15.5:0/4069765892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f901c0d3080 con 0x7f9028104370 2023-10-07T00:12:41.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:41 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3821027135' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:41.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:41 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1176544611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:42.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:41 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3821027135' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:42.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:41 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1176544611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.207+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f902810c8f0 con 0x7f9028104370 2023-10-07T00:12:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.209+0000 7f902c9fd700 1 -- 172.21.15.5:0/4069765892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f901c016090 con 0x7f9028104370 2023-10-07T00:12:42.210 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:42.210 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90100a1510 msgr2=0x7f90100a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90100a1510 0x7f90100a39d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9018006010 tx=0x7f901800b260 comp rx=0 tx=0).stop 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028104370 msgr2=0x7f9028199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028104370 0x7f9028199310 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f901c00d950 tx=0x7f901c00dc60 comp rx=0 tx=0).stop 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 shutdown_connections 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90100a1510 0x7f90100a39d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9028106ca0 0x7f90281a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9028101a40 0x7f9028198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 --2- 172.21.15.5:0/4069765892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9028104370 0x7f9028199310 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.211+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 >> 172.21.15.5:0/4069765892 conn(0x7f90280fb410 msgr2=0x7f90281026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.212+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 shutdown_connections 2023-10-07T00:12:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.212+0000 7f902d9ff700 1 -- 172.21.15.5:0/4069765892 wait complete. 2023-10-07T00:12:42.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:12:42.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:12:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 -- 172.21.15.5:0/124285551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56781021b0 msgr2=0x7f5678102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 --2- 172.21.15.5:0/124285551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56781021b0 0x7f5678102610 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f566c0099c0 tx=0x7f566c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 -- 172.21.15.5:0/124285551 shutdown_connections 2023-10-07T00:12:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 --2- 172.21.15.5:0/124285551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5678102b50 0x7f5678109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 --2- 172.21.15.5:0/124285551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5678100fc0 0x7f56781013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 --2- 172.21.15.5:0/124285551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56781021b0 0x7f5678102610 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 -- 172.21.15.5:0/124285551 >> 172.21.15.5:0/124285551 conn(0x7f56780fc530 msgr2=0x7f56780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 -- 172.21.15.5:0/124285551 shutdown_connections 2023-10-07T00:12:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.439+0000 7f567c9ff700 1 -- 172.21.15.5:0/124285551 wait complete. 2023-10-07T00:12:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.440+0000 7f567c9ff700 1 Processor -- start 2023-10-07T00:12:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f567c9ff700 1 -- start start 2023-10-07T00:12:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f567c9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5678100fc0 0x7f5678198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f567c9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56781021b0 0x7f5678199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f567c9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5678102b50 0x7f56781a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f567c9ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56781a0980 con 0x7f5678102b50 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f567c9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56781a0ac0 con 0x7f5678100fc0 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f567c9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56781a0c50 con 0x7f56781021b0 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f5676d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5678102b50 0x7f56781a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f567659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5678100fc0 0x7f5678198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f5676d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5678102b50 0x7f56781a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58574/0 (socket says 172.21.15.5:58574) 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f5676d9d700 1 -- 172.21.15.5:0/111533675 learned_addr learned my addr 172.21.15.5:0/111533675 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.441+0000 7f5675d9b700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56781021b0 0x7f5678199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f5676d9d700 1 -- 172.21.15.5:0/111533675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56781021b0 msgr2=0x7f5678199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f5676d9d700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56781021b0 0x7f5678199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f5676d9d700 1 -- 172.21.15.5:0/111533675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5678100fc0 msgr2=0x7f5678198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f5676d9d700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5678100fc0 0x7f5678198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f5676d9d700 1 -- 172.21.15.5:0/111533675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0095f0 con 0x7f5678102b50 2023-10-07T00:12:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f567659c700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5678100fc0 0x7f5678198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f5676d9d700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5678102b50 0x7f56781a03b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5670007ee0 tx=0x7f567000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f56677fe700 1 -- 172.21.15.5:0/111533675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567000dd20 con 0x7f5678102b50 2023-10-07T00:12:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f56677fe700 1 -- 172.21.15.5:0/111533675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f567000f040 con 0x7f5678102b50 2023-10-07T00:12:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56781a0f30 con 0x7f5678102b50 2023-10-07T00:12:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f56677fe700 1 -- 172.21.15.5:0/111533675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670004750 con 0x7f5678102b50 2023-10-07T00:12:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.442+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56781a13b0 con 0x7f5678102b50 2023-10-07T00:12:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.443+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56781934d0 con 0x7f5678102b50 2023-10-07T00:12:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.445+0000 7f56677fe700 1 -- 172.21.15.5:0/111533675 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f5670003a00 con 0x7f5678102b50 2023-10-07T00:12:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.447+0000 7f56677fe700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f56600a1590 0x7f56600a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.447+0000 7f56677fe700 1 -- 172.21.15.5:0/111533675 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f56700cc690 con 0x7f5678102b50 2023-10-07T00:12:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.447+0000 7f567659c700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f56600a1590 0x7f56600a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.448+0000 7f567659c700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f56600a1590 0x7f56600a3a50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5678102010 tx=0x7f5668009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:42.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.451+0000 7f56677fe700 1 -- 172.21.15.5:0/111533675 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f567004f100 con 0x7f5678102b50 2023-10-07T00:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.665+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f567810c900 con 0x7f5678102b50 2023-10-07T00:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.665+0000 7f56677fe700 1 -- 172.21.15.5:0/111533675 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5670095b70 con 0x7f5678102b50 2023-10-07T00:12:42.667 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:12:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f56600a1590 msgr2=0x7f56600a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f56600a1590 0x7f56600a3a50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5678102010 tx=0x7f5668009260 comp rx=0 tx=0).stop 2023-10-07T00:12:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5678102b50 msgr2=0x7f56781a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5678102b50 0x7f56781a03b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5670007ee0 tx=0x7f567000d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 shutdown_connections 2023-10-07T00:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f56600a1590 0x7f56600a3a50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5678102b50 0x7f56781a03b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5678100fc0 0x7f5678198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 --2- 172.21.15.5:0/111533675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56781021b0 0x7f5678199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 >> 172.21.15.5:0/111533675 conn(0x7f56780fc530 msgr2=0x7f5678107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 shutdown_connections 2023-10-07T00:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.668+0000 7f567c9ff700 1 -- 172.21.15.5:0/111533675 wait complete. 2023-10-07T00:12:42.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:12:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.894+0000 7f61b4dff700 1 -- 172.21.15.5:0/81170945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 msgr2=0x7f61b010b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.894+0000 7f61b4dff700 1 --2- 172.21.15.5:0/81170945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 0x7f61b010b310 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f61a800b0a0 tx=0x7f61a800b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.894+0000 7f61b4dff700 1 -- 172.21.15.5:0/81170945 shutdown_connections 2023-10-07T00:12:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.894+0000 7f61b4dff700 1 --2- 172.21.15.5:0/81170945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 0x7f61b010b310 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.894+0000 7f61b4dff700 1 --2- 172.21.15.5:0/81170945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0074ef0 0x7f61b0073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.894+0000 7f61b4dff700 1 --2- 172.21.15.5:0/81170945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b0073910 0x7f61b0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.894+0000 7f61b4dff700 1 -- 172.21.15.5:0/81170945 >> 172.21.15.5:0/81170945 conn(0x7f61b00fc530 msgr2=0x7f61b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:42.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.894+0000 7f61b4dff700 1 -- 172.21.15.5:0/81170945 shutdown_connections 2023-10-07T00:12:42.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.895+0000 7f61b4dff700 1 -- 172.21.15.5:0/81170945 wait complete. 2023-10-07T00:12:42.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.895+0000 7f61b4dff700 1 Processor -- start 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61b4dff700 1 -- start start 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61b4dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b0073910 0x7f61b0198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61b4dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0074ef0 0x7f61b01993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61b4dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 0x7f61b01a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61b4dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01a0a10 con 0x7f61b0108e80 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61b4dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01a0b50 con 0x7f61b0074ef0 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61b4dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01a0ce0 con 0x7f61b0073910 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61aed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 0x7f61b01a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61aed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 0x7f61b01a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58590/0 (socket says 172.21.15.5:58590) 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61aed9d700 1 -- 172.21.15.5:0/2778833115 learned_addr learned my addr 172.21.15.5:0/2778833115 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:42.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61add9b700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0074ef0 0x7f61b01993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.896+0000 7f61ae59c700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b0073910 0x7f61b0198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f61aed9d700 1 -- 172.21.15.5:0/2778833115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b0073910 msgr2=0x7f61b0198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f61aed9d700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b0073910 0x7f61b0198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f61aed9d700 1 -- 172.21.15.5:0/2778833115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0074ef0 msgr2=0x7f61b01993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f61aed9d700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0074ef0 0x7f61b01993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f61aed9d700 1 -- 172.21.15.5:0/2778833115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8009d00 con 0x7f61b0108e80 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f61aed9d700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 0x7f61b01a0440 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f61a800d010 tx=0x7f61a800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f619f7fe700 1 -- 172.21.15.5:0/2778833115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800e040 con 0x7f61b0108e80 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f619f7fe700 1 -- 172.21.15.5:0/2778833115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61a8003e10 con 0x7f61b0108e80 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b01a0f60 con 0x7f61b0108e80 2023-10-07T00:12:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f619f7fe700 1 -- 172.21.15.5:0/2778833115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80052a0 con 0x7f61b0108e80 2023-10-07T00:12:42.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.897+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b01a1320 con 0x7f61b0108e80 2023-10-07T00:12:42.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.898+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b0107530 con 0x7f61b0108e80 2023-10-07T00:12:42.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.900+0000 7f619f7fe700 1 -- 172.21.15.5:0/2778833115 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f61a801d9a0 con 0x7f61b0108e80 2023-10-07T00:12:42.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.903+0000 7f619f7fe700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61980a1510 0x7f61980a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:42.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.903+0000 7f619f7fe700 1 -- 172.21.15.5:0/2778833115 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f61a80ce060 con 0x7f61b0108e80 2023-10-07T00:12:42.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.903+0000 7f61ae59c700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61980a1510 0x7f61980a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:42.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.903+0000 7f61ae59c700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61980a1510 0x7f61980a39d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005950 tx=0x7f61a000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:42.907+0000 7f619f7fe700 1 -- 172.21.15.5:0/2778833115 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f61a8097570 con 0x7f61b0108e80 2023-10-07T00:12:42.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:42 smithi088 ceph-mon[103111]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:42 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2944169481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:42 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4069765892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:42.953 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:42 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/111533675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:42 smithi112 ceph-mon[133548]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:42 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2944169481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:42 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4069765892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:42 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/111533675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:42 smithi005 ceph-mon[129406]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-07T00:12:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:42 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2944169481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:42 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4069765892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:43.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:42 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/111533675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.118+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61b010ea80 con 0x7f61b0108e80 2023-10-07T00:12:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.118+0000 7f619f7fe700 1 -- 172.21.15.5:0/2778833115 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61a809ab90 con 0x7f61b0108e80 2023-10-07T00:12:43.120 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:12:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61980a1510 msgr2=0x7f61980a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61980a1510 0x7f61980a39d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005950 tx=0x7f61a000b410 comp rx=0 tx=0).stop 2023-10-07T00:12:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 msgr2=0x7f61b01a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 0x7f61b01a0440 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f61a800d010 tx=0x7f61a800bcc0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 shutdown_connections 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f61980a1510 0x7f61980a39d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b0108e80 0x7f61b01a0440 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b0073910 0x7f61b0198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 --2- 172.21.15.5:0/2778833115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b0074ef0 0x7f61b01993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 >> 172.21.15.5:0/2778833115 conn(0x7f61b00fc530 msgr2=0x7f61b00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 shutdown_connections 2023-10-07T00:12:43.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.121+0000 7f61b4dff700 1 -- 172.21.15.5:0/2778833115 wait complete. 2023-10-07T00:12:43.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:12:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 -- 172.21.15.5:0/2180162963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 msgr2=0x7effc4102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 --2- 172.21.15.5:0/2180162963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 0x7effc4102610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7effb40099c0 tx=0x7effb4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 -- 172.21.15.5:0/2180162963 shutdown_connections 2023-10-07T00:12:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 --2- 172.21.15.5:0/2180162963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4102b50 0x7effc4109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 --2- 172.21.15.5:0/2180162963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4100fc0 0x7effc41013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 --2- 172.21.15.5:0/2180162963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 0x7effc4102610 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 -- 172.21.15.5:0/2180162963 >> 172.21.15.5:0/2180162963 conn(0x7effc40fc530 msgr2=0x7effc40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 -- 172.21.15.5:0/2180162963 shutdown_connections 2023-10-07T00:12:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.345+0000 7effcbfff700 1 -- 172.21.15.5:0/2180162963 wait complete. 2023-10-07T00:12:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.346+0000 7effcbfff700 1 Processor -- start 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.346+0000 7effcbfff700 1 -- start start 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effcbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4100fc0 0x7effc4196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effcbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 0x7effc4197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effcbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4102b50 0x7effc419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effcbfff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc419e760 con 0x7effc41021b0 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effcbfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc419e8d0 con 0x7effc4102b50 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effcbfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc419ea90 con 0x7effc4100fc0 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc959a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 0x7effc4197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc959a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 0x7effc4197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58612/0 (socket says 172.21.15.5:58612) 2023-10-07T00:12:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc959a700 1 -- 172.21.15.5:0/3878475838 learned_addr learned my addr 172.21.15.5:0/3878475838 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc9d9b700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4100fc0 0x7effc4196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effca59c700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4102b50 0x7effc419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc959a700 1 -- 172.21.15.5:0/3878475838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4100fc0 msgr2=0x7effc4196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc959a700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4100fc0 0x7effc4196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc959a700 1 -- 172.21.15.5:0/3878475838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4102b50 msgr2=0x7effc419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc959a700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4102b50 0x7effc419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.347+0000 7effc959a700 1 -- 172.21.15.5:0/3878475838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40095f0 con 0x7effc41021b0 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.348+0000 7effc959a700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 0x7effc4197160 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7effb4005910 tx=0x7effb4003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.348+0000 7effbaffd700 1 -- 172.21.15.5:0/3878475838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb401d070 con 0x7effc41021b0 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.348+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc419ed10 con 0x7effc41021b0 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.348+0000 7effbaffd700 1 -- 172.21.15.5:0/3878475838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effb400bd30 con 0x7effc41021b0 2023-10-07T00:12:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.348+0000 7effbaffd700 1 -- 172.21.15.5:0/3878475838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4022cb0 con 0x7effc41021b0 2023-10-07T00:12:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.348+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc419f130 con 0x7effc41021b0 2023-10-07T00:12:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.349+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc410c6e0 con 0x7effc41021b0 2023-10-07T00:12:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.351+0000 7effbaffd700 1 -- 172.21.15.5:0/3878475838 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7effb4022470 con 0x7effc41021b0 2023-10-07T00:12:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.352+0000 7effbaffd700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effb00a1510 0x7effb00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.352+0000 7effbaffd700 1 -- 172.21.15.5:0/3878475838 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7effb40ce5a0 con 0x7effc41021b0 2023-10-07T00:12:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.353+0000 7effc9d9b700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effb00a1510 0x7effb00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.353+0000 7effc9d9b700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effb00a1510 0x7effb00a39d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7effc41980f0 tx=0x7effc000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:43.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.356+0000 7effbaffd700 1 -- 172.21.15.5:0/3878475838 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7effb4097ab0 con 0x7effc41021b0 2023-10-07T00:12:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.565+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effc4107fa0 con 0x7effc41021b0 2023-10-07T00:12:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.565+0000 7effbaffd700 1 -- 172.21.15.5:0/3878475838 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7effb409b0d0 con 0x7effc41021b0 2023-10-07T00:12:43.567 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:12:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effb00a1510 msgr2=0x7effb00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effb00a1510 0x7effb00a39d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7effc41980f0 tx=0x7effc000b410 comp rx=0 tx=0).stop 2023-10-07T00:12:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 msgr2=0x7effc4197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 0x7effc4197160 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7effb4005910 tx=0x7effb4003a50 comp rx=0 tx=0).stop 2023-10-07T00:12:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 shutdown_connections 2023-10-07T00:12:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7effb00a1510 0x7effb00a39d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc4102b50 0x7effc419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effc4100fc0 0x7effc4196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 --2- 172.21.15.5:0/3878475838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc41021b0 0x7effc4197160 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 >> 172.21.15.5:0/3878475838 conn(0x7effc40fc530 msgr2=0x7effc40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 shutdown_connections 2023-10-07T00:12:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.568+0000 7effcbfff700 1 -- 172.21.15.5:0/3878475838 wait complete. 2023-10-07T00:12:43.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:12:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3143787735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac073910 msgr2=0x7ff9ac073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3143787735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac073910 0x7ff9ac073d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009990 tx=0x7ff9a0009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3143787735 shutdown_connections 2023-10-07T00:12:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3143787735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac10d580 0x7ff9ac10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3143787735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9ac074ef0 0x7ff9ac073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3143787735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac073910 0x7ff9ac073d90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3143787735 >> 172.21.15.5:0/3143787735 conn(0x7ff9ac0fc520 msgr2=0x7ff9ac0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3143787735 shutdown_connections 2023-10-07T00:12:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.795+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3143787735 wait complete. 2023-10-07T00:12:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.796+0000 7ff9b15ff700 1 Processor -- start 2023-10-07T00:12:43.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9b15ff700 1 -- start start 2023-10-07T00:12:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9b15ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9ac073910 0x7ff9ac19d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:43.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9b15ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac074ef0 0x7ff9ac19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9b15ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac10d580 0x7ff9ac1a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9b15ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1a4db0 con 0x7ff9ac10d580 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9b15ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1a4ef0 con 0x7ff9ac074ef0 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9b15ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1a5080 con 0x7ff9ac073910 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac10d580 0x7ff9ac1a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac10d580 0x7ff9ac1a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58636/0 (socket says 172.21.15.5:58636) 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.797+0000 7ff9ab7fe700 1 -- 172.21.15.5:0/3265627416 learned_addr learned my addr 172.21.15.5:0/3265627416 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9aa7fc700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac074ef0 0x7ff9ac19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9aaffd700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9ac073910 0x7ff9ac19d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9ab7fe700 1 -- 172.21.15.5:0/3265627416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9ac073910 msgr2=0x7ff9ac19d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9ab7fe700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9ac073910 0x7ff9ac19d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9ab7fe700 1 -- 172.21.15.5:0/3265627416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac074ef0 msgr2=0x7ff9ac19d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9ab7fe700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac074ef0 0x7ff9ac19d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9ab7fe700 1 -- 172.21.15.5:0/3265627416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00095f0 con 0x7ff9ac10d580 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9aaffd700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9ac073910 0x7ff9ac19d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9ab7fe700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac10d580 0x7ff9ac1a47e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4007ee0 tx=0x7ff9a400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff993fff700 1 -- 172.21.15.5:0/3265627416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4017070 con 0x7ff9ac10d580 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff993fff700 1 -- 172.21.15.5:0/3265627416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9a400f040 con 0x7ff9ac10d580 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac1a5360 con 0x7ff9ac10d580 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.798+0000 7ff993fff700 1 -- 172.21.15.5:0/3265627416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4005710 con 0x7ff9ac10d580 2023-10-07T00:12:43.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.799+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac1a5870 con 0x7ff9ac10d580 2023-10-07T00:12:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.800+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac1030d0 con 0x7ff9ac10d580 2023-10-07T00:12:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.802+0000 7ff993fff700 1 -- 172.21.15.5:0/3265627416 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7ff9a4005870 con 0x7ff9ac10d580 2023-10-07T00:12:43.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.804+0000 7ff993fff700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff9940a1590 0x7ff9940a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.804+0000 7ff993fff700 1 -- 172.21.15.5:0/3265627416 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff9a40cc6d0 con 0x7ff9ac10d580 2023-10-07T00:12:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.804+0000 7ff9aaffd700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff9940a1590 0x7ff9940a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:43.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.805+0000 7ff9aaffd700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff9940a1590 0x7ff9940a3a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff99c005fd0 tx=0x7ff99c005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:43.808+0000 7ff993fff700 1 -- 172.21.15.5:0/3265627416 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff9a4095b50 con 0x7ff9ac10d580 2023-10-07T00:12:43.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:43 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2778833115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:43.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:43 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3878475838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:43.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:43 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2778833115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:43.952 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:43 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3878475838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:43.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:43 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2778833115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:43.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:43 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3878475838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.066+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9ac112cb0 con 0x7ff9ac10d580 2023-10-07T00:12:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.067+0000 7ff993fff700 1 -- 172.21.15.5:0/3265627416 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7ff9a4099170 con 0x7ff9ac10d580 2023-10-07T00:12:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:44.069 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:12:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff9940a1590 msgr2=0x7ff9940a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff9940a1590 0x7ff9940a3a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff99c005fd0 tx=0x7ff99c005ee0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac10d580 msgr2=0x7ff9ac1a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac10d580 0x7ff9ac1a47e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4007ee0 tx=0x7ff9a400d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 shutdown_connections 2023-10-07T00:12:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff9940a1590 0x7ff9940a3a50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ac10d580 0x7ff9ac1a47e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9ac073910 0x7ff9ac19d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 --2- 172.21.15.5:0/3265627416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac074ef0 0x7ff9ac19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 >> 172.21.15.5:0/3265627416 conn(0x7ff9ac0fc520 msgr2=0x7ff9ac0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 shutdown_connections 2023-10-07T00:12:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.070+0000 7ff9b15ff700 1 -- 172.21.15.5:0/3265627416 wait complete. 2023-10-07T00:12:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:12:44.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 -- 172.21.15.5:0/942190089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c1021a0 msgr2=0x7f547c102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 --2- 172.21.15.5:0/942190089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c1021a0 0x7f547c102600 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f546c0099c0 tx=0x7f546c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 -- 172.21.15.5:0/942190089 shutdown_connections 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 --2- 172.21.15.5:0/942190089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c102b40 0x7f547c1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 --2- 172.21.15.5:0/942190089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f547c100fb0 0x7f547c1013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 --2- 172.21.15.5:0/942190089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c1021a0 0x7f547c102600 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 -- 172.21.15.5:0/942190089 >> 172.21.15.5:0/942190089 conn(0x7f547c0fc520 msgr2=0x7f547c0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 -- 172.21.15.5:0/942190089 shutdown_connections 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.293+0000 7f54839ff700 1 -- 172.21.15.5:0/942190089 wait complete. 2023-10-07T00:12:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f54839ff700 1 Processor -- start 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f54839ff700 1 -- start start 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f54839ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c100fb0 0x7f547c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f54839ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f547c1021a0 0x7f547c197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f54839ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c102b40 0x7f547c19e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f54839ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19e780 con 0x7f547c100fb0 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f54839ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19e8f0 con 0x7f547c102b40 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f54839ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19eab0 con 0x7f547c1021a0 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f548179b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c100fb0 0x7f547c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f548179b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c100fb0 0x7f547c196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58650/0 (socket says 172.21.15.5:58650) 2023-10-07T00:12:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.294+0000 7f548179b700 1 -- 172.21.15.5:0/2650381583 learned_addr learned my addr 172.21.15.5:0/2650381583 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f5480f9a700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f547c1021a0 0x7f547c197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f5481f9c700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c102b40 0x7f547c19e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f548179b700 1 -- 172.21.15.5:0/2650381583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f547c1021a0 msgr2=0x7f547c197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f548179b700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f547c1021a0 0x7f547c197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f548179b700 1 -- 172.21.15.5:0/2650381583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c102b40 msgr2=0x7f547c19e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f548179b700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c102b40 0x7f547c19e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f548179b700 1 -- 172.21.15.5:0/2650381583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c0095f0 con 0x7f547c100fb0 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f548179b700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c100fb0 0x7f547c196c40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f547800d980 tx=0x7f547800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f54727fc700 1 -- 172.21.15.5:0/2650381583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800b950 con 0x7f547c100fb0 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f54727fc700 1 -- 172.21.15.5:0/2650381583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5478007620 con 0x7f547c100fb0 2023-10-07T00:12:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c19ed90 con 0x7f547c100fb0 2023-10-07T00:12:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f54727fc700 1 -- 172.21.15.5:0/2650381583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800f3c0 con 0x7f547c100fb0 2023-10-07T00:12:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.295+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c19f200 con 0x7f547c100fb0 2023-10-07T00:12:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.296+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c10c6c0 con 0x7f547c100fb0 2023-10-07T00:12:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.298+0000 7f54727fc700 1 -- 172.21.15.5:0/2650381583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f547800bab0 con 0x7f547c100fb0 2023-10-07T00:12:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.301+0000 7f54727fc700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f54680a1590 0x7f54680a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.301+0000 7f54727fc700 1 -- 172.21.15.5:0/2650381583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f54780cd060 con 0x7f547c100fb0 2023-10-07T00:12:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.301+0000 7f5480f9a700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f54680a1590 0x7f54680a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.301+0000 7f5480f9a700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f54680a1590 0x7f54680a3a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f546c00b580 tx=0x7f546c005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.305+0000 7f54727fc700 1 -- 172.21.15.5:0/2650381583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5478100100 con 0x7f547c100fb0 2023-10-07T00:12:44.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.522+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f547c19f3f0 con 0x7f547c100fb0 2023-10-07T00:12:44.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.523+0000 7f54727fc700 1 -- 172.21.15.5:0/2650381583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f5478016090 con 0x7f547c100fb0 2023-10-07T00:12:44.525 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:44.525 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f54680a1590 msgr2=0x7f54680a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f54680a1590 0x7f54680a3a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f546c00b580 tx=0x7f546c005ea0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c100fb0 msgr2=0x7f547c196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c100fb0 0x7f547c196c40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f547800d980 tx=0x7f547800dc90 comp rx=0 tx=0).stop 2023-10-07T00:12:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 shutdown_connections 2023-10-07T00:12:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f54680a1590 0x7f54680a3a50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c102b40 0x7f547c19e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547c100fb0 0x7f547c196c40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 --2- 172.21.15.5:0/2650381583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f547c1021a0 0x7f547c197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 >> 172.21.15.5:0/2650381583 conn(0x7f547c0fc520 msgr2=0x7f547c0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 shutdown_connections 2023-10-07T00:12:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.526+0000 7f54839ff700 1 -- 172.21.15.5:0/2650381583 wait complete. 2023-10-07T00:12:44.547 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-07T00:11:13.365038+0000', 'modified': '2023-10-07T00:11:20.652397+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24611, 'mds_1': 24574, 'mds_2': 24566, 'mds_3': 24553, 'mds_4': 14682}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14607': {'gid': 14607, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6837/3650932338', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6836', 'nonce': 3650932338}, {'type': 'v1', 'addr': '172.21.15.5:6837', 'nonce': 3650932338}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14682': {'gid': 14682, 'name': 'g', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.5:6839/2286789609', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6838', 'nonce': 2286789609}, {'type': 'v1', 'addr': '172.21.15.5:6839', 'nonce': 2286789609}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24460': {'gid': 24460, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6833/2184532481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6832', 'nonce': 2184532481}, {'type': 'v1', 'addr': '172.21.15.112:6833', 'nonce': 2184532481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24502': {'gid': 24502, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.88:6835/987389810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 987389810}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 987389810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6835/1364284217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 1364284217}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 1364284217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24532': {'gid': 24532, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6837/963373716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 963373716}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 963373716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24553': {'gid': 24553, 'name': 'i', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.112:6839/1437328815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 1437328815}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 1437328815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24566': {'gid': 24566, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.88:6837/3467169858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6836', 'nonce': 3467169858}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 3467169858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24574': {'gid': 24574, 'name': 'a', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.5:6841/3808461894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6840', 'nonce': 3808461894}, {'type': 'v1', 'addr': '172.21.15.5:6841', 'nonce': 3808461894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24611': {'gid': 24611, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6839/4013876185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6838', 'nonce': 4013876185}, {'type': 'v1', 'addr': '172.21.15.88:6839', 'nonce': 4013876185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-07T00:12:44.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-07T00:12:44.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2023-10-07T00:12:44.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.800+0000 7f4f91dff700 1 -- 172.21.15.5:0/1297843915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c100fc0 msgr2=0x7f4f8c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.800+0000 7f4f91dff700 1 --2- 172.21.15.5:0/1297843915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c100fc0 0x7f4f8c1013e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0099c0 tx=0x7f4f7c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.801+0000 7f4f91dff700 1 -- 172.21.15.5:0/1297843915 shutdown_connections 2023-10-07T00:12:44.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.801+0000 7f4f91dff700 1 --2- 172.21.15.5:0/1297843915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c102b50 0x7f4f8c109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.801+0000 7f4f91dff700 1 --2- 172.21.15.5:0/1297843915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c100fc0 0x7f4f8c1013e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.801+0000 7f4f91dff700 1 --2- 172.21.15.5:0/1297843915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f8c1021b0 0x7f4f8c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.801+0000 7f4f91dff700 1 -- 172.21.15.5:0/1297843915 >> 172.21.15.5:0/1297843915 conn(0x7f4f8c0fc530 msgr2=0x7f4f8c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.801+0000 7f4f91dff700 1 -- 172.21.15.5:0/1297843915 shutdown_connections 2023-10-07T00:12:44.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.801+0000 7f4f91dff700 1 -- 172.21.15.5:0/1297843915 wait complete. 2023-10-07T00:12:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.802+0000 7f4f91dff700 1 Processor -- start 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.802+0000 7f4f91dff700 1 -- start start 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.802+0000 7f4f91dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f8c100fc0 0x7f4f8c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.802+0000 7f4f91dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c1021b0 0x7f4f8c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.802+0000 7f4f91dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c102b50 0x7f4f8c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.802+0000 7f4f91dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c073f80 con 0x7f4f8c102b50 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.802+0000 7f4f91dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0740f0 con 0x7f4f8c100fc0 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.802+0000 7f4f91dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1a0bf0 con 0x7f4f8c1021b0 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c102b50 0x7f4f8c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c102b50 0x7f4f8c0737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58666/0 (socket says 172.21.15.5:58666) 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 -- 172.21.15.5:0/4239055010 learned_addr learned my addr 172.21.15.5:0/4239055010 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f8c100fc0 0x7f4f8c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8affd700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c1021b0 0x7f4f8c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 -- 172.21.15.5:0/4239055010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c1021b0 msgr2=0x7f4f8c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c1021b0 0x7f4f8c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 -- 172.21.15.5:0/4239055010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f8c100fc0 msgr2=0x7f4f8c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f8c100fc0 0x7f4f8c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 -- 172.21.15.5:0/4239055010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0095f0 con 0x7f4f8c102b50 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8affd700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c1021b0 0x7f4f8c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c102b50 0x7f4f8c0737e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4f84007ee0 tx=0x7f4f8400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.803+0000 7f4f88ff9700 1 -- 172.21.15.5:0/4239055010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84017070 con 0x7f4f8c102b50 2023-10-07T00:12:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.804+0000 7f4f91dff700 1 -- 172.21.15.5:0/4239055010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c1a0ed0 con 0x7f4f8c102b50 2023-10-07T00:12:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.804+0000 7f4f88ff9700 1 -- 172.21.15.5:0/4239055010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f8400f040 con 0x7f4f8c102b50 2023-10-07T00:12:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.804+0000 7f4f88ff9700 1 -- 172.21.15.5:0/4239055010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84005710 con 0x7f4f8c102b50 2023-10-07T00:12:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.804+0000 7f4f91dff700 1 -- 172.21.15.5:0/4239055010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c1a1300 con 0x7f4f8c102b50 2023-10-07T00:12:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.807+0000 7f4f88ff9700 1 -- 172.21.15.5:0/4239055010 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f4f84005870 con 0x7f4f8c102b50 2023-10-07T00:12:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.808+0000 7f4f88ff9700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f740a1510 0x7f4f740a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.808+0000 7f4fa5646b80 1 Processor -- start 2023-10-07T00:12:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.808+0000 7f4f88ff9700 1 -- 172.21.15.5:0/4239055010 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4f840cc670 con 0x7f4f8c102b50 2023-10-07T00:12:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4fa5646b80 1 -- start start 2023-10-07T00:12:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f740a1510 0x7f4f740a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 0x55807b251630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b252430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b252e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b1b9410 con 0x55807b252a10 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b1aabd0 con 0x55807b251b70 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b1a84f0 con 0x55807b251210 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4f8bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b252e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4f8bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b252e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58672/0 (socket says 172.21.15.5:58672) 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4f8bfff700 1 -- 172.21.15.5:0/1343150561 learned_addr learned my addr 172.21.15.5:0/1343150561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f740a1510 0x7f4f740a39d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00c010 tx=0x7f4f7c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.809+0000 7f4f8affd700 1 --2- 172.21.15.5:0/1343150561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b252430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f8bfff700 1 -- 172.21.15.5:0/1343150561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 msgr2=0x55807b251630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/1343150561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 0x55807b251630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f8bfff700 1 -- 172.21.15.5:0/1343150561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 msgr2=0x55807b252430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/1343150561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b252430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f8bfff700 1 -- 172.21.15.5:0/1343150561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55807afced90 con 0x55807b252a10 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/1343150561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b252e90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4f84096220 tx=0x7f4f84099600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c6d382b7b79d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f71ffb700 1 -- 172.21.15.5:0/1343150561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400dc60 con 0x55807b252a10 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f71ffb700 1 -- 172.21.15.5:0/1343150561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f84099eb0 con 0x55807b252a10 2023-10-07T00:12:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.810+0000 7f4f71ffb700 1 -- 172.21.15.5:0/1343150561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840a1b40 con 0x55807b252a10 2023-10-07T00:12:44.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1343150561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 msgr2=0x55807b252e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1343150561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b252e90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4f84096220 tx=0x7f4f84099600 comp rx=0 tx=0).stop 2023-10-07T00:12:44.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1343150561 shutdown_connections 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1343150561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b252e90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1343150561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 0x55807b251630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1343150561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b252430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1343150561 >> 172.21.15.5:0/1343150561 conn(0x55807b1c5210 msgr2=0x55807b24c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1343150561 shutdown_connections 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.811+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1343150561 wait complete. 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.812+0000 7f4fa5646b80 1 -- start start 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.812+0000 7f4fa5646b80 1 Processor -- start 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.812+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251210 0x55807b25afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.812+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251b70 0x55807b25b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.812+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b262560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.812+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b1a3de0 con 0x55807b251b70 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.812+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b1406c0 con 0x55807b251210 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.812+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b140360 con 0x55807b252a10 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4fa5646b80 10 client.0 _ll_register_callbacks cb 0x55807af9d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251b70 0x55807b25b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251b70 0x55807b25b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58682/0 (socket says 172.21.15.5:58682) 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 -- 172.21.15.5:0/1910474448 learned_addr learned my addr 172.21.15.5:0/1910474448 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b262560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251210 0x55807b25afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 -- 172.21.15.5:0/1910474448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 msgr2=0x55807b262560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b262560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 -- 172.21.15.5:0/1910474448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251210 msgr2=0x55807b25afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251210 0x55807b25afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 -- 172.21.15.5:0/1910474448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c1a1300 con 0x55807b251b70 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b262560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.813+0000 7f4f8affd700 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251b70 0x55807b25b520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4f80012700 tx=0x7f4f80012a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508d96aabd082602 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.814+0000 7f4f6affd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.814+0000 7f4f6affd700 1 -- 172.21.15.5:0/1910474448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000b9d0 con 0x55807b251b70 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.814+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1910474448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55807b243ec0 con 0x55807b251b70 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.814+0000 7f4f6affd700 1 -- 172.21.15.5:0/1910474448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4f80004220 con 0x55807b251b70 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.814+0000 7f4f6affd700 1 -- 172.21.15.5:0/1910474448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f800043e0 con 0x55807b251b70 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.814+0000 7f4fa5646b80 10 client.15306 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.814+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1910474448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55807afb7c10 con 0x55807b251b70 2023-10-07T00:12:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.814+0000 7f4f6affd700 1 -- 172.21.15.5:0/1910474448 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55807b243ec0 con 0x55807b251b70 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4f6affd700 1 -- 172.21.15.5:0/1910474448 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f80010840 con 0x55807b251b70 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4fa5646b80 10 client.15306 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4fa5646b80 10 client.15306 resolve_mds: resolved name 'g' to daemon mds.g 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4fa5646b80 20 client.15306 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55807b266c90 0x55807b265710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4fa5646b80 4 client.15306 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1910474448 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55807b19cdc0 con 0x55807b266c90 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55807b266c90 0x55807b265710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55807b266c90 0x55807b265710 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ae9fcace3efdddb server_cookie=35a12fc97c0ca70e in_seq=0 out_seq=0 2023-10-07T00:12:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.815+0000 7f4f6affd700 10 client.15306 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:12:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4f6affd700 1 -- 172.21.15.5:0/1910474448 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55807b19cdc0 con 0x55807b266c90 2023-10-07T00:12:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4f6affd700 10 client.15306 handle_command_reply: tid=0 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 client.15306 shutdown 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1910474448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251b70 msgr2=0x55807b25b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251b70 0x55807b25b520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4f80012700 tx=0x7f4f80012a10 comp rx=0 tx=0).stop 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1910474448 shutdown_connections 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b262560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55807b266c90 0x55807b265710 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251210 0x55807b25afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/1910474448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251b70 0x55807b25b520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4f6affd700 0 client.15306 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.816+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1910474448 >> 172.21.15.5:0/1910474448 conn(0x55807b1c5210 msgr2=0x55807b24bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.817+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1910474448 shutdown_connections 2023-10-07T00:12:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.817+0000 7f4fa5646b80 1 -- 172.21.15.5:0/1910474448 wait complete. 2023-10-07T00:12:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.817+0000 7f4fa5646b80 20 client.15306 trim_cache size 0 max 16384 2023-10-07T00:12:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4fa5646b80 1 Processor -- start 2023-10-07T00:12:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4fa5646b80 1 -- start start 2023-10-07T00:12:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251210 0x55807b258ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b2624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b24bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b0248d0 con 0x55807b251210 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b19fed0 con 0x55807b251b70 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b14a4d0 con 0x55807b252a10 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.835+0000 7f4f8b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251210 0x55807b258ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251210 0x55807b258ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58686/0 (socket says 172.21.15.5:58686) 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8b7fe700 1 -- 172.21.15.5:0/3252921708 learned_addr learned my addr 172.21.15.5:0/3252921708 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8affd700 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b2624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b24bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8b7fe700 1 -- 172.21.15.5:0/3252921708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 msgr2=0x55807b24bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b24bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8b7fe700 1 -- 172.21.15.5:0/3252921708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 msgr2=0x55807b2624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b2624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8b7fe700 1 -- 172.21.15.5:0/3252921708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55807aff5200 con 0x55807b251210 2023-10-07T00:12:44.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251210 0x55807b258ee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c102010 tx=0x7f4f7c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306deb6fbf41135a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f727fc700 1 -- 172.21.15.5:0/3252921708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c031990 con 0x55807b251210 2023-10-07T00:12:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f727fc700 1 -- 172.21.15.5:0/3252921708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f7c01e040 con 0x55807b251210 2023-10-07T00:12:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.836+0000 7f4f727fc700 1 -- 172.21.15.5:0/3252921708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c004c90 con 0x55807b251210 2023-10-07T00:12:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 -- 172.21.15.5:0/3252921708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251210 msgr2=0x55807b258ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251210 0x55807b258ee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c102010 tx=0x7f4f7c020000 comp rx=0 tx=0).stop 2023-10-07T00:12:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 -- 172.21.15.5:0/3252921708 shutdown_connections 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b252a10 0x55807b24bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b251210 0x55807b258ee0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/3252921708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b2624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 -- 172.21.15.5:0/3252921708 >> 172.21.15.5:0/3252921708 conn(0x55807b1c5210 msgr2=0x55807b259c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 -- 172.21.15.5:0/3252921708 shutdown_connections 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.837+0000 7f4fa5646b80 1 -- 172.21.15.5:0/3252921708 wait complete. 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.838+0000 7f4fa5646b80 1 -- start start 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.838+0000 7f4fa5646b80 1 Processor -- start 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 0x55807b262050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b25eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4fa5646b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b25f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b25f710 con 0x55807b252a10 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b2626d0 con 0x55807b251b70 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4fa5646b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807b262860 con 0x55807b251210 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4fa5646b80 10 client.0 _ll_register_callbacks cb 0x7f4f8000bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b25f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b25f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58698/0 (socket says 172.21.15.5:58698) 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 -- 172.21.15.5:0/2633108097 learned_addr learned my addr 172.21.15.5:0/2633108097 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8affd700 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b25eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 0x55807b262050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 -- 172.21.15.5:0/2633108097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 msgr2=0x55807b262050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 0x55807b262050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 -- 172.21.15.5:0/2633108097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 msgr2=0x55807b25eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b25eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 -- 172.21.15.5:0/2633108097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c109d50 con 0x55807b252a10 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f8bfff700 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b25f030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4f840994b0 tx=0x7f4f840b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5cf2aa2d0cdb90 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.839+0000 7f4f6affd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4f6affd700 1 -- 172.21.15.5:0/2633108097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840a18b0 con 0x55807b252a10 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4f6affd700 1 -- 172.21.15.5:0/2633108097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4f8400dc60 con 0x55807b252a10 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 1 -- 172.21.15.5:0/2633108097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f84099eb0 con 0x55807b252a10 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4f6affd700 1 -- 172.21.15.5:0/2633108097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f840a1b40 con 0x55807b252a10 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 10 client.15312 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 1 -- 172.21.15.5:0/2633108097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55807afcd260 con 0x55807b252a10 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4f6affd700 1 -- 172.21.15.5:0/2633108097 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f84099eb0 con 0x55807b252a10 2023-10-07T00:12:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4f6affd700 1 -- 172.21.15.5:0/2633108097 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f84098ca0 con 0x55807b252a10 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 10 client.15312 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 10 client.15312 resolve_mds: resolved name 'g' to daemon mds.g 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 20 client.15312 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55807b2bf4d0 0x55807b2bb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 4 client.15312 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.840+0000 7f4fa5646b80 1 -- 172.21.15.5:0/2633108097 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55807b19cae0 con 0x55807b2bf4d0 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.841+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55807b2bf4d0 0x55807b2bb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.841+0000 7f4f8b7fe700 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55807b2bf4d0 0x55807b2bb970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b9bb6de4996cbee7 server_cookie=8404e9582cd5ce66 in_seq=0 out_seq=0 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.841+0000 7f4f6affd700 10 client.15312 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.841+0000 7f4f6affd700 1 -- 172.21.15.5:0/2633108097 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55807b19cae0 con 0x55807b2bf4d0 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.841+0000 7f4f6affd700 10 client.15312 handle_command_reply: tid=0 2023-10-07T00:12:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.841+0000 7f4fa5646b80 1 client.15312 shutdown 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.841+0000 7f4fa5646b80 1 -- 172.21.15.5:0/2633108097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 msgr2=0x55807b25f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.841+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b25f030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4f840994b0 tx=0x7f4f840b9040 comp rx=0 tx=0).stop 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 1 -- 172.21.15.5:0/2633108097 shutdown_connections 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55807b252a10 0x55807b25f030 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55807b251210 0x55807b262050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55807b2bf4d0 0x55807b2bb970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 1 --2- 172.21.15.5:0/2633108097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55807b251b70 0x55807b25eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f6affd700 0 client.15312 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 1 -- 172.21.15.5:0/2633108097 >> 172.21.15.5:0/2633108097 conn(0x55807b1c5210 msgr2=0x55807b258ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 1 -- 172.21.15.5:0/2633108097 shutdown_connections 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 1 -- 172.21.15.5:0/2633108097 wait complete. 2023-10-07T00:12:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4fa5646b80 20 client.15312 trim_cache size 0 max 16384 2023-10-07T00:12:44.850 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:44.850 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:44.850 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 4, 2023-10-07T00:12:44.850 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 14682, 2023-10-07T00:12:44.850 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:44.850 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:44.850 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:44.850 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 85.199006167999997, 2023-10-07T00:12:44.851 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:44.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:44.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:44.851 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 104.497164372 2023-10-07T00:12:44.851 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 -- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f740a1510 msgr2=0x7f4f740a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f740a1510 0x7f4f740a39d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00c010 tx=0x7f4f7c005e80 comp rx=0 tx=0).stop 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 -- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c102b50 msgr2=0x7f4f8c0737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c102b50 0x7f4f8c0737e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4f84007ee0 tx=0x7f4f8400d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 -- 172.21.15.5:0/4239055010 shutdown_connections 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f740a1510 0x7f4f740a39d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f8c102b50 0x7f4f8c0737e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f8c100fc0 0x7f4f8c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 --2- 172.21.15.5:0/4239055010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c1021b0 0x7f4f8c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.842+0000 7f4f91dff700 1 -- 172.21.15.5:0/4239055010 >> 172.21.15.5:0/4239055010 conn(0x7f4f8c0fc530 msgr2=0x7f4f8c1056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:44.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.843+0000 7f4f91dff700 1 -- 172.21.15.5:0/4239055010 shutdown_connections 2023-10-07T00:12:44.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:44.843+0000 7f4f91dff700 1 -- 172.21.15.5:0/4239055010 wait complete. 2023-10-07T00:12:44.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:44 smithi005 ceph-mon[129406]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:44.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:44 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3265627416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:44.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:44 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2650381583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:44.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-07T00:12:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:44 smithi112 ceph-mon[133548]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:44 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3265627416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:44 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2650381583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.065+0000 7f02b5bff700 1 -- 172.21.15.5:0/2332821180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b01021b0 msgr2=0x7f02b0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.065+0000 7f02b5bff700 1 --2- 172.21.15.5:0/2332821180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b01021b0 0x7f02b0102610 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f02a40099c0 tx=0x7f02a4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.066+0000 7f02b5bff700 1 -- 172.21.15.5:0/2332821180 shutdown_connections 2023-10-07T00:12:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.066+0000 7f02b5bff700 1 --2- 172.21.15.5:0/2332821180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02b0102b50 0x7f02b0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.066+0000 7f02b5bff700 1 --2- 172.21.15.5:0/2332821180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0100fc0 0x7f02b01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.066+0000 7f02b5bff700 1 --2- 172.21.15.5:0/2332821180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b01021b0 0x7f02b0102610 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.066+0000 7f02b5bff700 1 -- 172.21.15.5:0/2332821180 >> 172.21.15.5:0/2332821180 conn(0x7f02b00fc530 msgr2=0x7f02b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.066+0000 7f02b5bff700 1 -- 172.21.15.5:0/2332821180 shutdown_connections 2023-10-07T00:12:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.066+0000 7f02b5bff700 1 -- 172.21.15.5:0/2332821180 wait complete. 2023-10-07T00:12:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02b5bff700 1 Processor -- start 2023-10-07T00:12:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02b5bff700 1 -- start start 2023-10-07T00:12:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02b5bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b0100fc0 0x7f02b0196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02b5bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02b01021b0 0x7f02b0197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02b5bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0102b50 0x7f02b019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02b5bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b019e760 con 0x7f02b0100fc0 2023-10-07T00:12:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02b5bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b019e8d0 con 0x7f02b01021b0 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02b5bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b019ea90 con 0x7f02b0102b50 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b0100fc0 0x7f02b0196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b0100fc0 0x7f02b0196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58720/0 (socket says 172.21.15.5:58720) 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.067+0000 7f02af7fe700 1 -- 172.21.15.5:0/103208820 learned_addr learned my addr 172.21.15.5:0/103208820 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02affff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0102b50 0x7f02b019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02af7fe700 1 -- 172.21.15.5:0/103208820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0102b50 msgr2=0x7f02b019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02af7fe700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0102b50 0x7f02b019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02af7fe700 1 -- 172.21.15.5:0/103208820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02b01021b0 msgr2=0x7f02b0197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02aeffd700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02b01021b0 0x7f02b0197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02af7fe700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02b01021b0 0x7f02b0197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02af7fe700 1 -- 172.21.15.5:0/103208820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40095f0 con 0x7f02b0100fc0 2023-10-07T00:12:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02af7fe700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b0100fc0 0x7f02b0196c20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f02a000d980 tx=0x7f02a000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02acff9700 1 -- 172.21.15.5:0/103208820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a000de60 con 0x7f02b0100fc0 2023-10-07T00:12:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02b5bff700 1 -- 172.21.15.5:0/103208820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b019ed70 con 0x7f02b0100fc0 2023-10-07T00:12:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02acff9700 1 -- 172.21.15.5:0/103208820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02a00044b0 con 0x7f02b0100fc0 2023-10-07T00:12:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.068+0000 7f02acff9700 1 -- 172.21.15.5:0/103208820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0003b40 con 0x7f02b0100fc0 2023-10-07T00:12:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.069+0000 7f02b5bff700 1 -- 172.21.15.5:0/103208820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b019f1d0 con 0x7f02b0100fc0 2023-10-07T00:12:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.072+0000 7f02acff9700 1 -- 172.21.15.5:0/103208820 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f02a0003ca0 con 0x7f02b0100fc0 2023-10-07T00:12:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.074+0000 7f02c95efb80 1 Processor -- start 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.074+0000 7f02c95efb80 1 -- start start 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.074+0000 7f02acff9700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02980a1510 0x7f02980a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.074+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b81630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.074+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 0x55cce3b82430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 0x55cce3b82e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.074+0000 7f02acff9700 1 -- 172.21.15.5:0/103208820 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f02a00ccc00 con 0x7f02b0100fc0 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02c95efb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3ae9410 con 0x55cce3b81210 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02c95efb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3adabd0 con 0x55cce3b82a10 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02c95efb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3ad84f0 con 0x55cce3b81b70 2023-10-07T00:12:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02affff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02980a1510 0x7f02980a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b81630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b81630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58726/0 (socket says 172.21.15.5:58726) 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02af7fe700 1 -- 172.21.15.5:0/372314870 learned_addr learned my addr 172.21.15.5:0/372314870 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02aeffd700 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 0x55cce3b82430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02affff700 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 0x55cce3b82e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02af7fe700 1 -- 172.21.15.5:0/372314870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 msgr2=0x55cce3b82430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02af7fe700 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 0x55cce3b82430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02af7fe700 1 -- 172.21.15.5:0/372314870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 msgr2=0x55cce3b82e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02af7fe700 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 0x55cce3b82e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02af7fe700 1 -- 172.21.15.5:0/372314870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce38fed90 con 0x55cce3b81210 2023-10-07T00:12:45.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.075+0000 7f02affff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02980a1510 0x7f02980a39d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009cb0 tx=0x7f02a80077e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.076+0000 7f02af7fe700 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b81630 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f02a00a1ba0 tx=0x7f02a0099980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3ee2eeee52d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.076+0000 7f0295ffb700 1 -- 172.21.15.5:0/372314870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0009bb0 con 0x55cce3b81210 2023-10-07T00:12:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.076+0000 7f0295ffb700 1 -- 172.21.15.5:0/372314870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02a009a440 con 0x55cce3b81210 2023-10-07T00:12:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.076+0000 7f0295ffb700 1 -- 172.21.15.5:0/372314870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0099490 con 0x55cce3b81210 2023-10-07T00:12:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.076+0000 7f02c95efb80 1 -- 172.21.15.5:0/372314870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 msgr2=0x55cce3b81630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.076+0000 7f02c95efb80 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b81630 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f02a00a1ba0 tx=0x7f02a0099980 comp rx=0 tx=0).stop 2023-10-07T00:12:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 -- 172.21.15.5:0/372314870 shutdown_connections 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 0x55cce3b82e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b81630 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 --2- 172.21.15.5:0/372314870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 0x55cce3b82430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 -- 172.21.15.5:0/372314870 >> 172.21.15.5:0/372314870 conn(0x55cce3af5210 msgr2=0x55cce3b7c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 -- 172.21.15.5:0/372314870 shutdown_connections 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 -- 172.21.15.5:0/372314870 wait complete. 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 -- start start 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.077+0000 7f02c95efb80 1 Processor -- start 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b8f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 0x55cce3b8f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 0x55cce3b96900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02c95efb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3ad3de0 con 0x55cce3b81210 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02c95efb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3a706c0 con 0x55cce3b82a10 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02c95efb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3a70360 con 0x55cce3b81b70 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02c95efb80 10 client.0 _ll_register_callbacks cb 0x55cce38cd7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b8f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b8f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58740/0 (socket says 172.21.15.5:58740) 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02af7fe700 1 -- 172.21.15.5:0/1082125625 learned_addr learned my addr 172.21.15.5:0/1082125625 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02aeffd700 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 0x55cce3b8f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02af7fe700 1 -- 172.21.15.5:0/1082125625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 msgr2=0x55cce3b8f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02af7fe700 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 0x55cce3b8f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02af7fe700 1 -- 172.21.15.5:0/1082125625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 msgr2=0x55cce3b96900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02af7fe700 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 0x55cce3b96900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.078+0000 7f02af7fe700 1 -- 172.21.15.5:0/1082125625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b019f1d0 con 0x55cce3b81210 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f02af7fe700 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b8f380 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f02a00a2290 tx=0x7f02a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694ccee8be190d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f028effd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f028effd700 1 -- 172.21.15.5:0/1082125625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00b8060 con 0x55cce3b81210 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f02c95efb80 1 -- 172.21.15.5:0/1082125625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cce3b73ec0 con 0x55cce3b81210 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f028effd700 1 -- 172.21.15.5:0/1082125625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f02a0009bb0 con 0x55cce3b81210 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f028effd700 1 -- 172.21.15.5:0/1082125625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02a00ca8f0 con 0x55cce3b81210 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f02c95efb80 10 client.15324 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f02c95efb80 1 -- 172.21.15.5:0/1082125625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cce38e7c10 con 0x55cce3b81210 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.079+0000 7f028effd700 1 -- 172.21.15.5:0/1082125625 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cce3b73ec0 con 0x55cce3b81210 2023-10-07T00:12:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.080+0000 7f028effd700 1 -- 172.21.15.5:0/1082125625 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f02a0095c50 con 0x55cce3b81210 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.080+0000 7f02c95efb80 10 client.15324 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.080+0000 7f02c95efb80 10 client.15324 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.080+0000 7f02c95efb80 20 client.15324 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.080+0000 7f02c95efb80 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55cce3b9a9c0 0x55cce3b99830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.080+0000 7f02c95efb80 4 client.15324 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.080+0000 7f02c95efb80 1 -- 172.21.15.5:0/1082125625 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cce3accdc0 con 0x55cce3b9a9c0 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.080+0000 7f02aeffd700 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55cce3b9a9c0 0x55cce3b99830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.081+0000 7f02aeffd700 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55cce3b9a9c0 0x55cce3b99830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=186f8696221c45b9 server_cookie=57738fb369f1c4b0 in_seq=0 out_seq=0 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.081+0000 7f028effd700 10 client.15324 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f028effd700 1 -- 172.21.15.5:0/1082125625 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cce3accdc0 con 0x55cce3b9a9c0 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f028effd700 10 client.15324 handle_command_reply: tid=0 2023-10-07T00:12:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 client.15324 shutdown 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 -- 172.21.15.5:0/1082125625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 msgr2=0x55cce3b8f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b8f380 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f02a00a2290 tx=0x7f02a0000bc0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 -- 172.21.15.5:0/1082125625 shutdown_connections 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55cce3b9a9c0 0x55cce3b99830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b82a10 0x55cce3b96900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81210 0x55cce3b8f380 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 --2- 172.21.15.5:0/1082125625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b81b70 0x55cce3b8f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f028effd700 0 client.15324 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 -- 172.21.15.5:0/1082125625 >> 172.21.15.5:0/1082125625 conn(0x55cce3af5210 msgr2=0x55cce3b7bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 -- 172.21.15.5:0/1082125625 shutdown_connections 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 1 -- 172.21.15.5:0/1082125625 wait complete. 2023-10-07T00:12:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.082+0000 7f02c95efb80 20 client.15324 trim_cache size 0 max 16384 2023-10-07T00:12:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02c95efb80 1 Processor -- start 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02c95efb80 1 -- start start 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b7bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b96890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b99830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02c95efb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce39548d0 con 0x55cce3b81b70 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02c95efb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3b762b0 con 0x55cce3b81210 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02c95efb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3accdc0 con 0x55cce3b82a10 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02aeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b96890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02aeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b96890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58742/0 (socket says 172.21.15.5:58742) 2023-10-07T00:12:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02aeffd700 1 -- 172.21.15.5:0/3647785583 learned_addr learned my addr 172.21.15.5:0/3647785583 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.101+0000 7f02af7fe700 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b7bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02affff700 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b99830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02aeffd700 1 -- 172.21.15.5:0/3647785583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 msgr2=0x55cce3b99830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02aeffd700 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b99830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02aeffd700 1 -- 172.21.15.5:0/3647785583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 msgr2=0x55cce3b7bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02aeffd700 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b7bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02aeffd700 1 -- 172.21.15.5:0/3647785583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce3925200 con 0x55cce3b81b70 2023-10-07T00:12:45.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02aeffd700 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b96890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f02a40099c0 tx=0x7f02a4005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0c80a7ed7698b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02967fc700 1 -- 172.21.15.5:0/3647785583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a401e040 con 0x55cce3b81b70 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02967fc700 1 -- 172.21.15.5:0/3647785583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02a401f040 con 0x55cce3b81b70 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.102+0000 7f02967fc700 1 -- 172.21.15.5:0/3647785583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a4005040 con 0x55cce3b81b70 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 -- 172.21.15.5:0/3647785583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 msgr2=0x55cce3b96890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b96890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f02a40099c0 tx=0x7f02a4005fb0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 -- 172.21.15.5:0/3647785583 shutdown_connections 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b99830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b7bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3647785583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b96890 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 -- 172.21.15.5:0/3647785583 >> 172.21.15.5:0/3647785583 conn(0x55cce3af5210 msgr2=0x55cce3b97130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 -- 172.21.15.5:0/3647785583 shutdown_connections 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 -- 172.21.15.5:0/3647785583 wait complete. 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 -- start start 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.103+0000 7f02c95efb80 1 Processor -- start 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b96790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b933a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02c95efb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b938e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02c95efb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3b93f30 con 0x55cce3b81b70 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02c95efb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3bee3b0 con 0x55cce3b81210 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02c95efb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce3bee4f0 con 0x55cce3b82a10 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02c95efb80 10 client.0 _ll_register_callbacks cb 0x7f02a4009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02aeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02aeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b933a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58752/0 (socket says 172.21.15.5:58752) 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02aeffd700 1 -- 172.21.15.5:0/3594561757 learned_addr learned my addr 172.21.15.5:0/3594561757 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02af7fe700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b96790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02aeffd700 1 -- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 msgr2=0x55cce3b938e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02affff700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02aeffd700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b938e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02aeffd700 1 -- 172.21.15.5:0/3594561757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 msgr2=0x55cce3b96790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02aeffd700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b96790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.104+0000 7f02aeffd700 1 -- 172.21.15.5:0/3594561757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b0109d50 con 0x55cce3b81b70 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f02af7fe700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b96790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f02affff700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f02aeffd700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b933a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f02a40098e0 tx=0x7f02a400bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b5527e8fa0ebfc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f028effd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f028effd700 1 -- 172.21.15.5:0/3594561757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a401e070 con 0x55cce3b81b70 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f028effd700 1 -- 172.21.15.5:0/3594561757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f02a4029360 con 0x55cce3b81b70 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f02c95efb80 1 -- 172.21.15.5:0/3594561757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02a009a440 con 0x55cce3b81b70 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f028effd700 1 -- 172.21.15.5:0/3594561757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02a4029520 con 0x55cce3b81b70 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f02c95efb80 10 client.15330 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f02c95efb80 1 -- 172.21.15.5:0/3594561757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cce38fd260 con 0x55cce3b81b70 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.105+0000 7f028effd700 1 -- 172.21.15.5:0/3594561757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02a009a440 con 0x55cce3b81b70 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.106+0000 7f028effd700 1 -- 172.21.15.5:0/3594561757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f02a403a020 con 0x55cce3b81b70 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.106+0000 7f02c95efb80 10 client.15330 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.106+0000 7f02c95efb80 10 client.15330 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-07T00:12:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.106+0000 7f02c95efb80 20 client.15330 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.106+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55cce3bf3240 0x55cce3bef710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.106+0000 7f02c95efb80 4 client.15330 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.106+0000 7f02c95efb80 1 -- 172.21.15.5:0/3594561757 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cce3accae0 con 0x55cce3bf3240 2023-10-07T00:12:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.106+0000 7f02af7fe700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55cce3bf3240 0x55cce3bef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02af7fe700 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55cce3bf3240 0x55cce3bef710 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cdce87bf2d2d5dce server_cookie=12556bf082ed997a in_seq=0 out_seq=0 2023-10-07T00:12:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f028effd700 10 client.15330 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:12:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f028effd700 1 -- 172.21.15.5:0/3594561757 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55cce3accae0 con 0x55cce3bf3240 2023-10-07T00:12:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f028effd700 10 client.15330 handle_command_reply: tid=0 2023-10-07T00:12:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 client.15330 shutdown 2023-10-07T00:12:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 -- 172.21.15.5:0/3594561757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 msgr2=0x55cce3b933a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b933a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f02a40098e0 tx=0x7f02a400bc70 comp rx=0 tx=0).stop 2023-10-07T00:12:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 -- 172.21.15.5:0/3594561757 shutdown_connections 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x55cce3bf3240 0x55cce3bef710 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cce3b82a10 0x55cce3b938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55cce3b81210 0x55cce3b96790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 --2- 172.21.15.5:0/3594561757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cce3b81b70 0x55cce3b933a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f028effd700 0 client.15330 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 -- 172.21.15.5:0/3594561757 >> 172.21.15.5:0/3594561757 conn(0x55cce3af5210 msgr2=0x55cce3b99830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 -- 172.21.15.5:0/3594561757 shutdown_connections 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 1 -- 172.21.15.5:0/3594561757 wait complete. 2023-10-07T00:12:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.107+0000 7f02c95efb80 20 client.15330 trim_cache size 0 max 16384 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 3, 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24553, 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 85.773175969999997, 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:45.115 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 107.728922614 2023-10-07T00:12:45.116 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 -- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02980a1510 msgr2=0x7f02980a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02980a1510 0x7f02980a39d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009cb0 tx=0x7f02a80077e0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 -- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b0100fc0 msgr2=0x7f02b0196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b0100fc0 0x7f02b0196c20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f02a000d980 tx=0x7f02a000dd40 comp rx=0 tx=0).stop 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 -- 172.21.15.5:0/103208820 shutdown_connections 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02980a1510 0x7f02980a39d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0102b50 0x7f02b019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b0100fc0 0x7f02b0196c20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 --2- 172.21.15.5:0/103208820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02b01021b0 0x7f02b0197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 -- 172.21.15.5:0/103208820 >> 172.21.15.5:0/103208820 conn(0x7f02b00fc530 msgr2=0x7f02b00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 -- 172.21.15.5:0/103208820 shutdown_connections 2023-10-07T00:12:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.108+0000 7f02b5bff700 1 -- 172.21.15.5:0/103208820 wait complete. 2023-10-07T00:12:45.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-07T00:12:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:44 smithi088 ceph-mon[103111]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:44 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3265627416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:45.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:44 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2650381583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 -- 172.21.15.5:0/3810572632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140102b50 msgr2=0x7fd140109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 --2- 172.21.15.5:0/3810572632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140102b50 0x7fd140109400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd13800b0d0 tx=0x7fd13800b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 -- 172.21.15.5:0/3810572632 shutdown_connections 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 --2- 172.21.15.5:0/3810572632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140102b50 0x7fd140109400 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 --2- 172.21.15.5:0/3810572632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100fc0 0x7fd1401013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 --2- 172.21.15.5:0/3810572632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1401021b0 0x7fd140102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 -- 172.21.15.5:0/3810572632 >> 172.21.15.5:0/3810572632 conn(0x7fd1400fc530 msgr2=0x7fd1400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 -- 172.21.15.5:0/3810572632 shutdown_connections 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.330+0000 7fd1463ff700 1 -- 172.21.15.5:0/3810572632 wait complete. 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.331+0000 7fd1463ff700 1 Processor -- start 2023-10-07T00:12:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd1463ff700 1 -- start start 2023-10-07T00:12:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd1463ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140100fc0 0x7fd140074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd1463ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1401021b0 0x7fd1400732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd1463ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd140102b50 0x7fd1400737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd1463ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140073f80 con 0x7fd140100fc0 2023-10-07T00:12:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd1463ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400740f0 con 0x7fd1401021b0 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd1463ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401a0cb0 con 0x7fd140102b50 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd13ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140100fc0 0x7fd140074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd13ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140100fc0 0x7fd140074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58778/0 (socket says 172.21.15.5:58778) 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd13ffff700 1 -- 172.21.15.5:0/2277832746 learned_addr learned my addr 172.21.15.5:0/2277832746 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd14499c700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd140102b50 0x7fd1400737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1401021b0 0x7fd1400732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd13ffff700 1 -- 172.21.15.5:0/2277832746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd140102b50 msgr2=0x7fd1400737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd13ffff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd140102b50 0x7fd1400737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.332+0000 7fd13ffff700 1 -- 172.21.15.5:0/2277832746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1401021b0 msgr2=0x7fd1400732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd13ffff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1401021b0 0x7fd1400732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd13ffff700 1 -- 172.21.15.5:0/2277832746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138009d00 con 0x7fd140100fc0 2023-10-07T00:12:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1401021b0 0x7fd1400732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd13ffff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140100fc0 0x7fd140074c60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd13000e970 tx=0x7fd13000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd13d7fa700 1 -- 172.21.15.5:0/2277832746 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130009790 con 0x7fd140100fc0 2023-10-07T00:12:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd13d7fa700 1 -- 172.21.15.5:0/2277832746 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd13000eec0 con 0x7fd140100fc0 2023-10-07T00:12:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd1463ff700 1 -- 172.21.15.5:0/2277832746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1401a0f90 con 0x7fd140100fc0 2023-10-07T00:12:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd13d7fa700 1 -- 172.21.15.5:0/2277832746 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130003c10 con 0x7fd140100fc0 2023-10-07T00:12:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.333+0000 7fd1463ff700 1 -- 172.21.15.5:0/2277832746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1401a13b0 con 0x7fd140100fc0 2023-10-07T00:12:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.336+0000 7fd13d7fa700 1 -- 172.21.15.5:0/2277832746 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fd130003db0 con 0x7fd140100fc0 2023-10-07T00:12:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.338+0000 7fd159d83b80 1 Processor -- start 2023-10-07T00:12:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.338+0000 7fd159d83b80 1 -- start start 2023-10-07T00:12:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.338+0000 7fd13d7fa700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd1280a1510 0x7fd1280a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.338+0000 7fd13d7fa700 1 -- 172.21.15.5:0/2277832746 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd130014070 con 0x7fd140100fc0 2023-10-07T00:12:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.338+0000 7fd14499c700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd1280a1510 0x7fd1280a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.338+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdc210 0x561382cdc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.338+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382cdd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.338+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdda10 0x561382cdde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd159d83b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382c44410 con 0x561382cdc210 2023-10-07T00:12:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd159d83b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382c35bd0 con 0x561382cdcb70 2023-10-07T00:12:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd159d83b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382c334f0 con 0x561382cdda10 2023-10-07T00:12:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdc210 0x561382cdc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdc210 0x561382cdc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58788/0 (socket says 172.21.15.5:58788) 2023-10-07T00:12:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 -- 172.21.15.5:0/2250107003 learned_addr learned my addr 172.21.15.5:0/2250107003 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382cdd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd14499c700 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdda10 0x561382cdde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 -- 172.21.15.5:0/2250107003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdda10 msgr2=0x561382cdde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdda10 0x561382cdde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 -- 172.21.15.5:0/2250107003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 msgr2=0x561382cdd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382cdd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 -- 172.21.15.5:0/2250107003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561382a59d90 con 0x561382cdc210 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382cdd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd14499c700 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdda10 0x561382cdde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd14499c700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd1280a1510 0x7fd1280a39d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1400752c0 tx=0x7fd13800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.339+0000 7fd13ffff700 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdc210 0x561382cdc630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd1300967b0 tx=0x7fd130099c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a76f7dfc73d0c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd1267fc700 1 -- 172.21.15.5:0/2250107003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300b0030 con 0x561382cdc210 2023-10-07T00:12:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd1267fc700 1 -- 172.21.15.5:0/2250107003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd13009a2b0 con 0x561382cdc210 2023-10-07T00:12:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd1267fc700 1 -- 172.21.15.5:0/2250107003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300cacf0 con 0x561382cdc210 2023-10-07T00:12:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd159d83b80 1 -- 172.21.15.5:0/2250107003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdc210 msgr2=0x561382cdc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd159d83b80 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdc210 0x561382cdc630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd1300967b0 tx=0x7fd130099c10 comp rx=0 tx=0).stop 2023-10-07T00:12:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd159d83b80 1 -- 172.21.15.5:0/2250107003 shutdown_connections 2023-10-07T00:12:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd159d83b80 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdda10 0x561382cdde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd159d83b80 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdc210 0x561382cdc630 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd159d83b80 1 --2- 172.21.15.5:0/2250107003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382cdd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.340+0000 7fd159d83b80 1 -- 172.21.15.5:0/2250107003 >> 172.21.15.5:0/2250107003 conn(0x561382c50210 msgr2=0x561382cd70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.341+0000 7fd159d83b80 1 -- 172.21.15.5:0/2250107003 shutdown_connections 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.341+0000 7fd159d83b80 1 -- 172.21.15.5:0/2250107003 wait complete. 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.341+0000 7fd159d83b80 1 -- start start 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.341+0000 7fd159d83b80 1 Processor -- start 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 0x561382ce6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382ce6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382ced5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd159d83b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382c2ede0 con 0x561382cdda10 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd159d83b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382bcb6c0 con 0x561382cdcb70 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd159d83b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382bcb360 con 0x561382cdc210 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd159d83b80 10 client.0 _ll_register_callbacks cb 0x561382a287b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd14499c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382ced5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd14499c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382ced5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58804/0 (socket says 172.21.15.5:58804) 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd14499c700 1 -- 172.21.15.5:0/3524097474 learned_addr learned my addr 172.21.15.5:0/3524097474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd13ffff700 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 0x561382ce6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382ce6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd14499c700 1 -- 172.21.15.5:0/3524097474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 msgr2=0x561382ce6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd14499c700 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 0x561382ce6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd14499c700 1 -- 172.21.15.5:0/3524097474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 msgr2=0x561382ce6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd14499c700 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382ce6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.342+0000 7fd14499c700 1 -- 172.21.15.5:0/3524097474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1401a13b0 con 0x561382cdda10 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd14499c700 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382ced5a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd138015000 tx=0x7fd1380099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7661cd5a44955b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd11f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd11f7fe700 1 -- 172.21.15.5:0/3524097474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800e040 con 0x561382cdda10 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd159d83b80 1 -- 172.21.15.5:0/3524097474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561382cceec0 con 0x561382cdda10 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd11f7fe700 1 -- 172.21.15.5:0/3524097474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd138023040 con 0x561382cdda10 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd11f7fe700 1 -- 172.21.15.5:0/3524097474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1380052c0 con 0x561382cdda10 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd159d83b80 10 client.15342 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd159d83b80 1 -- 172.21.15.5:0/3524097474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561382a42c10 con 0x561382cdda10 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.343+0000 7fd11f7fe700 1 -- 172.21.15.5:0/3524097474 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561382cceec0 con 0x561382cdda10 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.344+0000 7fd11f7fe700 1 -- 172.21.15.5:0/3524097474 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd13801caa0 con 0x561382cdda10 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.344+0000 7fd159d83b80 10 client.15342 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.344+0000 7fd159d83b80 10 client.15342 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.344+0000 7fd159d83b80 20 client.15342 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.344+0000 7fd159d83b80 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x561382cf1bb0 0x561382cf0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.344+0000 7fd159d83b80 4 client.15342 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.344+0000 7fd159d83b80 1 -- 172.21.15.5:0/3524097474 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561382c27dc0 con 0x561382cf1bb0 2023-10-07T00:12:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.344+0000 7fd13ffff700 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x561382cf1bb0 0x561382cf0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.345+0000 7fd11f7fe700 10 client.15342 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:12:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.345+0000 7fd13ffff700 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x561382cf1bb0 0x561382cf0660 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c281f104b7fe1cf server_cookie=f44135a479507bbb in_seq=0 out_seq=0 2023-10-07T00:12:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd11f7fe700 1 -- 172.21.15.5:0/3524097474 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561382c27dc0 con 0x561382cf1bb0 2023-10-07T00:12:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd11f7fe700 10 client.15342 handle_command_reply: tid=0 2023-10-07T00:12:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 client.15342 shutdown 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 -- 172.21.15.5:0/3524097474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 msgr2=0x561382ced5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382ced5a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd138015000 tx=0x7fd1380099e0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 -- 172.21.15.5:0/3524097474 shutdown_connections 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x561382cf1bb0 0x561382cf0660 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382ced5a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 0x561382ce6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 --2- 172.21.15.5:0/3524097474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdcb70 0x561382ce6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd11f7fe700 0 client.15342 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 -- 172.21.15.5:0/3524097474 >> 172.21.15.5:0/3524097474 conn(0x561382c50210 msgr2=0x561382cd6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 -- 172.21.15.5:0/3524097474 shutdown_connections 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 1 -- 172.21.15.5:0/3524097474 wait complete. 2023-10-07T00:12:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.346+0000 7fd159d83b80 20 client.15342 trim_cache size 0 max 16384 2023-10-07T00:12:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.365+0000 7fd159d83b80 1 Processor -- start 2023-10-07T00:12:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.365+0000 7fd159d83b80 1 -- start start 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.365+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdc210 0x561382cd6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.365+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdcb70 0x561382ced530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.365+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382cd6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.365+0000 7fd159d83b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382aaf8d0 con 0x561382cdda10 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.365+0000 7fd159d83b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382c2aed0 con 0x561382cdc210 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.365+0000 7fd159d83b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382bd54d0 con 0x561382cdcb70 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382cd6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382cd6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58816/0 (socket says 172.21.15.5:58816) 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 -- 172.21.15.5:0/2670675420 learned_addr learned my addr 172.21.15.5:0/2670675420 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdcb70 0x561382ced530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd13ffff700 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdc210 0x561382cd6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 -- 172.21.15.5:0/2670675420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdcb70 msgr2=0x561382ced530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdcb70 0x561382ced530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 -- 172.21.15.5:0/2670675420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdc210 msgr2=0x561382cd6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdc210 0x561382cd6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 -- 172.21.15.5:0/2670675420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561382a80200 con 0x561382cdda10 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd14499c700 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382cd6f00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd13800b0d0 tx=0x7fd1380095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d025c3ae7e1041f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.366+0000 7fd126ffd700 1 -- 172.21.15.5:0/2670675420 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138005270 con 0x561382cdda10 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd126ffd700 1 -- 172.21.15.5:0/2670675420 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1380284b0 con 0x561382cdda10 2023-10-07T00:12:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd126ffd700 1 -- 172.21.15.5:0/2670675420 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13801c6a0 con 0x561382cdda10 2023-10-07T00:12:45.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 -- 172.21.15.5:0/2670675420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 msgr2=0x561382cd6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382cd6f00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd13800b0d0 tx=0x7fd1380095d0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 -- 172.21.15.5:0/2670675420 shutdown_connections 2023-10-07T00:12:45.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdda10 0x561382cd6f00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdc210 0x561382cd6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 --2- 172.21.15.5:0/2670675420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdcb70 0x561382ced530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 -- 172.21.15.5:0/2670675420 >> 172.21.15.5:0/2670675420 conn(0x561382c50210 msgr2=0x561382cfa510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 -- 172.21.15.5:0/2670675420 shutdown_connections 2023-10-07T00:12:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.367+0000 7fd159d83b80 1 -- 172.21.15.5:0/2670675420 wait complete. 2023-10-07T00:12:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 1 -- start start 2023-10-07T00:12:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 1 Processor -- start 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 0x561382cecd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdcb70 0x561382ced290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdda10 0x561382ce97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382ce9d70 con 0x561382cdcb70 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382ce9ee0 con 0x561382cdda10 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561382cea0a0 con 0x561382cdc210 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.368+0000 7fd159d83b80 10 client.0 _ll_register_callbacks cb 0x7fd1380077f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdcb70 0x561382ced290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdcb70 0x561382ced290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58828/0 (socket says 172.21.15.5:58828) 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 -- 172.21.15.5:0/1495174844 learned_addr learned my addr 172.21.15.5:0/1495174844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd14499c700 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdda10 0x561382ce97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13ffff700 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 0x561382cecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 -- 172.21.15.5:0/1495174844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 msgr2=0x561382cecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 0x561382cecd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 -- 172.21.15.5:0/1495174844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdda10 msgr2=0x561382ce97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdda10 0x561382ce97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 -- 172.21.15.5:0/1495174844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561382a42c10 con 0x561382cdcb70 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd13f7fe700 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdcb70 0x561382ced290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd134012700 tx=0x7fd134012a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a21e4114581f28d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd11f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.369+0000 7fd11f7fe700 1 -- 172.21.15.5:0/1495174844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340118b0 con 0x561382cdcb70 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 1 -- 172.21.15.5:0/1495174844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd13009a2b0 con 0x561382cdcb70 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd11f7fe700 1 -- 172.21.15.5:0/1495174844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd134011a10 con 0x561382cdcb70 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd11f7fe700 1 -- 172.21.15.5:0/1495174844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd134011bd0 con 0x561382cdcb70 2023-10-07T00:12:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 10 client.15348 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 1 -- 172.21.15.5:0/1495174844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561382a58260 con 0x561382cdcb70 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd11f7fe700 1 -- 172.21.15.5:0/1495174844 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd13402b080 con 0x561382cdcb70 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd11f7fe700 1 -- 172.21.15.5:0/1495174844 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd134025030 con 0x561382cdcb70 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 10 client.15348 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 10 client.15348 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 20 client.15348 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x561382d4a480 0x561382d468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 4 client.15348 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.370+0000 7fd159d83b80 1 -- 172.21.15.5:0/1495174844 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561382c27ae0 con 0x561382d4a480 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.371+0000 7fd13ffff700 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x561382d4a480 0x561382d468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.371+0000 7fd13ffff700 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x561382d4a480 0x561382d468e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1eb98f89d64b8bc server_cookie=706a1c67cb37299e in_seq=0 out_seq=0 2023-10-07T00:12:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.371+0000 7fd11f7fe700 10 client.15348 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:12:45.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd11f7fe700 1 -- 172.21.15.5:0/1495174844 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561382c27ae0 con 0x561382d4a480 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd11f7fe700 10 client.15348 handle_command_reply: tid=0 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 client.15348 shutdown 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 -- 172.21.15.5:0/1495174844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdcb70 msgr2=0x561382ced290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdcb70 0x561382ced290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd134012700 tx=0x7fd134012a10 comp rx=0 tx=0).stop 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 -- 172.21.15.5:0/1495174844 shutdown_connections 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x561382d4a480 0x561382d468e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561382cdda10 0x561382ce97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd11f7fe700 0 client.15348 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561382cdc210 0x561382cecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 --2- 172.21.15.5:0/1495174844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561382cdcb70 0x561382ced290 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 -- 172.21.15.5:0/1495174844 >> 172.21.15.5:0/1495174844 conn(0x561382c50210 msgr2=0x561382ce4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 -- 172.21.15.5:0/1495174844 shutdown_connections 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 1 -- 172.21.15.5:0/1495174844 wait complete. 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.372+0000 7fd159d83b80 20 client.15348 trim_cache size 0 max 16384 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24566, 2023-10-07T00:12:45.379 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:45.380 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:45.380 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:45.380 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 87.045709364000004, 2023-10-07T00:12:45.380 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:45.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:45.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:45.380 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 111.116524441 2023-10-07T00:12:45.380 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 -- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd1280a1510 msgr2=0x7fd1280a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd1280a1510 0x7fd1280a39d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1400752c0 tx=0x7fd13800b040 comp rx=0 tx=0).stop 2023-10-07T00:12:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 -- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140100fc0 msgr2=0x7fd140074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140100fc0 0x7fd140074c60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd13000e970 tx=0x7fd13000ec80 comp rx=0 tx=0).stop 2023-10-07T00:12:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 -- 172.21.15.5:0/2277832746 shutdown_connections 2023-10-07T00:12:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd1280a1510 0x7fd1280a39d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd140102b50 0x7fd1400737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd140100fc0 0x7fd140074c60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 --2- 172.21.15.5:0/2277832746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1401021b0 0x7fd1400732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 -- 172.21.15.5:0/2277832746 >> 172.21.15.5:0/2277832746 conn(0x7fd1400fc530 msgr2=0x7fd140105640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 -- 172.21.15.5:0/2277832746 shutdown_connections 2023-10-07T00:12:45.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.373+0000 7fd1463ff700 1 -- 172.21.15.5:0/2277832746 wait complete. 2023-10-07T00:12:45.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T00:12:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.595+0000 7fcc21fff700 1 -- 172.21.15.5:0/2719155501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 msgr2=0x7fcc1c073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.595+0000 7fcc21fff700 1 --2- 172.21.15.5:0/2719155501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 0x7fcc1c073340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009990 tx=0x7fcc0c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.595+0000 7fcc21fff700 1 -- 172.21.15.5:0/2719155501 shutdown_connections 2023-10-07T00:12:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.595+0000 7fcc21fff700 1 --2- 172.21.15.5:0/2719155501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c108e80 0x7fcc1c10b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.595+0000 7fcc21fff700 1 --2- 172.21.15.5:0/2719155501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 0x7fcc1c073340 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.595+0000 7fcc21fff700 1 --2- 172.21.15.5:0/2719155501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc1c073910 0x7fcc1c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.595+0000 7fcc21fff700 1 -- 172.21.15.5:0/2719155501 >> 172.21.15.5:0/2719155501 conn(0x7fcc1c0fc530 msgr2=0x7fcc1c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.596+0000 7fcc21fff700 1 -- 172.21.15.5:0/2719155501 shutdown_connections 2023-10-07T00:12:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.596+0000 7fcc21fff700 1 -- 172.21.15.5:0/2719155501 wait complete. 2023-10-07T00:12:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.596+0000 7fcc21fff700 1 Processor -- start 2023-10-07T00:12:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc21fff700 1 -- start start 2023-10-07T00:12:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc21fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c073910 0x7fcc1c198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc21fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 0x7fcc1c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc21fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc1c108e80 0x7fcc1c1a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc21fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1a0990 con 0x7fcc1c074ef0 2023-10-07T00:12:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc21fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1a0ad0 con 0x7fcc1c073910 2023-10-07T00:12:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc21fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1a0c60 con 0x7fcc1c108e80 2023-10-07T00:12:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc1affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 0x7fcc1c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc1affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 0x7fcc1c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58860/0 (socket says 172.21.15.5:58860) 2023-10-07T00:12:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc1affd700 1 -- 172.21.15.5:0/3787240375 learned_addr learned my addr 172.21.15.5:0/3787240375 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc1b7fe700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c073910 0x7fcc1c198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.597+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc1c108e80 0x7fcc1c1a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc1affd700 1 -- 172.21.15.5:0/3787240375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc1c108e80 msgr2=0x7fcc1c1a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc1affd700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc1c108e80 0x7fcc1c1a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc1affd700 1 -- 172.21.15.5:0/3787240375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c073910 msgr2=0x7fcc1c198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc1affd700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c073910 0x7fcc1c198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc1affd700 1 -- 172.21.15.5:0/3787240375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0095f0 con 0x7fcc1c074ef0 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc1affd700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 0x7fcc1c199350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000e970 tx=0x7fcc1000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc18ff9700 1 -- 172.21.15.5:0/3787240375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10009790 con 0x7fcc1c074ef0 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc18ff9700 1 -- 172.21.15.5:0/3787240375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc1000c7e0 con 0x7fcc1c074ef0 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc21fff700 1 -- 172.21.15.5:0/3787240375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c1a0f40 con 0x7fcc1c074ef0 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc18ff9700 1 -- 172.21.15.5:0/3787240375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10003bd0 con 0x7fcc1c074ef0 2023-10-07T00:12:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.598+0000 7fcc21fff700 1 -- 172.21.15.5:0/3787240375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c1a13c0 con 0x7fcc1c074ef0 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.601+0000 7fcc18ff9700 1 -- 172.21.15.5:0/3787240375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fcc1000c950 con 0x7fcc1c074ef0 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc3598bb80 1 Processor -- start 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc18ff9700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc040a1510 0x7fcc040a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc3598bb80 1 -- start start 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc18ff9700 1 -- 172.21.15.5:0/3787240375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fcc10014070 con 0x7fcc1c074ef0 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc040a1510 0x7fcc040a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe252630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe252b70 0x55d4fe253430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe253a10 0x55d4fe253e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe1ba410 con 0x55d4fe253a10 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.603+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe1abbd0 con 0x55d4fe252b70 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe1a94f0 con 0x55d4fe252210 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe253a10 0x55d4fe253e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe252630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe253a10 0x55d4fe253e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58876/0 (socket says 172.21.15.5:58876) 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe252630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37928/0 (socket says 172.21.15.5:37928) 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 -- 172.21.15.5:0/667153366 learned_addr learned my addr 172.21.15.5:0/667153366 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc040a1510 0x7fcc040a39d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400f590 tx=0x7fcc14009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1affd700 1 --2- 172.21.15.5:0/667153366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe252b70 0x55d4fe253430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 -- 172.21.15.5:0/667153366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 msgr2=0x55d4fe252630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/667153366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe252630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 -- 172.21.15.5:0/667153366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe252b70 msgr2=0x55d4fe253430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/667153366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe252b70 0x55d4fe253430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.604+0000 7fcc1bfff700 1 -- 172.21.15.5:0/667153366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4fdfcfd90 con 0x55d4fe253a10 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.605+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/667153366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe253a10 0x55d4fe253e90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc140197b0 tx=0x7fcc1401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4e771213a00656 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.605+0000 7fcc01ffb700 1 -- 172.21.15.5:0/667153366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14025070 con 0x55d4fe253a10 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.605+0000 7fcc01ffb700 1 -- 172.21.15.5:0/667153366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc1400f040 con 0x55d4fe253a10 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.605+0000 7fcc01ffb700 1 -- 172.21.15.5:0/667153366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400e040 con 0x55d4fe253a10 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.605+0000 7fcc3598bb80 1 -- 172.21.15.5:0/667153366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe253a10 msgr2=0x55d4fe253e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.605+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/667153366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe253a10 0x55d4fe253e90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc140197b0 tx=0x7fcc1401c000 comp rx=0 tx=0).stop 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 -- 172.21.15.5:0/667153366 shutdown_connections 2023-10-07T00:12:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/667153366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe253a10 0x55d4fe253e90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/667153366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe252630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/667153366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe252b70 0x55d4fe253430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 -- 172.21.15.5:0/667153366 >> 172.21.15.5:0/667153366 conn(0x55d4fe1c6210 msgr2=0x55d4fe24d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 -- 172.21.15.5:0/667153366 shutdown_connections 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 -- 172.21.15.5:0/667153366 wait complete. 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 -- start start 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.606+0000 7fcc3598bb80 1 Processor -- start 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe25bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe25c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe263540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe1a4de0 con 0x55d4fe252b70 2023-10-07T00:12:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe1416c0 con 0x55d4fe253a10 2023-10-07T00:12:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe141360 con 0x55d4fe252210 2023-10-07T00:12:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc3598bb80 10 client.0 _ll_register_callbacks cb 0x55d4fdf9e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc1affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe25c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc1affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe25c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58886/0 (socket says 172.21.15.5:58886) 2023-10-07T00:12:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc1affd700 1 -- 172.21.15.5:0/1151693327 learned_addr learned my addr 172.21.15.5:0/1151693327 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc1b7fe700 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe25bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.607+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe263540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc1affd700 1 -- 172.21.15.5:0/1151693327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 msgr2=0x55d4fe25bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc1affd700 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe25bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc1affd700 1 -- 172.21.15.5:0/1151693327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 msgr2=0x55d4fe263540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc1affd700 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe263540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc1affd700 1 -- 172.21.15.5:0/1151693327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc14019460 con 0x55d4fe252b70 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc1affd700 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe25c500 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000efd0 tx=0x7fcc1009a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d45a658fa42f696 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcbfaffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcbfaffd700 1 -- 172.21.15.5:0/1151693327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1009e380 con 0x55d4fe252b70 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcbfaffd700 1 -- 172.21.15.5:0/1151693327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fcc10094e40 con 0x55d4fe252b70 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1151693327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4fe244ec0 con 0x55d4fe252b70 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcbfaffd700 1 -- 172.21.15.5:0/1151693327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc100a25c0 con 0x55d4fe252b70 2023-10-07T00:12:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc3598bb80 10 client.15360 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1151693327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d4fdfb8c10 con 0x55d4fe252b70 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.608+0000 7fcbfaffd700 1 -- 172.21.15.5:0/1151693327 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d4fe244ec0 con 0x55d4fe252b70 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.609+0000 7fcbfaffd700 1 -- 172.21.15.5:0/1151693327 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc10099720 con 0x55d4fe252b70 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.609+0000 7fcc3598bb80 10 client.15360 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.609+0000 7fcc3598bb80 10 client.15360 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.609+0000 7fcc3598bb80 20 client.15360 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.609+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d4fe267b20 0x55d4fe266650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.609+0000 7fcc3598bb80 4 client.15360 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.609+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1151693327 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4fe19ddc0 con 0x55d4fe267b20 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.609+0000 7fcc1b7fe700 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d4fe267b20 0x55d4fe266650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.610+0000 7fcc1b7fe700 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d4fe267b20 0x55d4fe266650 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c82412d1d01202d7 server_cookie=fe68c232a5ac12d7 in_seq=0 out_seq=0 2023-10-07T00:12:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.610+0000 7fcbfaffd700 10 client.15360 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.610+0000 7fcbfaffd700 1 -- 172.21.15.5:0/1151693327 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d4fe19ddc0 con 0x55d4fe267b20 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.610+0000 7fcbfaffd700 10 client.15360 handle_command_reply: tid=0 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.610+0000 7fcc3598bb80 1 client.15360 shutdown 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.610+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1151693327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 msgr2=0x55d4fe25c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.610+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe25c500 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000efd0 tx=0x7fcc1009a930 comp rx=0 tx=0).stop 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1151693327 shutdown_connections 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d4fe267b20 0x55d4fe266650 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe263540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe25bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1151693327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe25c500 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcbfaffd700 0 client.15360 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:12:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1151693327 >> 172.21.15.5:0/1151693327 conn(0x55d4fe1c6210 msgr2=0x55d4fe24cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1151693327 shutdown_connections 2023-10-07T00:12:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1151693327 wait complete. 2023-10-07T00:12:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.611+0000 7fcc3598bb80 20 client.15360 trim_cache size 0 max 16384 2023-10-07T00:12:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.629+0000 7fcc3598bb80 1 Processor -- start 2023-10-07T00:12:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.629+0000 7fcc3598bb80 1 -- start start 2023-10-07T00:12:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.629+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe259db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.629+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe2634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe0258d0 con 0x55d4fe252b70 2023-10-07T00:12:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe1a0ed0 con 0x55d4fe253a10 2023-10-07T00:12:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe14b4d0 con 0x55d4fe252210 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe2634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe2634d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58900/0 (socket says 172.21.15.5:58900) 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 -- 172.21.15.5:0/1850382603 learned_addr learned my addr 172.21.15.5:0/1850382603 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1b7fe700 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe259db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 -- 172.21.15.5:0/1850382603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 msgr2=0x55d4fe259db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe259db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 -- 172.21.15.5:0/1850382603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 msgr2=0x55d4fe2568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 -- 172.21.15.5:0/1850382603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4fdff6200 con 0x55d4fe252b70 2023-10-07T00:12:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.630+0000 7fcc1affd700 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe2634d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000cc00 tx=0x7fcc1000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1239d630e15034 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc027fc700 1 -- 172.21.15.5:0/1850382603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1009a9a0 con 0x55d4fe252b70 2023-10-07T00:12:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc027fc700 1 -- 172.21.15.5:0/1850382603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc1007a050 con 0x55d4fe252b70 2023-10-07T00:12:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc027fc700 1 -- 172.21.15.5:0/1850382603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1009a490 con 0x55d4fe252b70 2023-10-07T00:12:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1850382603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 msgr2=0x55d4fe2634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe2634d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000cc00 tx=0x7fcc1000cf50 comp rx=0 tx=0).stop 2023-10-07T00:12:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1850382603 shutdown_connections 2023-10-07T00:12:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252210 0x55d4fe259db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/1850382603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252b70 0x55d4fe2634d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1850382603 >> 172.21.15.5:0/1850382603 conn(0x55d4fe1c6210 msgr2=0x55d4fe24cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.631+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1850382603 shutdown_connections 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.632+0000 7fcc3598bb80 1 -- 172.21.15.5:0/1850382603 wait complete. 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.632+0000 7fcc3598bb80 1 -- start start 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.632+0000 7fcc3598bb80 1 Processor -- start 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252210 0x55d4fe25e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252b70 0x55d4fe25ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc3598bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2bb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe25f150 con 0x55d4fe252210 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe25f2c0 con 0x55d4fe253a10 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc3598bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe2bba50 con 0x55d4fe252b70 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc3598bb80 10 client.0 _ll_register_callbacks cb 0x7fcc10099b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252210 0x55d4fe25e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252210 0x55d4fe25e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58908/0 (socket says 172.21.15.5:58908) 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1b7fe700 1 -- 172.21.15.5:0/3414111218 learned_addr learned my addr 172.21.15.5:0/3414111218 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1affd700 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252b70 0x55d4fe25ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1bfff700 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2bb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1b7fe700 1 -- 172.21.15.5:0/3414111218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252b70 msgr2=0x55d4fe25ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1b7fe700 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252b70 0x55d4fe25ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1b7fe700 1 -- 172.21.15.5:0/3414111218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 msgr2=0x55d4fe2bb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.633+0000 7fcc1b7fe700 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2bb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcc1b7fe700 1 -- 172.21.15.5:0/3414111218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4fdfb8c10 con 0x55d4fe252210 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcc1affd700 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252b70 0x55d4fe25ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcc1b7fe700 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252210 0x55d4fe25e6d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009990 tx=0x7fcc0c005200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39764aaca468db40 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcbfaffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcbfaffd700 1 -- 172.21.15.5:0/3414111218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c01d040 con 0x55d4fe252210 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcbfaffd700 1 -- 172.21.15.5:0/3414111218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fcc0c029af0 con 0x55d4fe252210 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcc3598bb80 1 -- 172.21.15.5:0/3414111218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc1400f040 con 0x55d4fe252210 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcbfaffd700 1 -- 172.21.15.5:0/3414111218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc0c029cb0 con 0x55d4fe252210 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcc3598bb80 10 client.15366 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.634+0000 7fcc3598bb80 1 -- 172.21.15.5:0/3414111218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d4fdfce260 con 0x55d4fe252210 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcbfaffd700 1 -- 172.21.15.5:0/3414111218 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc1400f040 con 0x55d4fe252210 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcbfaffd700 1 -- 172.21.15.5:0/3414111218 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc0c003920 con 0x55d4fe252210 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcc3598bb80 10 client.15366 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcc3598bb80 10 client.15366 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcc3598bb80 20 client.15366 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d4fe2c0b90 0x55d4fe2bd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcc3598bb80 4 client.15366 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcc3598bb80 1 -- 172.21.15.5:0/3414111218 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4fe19dae0 con 0x55d4fe2c0b90 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.635+0000 7fcc1affd700 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d4fe2c0b90 0x55d4fe2bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc1affd700 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d4fe2c0b90 0x55d4fe2bd010 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c50e3d4ebf803ecf server_cookie=fe9bae1b431bba8 in_seq=0 out_seq=0 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcbfaffd700 10 client.15366 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcbfaffd700 1 -- 172.21.15.5:0/3414111218 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d4fe19dae0 con 0x55d4fe2c0b90 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcbfaffd700 10 client.15366 handle_command_reply: tid=0 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 client.15366 shutdown 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 -- 172.21.15.5:0/3414111218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252210 msgr2=0x55d4fe25e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252210 0x55d4fe25e6d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009990 tx=0x7fcc0c005200 comp rx=0 tx=0).stop 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 -- 172.21.15.5:0/3414111218 shutdown_connections 2023-10-07T00:12:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d4fe2c0b90 0x55d4fe2bd010 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4fe253a10 0x55d4fe2bb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4fe252210 0x55d4fe25e6d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 --2- 172.21.15.5:0/3414111218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4fe252b70 0x55d4fe25ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 -- 172.21.15.5:0/3414111218 >> 172.21.15.5:0/3414111218 conn(0x55d4fe1c6210 msgr2=0x55d4fe263d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcbfaffd700 0 client.15366 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:12:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 -- 172.21.15.5:0/3414111218 shutdown_connections 2023-10-07T00:12:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 1 -- 172.21.15.5:0/3414111218 wait complete. 2023-10-07T00:12:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.636+0000 7fcc3598bb80 20 client.15366 trim_cache size 0 max 16384 2023-10-07T00:12:45.645 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:45.645 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:45.645 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2023-10-07T00:12:45.645 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24574, 2023-10-07T00:12:45.645 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:45.645 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:45.645 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:45.646 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 88.320914123999998, 2023-10-07T00:12:45.646 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:45.646 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:45.646 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:45.646 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 102.149867195 2023-10-07T00:12:45.646 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:45.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 -- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc040a1510 msgr2=0x7fcc040a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc040a1510 0x7fcc040a39d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400f590 tx=0x7fcc14009920 comp rx=0 tx=0).stop 2023-10-07T00:12:45.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 -- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 msgr2=0x7fcc1c199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 0x7fcc1c199350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000e970 tx=0x7fcc1000ec80 comp rx=0 tx=0).stop 2023-10-07T00:12:45.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 -- 172.21.15.5:0/3787240375 shutdown_connections 2023-10-07T00:12:45.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcc040a1510 0x7fcc040a39d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc1c108e80 0x7fcc1c1a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c073910 0x7fcc1c198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 --2- 172.21.15.5:0/3787240375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1c074ef0 0x7fcc1c199350 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 -- 172.21.15.5:0/3787240375 >> 172.21.15.5:0/3787240375 conn(0x7fcc1c0fc530 msgr2=0x7fcc1c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 -- 172.21.15.5:0/3787240375 shutdown_connections 2023-10-07T00:12:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.637+0000 7fcc21fff700 1 -- 172.21.15.5:0/3787240375 wait complete. 2023-10-07T00:12:45.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-07T00:12:45.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 -- 172.21.15.5:0/3504189983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668102b50 msgr2=0x7f8668109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3504189983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668102b50 0x7f8668109400 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f866000b0d0 tx=0x7f866000b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 -- 172.21.15.5:0/3504189983 shutdown_connections 2023-10-07T00:12:45.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3504189983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668102b50 0x7f8668109400 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3504189983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8668100fc0 0x7f86681013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3504189983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86681021b0 0x7f8668102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 -- 172.21.15.5:0/3504189983 >> 172.21.15.5:0/3504189983 conn(0x7f86680fc530 msgr2=0x7f86680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 -- 172.21.15.5:0/3504189983 shutdown_connections 2023-10-07T00:12:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.862+0000 7f866e5ff700 1 -- 172.21.15.5:0/3504189983 wait complete. 2023-10-07T00:12:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.863+0000 7f866e5ff700 1 Processor -- start 2023-10-07T00:12:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f866e5ff700 1 -- start start 2023-10-07T00:12:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f866e5ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668100fc0 0x7f8668198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f866e5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86681021b0 0x7f86681993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f866e5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8668102b50 0x7f86681a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f866e5ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681a09f0 con 0x7f8668100fc0 2023-10-07T00:12:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f866e5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681a0b30 con 0x7f8668102b50 2023-10-07T00:12:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f866e5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681a0cc0 con 0x7f86681021b0 2023-10-07T00:12:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f8667fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668100fc0 0x7f8668198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f8667fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668100fc0 0x7f8668198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58926/0 (socket says 172.21.15.5:58926) 2023-10-07T00:12:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.864+0000 7f8667fff700 1 -- 172.21.15.5:0/3920584590 learned_addr learned my addr 172.21.15.5:0/3920584590 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f866cb9c700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8668102b50 0x7f86681a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f8667fff700 1 -- 172.21.15.5:0/3920584590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86681021b0 msgr2=0x7f86681993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f86677fe700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86681021b0 0x7f86681993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f8667fff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86681021b0 0x7f86681993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f8667fff700 1 -- 172.21.15.5:0/3920584590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8668102b50 msgr2=0x7f86681a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f8667fff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8668102b50 0x7f86681a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f8667fff700 1 -- 172.21.15.5:0/3920584590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660009d00 con 0x7f8668100fc0 2023-10-07T00:12:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f86677fe700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86681021b0 0x7f86681993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:45.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f8667fff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668100fc0 0x7f8668198e70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f865800e970 tx=0x7f865800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f86657fa700 1 -- 172.21.15.5:0/3920584590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658009790 con 0x7f8668100fc0 2023-10-07T00:12:45.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f86657fa700 1 -- 172.21.15.5:0/3920584590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f865800eec0 con 0x7f8668100fc0 2023-10-07T00:12:45.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f866e5ff700 1 -- 172.21.15.5:0/3920584590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86681a0fa0 con 0x7f8668100fc0 2023-10-07T00:12:45.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.865+0000 7f86657fa700 1 -- 172.21.15.5:0/3920584590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658003c10 con 0x7f8668100fc0 2023-10-07T00:12:45.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.866+0000 7f866e5ff700 1 -- 172.21.15.5:0/3920584590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86681a13c0 con 0x7f8668100fc0 2023-10-07T00:12:45.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.869+0000 7f86657fa700 1 -- 172.21.15.5:0/3920584590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f8658003db0 con 0x7f8668100fc0 2023-10-07T00:12:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.870+0000 7f8681f31b80 1 Processor -- start 2023-10-07T00:12:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.870+0000 7f8681f31b80 1 -- start start 2023-10-07T00:12:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd69630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd6ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8681f31b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dcd1410 con 0x55ed6dd69210 2023-10-07T00:12:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8681f31b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dcc2bd0 con 0x55ed6dd6aa10 2023-10-07T00:12:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8681f31b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dcc04f0 con 0x55ed6dd69b70 2023-10-07T00:12:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f86657fa700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f86500a1510 0x7f86500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f866cb9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd69630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8667fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f866cb9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd69630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58938/0 (socket says 172.21.15.5:58938) 2023-10-07T00:12:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f866cb9c700 1 -- 172.21.15.5:0/321078741 learned_addr learned my addr 172.21.15.5:0/321078741 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f86657fa700 1 -- 172.21.15.5:0/3920584590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8658014070 con 0x7f8668100fc0 2023-10-07T00:12:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f86677fe700 1 --2- 172.21.15.5:0/321078741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd6ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f866cb9c700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f86500a1510 0x7f86500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8667fff700 1 -- 172.21.15.5:0/321078741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 msgr2=0x55ed6dd6ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8667fff700 1 --2- 172.21.15.5:0/321078741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd6ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8667fff700 1 -- 172.21.15.5:0/321078741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 msgr2=0x55ed6dd69630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8667fff700 1 --2- 172.21.15.5:0/321078741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd69630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.871+0000 7f8667fff700 1 -- 172.21.15.5:0/321078741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed6dae6d90 con 0x55ed6dd69b70 2023-10-07T00:12:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.872+0000 7f8667fff700 1 --2- 172.21.15.5:0/321078741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86580caab0 tx=0x7f865806d280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6024b95495757aca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.872+0000 7f864e7fc700 1 -- 172.21.15.5:0/321078741 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658099c20 con 0x55ed6dd69b70 2023-10-07T00:12:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.872+0000 7f866cb9c700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f86500a1510 0x7f86500a39d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f866000b0d0 tx=0x7f866000b3e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.872+0000 7f864e7fc700 1 -- 172.21.15.5:0/321078741 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f865800ccd0 con 0x55ed6dd69b70 2023-10-07T00:12:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.872+0000 7f864e7fc700 1 -- 172.21.15.5:0/321078741 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580a2650 con 0x55ed6dd69b70 2023-10-07T00:12:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 -- 172.21.15.5:0/321078741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69b70 msgr2=0x55ed6dd6a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 --2- 172.21.15.5:0/321078741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86580caab0 tx=0x7f865806d280 comp rx=0 tx=0).stop 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 -- 172.21.15.5:0/321078741 shutdown_connections 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 --2- 172.21.15.5:0/321078741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd6ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 --2- 172.21.15.5:0/321078741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd69630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 --2- 172.21.15.5:0/321078741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6a430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 -- 172.21.15.5:0/321078741 >> 172.21.15.5:0/321078741 conn(0x55ed6dcdd210 msgr2=0x55ed6dd640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 -- 172.21.15.5:0/321078741 shutdown_connections 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 -- 172.21.15.5:0/321078741 wait complete. 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.873+0000 7f8681f31b80 1 -- start start 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.874+0000 7f8681f31b80 1 Processor -- start 2023-10-07T00:12:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 0x55ed6dd72fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd734e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f8681f31b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dcbbde0 con 0x55ed6dd69b70 2023-10-07T00:12:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f8681f31b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dc586c0 con 0x55ed6dd6aa10 2023-10-07T00:12:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f8681f31b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dc58360 con 0x55ed6dd69210 2023-10-07T00:12:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f8681f31b80 10 client.0 _ll_register_callbacks cb 0x55ed6dab57b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f86677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f86677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd734e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58954/0 (socket says 172.21.15.5:58954) 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f86677fe700 1 -- 172.21.15.5:0/2120054718 learned_addr learned my addr 172.21.15.5:0/2120054718 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f8667fff700 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 0x55ed6dd72fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f866cb9c700 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f86677fe700 1 -- 172.21.15.5:0/2120054718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 msgr2=0x55ed6dd72fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f86677fe700 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 0x55ed6dd72fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f86677fe700 1 -- 172.21.15.5:0/2120054718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 msgr2=0x55ed6dd7a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f86677fe700 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.875+0000 7f86677fe700 1 -- 172.21.15.5:0/2120054718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86681a13c0 con 0x55ed6dd69b70 2023-10-07T00:12:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f86677fe700 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd734e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f865c013780 tx=0x7f865c013a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3ff4704e93f254 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f86477fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f86477fe700 1 -- 172.21.15.5:0/2120054718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0116d0 con 0x55ed6dd69b70 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f8681f31b80 1 -- 172.21.15.5:0/2120054718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed6dd5bec0 con 0x55ed6dd69b70 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f86477fe700 1 -- 172.21.15.5:0/2120054718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f865c011830 con 0x55ed6dd69b70 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f86477fe700 1 -- 172.21.15.5:0/2120054718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f865c0119f0 con 0x55ed6dd69b70 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f8681f31b80 10 client.15378 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f8681f31b80 1 -- 172.21.15.5:0/2120054718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ed6dacfc10 con 0x55ed6dd69b70 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.876+0000 7f86477fe700 1 -- 172.21.15.5:0/2120054718 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f865c02a080 con 0x55ed6dd69b70 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.877+0000 7f86477fe700 1 -- 172.21.15.5:0/2120054718 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f865c024030 con 0x55ed6dd69b70 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.877+0000 7f8681f31b80 10 client.15378 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.877+0000 7f8681f31b80 10 client.15378 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T00:12:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.877+0000 7f8681f31b80 20 client.15378 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.877+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ed6dd7ec40 0x55ed6dd7d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.877+0000 7f8681f31b80 4 client.15378 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.877+0000 7f8681f31b80 1 -- 172.21.15.5:0/2120054718 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed6dcb4dc0 con 0x55ed6dd7ec40 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.877+0000 7f8667fff700 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ed6dd7ec40 0x55ed6dd7d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.878+0000 7f8667fff700 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ed6dd7ec40 0x55ed6dd7d6d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f50ba9064ce0fcdf server_cookie=1584a6d319b689b7 in_seq=0 out_seq=0 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.878+0000 7f86477fe700 10 client.15378 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f86477fe700 1 -- 172.21.15.5:0/2120054718 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed6dcb4dc0 con 0x55ed6dd7ec40 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f86477fe700 10 client.15378 handle_command_reply: tid=0 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 client.15378 shutdown 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 -- 172.21.15.5:0/2120054718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 msgr2=0x55ed6dd734e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd734e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f865c013780 tx=0x7f865c013a90 comp rx=0 tx=0).stop 2023-10-07T00:12:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 -- 172.21.15.5:0/2120054718 shutdown_connections 2023-10-07T00:12:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ed6dd7ec40 0x55ed6dd7d6d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f86477fe700 0 client.15378 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:12:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 0x55ed6dd72fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2120054718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd734e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 -- 172.21.15.5:0/2120054718 >> 172.21.15.5:0/2120054718 conn(0x55ed6dcdd210 msgr2=0x55ed6dd63f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 -- 172.21.15.5:0/2120054718 shutdown_connections 2023-10-07T00:12:45.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 1 -- 172.21.15.5:0/2120054718 wait complete. 2023-10-07T00:12:45.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.879+0000 7f8681f31b80 20 client.15378 trim_cache size 0 max 16384 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.897+0000 7f8681f31b80 1 Processor -- start 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.897+0000 7f8681f31b80 1 -- start start 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 0x55ed6dd6d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f8681f31b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dd729b0 con 0x55ed6dd69b70 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f8681f31b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6db3c8d0 con 0x55ed6dd6aa10 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f8681f31b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dd5e2b0 con 0x55ed6dd69210 2023-10-07T00:12:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f86677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f86677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58960/0 (socket says 172.21.15.5:58960) 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f86677fe700 1 -- 172.21.15.5:0/3622838844 learned_addr learned my addr 172.21.15.5:0/3622838844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f8667fff700 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 0x55ed6dd6d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f866cb9c700 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f86677fe700 1 -- 172.21.15.5:0/3622838844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 msgr2=0x55ed6dd6d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f86677fe700 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 0x55ed6dd6d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f86677fe700 1 -- 172.21.15.5:0/3622838844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 msgr2=0x55ed6dd7a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f86677fe700 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.898+0000 7f86677fe700 1 -- 172.21.15.5:0/3622838844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed6db0d200 con 0x55ed6dd69b70 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f86677fe700 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6de20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f865c005d60 tx=0x7f865c00e340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bebf0aeee695a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f864effd700 1 -- 172.21.15.5:0/3622838844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0050b0 con 0x55ed6dd69b70 2023-10-07T00:12:45.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f864effd700 1 -- 172.21.15.5:0/3622838844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ed6dd5bec0 con 0x55ed6dd69b70 2023-10-07T00:12:45.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f864effd700 1 -- 172.21.15.5:0/3622838844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c026400 con 0x55ed6dd69b70 2023-10-07T00:12:45.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f8681f31b80 1 -- 172.21.15.5:0/3622838844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 msgr2=0x55ed6dd6de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f8681f31b80 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6de20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f865c005d60 tx=0x7f865c00e340 comp rx=0 tx=0).stop 2023-10-07T00:12:45.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f8681f31b80 1 -- 172.21.15.5:0/3622838844 shutdown_connections 2023-10-07T00:12:45.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f8681f31b80 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f8681f31b80 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd69210 0x55ed6dd6d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f8681f31b80 1 --2- 172.21.15.5:0/3622838844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69b70 0x55ed6dd6de20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.899+0000 7f8681f31b80 1 -- 172.21.15.5:0/3622838844 >> 172.21.15.5:0/3622838844 conn(0x55ed6dcdd210 msgr2=0x55ed6dd62b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.900+0000 7f8681f31b80 1 -- 172.21.15.5:0/3622838844 shutdown_connections 2023-10-07T00:12:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.900+0000 7f8681f31b80 1 -- 172.21.15.5:0/3622838844 wait complete. 2023-10-07T00:12:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.900+0000 7f8681f31b80 1 -- start start 2023-10-07T00:12:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.900+0000 7f8681f31b80 1 Processor -- start 2023-10-07T00:12:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd74b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd69b70 0x55ed6dd75090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8681f31b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8681f31b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dd7a570 con 0x55ed6dd69210 2023-10-07T00:12:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8681f31b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dd7a6e0 con 0x55ed6dd69b70 2023-10-07T00:12:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8681f31b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6dd7a8a0 con 0x55ed6dd6aa10 2023-10-07T00:12:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8681f31b80 10 client.0 _ll_register_callbacks cb 0x7f865c009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:12:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8667fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd74b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8667fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd74b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58966/0 (socket says 172.21.15.5:58966) 2023-10-07T00:12:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f8667fff700 1 -- 172.21.15.5:0/2955598379 learned_addr learned my addr 172.21.15.5:0/2955598379 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.901+0000 7f86677fe700 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd69b70 0x55ed6dd75090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8667fff700 1 -- 172.21.15.5:0/2955598379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd6aa10 msgr2=0x55ed6dd7a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8667fff700 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8667fff700 1 -- 172.21.15.5:0/2955598379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd69b70 msgr2=0x55ed6dd75090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:12:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8667fff700 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd69b70 0x55ed6dd75090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8667fff700 1 -- 172.21.15.5:0/2955598379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed6dacfc10 con 0x55ed6dd69210 2023-10-07T00:12:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8667fff700 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd74b50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86580a2120 tx=0x7f865800cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaefd64fa402649a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f86477fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:12:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f86477fe700 1 -- 172.21.15.5:0/2955598379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865809aa40 con 0x55ed6dd69210 2023-10-07T00:12:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8681f31b80 1 -- 172.21.15.5:0/2955598379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f865800ccd0 con 0x55ed6dd69210 2023-10-07T00:12:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f86477fe700 1 -- 172.21.15.5:0/2955598379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f86580a2650 con 0x55ed6dd69210 2023-10-07T00:12:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f86477fe700 1 -- 172.21.15.5:0/2955598379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86580969d0 con 0x55ed6dd69210 2023-10-07T00:12:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8681f31b80 10 client.15384 fetch_fsmap learned FSMap version 26 2023-10-07T00:12:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.902+0000 7f8681f31b80 1 -- 172.21.15.5:0/2955598379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ed6dae5260 con 0x55ed6dd69210 2023-10-07T00:12:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f86477fe700 1 -- 172.21.15.5:0/2955598379 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f865800ccd0 con 0x55ed6dd69210 2023-10-07T00:12:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f86477fe700 1 -- 172.21.15.5:0/2955598379 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f86580997b0 con 0x55ed6dd69210 2023-10-07T00:12:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f8681f31b80 10 client.15384 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:12:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f8681f31b80 10 client.15384 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T00:12:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f8681f31b80 20 client.15384 populate_metadata read hostname 'smithi005' 2023-10-07T00:12:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ed6ddd73d0 0x55ed6ddd3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f8681f31b80 4 client.15384 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-07T00:12:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f8681f31b80 1 -- 172.21.15.5:0/2955598379 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ed6dcb4ae0 con 0x55ed6ddd73d0 2023-10-07T00:12:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.903+0000 7f86677fe700 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ed6ddd73d0 0x55ed6ddd3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f86677fe700 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ed6ddd73d0 0x55ed6ddd3790 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45e531157c5f7f02 server_cookie=e8903c21887a46df in_seq=0 out_seq=0 2023-10-07T00:12:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f86477fe700 10 client.15384 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:12:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f86477fe700 1 -- 172.21.15.5:0/2955598379 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ed6dcb4ae0 con 0x55ed6ddd73d0 2023-10-07T00:12:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f86477fe700 10 client.15384 handle_command_reply: tid=0 2023-10-07T00:12:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 client.15384 shutdown 2023-10-07T00:12:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 -- 172.21.15.5:0/2955598379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 msgr2=0x55ed6dd74b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd74b50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86580a2120 tx=0x7f865800cec0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 -- 172.21.15.5:0/2955598379 shutdown_connections 2023-10-07T00:12:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ed6ddd73d0 0x55ed6ddd3790 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ed6dd6aa10 0x55ed6dd7a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ed6dd69210 0x55ed6dd74b50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f86477fe700 0 client.15384 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:12:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 --2- 172.21.15.5:0/2955598379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ed6dd69b70 0x55ed6dd75090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 -- 172.21.15.5:0/2955598379 >> 172.21.15.5:0/2955598379 conn(0x55ed6dcdd210 msgr2=0x55ed6dd6d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 -- 172.21.15.5:0/2955598379 shutdown_connections 2023-10-07T00:12:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.904+0000 7f8681f31b80 1 -- 172.21.15.5:0/2955598379 wait complete. 2023-10-07T00:12:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f8681f31b80 20 client.15384 trim_cache size 0 max 16384 2023-10-07T00:12:45.916 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:45.916 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "bdea4c58-64a4-11ee-8db5-212e2dc638e7", 2023-10-07T00:12:45.916 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-07T00:12:45.917 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24611, 2023-10-07T00:12:45.917 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-07T00:12:45.917 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-07T00:12:45.917 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-07T00:12:45.917 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 92.069663629000004, 2023-10-07T00:12:45.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2023-10-07T00:12:45.918 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2023-10-07T00:12:45.918 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-07T00:12:45.918 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 99.284608727000006 2023-10-07T00:12:45.918 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 -- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f86500a1510 msgr2=0x7f86500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f86500a1510 0x7f86500a39d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f866000b0d0 tx=0x7f866000b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 -- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668100fc0 msgr2=0x7f8668198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668100fc0 0x7f8668198e70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f865800e970 tx=0x7f865800ec80 comp rx=0 tx=0).stop 2023-10-07T00:12:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 -- 172.21.15.5:0/3920584590 shutdown_connections 2023-10-07T00:12:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f86500a1510 0x7f86500a39d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8668102b50 0x7f86681a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8668100fc0 0x7f8668198e70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 --2- 172.21.15.5:0/3920584590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86681021b0 0x7f86681993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 -- 172.21.15.5:0/3920584590 >> 172.21.15.5:0/3920584590 conn(0x7f86680fc530 msgr2=0x7f8668107aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 -- 172.21.15.5:0/3920584590 shutdown_connections 2023-10-07T00:12:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:45.905+0000 7f866e5ff700 1 -- 172.21.15.5:0/3920584590 wait complete. 2023-10-07T00:12:45.924 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-07T00:12:45.950 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-07T00:12:45.950 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-07T00:12:45.950 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2023-10-07T00:12:45.950 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-07T00:12:45.950 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T00:12:45.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:45.951 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-07T00:12:45.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:45.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-07T00:12:46.109 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-10-07T00:12:46.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T00:12:46.112 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-07T00:12:46.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-07T00:12:46.860 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:12:46.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:46 smithi112 ceph-mon[133548]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:47.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:46 smithi005 ceph-mon[129406]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:46 smithi088 ceph-mon[103111]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-07T00:12:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.361+0000 7fc66713e700 1 -- 172.21.15.5:0/3924810401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 msgr2=0x7fc660107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.361+0000 7fc66713e700 1 --2- 172.21.15.5:0/3924810401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 0x7fc660107370 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc6540099c0 tx=0x7fc654009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.362+0000 7fc66713e700 1 -- 172.21.15.5:0/3924810401 shutdown_connections 2023-10-07T00:12:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.362+0000 7fc66713e700 1 --2- 172.21.15.5:0/3924810401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc660101940 0x7fc66010ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.362+0000 7fc66713e700 1 --2- 172.21.15.5:0/3924810401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 0x7fc660107370 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.362+0000 7fc66713e700 1 --2- 172.21.15.5:0/3924810401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc660100f80 0x7fc660101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.362+0000 7fc66713e700 1 -- 172.21.15.5:0/3924810401 >> 172.21.15.5:0/3924810401 conn(0x7fc6600780a0 msgr2=0x7fc6600784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.362+0000 7fc66713e700 1 -- 172.21.15.5:0/3924810401 shutdown_connections 2023-10-07T00:12:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.362+0000 7fc66713e700 1 -- 172.21.15.5:0/3924810401 wait complete. 2023-10-07T00:12:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.363+0000 7fc66713e700 1 Processor -- start 2023-10-07T00:12:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.363+0000 7fc66713e700 1 -- start start 2023-10-07T00:12:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.363+0000 7fc66713e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc660100f80 0x7fc660196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.363+0000 7fc66713e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc660101940 0x7fc660197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.363+0000 7fc66713e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 0x7fc66019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.363+0000 7fc66713e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66019beb0 con 0x7fc660106f90 2023-10-07T00:12:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.363+0000 7fc66713e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66019c020 con 0x7fc660101940 2023-10-07T00:12:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.363+0000 7fc66713e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66019c1e0 con 0x7fc660100f80 2023-10-07T00:12:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 0x7fc66019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 0x7fc66019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58982/0 (socket says 172.21.15.5:58982) 2023-10-07T00:12:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 -- 172.21.15.5:0/1244684256 learned_addr learned my addr 172.21.15.5:0/1244684256 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc664eda700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc660100f80 0x7fc660196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc65ffff700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc660101940 0x7fc660197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 -- 172.21.15.5:0/1244684256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc660100f80 msgr2=0x7fc660196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc660100f80 0x7fc660196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 -- 172.21.15.5:0/1244684256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc660101940 msgr2=0x7fc660197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc660101940 0x7fc660197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 -- 172.21.15.5:0/1244684256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540095f0 con 0x7fc660106f90 2023-10-07T00:12:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.364+0000 7fc6656db700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 0x7fc66019b8a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc65800ab50 tx=0x7fc65800ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.365+0000 7fc65dffb700 1 -- 172.21.15.5:0/1244684256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800f070 con 0x7fc660106f90 2023-10-07T00:12:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.365+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66019c4c0 con 0x7fc660106f90 2023-10-07T00:12:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.365+0000 7fc65dffb700 1 -- 172.21.15.5:0/1244684256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc658004bb0 con 0x7fc660106f90 2023-10-07T00:12:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.365+0000 7fc65dffb700 1 -- 172.21.15.5:0/1244684256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658005280 con 0x7fc660106f90 2023-10-07T00:12:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.365+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6601a3d20 con 0x7fc660106f90 2023-10-07T00:12:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.366+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66004ebb0 con 0x7fc660106f90 2023-10-07T00:12:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.368+0000 7fc65dffb700 1 -- 172.21.15.5:0/1244684256 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fc658004d20 con 0x7fc660106f90 2023-10-07T00:12:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.370+0000 7fc65dffb700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc6500a1590 0x7fc6500a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.371+0000 7fc65dffb700 1 -- 172.21.15.5:0/1244684256 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc6580cc390 con 0x7fc660106f90 2023-10-07T00:12:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.371+0000 7fc664eda700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc6500a1590 0x7fc6500a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.371+0000 7fc664eda700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc6500a1590 0x7fc6500a3a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc654000c00 tx=0x7fc654009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.375+0000 7fc65dffb700 1 -- 172.21.15.5:0/1244684256 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc6580958a0 con 0x7fc660106f90 2023-10-07T00:12:48.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.631+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc660110f30 con 0x7fc660106f90 2023-10-07T00:12:48.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.631+0000 7fc65dffb700 1 -- 172.21.15.5:0/1244684256 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc658095030 con 0x7fc660106f90 2023-10-07T00:12:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T00:12:48.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc6500a1590 msgr2=0x7fc6500a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:48.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc6500a1590 0x7fc6500a3a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc654000c00 tx=0x7fc654009f10 comp rx=0 tx=0).stop 2023-10-07T00:12:48.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 msgr2=0x7fc66019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:48.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 0x7fc66019b8a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc65800ab50 tx=0x7fc65800ae60 comp rx=0 tx=0).stop 2023-10-07T00:12:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 shutdown_connections 2023-10-07T00:12:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc6500a1590 0x7fc6500a3a50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc660106f90 0x7fc66019b8a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc660100f80 0x7fc660196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 --2- 172.21.15.5:0/1244684256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc660101940 0x7fc660197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 >> 172.21.15.5:0/1244684256 conn(0x7fc6600780a0 msgr2=0x7fc6600ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 shutdown_connections 2023-10-07T00:12:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:48.634+0000 7fc66713e700 1 -- 172.21.15.5:0/1244684256 wait complete. 2023-10-07T00:12:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:48 smithi112 ceph-mon[133548]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:48 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1244684256' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-07T00:12:49.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:48 smithi005 ceph-mon[129406]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:49.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:48 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1244684256' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-07T00:12:49.146 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T00:12:49.147 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T00:12:49.147 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-07T00:12:49.147 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T00:12:49.147 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T00:12:49.147 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T00:12:49.147 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T00:12:49.148 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T00:12:49.148 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T00:12:49.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:49.148 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-07T00:12:49.196 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T00:12:49.196 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T00:12:49.196 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T00:12:49.196 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-07T00:12:49.196 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-07T00:12:49.196 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-07T00:12:49.196 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T00:12:49.197 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-07T00:12:49.197 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-10-07T00:12:49.197 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T00:12:49.197 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-07T00:12:49.197 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-10-07T00:12:49.197 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T00:12:49.197 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-07T00:12:49.197 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-10-07T00:12:49.198 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-07T00:12:49.198 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41449sec preferred_lft 41449sec 2023-10-07T00:12:49.198 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-07T00:12:49.198 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-07T00:12:49.198 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T00:12:49.198 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-07T00:12:49.198 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-10-07T00:12:49.199 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-07T00:12:49.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:49.199 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-07T00:12:49.199 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-07T00:12:49.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-10-07T00:12:49.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-10-07T00:12:49.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-10-07T00:12:49.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-07T00:12:49.199 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-07T00:12:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:48 smithi088 ceph-mon[103111]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:12:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:48 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1244684256' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-07T00:12:49.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:49.709 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T00:12:49.784 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-07T00:12:49.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:49.789 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-07T00:12:49.845 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-07T00:12:49.845 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T00:12:49.845 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-07T00:12:49.846 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-07T00:12:49.846 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T00:12:49.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:49.846 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-07T00:12:49.846 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-07T00:12:49.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-07T00:12:49.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-07T00:12:49.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-07T00:12:49.847 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-07T00:12:50.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:50.568 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-07T00:12:50.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:50.613 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-10-07T00:12:50.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:50.697 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-07T00:12:50.697 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-07T00:12:50.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T00:12:50.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-07T00:12:50.698 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-07T00:12:50.841 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:50 smithi005 ceph-mon[129406]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:50.884 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-07T00:12:50.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:50.885 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-07T00:12:50.885 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-07T00:12:50.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-07T00:12:50.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-07T00:12:50.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-07T00:12:50.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-07T00:12:50.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-07T00:12:50.885 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-07T00:12:50.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:50 smithi112 ceph-mon[133548]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:51.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:51.167 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-07T00:12:51.167 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-07T00:12:51.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-07T00:12:51.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-10-07T00:12:51.167 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-07T00:12:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:50 smithi088 ceph-mon[103111]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-07T00:12:51.344 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2023-10-07T00:12:51.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T00:12:51.344 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T00:12:51.388 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T00:12:51.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T00:12:51.389 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T00:12:51.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2023-10-07T00:12:51.583 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/systemd 2023-10-07T00:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/devices 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/hugetlb 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/blkio 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/pids 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/perf_event 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpuset 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/memory 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/freezer 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2023-10-07T00:12:51.629 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2023-10-07T00:12:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/f79a2affa2b754c0a52a79ae558e3560c41c82190db409845a128013f80aa8ca/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/5955ac3013b14c3bdc719029fbfbe9e952ea505be4b7715149190bbff2d92c84/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/8c5be2be16eb2cd8fa8259baca175b818b20d50f2ef19ecef151cdd4b81f1f38/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/287fa0a35d0c5454fa75d67ec07b9b3170fe831da07b4740366bbd72567dbd8e/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/ee078d0884d09478b1dfcbf4b6b9d661eb51289bca2c6f75d2eec72fa1d907be/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c4b8279cfd918616ce55ee29253fae85be1075ac80a3b587054c6dcab9e02515/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/d9b14ede269d105d4a02f4ab65135b261e28895475a2b05abc333234de6b9107/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/b5aa8495ae1c48cd3333a1ab2a94bc7483861bb72627d8e9960772a9300c3924/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/35a72bae30e4cab8e2caa2434bc9cefaf533bb3e53c02ee9ab95eb17c17b6e14/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/685f31a14232676dc6234033017c64e4b87a5fdcc00c85a7d3274f8d0ff1cb13/merged 2023-10-07T00:12:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2023-10-07T00:12:51.632 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T00:12:51.632 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T00:12:51.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:51.633 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2023-10-07T00:12:51.717 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-07T00:12:51.717 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c --client_fs=cephfs) 2023-10-07T00:12:51.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2023-10-07T00:12:51.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:51 smithi005 ceph-mon[129406]: mgrmap e18: x(active, since 9m), standbys: y, z 2023-10-07T00:12:51.833 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2023-10-07T00:12:51.879 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2023-10-07T00:12:51.879 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2023-10-07T00:12:51.879 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2023-10-07T00:12:51.879 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/systemd 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/devices 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/hugetlb 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/blkio 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-07T00:12:51.880 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/pids 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/perf_event 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpuset 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/memory 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/freezer 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2023-10-07T00:12:51.881 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/f79a2affa2b754c0a52a79ae558e3560c41c82190db409845a128013f80aa8ca/merged 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/5955ac3013b14c3bdc719029fbfbe9e952ea505be4b7715149190bbff2d92c84/merged 2023-10-07T00:12:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/8c5be2be16eb2cd8fa8259baca175b818b20d50f2ef19ecef151cdd4b81f1f38/merged 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/287fa0a35d0c5454fa75d67ec07b9b3170fe831da07b4740366bbd72567dbd8e/merged 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/ee078d0884d09478b1dfcbf4b6b9d661eb51289bca2c6f75d2eec72fa1d907be/merged 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c4b8279cfd918616ce55ee29253fae85be1075ac80a3b587054c6dcab9e02515/merged 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/d9b14ede269d105d4a02f4ab65135b261e28895475a2b05abc333234de6b9107/merged 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/b5aa8495ae1c48cd3333a1ab2a94bc7483861bb72627d8e9960772a9300c3924/merged 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/35a72bae30e4cab8e2caa2434bc9cefaf533bb3e53c02ee9ab95eb17c17b6e14/merged 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/685f31a14232676dc6234033017c64e4b87a5fdcc00c85a7d3274f8d0ff1cb13/merged 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2023-10-07T00:12:51.883 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T00:12:51.884 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T00:12:51.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:51.885 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2023-10-07T00:12:51.985 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2023-10-07T00:12:51.983+0000 7f6a21ff05c0 -1 init, newargv = 0x560a7c2a80e0 newargc=15 2023-10-07T00:12:51.985 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[191740]: starting ceph client 2023-10-07T00:12:51.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:51 smithi112 ceph-mon[133548]: mgrmap e18: x(active, since 9m), standbys: y, z 2023-10-07T00:12:52.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[191740]: starting fuse 2023-10-07T00:12:52.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:51 smithi088 ceph-mon[103111]: mgrmap e18: x(active, since 9m), standbys: y, z 2023-10-07T00:12:52.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:52 smithi112 ceph-mon[133548]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-07T00:12:53.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2023-10-07T00:12:53.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:52 smithi005 ceph-mon[129406]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-07T00:12:53.150 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2023-10-07T00:12:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:52 smithi088 ceph-mon[103111]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-07T00:12:53.237 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2023-10-07T00:12:53.237 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2023-10-07T00:12:53.237 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2023-10-07T00:12:53.237 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2023-10-07T00:12:53.237 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2023-10-07T00:12:53.237 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/systemd 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/devices 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/hugetlb 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/blkio 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-07T00:12:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/pids 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/perf_event 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpuset 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/memory 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/freezer 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2023-10-07T00:12:53.239 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/f79a2affa2b754c0a52a79ae558e3560c41c82190db409845a128013f80aa8ca/merged 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/5955ac3013b14c3bdc719029fbfbe9e952ea505be4b7715149190bbff2d92c84/merged 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/8c5be2be16eb2cd8fa8259baca175b818b20d50f2ef19ecef151cdd4b81f1f38/merged 2023-10-07T00:12:53.240 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/287fa0a35d0c5454fa75d67ec07b9b3170fe831da07b4740366bbd72567dbd8e/merged 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/ee078d0884d09478b1dfcbf4b6b9d661eb51289bca2c6f75d2eec72fa1d907be/merged 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c4b8279cfd918616ce55ee29253fae85be1075ac80a3b587054c6dcab9e02515/merged 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/d9b14ede269d105d4a02f4ab65135b261e28895475a2b05abc333234de6b9107/merged 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/b5aa8495ae1c48cd3333a1ab2a94bc7483861bb72627d8e9960772a9300c3924/merged 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/35a72bae30e4cab8e2caa2434bc9cefaf533bb3e53c02ee9ab95eb17c17b6e14/merged 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/685f31a14232676dc6234033017c64e4b87a5fdcc00c85a7d3274f8d0ff1cb13/merged 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T00:12:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-07T00:12:53.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:53.242 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2023-10-07T00:12:53.287 INFO:teuthology.orchestra.run.smithi005.stdout:121 2023-10-07T00:12:53.287 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-10-07T00:12:53.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo stdin-killer -- python3 -c ' 2023-10-07T00:12:53.287 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> import re 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> import os 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2023-10-07T00:12:53.288 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> return f 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-07T00:12:53.289 DEBUG:teuthology.orchestra.run.smithi005:> 2023-10-07T00:12:53.290 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2023-10-07T00:12:53.290 DEBUG:teuthology.orchestra.run.smithi005:> ' 2023-10-07T00:12:53.472 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.191740.asok 2023-10-07T00:12:53.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-07T00:12:53.486 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.191740.asok 2023-10-07T00:12:53.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:53.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.191740.asok status 2023-10-07T00:12:53.718 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:12:53.718 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2023-10-07T00:12:53.718 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "14d8d032507701c76ca224e769ee65a96b660a8c", 2023-10-07T00:12:53.718 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev)", 2023-10-07T00:12:53.718 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2023-10-07T00:12:53.718 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "191740", 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c" 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 25211, 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2023-10-07T00:12:53.719 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 25211 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 705273339 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-07T00:12:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 705273339 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.25211 172.21.15.5:0/705273339", 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "172.21.15.5:0/705273339", 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 5, 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 26, 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 88, 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2023-10-07T00:12:53.721 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:12:53.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:53.733 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2023-10-07T00:12:53.734 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-07T00:12:53.778 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2023-10-07T00:12:53.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-07T00:12:53.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:12:53.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T00:12:53.892 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-07T00:12:53.919 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-07T00:12:53.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 -- 172.21.15.5:0/3723562852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda0102b40 msgr2=0x7efda01093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 --2- 172.21.15.5:0/3723562852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda0102b40 0x7efda01093f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd9800b0d0 tx=0x7efd9800b3e0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 -- 172.21.15.5:0/3723562852 shutdown_connections 2023-10-07T00:12:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 --2- 172.21.15.5:0/3723562852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda0102b40 0x7efda01093f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 --2- 172.21.15.5:0/3723562852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efda0100fb0 0x7efda01013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 --2- 172.21.15.5:0/3723562852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda01021a0 0x7efda0102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 -- 172.21.15.5:0/3723562852 >> 172.21.15.5:0/3723562852 conn(0x7efda00fc520 msgr2=0x7efda00fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 -- 172.21.15.5:0/3723562852 shutdown_connections 2023-10-07T00:12:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.130+0000 7efda59ff700 1 -- 172.21.15.5:0/3723562852 wait complete. 2023-10-07T00:12:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.131+0000 7efda59ff700 1 Processor -- start 2023-10-07T00:12:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.131+0000 7efda59ff700 1 -- start start 2023-10-07T00:12:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.131+0000 7efda59ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda0100fb0 0x7efda0196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.131+0000 7efda59ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda01021a0 0x7efda0197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.131+0000 7efda59ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efda0102b40 0x7efda019e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.131+0000 7efda59ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda019e860 con 0x7efda01021a0 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.131+0000 7efda59ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda019e9d0 con 0x7efda0102b40 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.131+0000 7efda59ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda019eb90 con 0x7efda0100fb0 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda01021a0 0x7efda0197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda01021a0 0x7efda0197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60138/0 (socket says 172.21.15.5:60138) 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 -- 172.21.15.5:0/4281105483 learned_addr learned my addr 172.21.15.5:0/4281105483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd9effd700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda0100fb0 0x7efda0196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 -- 172.21.15.5:0/4281105483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda0100fb0 msgr2=0x7efda0196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda0100fb0 0x7efda0196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 -- 172.21.15.5:0/4281105483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efda0102b40 msgr2=0x7efda019e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd9f7fe700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efda0102b40 0x7efda019e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efda0102b40 0x7efda019e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 -- 172.21.15.5:0/4281105483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98009d00 con 0x7efda01021a0 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd9f7fe700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efda0102b40 0x7efda019e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efd97fff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda01021a0 0x7efda0197260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd8800d950 tx=0x7efd8800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.132+0000 7efda49fd700 1 -- 172.21.15.5:0/4281105483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88009b40 con 0x7efda01021a0 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.133+0000 7efda49fd700 1 -- 172.21.15.5:0/4281105483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd88009ca0 con 0x7efda01021a0 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.133+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda019ee70 con 0x7efda01021a0 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.133+0000 7efda49fd700 1 -- 172.21.15.5:0/4281105483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800f620 con 0x7efda01021a0 2023-10-07T00:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.133+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda019f290 con 0x7efda01021a0 2023-10-07T00:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.134+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda010c6d0 con 0x7efda01021a0 2023-10-07T00:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.136+0000 7efda49fd700 1 -- 172.21.15.5:0/4281105483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7efd88010460 con 0x7efda01021a0 2023-10-07T00:12:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.137+0000 7efda49fd700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efd8c0a1480 0x7efd8c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.138+0000 7efda49fd700 1 -- 172.21.15.5:0/4281105483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7efd880cd080 con 0x7efda01021a0 2023-10-07T00:12:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.138+0000 7efd9effd700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efd8c0a1480 0x7efd8c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.138+0000 7efd9effd700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efd8c0a1480 0x7efd8c0a3940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efda01981f0 tx=0x7efd9000b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.141+0000 7efda49fd700 1 -- 172.21.15.5:0/4281105483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efd88100100 con 0x7efda01021a0 2023-10-07T00:12:54.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.353+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efda0107eb0 con 0x7efda01021a0 2023-10-07T00:12:54.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.355+0000 7efda49fd700 1 -- 172.21.15.5:0/4281105483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7efd88096660 con 0x7efda01021a0 2023-10-07T00:12:54.357 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:54.357 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:54.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efd8c0a1480 msgr2=0x7efd8c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efd8c0a1480 0x7efd8c0a3940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efda01981f0 tx=0x7efd9000b5d0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda01021a0 msgr2=0x7efda0197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda01021a0 0x7efda0197260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd8800d950 tx=0x7efd8800dd10 comp rx=0 tx=0).stop 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 shutdown_connections 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7efd8c0a1480 0x7efd8c0a3940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efda0102b40 0x7efda019e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda0100fb0 0x7efda0196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 --2- 172.21.15.5:0/4281105483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda01021a0 0x7efda0197260 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 >> 172.21.15.5:0/4281105483 conn(0x7efda00fc520 msgr2=0x7efda00fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 shutdown_connections 2023-10-07T00:12:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.358+0000 7efda59ff700 1 -- 172.21.15.5:0/4281105483 wait complete. 2023-10-07T00:12:54.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:12:54.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:12:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/1703979859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f41021b0 msgr2=0x7fc3f4102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/1703979859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f41021b0 0x7fc3f4102610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40099c0 tx=0x7fc3e4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/1703979859 shutdown_connections 2023-10-07T00:12:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/1703979859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f4102b50 0x7fc3f4109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/1703979859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f4100fc0 0x7fc3f41013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/1703979859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f41021b0 0x7fc3f4102610 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/1703979859 >> 172.21.15.5:0/1703979859 conn(0x7fc3f40fc530 msgr2=0x7fc3f40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/1703979859 shutdown_connections 2023-10-07T00:12:54.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.583+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/1703979859 wait complete. 2023-10-07T00:12:54.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.584+0000 7fc3fc7ff700 1 Processor -- start 2023-10-07T00:12:54.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.584+0000 7fc3fc7ff700 1 -- start start 2023-10-07T00:12:54.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fc7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f4100fc0 0x7fc3f4196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:54.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fc7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f41021b0 0x7fc3f41970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:54.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fc7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f4102b50 0x7fc3f419e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:54.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fc7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f419e6f0 con 0x7fc3f4100fc0 2023-10-07T00:12:54.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fc7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f419e830 con 0x7fc3f41021b0 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fc7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f419e9c0 con 0x7fc3f4102b50 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fa59b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f4100fc0 0x7fc3f4196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fa59b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f4100fc0 0x7fc3f4196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60164/0 (socket says 172.21.15.5:60164) 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fa59b700 1 -- 172.21.15.5:0/181043686 learned_addr learned my addr 172.21.15.5:0/181043686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3f9d9a700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f41021b0 0x7fc3f41970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fa59b700 1 -- 172.21.15.5:0/181043686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f4102b50 msgr2=0x7fc3f419e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fad9c700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f4102b50 0x7fc3f419e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fa59b700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f4102b50 0x7fc3f419e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fa59b700 1 -- 172.21.15.5:0/181043686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f41021b0 msgr2=0x7fc3f41970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fa59b700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f41021b0 0x7fc3f41970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fa59b700 1 -- 172.21.15.5:0/181043686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e40095f0 con 0x7fc3f4100fc0 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3f9d9a700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f41021b0 0x7fc3f41970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.585+0000 7fc3fad9c700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f4102b50 0x7fc3f419e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.586+0000 7fc3fa59b700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f4100fc0 0x7fc3f4196b70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000e970 tx=0x7fc3f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.586+0000 7fc3eb7fe700 1 -- 172.21.15.5:0/181043686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0009790 con 0x7fc3f4100fc0 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.586+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f419eca0 con 0x7fc3f4100fc0 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.586+0000 7fc3eb7fe700 1 -- 172.21.15.5:0/181043686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3f00044b0 con 0x7fc3f4100fc0 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.586+0000 7fc3eb7fe700 1 -- 172.21.15.5:0/181043686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0003dd0 con 0x7fc3f4100fc0 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.586+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f419f1b0 con 0x7fc3f4100fc0 2023-10-07T00:12:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.587+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f410c690 con 0x7fc3f4100fc0 2023-10-07T00:12:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.589+0000 7fc3eb7fe700 1 -- 172.21.15.5:0/181043686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc3f0003f30 con 0x7fc3f4100fc0 2023-10-07T00:12:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.590+0000 7fc3eb7fe700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc3e00a1480 0x7fc3e00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:54.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.590+0000 7fc3eb7fe700 1 -- 172.21.15.5:0/181043686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc3f0014070 con 0x7fc3f4100fc0 2023-10-07T00:12:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.590+0000 7fc3f9d9a700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc3e00a1480 0x7fc3e00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.591+0000 7fc3f9d9a700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc3e00a1480 0x7fc3e00a3940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400b580 tx=0x7fc3e401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.594+0000 7fc3eb7fe700 1 -- 172.21.15.5:0/181043686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc3f0096650 con 0x7fc3f4100fc0 2023-10-07T00:12:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.808+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3f4107f90 con 0x7fc3f4100fc0 2023-10-07T00:12:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.808+0000 7fc3eb7fe700 1 -- 172.21.15.5:0/181043686 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3f0099c70 con 0x7fc3f4100fc0 2023-10-07T00:12:54.810 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:12:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc3e00a1480 msgr2=0x7fc3e00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc3e00a1480 0x7fc3e00a3940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400b580 tx=0x7fc3e401a040 comp rx=0 tx=0).stop 2023-10-07T00:12:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f4100fc0 msgr2=0x7fc3f4196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f4100fc0 0x7fc3f4196b70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000e970 tx=0x7fc3f000ed30 comp rx=0 tx=0).stop 2023-10-07T00:12:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 shutdown_connections 2023-10-07T00:12:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc3e00a1480 0x7fc3e00a3940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f4102b50 0x7fc3f419e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f4100fc0 0x7fc3f4196b70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 --2- 172.21.15.5:0/181043686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f41021b0 0x7fc3f41970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 >> 172.21.15.5:0/181043686 conn(0x7fc3f40fc530 msgr2=0x7fc3f40fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 shutdown_connections 2023-10-07T00:12:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:54.811+0000 7fc3fc7ff700 1 -- 172.21.15.5:0/181043686 wait complete. 2023-10-07T00:12:54.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:12:54.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:54 smithi112 ceph-mon[133548]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-07T00:12:54.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:54 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4281105483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:55.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 -- 172.21.15.5:0/1140028885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460100fc0 msgr2=0x7ff4601013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 --2- 172.21.15.5:0/1140028885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460100fc0 0x7ff4601013e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff4500099c0 tx=0x7ff450009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 -- 172.21.15.5:0/1140028885 shutdown_connections 2023-10-07T00:12:55.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 --2- 172.21.15.5:0/1140028885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff460102b50 0x7ff460109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 --2- 172.21.15.5:0/1140028885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460100fc0 0x7ff4601013e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 --2- 172.21.15.5:0/1140028885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4601021b0 0x7ff460102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 -- 172.21.15.5:0/1140028885 >> 172.21.15.5:0/1140028885 conn(0x7ff4600fc530 msgr2=0x7ff4600fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:55.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 -- 172.21.15.5:0/1140028885 shutdown_connections 2023-10-07T00:12:55.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.035+0000 7ff464bff700 1 -- 172.21.15.5:0/1140028885 wait complete. 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.036+0000 7ff464bff700 1 Processor -- start 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.036+0000 7ff464bff700 1 -- start start 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff464bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff460100fc0 0x7ff460196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff464bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4601021b0 0x7ff460197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff464bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460102b50 0x7ff46019e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff464bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46019e790 con 0x7ff460102b50 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff464bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46019e900 con 0x7ff4601021b0 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff464bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46019eac0 con 0x7ff460100fc0 2023-10-07T00:12:55.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff45ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460102b50 0x7ff46019e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff45ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460102b50 0x7ff46019e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60172/0 (socket says 172.21.15.5:60172) 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff45ed9d700 1 -- 172.21.15.5:0/3019396933 learned_addr learned my addr 172.21.15.5:0/3019396933 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff45e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff460100fc0 0x7ff460196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.037+0000 7ff45dd9b700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4601021b0 0x7ff460197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff45ed9d700 1 -- 172.21.15.5:0/3019396933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff460100fc0 msgr2=0x7ff460196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff45ed9d700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff460100fc0 0x7ff460196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff45ed9d700 1 -- 172.21.15.5:0/3019396933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4601021b0 msgr2=0x7ff460197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff45ed9d700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4601021b0 0x7ff460197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff45ed9d700 1 -- 172.21.15.5:0/3019396933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4500095f0 con 0x7ff460102b50 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff45ed9d700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460102b50 0x7ff46019e1c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff458007d70 tx=0x7ff45800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff44f7fe700 1 -- 172.21.15.5:0/3019396933 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45800ac90 con 0x7ff460102b50 2023-10-07T00:12:55.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46019eda0 con 0x7ff460102b50 2023-10-07T00:12:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff44f7fe700 1 -- 172.21.15.5:0/3019396933 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff45800adf0 con 0x7ff460102b50 2023-10-07T00:12:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff44f7fe700 1 -- 172.21.15.5:0/3019396933 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580115e0 con 0x7ff460102b50 2023-10-07T00:12:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.038+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46019f1d0 con 0x7ff460102b50 2023-10-07T00:12:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.039+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46010c750 con 0x7ff460102b50 2023-10-07T00:12:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.041+0000 7ff44f7fe700 1 -- 172.21.15.5:0/3019396933 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff458012420 con 0x7ff460102b50 2023-10-07T00:12:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.043+0000 7ff44f7fe700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4480a1480 0x7ff4480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.043+0000 7ff44f7fe700 1 -- 172.21.15.5:0/3019396933 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4580ccf90 con 0x7ff460102b50 2023-10-07T00:12:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.043+0000 7ff45e59c700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4480a1480 0x7ff4480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.044+0000 7ff45e59c700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4480a1480 0x7ff4480a3940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff450006010 tx=0x7ff450005c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.047+0000 7ff44f7fe700 1 -- 172.21.15.5:0/3019396933 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff458096570 con 0x7ff460102b50 2023-10-07T00:12:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:54 smithi005 ceph-mon[129406]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-07T00:12:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:54 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4281105483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:54 smithi088 ceph-mon[103111]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-07T00:12:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:54 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4281105483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.259+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff460107f60 con 0x7ff460102b50 2023-10-07T00:12:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.259+0000 7ff44f7fe700 1 -- 172.21.15.5:0/3019396933 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff458099b90 con 0x7ff460102b50 2023-10-07T00:12:55.260 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:12:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4480a1480 msgr2=0x7ff4480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4480a1480 0x7ff4480a3940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff450006010 tx=0x7ff450005c40 comp rx=0 tx=0).stop 2023-10-07T00:12:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460102b50 msgr2=0x7ff46019e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460102b50 0x7ff46019e1c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff458007d70 tx=0x7ff45800a340 comp rx=0 tx=0).stop 2023-10-07T00:12:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 shutdown_connections 2023-10-07T00:12:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4480a1480 0x7ff4480a3940 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460102b50 0x7ff46019e1c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff460100fc0 0x7ff460196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 --2- 172.21.15.5:0/3019396933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4601021b0 0x7ff460197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 >> 172.21.15.5:0/3019396933 conn(0x7ff4600fc530 msgr2=0x7ff4600fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 shutdown_connections 2023-10-07T00:12:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.262+0000 7ff464bff700 1 -- 172.21.15.5:0/3019396933 wait complete. 2023-10-07T00:12:55.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:12:55.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.485+0000 7f17cefff700 1 -- 172.21.15.5:0/37572419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8108e80 msgr2=0x7f17c810b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.485+0000 7f17cefff700 1 --2- 172.21.15.5:0/37572419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8108e80 0x7f17c810b310 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f17c000b0a0 tx=0x7f17c000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.486+0000 7f17cefff700 1 -- 172.21.15.5:0/37572419 shutdown_connections 2023-10-07T00:12:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.486+0000 7f17cefff700 1 --2- 172.21.15.5:0/37572419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8108e80 0x7f17c810b310 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.486+0000 7f17cefff700 1 --2- 172.21.15.5:0/37572419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c8074ef0 0x7f17c8073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.486+0000 7f17cefff700 1 --2- 172.21.15.5:0/37572419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c8073910 0x7f17c8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.486+0000 7f17cefff700 1 -- 172.21.15.5:0/37572419 >> 172.21.15.5:0/37572419 conn(0x7f17c80fc530 msgr2=0x7f17c80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:55.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.486+0000 7f17cefff700 1 -- 172.21.15.5:0/37572419 shutdown_connections 2023-10-07T00:12:55.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.486+0000 7f17cefff700 1 -- 172.21.15.5:0/37572419 wait complete. 2023-10-07T00:12:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cefff700 1 Processor -- start 2023-10-07T00:12:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cefff700 1 -- start start 2023-10-07T00:12:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cefff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c8073910 0x7f17c8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cefff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8074ef0 0x7f17c81993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cefff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c8108e80 0x7f17c81a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cefff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81a0a20 con 0x7f17c8074ef0 2023-10-07T00:12:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cefff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81a0b60 con 0x7f17c8073910 2023-10-07T00:12:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cefff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81a0cf0 con 0x7f17c8108e80 2023-10-07T00:12:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8074ef0 0x7f17c81993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8074ef0 0x7f17c81993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60180/0 (socket says 172.21.15.5:60180) 2023-10-07T00:12:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17c7fff700 1 -- 172.21.15.5:0/2021367525 learned_addr learned my addr 172.21.15.5:0/2021367525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17ccd9b700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c8073910 0x7f17c8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.487+0000 7f17cd59c700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c8108e80 0x7f17c81a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c7fff700 1 -- 172.21.15.5:0/2021367525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c8108e80 msgr2=0x7f17c81a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c7fff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c8108e80 0x7f17c81a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c7fff700 1 -- 172.21.15.5:0/2021367525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c8073910 msgr2=0x7f17c8198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c7fff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c8073910 0x7f17c8198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c7fff700 1 -- 172.21.15.5:0/2021367525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0009d00 con 0x7f17c8074ef0 2023-10-07T00:12:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17ccd9b700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c8073910 0x7f17c8198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:12:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c7fff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8074ef0 0x7f17c81993e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f17b400d980 tx=0x7f17b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c5ffb700 1 -- 172.21.15.5:0/2021367525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400f890 con 0x7f17c8074ef0 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c5ffb700 1 -- 172.21.15.5:0/2021367525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17b400fe80 con 0x7f17c8074ef0 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17c5ffb700 1 -- 172.21.15.5:0/2021367525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4019360 con 0x7f17c8074ef0 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.488+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c81a0fd0 con 0x7f17c8074ef0 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.489+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c81a1400 con 0x7f17c8074ef0 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.490+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c8107530 con 0x7f17c8074ef0 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.492+0000 7f17c5ffb700 1 -- 172.21.15.5:0/2021367525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f17b400f9f0 con 0x7f17c8074ef0 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.493+0000 7f17c5ffb700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f17b80a1500 0x7f17b80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.493+0000 7f17c5ffb700 1 -- 172.21.15.5:0/2021367525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f17b40cc700 con 0x7f17c8074ef0 2023-10-07T00:12:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.493+0000 7f17ccd9b700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f17b80a1500 0x7f17b80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.494+0000 7f17ccd9b700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f17b80a1500 0x7f17b80a39c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009fd0 tx=0x7f17bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.497+0000 7f17c5ffb700 1 -- 172.21.15.5:0/2021367525 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f17b4095ce0 con 0x7f17c8074ef0 2023-10-07T00:12:55.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.712+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17c802d1f0 con 0x7f17c8074ef0 2023-10-07T00:12:55.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.712+0000 7f17c5ffb700 1 -- 172.21.15.5:0/2021367525 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17b4099300 con 0x7f17c8074ef0 2023-10-07T00:12:55.714 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:12:55.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f17b80a1500 msgr2=0x7f17b80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f17b80a1500 0x7f17b80a39c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009fd0 tx=0x7f17bc009260 comp rx=0 tx=0).stop 2023-10-07T00:12:55.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8074ef0 msgr2=0x7f17c81993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8074ef0 0x7f17c81993e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f17b400d980 tx=0x7f17b400dc90 comp rx=0 tx=0).stop 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 shutdown_connections 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f17b80a1500 0x7f17b80a39c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c8108e80 0x7f17c81a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c8073910 0x7f17c8198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 --2- 172.21.15.5:0/2021367525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17c8074ef0 0x7f17c81993e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 >> 172.21.15.5:0/2021367525 conn(0x7f17c80fc530 msgr2=0x7f17c80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 shutdown_connections 2023-10-07T00:12:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.715+0000 7f17cefff700 1 -- 172.21.15.5:0/2021367525 wait complete. 2023-10-07T00:12:55.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 -- 172.21.15.5:0/2747821196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 msgr2=0x7f7e50102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 --2- 172.21.15.5:0/2747821196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 0x7f7e50102610 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e400099c0 tx=0x7f7e40009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 -- 172.21.15.5:0/2747821196 shutdown_connections 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 --2- 172.21.15.5:0/2747821196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e50102b50 0x7f7e50109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 --2- 172.21.15.5:0/2747821196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e50100fc0 0x7f7e501013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 --2- 172.21.15.5:0/2747821196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 0x7f7e50102610 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 -- 172.21.15.5:0/2747821196 >> 172.21.15.5:0/2747821196 conn(0x7f7e500fc530 msgr2=0x7f7e500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 -- 172.21.15.5:0/2747821196 shutdown_connections 2023-10-07T00:12:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.937+0000 7f7e573ff700 1 -- 172.21.15.5:0/2747821196 wait complete. 2023-10-07T00:12:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.938+0000 7f7e573ff700 1 Processor -- start 2023-10-07T00:12:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.938+0000 7f7e573ff700 1 -- start start 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e573ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e50100fc0 0x7f7e50196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e573ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 0x7f7e501970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e573ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e50102b50 0x7f7e5019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e573ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5019e720 con 0x7f7e501021b0 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e573ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5019e860 con 0x7f7e50102b50 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e573ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5019e9f0 con 0x7f7e50100fc0 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 0x7f7e501970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 0x7f7e501970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60198/0 (socket says 172.21.15.5:60198) 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5499a700 1 -- 172.21.15.5:0/4050542902 learned_addr learned my addr 172.21.15.5:0/4050542902 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5599c700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e50102b50 0x7f7e5019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5519b700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e50100fc0 0x7f7e50196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5499a700 1 -- 172.21.15.5:0/4050542902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e50100fc0 msgr2=0x7f7e50196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5499a700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e50100fc0 0x7f7e50196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5499a700 1 -- 172.21.15.5:0/4050542902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e50102b50 msgr2=0x7f7e5019e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5499a700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e50102b50 0x7f7e5019e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.939+0000 7f7e5499a700 1 -- 172.21.15.5:0/4050542902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400095f0 con 0x7f7e501021b0 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.940+0000 7f7e5499a700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 0x7f7e501970e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009f50 tx=0x7f7e40003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.940+0000 7f7e467fc700 1 -- 172.21.15.5:0/4050542902 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4001d070 con 0x7f7e501021b0 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.940+0000 7f7e467fc700 1 -- 172.21.15.5:0/4050542902 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e4000bda0 con 0x7f7e501021b0 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.940+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5019ec70 con 0x7f7e501021b0 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.940+0000 7f7e467fc700 1 -- 172.21.15.5:0/4050542902 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e40005280 con 0x7f7e501021b0 2023-10-07T00:12:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.940+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5019f090 con 0x7f7e501021b0 2023-10-07T00:12:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.941+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e50107f40 con 0x7f7e501021b0 2023-10-07T00:12:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.943+0000 7f7e467fc700 1 -- 172.21.15.5:0/4050542902 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7e400053e0 con 0x7f7e501021b0 2023-10-07T00:12:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.944+0000 7f7e467fc700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7e3c0a1500 0x7f7e3c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.944+0000 7f7e467fc700 1 -- 172.21.15.5:0/4050542902 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7e400cdec0 con 0x7f7e501021b0 2023-10-07T00:12:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.945+0000 7f7e5519b700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7e3c0a1500 0x7f7e3c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.945+0000 7f7e5519b700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7e3c0a1500 0x7f7e3c0a39c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c005950 tx=0x7f7e4c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:55.948+0000 7f7e467fc700 1 -- 172.21.15.5:0/4050542902 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7e40097530 con 0x7f7e501021b0 2023-10-07T00:12:55.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:55 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/181043686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:55.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:55 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3019396933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:55.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:55 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2021367525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:56.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:55 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/181043686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:56.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:55 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3019396933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:56.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:55 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2021367525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:56.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.162+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e5010c6e0 con 0x7f7e501021b0 2023-10-07T00:12:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.164+0000 7f7e467fc700 1 -- 172.21.15.5:0/4050542902 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f7e4009ab50 con 0x7f7e501021b0 2023-10-07T00:12:56.165 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7e3c0a1500 msgr2=0x7f7e3c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7e3c0a1500 0x7f7e3c0a39c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c005950 tx=0x7f7e4c0058e0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 msgr2=0x7f7e501970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 0x7f7e501970e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009f50 tx=0x7f7e40003b00 comp rx=0 tx=0).stop 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 shutdown_connections 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7e3c0a1500 0x7f7e3c0a39c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e50102b50 0x7f7e5019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e50100fc0 0x7f7e50196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 --2- 172.21.15.5:0/4050542902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e501021b0 0x7f7e501970e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 >> 172.21.15.5:0/4050542902 conn(0x7f7e500fc530 msgr2=0x7f7e500fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 shutdown_connections 2023-10-07T00:12:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.166+0000 7f7e573ff700 1 -- 172.21.15.5:0/4050542902 wait complete. 2023-10-07T00:12:56.187 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:12:56.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:12:56.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:55 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/181043686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:56.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:55 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3019396933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:56.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:55 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2021367525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 -- 172.21.15.5:0/2834345151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 msgr2=0x7f9bcc102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/2834345151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 0x7f9bcc102610 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00099c0 tx=0x7f9bc0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 -- 172.21.15.5:0/2834345151 shutdown_connections 2023-10-07T00:12:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/2834345151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc102b50 0x7f9bcc109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/2834345151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc100fc0 0x7f9bcc1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/2834345151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 0x7f9bcc102610 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 -- 172.21.15.5:0/2834345151 >> 172.21.15.5:0/2834345151 conn(0x7f9bcc0fc530 msgr2=0x7f9bcc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:56.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 -- 172.21.15.5:0/2834345151 shutdown_connections 2023-10-07T00:12:56.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.393+0000 7f9bd27ff700 1 -- 172.21.15.5:0/2834345151 wait complete. 2023-10-07T00:12:56.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.394+0000 7f9bd27ff700 1 Processor -- start 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.394+0000 7f9bd27ff700 1 -- start start 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bd27ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc100fc0 0x7f9bcc198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bd27ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 0x7f9bcc1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bd27ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc102b50 0x7f9bcc1a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bd27ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc1a08f0 con 0x7f9bcc1021b0 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bd27ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc1a0a30 con 0x7f9bcc100fc0 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bd27ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc1a0bc0 con 0x7f9bcc102b50 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bcb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 0x7f9bcc1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bcb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 0x7f9bcc1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60218/0 (socket says 172.21.15.5:60218) 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bcb7fe700 1 -- 172.21.15.5:0/4173849110 learned_addr learned my addr 172.21.15.5:0/4173849110 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bcb7fe700 1 -- 172.21.15.5:0/4173849110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc102b50 msgr2=0x7f9bcc1a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bd0d9c700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc102b50 0x7f9bcc1a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bcbfff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc100fc0 0x7f9bcc198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bcb7fe700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc102b50 0x7f9bcc1a0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bcb7fe700 1 -- 172.21.15.5:0/4173849110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc100fc0 msgr2=0x7f9bcc198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.395+0000 7f9bcb7fe700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc100fc0 0x7f9bcc198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.396+0000 7f9bcb7fe700 1 -- 172.21.15.5:0/4173849110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc00095f0 con 0x7f9bcc1021b0 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.396+0000 7f9bcbfff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc100fc0 0x7f9bcc198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.396+0000 7f9bcb7fe700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 0x7f9bcc1992b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0000c00 tx=0x7f9bc000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.396+0000 7f9bc97fa700 1 -- 172.21.15.5:0/4173849110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc001d070 con 0x7f9bcc1021b0 2023-10-07T00:12:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.396+0000 7f9bc97fa700 1 -- 172.21.15.5:0/4173849110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bc00054e0 con 0x7f9bcc1021b0 2023-10-07T00:12:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.396+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc1a0e40 con 0x7f9bcc1021b0 2023-10-07T00:12:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.396+0000 7f9bc97fa700 1 -- 172.21.15.5:0/4173849110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0004c90 con 0x7f9bcc1021b0 2023-10-07T00:12:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.396+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc1a1200 con 0x7f9bcc1021b0 2023-10-07T00:12:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.397+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc1934d0 con 0x7f9bcc1021b0 2023-10-07T00:12:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.399+0000 7f9bc97fa700 1 -- 172.21.15.5:0/4173849110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9bc0005050 con 0x7f9bcc1021b0 2023-10-07T00:12:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.400+0000 7f9bc97fa700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9bb40a1480 0x7f9bb40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.401+0000 7f9bc97fa700 1 -- 172.21.15.5:0/4173849110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9bc00cde90 con 0x7f9bcc1021b0 2023-10-07T00:12:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.401+0000 7f9bcbfff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9bb40a1480 0x7f9bb40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.401+0000 7f9bcbfff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9bb40a1480 0x7f9bb40a3940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc102010 tx=0x7f9bbc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:56.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.403+0000 7f9bc97fa700 1 -- 172.21.15.5:0/4173849110 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9bc0097500 con 0x7f9bcc1021b0 2023-10-07T00:12:56.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.614+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bcc10c870 con 0x7f9bcc1021b0 2023-10-07T00:12:56.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.615+0000 7f9bc97fa700 1 -- 172.21.15.5:0/4173849110 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bc009ab20 con 0x7f9bcc1021b0 2023-10-07T00:12:56.616 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:12:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9bb40a1480 msgr2=0x7f9bb40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9bb40a1480 0x7f9bb40a3940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc102010 tx=0x7f9bbc009260 comp rx=0 tx=0).stop 2023-10-07T00:12:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 msgr2=0x7f9bcc1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 0x7f9bcc1992b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0000c00 tx=0x7f9bc000fab0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 shutdown_connections 2023-10-07T00:12:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9bb40a1480 0x7f9bb40a3940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc102b50 0x7f9bcc1a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc100fc0 0x7f9bcc198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 --2- 172.21.15.5:0/4173849110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bcc1021b0 0x7f9bcc1992b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 >> 172.21.15.5:0/4173849110 conn(0x7f9bcc0fc530 msgr2=0x7f9bcc107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 shutdown_connections 2023-10-07T00:12:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.617+0000 7f9bd27ff700 1 -- 172.21.15.5:0/4173849110 wait complete. 2023-10-07T00:12:56.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 -- 172.21.15.5:0/1981424747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e81021b0 msgr2=0x7f69e8102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 --2- 172.21.15.5:0/1981424747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e81021b0 0x7f69e8102610 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f69d40099c0 tx=0x7f69d4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 -- 172.21.15.5:0/1981424747 shutdown_connections 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 --2- 172.21.15.5:0/1981424747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69e8102b50 0x7f69e8109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 --2- 172.21.15.5:0/1981424747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e8100fc0 0x7f69e81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 --2- 172.21.15.5:0/1981424747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e81021b0 0x7f69e8102610 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 -- 172.21.15.5:0/1981424747 >> 172.21.15.5:0/1981424747 conn(0x7f69e80fc530 msgr2=0x7f69e80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 -- 172.21.15.5:0/1981424747 shutdown_connections 2023-10-07T00:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.847+0000 7f69eebff700 1 -- 172.21.15.5:0/1981424747 wait complete. 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.848+0000 7f69eebff700 1 Processor -- start 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.848+0000 7f69eebff700 1 -- start start 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69eebff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e8100fc0 0x7f69e8198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69eebff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e81021b0 0x7f69e8199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69eebff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69e8102b50 0x7f69e81a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69eebff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e81a0980 con 0x7f69e8100fc0 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69eebff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e81a0ac0 con 0x7f69e81021b0 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69eebff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e81a0c50 con 0x7f69e8102b50 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ec99b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e8100fc0 0x7f69e8198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ec99b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e8100fc0 0x7f69e8198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60236/0 (socket says 172.21.15.5:60236) 2023-10-07T00:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ec99b700 1 -- 172.21.15.5:0/1827372337 learned_addr learned my addr 172.21.15.5:0/1827372337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ed19c700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69e8102b50 0x7f69e81a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69e7fff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e81021b0 0x7f69e8199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ec99b700 1 -- 172.21.15.5:0/1827372337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69e8102b50 msgr2=0x7f69e81a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ec99b700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69e8102b50 0x7f69e81a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ec99b700 1 -- 172.21.15.5:0/1827372337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e81021b0 msgr2=0x7f69e8199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ec99b700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e81021b0 0x7f69e8199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ec99b700 1 -- 172.21.15.5:0/1827372337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d40095f0 con 0x7f69e8100fc0 2023-10-07T00:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69e7fff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e81021b0 0x7f69e8199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.849+0000 7f69ed19c700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69e8102b50 0x7f69e81a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.850+0000 7f69ec99b700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e8100fc0 0x7f69e8198e00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00e970 tx=0x7f69dc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.850+0000 7f69e5ffb700 1 -- 172.21.15.5:0/1827372337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc009790 con 0x7f69e8100fc0 2023-10-07T00:12:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.850+0000 7f69e5ffb700 1 -- 172.21.15.5:0/1827372337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69dc0044b0 con 0x7f69e8100fc0 2023-10-07T00:12:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.850+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e81a0f30 con 0x7f69e8100fc0 2023-10-07T00:12:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.850+0000 7f69e5ffb700 1 -- 172.21.15.5:0/1827372337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc003dd0 con 0x7f69e8100fc0 2023-10-07T00:12:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.850+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e81a1350 con 0x7f69e8100fc0 2023-10-07T00:12:56.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.851+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e81934d0 con 0x7f69e8100fc0 2023-10-07T00:12:56.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.853+0000 7f69e5ffb700 1 -- 172.21.15.5:0/1827372337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f69dc004000 con 0x7f69e8100fc0 2023-10-07T00:12:56.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.855+0000 7f69e5ffb700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f69d80a1480 0x7f69d80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:56.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.856+0000 7f69e5ffb700 1 -- 172.21.15.5:0/1827372337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f69dc014070 con 0x7f69e8100fc0 2023-10-07T00:12:56.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.856+0000 7f69e7fff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f69d80a1480 0x7f69d80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:56.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.857+0000 7f69e7fff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f69d80a1480 0x7f69d80a3940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f69d40098e0 tx=0x7f69d400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:56.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:56.859+0000 7f69e5ffb700 1 -- 172.21.15.5:0/1827372337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f69dc096660 con 0x7f69e8100fc0 2023-10-07T00:12:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:56 smithi112 ceph-mon[133548]: pgmap v351: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-10-07T00:12:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:56 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4050542902' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:56.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:56 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4173849110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:57.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.071+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69e802cf70 con 0x7f69e8100fc0 2023-10-07T00:12:57.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.071+0000 7f69e5ffb700 1 -- 172.21.15.5:0/1827372337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69dc099c80 con 0x7f69e8100fc0 2023-10-07T00:12:57.073 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:12:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.073+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f69d80a1480 msgr2=0x7f69d80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.073+0000 7f69eebff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f69d80a1480 0x7f69d80a3940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f69d40098e0 tx=0x7f69d400b540 comp rx=0 tx=0).stop 2023-10-07T00:12:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.073+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e8100fc0 msgr2=0x7f69e8198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.073+0000 7f69eebff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e8100fc0 0x7f69e8198e00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00e970 tx=0x7f69dc00ed30 comp rx=0 tx=0).stop 2023-10-07T00:12:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.074+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 shutdown_connections 2023-10-07T00:12:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.074+0000 7f69eebff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f69d80a1480 0x7f69d80a3940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.074+0000 7f69eebff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69e8102b50 0x7f69e81a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.074+0000 7f69eebff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69e8100fc0 0x7f69e8198e00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.074+0000 7f69eebff700 1 --2- 172.21.15.5:0/1827372337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e81021b0 0x7f69e8199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.074+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 >> 172.21.15.5:0/1827372337 conn(0x7f69e80fc530 msgr2=0x7f69e8107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.074+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 shutdown_connections 2023-10-07T00:12:57.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.074+0000 7f69eebff700 1 -- 172.21.15.5:0/1827372337 wait complete. 2023-10-07T00:12:57.090 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:56 smithi005 ceph-mon[129406]: pgmap v351: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-10-07T00:12:57.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:56 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4050542902' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:57.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:56 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4173849110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:57.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:12:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:56 smithi088 ceph-mon[103111]: pgmap v351: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-10-07T00:12:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:56 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4050542902' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:12:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:56 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4173849110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:12:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 -- 172.21.15.5:0/3295701099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230100fc0 msgr2=0x7fe2301013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3295701099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230100fc0 0x7fe2301013e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0099c0 tx=0x7fe22c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 -- 172.21.15.5:0/3295701099 shutdown_connections 2023-10-07T00:12:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3295701099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe230102b50 0x7fe230109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3295701099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230100fc0 0x7fe2301013e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3295701099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2301021b0 0x7fe230102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 -- 172.21.15.5:0/3295701099 >> 172.21.15.5:0/3295701099 conn(0x7fe2300fc530 msgr2=0x7fe2300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 -- 172.21.15.5:0/3295701099 shutdown_connections 2023-10-07T00:12:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.298+0000 7fe2377ff700 1 -- 172.21.15.5:0/3295701099 wait complete. 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.299+0000 7fe2377ff700 1 Processor -- start 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.299+0000 7fe2377ff700 1 -- start start 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe2377ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe230100fc0 0x7fe230198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe2377ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2301021b0 0x7fe230199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe2377ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230102b50 0x7fe2301a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe2377ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2301a0970 con 0x7fe230100fc0 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe2377ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2301a0ab0 con 0x7fe230102b50 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe2377ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2301a0c40 con 0x7fe2301021b0 2023-10-07T00:12:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe23559b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe230100fc0 0x7fe230198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe23559b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe230100fc0 0x7fe230198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60260/0 (socket says 172.21.15.5:60260) 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe23559b700 1 -- 172.21.15.5:0/3224670327 learned_addr learned my addr 172.21.15.5:0/3224670327 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe234d9a700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2301021b0 0x7fe230199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe235d9c700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230102b50 0x7fe2301a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe23559b700 1 -- 172.21.15.5:0/3224670327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2301021b0 msgr2=0x7fe230199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe23559b700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2301021b0 0x7fe230199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe23559b700 1 -- 172.21.15.5:0/3224670327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230102b50 msgr2=0x7fe2301a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe23559b700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230102b50 0x7fe2301a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe23559b700 1 -- 172.21.15.5:0/3224670327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0095f0 con 0x7fe230100fc0 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.300+0000 7fe235d9c700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230102b50 0x7fe2301a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:12:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.301+0000 7fe23559b700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe230100fc0 0x7fe230198df0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe22c000c00 tx=0x7fe22c00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.301+0000 7fe2267fc700 1 -- 172.21.15.5:0/3224670327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c01d070 con 0x7fe230100fc0 2023-10-07T00:12:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.301+0000 7fe2267fc700 1 -- 172.21.15.5:0/3224670327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe22c00bcf0 con 0x7fe230100fc0 2023-10-07T00:12:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.301+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2301a0ec0 con 0x7fe230100fc0 2023-10-07T00:12:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.301+0000 7fe2267fc700 1 -- 172.21.15.5:0/3224670327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c004bb0 con 0x7fe230100fc0 2023-10-07T00:12:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.301+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2301a1230 con 0x7fe230100fc0 2023-10-07T00:12:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.302+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23010c6d0 con 0x7fe230100fc0 2023-10-07T00:12:57.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.304+0000 7fe2267fc700 1 -- 172.21.15.5:0/3224670327 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe22c004d10 con 0x7fe230100fc0 2023-10-07T00:12:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.306+0000 7fe2267fc700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe21c0a1480 0x7fe21c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.306+0000 7fe2267fc700 1 -- 172.21.15.5:0/3224670327 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe22c0cdfc0 con 0x7fe230100fc0 2023-10-07T00:12:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.306+0000 7fe234d9a700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe21c0a1480 0x7fe21c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.306+0000 7fe234d9a700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe21c0a1480 0x7fe21c0a3940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe220009bf0 tx=0x7fe220009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.308+0000 7fe2267fc700 1 -- 172.21.15.5:0/3224670327 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe22c097630 con 0x7fe230100fc0 2023-10-07T00:12:57.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.521+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2301a1420 con 0x7fe230100fc0 2023-10-07T00:12:57.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.521+0000 7fe2267fc700 1 -- 172.21.15.5:0/3224670327 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe22c09ac50 con 0x7fe230100fc0 2023-10-07T00:12:57.523 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:12:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe21c0a1480 msgr2=0x7fe21c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe21c0a1480 0x7fe21c0a3940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe220009bf0 tx=0x7fe220009260 comp rx=0 tx=0).stop 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe230100fc0 msgr2=0x7fe230198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe230100fc0 0x7fe230198df0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe22c000c00 tx=0x7fe22c00fab0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 shutdown_connections 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe21c0a1480 0x7fe21c0a3940 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe230102b50 0x7fe2301a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe230100fc0 0x7fe230198df0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 --2- 172.21.15.5:0/3224670327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2301021b0 0x7fe230199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 >> 172.21.15.5:0/3224670327 conn(0x7fe2300fc530 msgr2=0x7fe2300fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 shutdown_connections 2023-10-07T00:12:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.524+0000 7fe2377ff700 1 -- 172.21.15.5:0/3224670327 wait complete. 2023-10-07T00:12:57.544 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-07T00:12:57.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:12:57.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 -- 172.21.15.5:0/3697740600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38106c70 msgr2=0x7fdb381090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/3697740600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38106c70 0x7fdb381090e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000b0a0 tx=0x7fdb3000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 -- 172.21.15.5:0/3697740600 shutdown_connections 2023-10-07T00:12:57.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/3697740600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38106c70 0x7fdb381090e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/3697740600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb38101a10 0x7fdb38103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/3697740600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb38104340 0x7fdb38106730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 -- 172.21.15.5:0/3697740600 >> 172.21.15.5:0/3697740600 conn(0x7fdb380fb420 msgr2=0x7fdb380fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:57.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 -- 172.21.15.5:0/3697740600 shutdown_connections 2023-10-07T00:12:57.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.748+0000 7fdb3cbff700 1 -- 172.21.15.5:0/3697740600 wait complete. 2023-10-07T00:12:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.749+0000 7fdb3cbff700 1 Processor -- start 2023-10-07T00:12:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.749+0000 7fdb3cbff700 1 -- start start 2023-10-07T00:12:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.749+0000 7fdb3cbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb38101a10 0x7fdb38198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.749+0000 7fdb3cbff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38104340 0x7fdb38199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.749+0000 7fdb3cbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb38106c70 0x7fdb381a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.749+0000 7fdb3cbff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb381a09d0 con 0x7fdb38104340 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.749+0000 7fdb3cbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb381a0b10 con 0x7fdb38101a10 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.749+0000 7fdb3cbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb381a0ca0 con 0x7fdb38106c70 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb35d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38104340 0x7fdb38199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb3659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb38101a10 0x7fdb38198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb36d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb38106c70 0x7fdb381a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb3659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb38101a10 0x7fdb38198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:48250/0 (socket says 172.21.15.5:48250) 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb3659c700 1 -- 172.21.15.5:0/359527918 learned_addr learned my addr 172.21.15.5:0/359527918 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb35d9b700 1 -- 172.21.15.5:0/359527918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb38106c70 msgr2=0x7fdb381a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb35d9b700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb38106c70 0x7fdb381a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb35d9b700 1 -- 172.21.15.5:0/359527918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb38101a10 msgr2=0x7fdb38198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb35d9b700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb38101a10 0x7fdb38198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb35d9b700 1 -- 172.21.15.5:0/359527918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb30009d00 con 0x7fdb38104340 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.750+0000 7fdb35d9b700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38104340 0x7fdb38199390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00e9f0 tx=0x7fdb2c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.751+0000 7fdb277fe700 1 -- 172.21.15.5:0/359527918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00c9c0 con 0x7fdb38104340 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.751+0000 7fdb277fe700 1 -- 172.21.15.5:0/359527918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb2c010430 con 0x7fdb38104340 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.751+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb381a0f80 con 0x7fdb38104340 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.751+0000 7fdb277fe700 1 -- 172.21.15.5:0/359527918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c018680 con 0x7fdb38104340 2023-10-07T00:12:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.751+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb381a1400 con 0x7fdb38104340 2023-10-07T00:12:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.752+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb381087f0 con 0x7fdb38104340 2023-10-07T00:12:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.754+0000 7fdb277fe700 1 -- 172.21.15.5:0/359527918 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdb2c0105a0 con 0x7fdb38104340 2023-10-07T00:12:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.755+0000 7fdb277fe700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb200a1480 0x7fdb200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.756+0000 7fdb277fe700 1 -- 172.21.15.5:0/359527918 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdb2c014070 con 0x7fdb38104340 2023-10-07T00:12:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.756+0000 7fdb3659c700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb200a1480 0x7fdb200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.756+0000 7fdb3659c700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb200a1480 0x7fdb200a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009d20 tx=0x7fdb28009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:57.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:57.757+0000 7fdb277fe700 1 -- 172.21.15.5:0/359527918 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdb2c096750 con 0x7fdb38104340 2023-10-07T00:12:57.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:57 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1827372337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:57.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:57 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3224670327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:57 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1827372337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:57 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3224670327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.020+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb3810c870 con 0x7fdb38104340 2023-10-07T00:12:58.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.021+0000 7fdb277fe700 1 -- 172.21.15.5:0/359527918 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7fdb2c099d70 con 0x7fdb38104340 2023-10-07T00:12:58.022 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:58.023 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:12:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb200a1480 msgr2=0x7fdb200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb200a1480 0x7fdb200a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009d20 tx=0x7fdb28009260 comp rx=0 tx=0).stop 2023-10-07T00:12:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38104340 msgr2=0x7fdb38199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38104340 0x7fdb38199390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00e9f0 tx=0x7fdb2c00ed00 comp rx=0 tx=0).stop 2023-10-07T00:12:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 shutdown_connections 2023-10-07T00:12:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fdb200a1480 0x7fdb200a3940 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb38106c70 0x7fdb381a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb38101a10 0x7fdb38198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 --2- 172.21.15.5:0/359527918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb38104340 0x7fdb38199390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 >> 172.21.15.5:0/359527918 conn(0x7fdb380fb420 msgr2=0x7fdb381000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 shutdown_connections 2023-10-07T00:12:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.024+0000 7fdb3cbff700 1 -- 172.21.15.5:0/359527918 wait complete. 2023-10-07T00:12:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:12:58.043 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-07T00:12:58.043 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-07T00:12:58.044 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T00:12:58.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:57 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1827372337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:12:58.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:57 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3224670327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:12:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/115592374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e441021a0 msgr2=0x7f2e44102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/115592374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e441021a0 0x7f2e44102600 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2e380099c0 tx=0x7f2e38009cd0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/115592374 shutdown_connections 2023-10-07T00:12:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/115592374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e44102b40 0x7f2e441093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/115592374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e44100fb0 0x7f2e441013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/115592374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e441021a0 0x7f2e44102600 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/115592374 >> 172.21.15.5:0/115592374 conn(0x7f2e440fc520 msgr2=0x7f2e440fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/115592374 shutdown_connections 2023-10-07T00:12:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.245+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/115592374 wait complete. 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.246+0000 7f2e4a7ff700 1 Processor -- start 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e4a7ff700 1 -- start start 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e4a7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e44100fb0 0x7f2e44196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e4a7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e441021a0 0x7f2e44197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e4a7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e44102b40 0x7f2e4419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e4a7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4419e770 con 0x7f2e44100fb0 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e4a7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4419e8b0 con 0x7f2e44102b40 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e4a7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4419ea40 con 0x7f2e441021a0 2023-10-07T00:12:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e43fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e44100fb0 0x7f2e44196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e43fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e44100fb0 0x7f2e44196bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60294/0 (socket says 172.21.15.5:60294) 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e43fff700 1 -- 172.21.15.5:0/379438014 learned_addr learned my addr 172.21.15.5:0/379438014 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e437fe700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e441021a0 0x7f2e44197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.247+0000 7f2e48d9c700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e44102b40 0x7f2e4419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e43fff700 1 -- 172.21.15.5:0/379438014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e441021a0 msgr2=0x7f2e44197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e43fff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e441021a0 0x7f2e44197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e43fff700 1 -- 172.21.15.5:0/379438014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e44102b40 msgr2=0x7f2e4419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e43fff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e44102b40 0x7f2e4419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e43fff700 1 -- 172.21.15.5:0/379438014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e380095f0 con 0x7f2e44100fb0 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e48d9c700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e44102b40 0x7f2e4419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e43fff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e44100fb0 0x7f2e44196bf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400d980 tx=0x7f2e3400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e417fa700 1 -- 172.21.15.5:0/379438014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3400b950 con 0x7f2e44100fb0 2023-10-07T00:12:58.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e417fa700 1 -- 172.21.15.5:0/379438014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e34007620 con 0x7f2e44100fb0 2023-10-07T00:12:58.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4419ed20 con 0x7f2e44100fb0 2023-10-07T00:12:58.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e417fa700 1 -- 172.21.15.5:0/379438014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3400f3c0 con 0x7f2e44100fb0 2023-10-07T00:12:58.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.248+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4419f1d0 con 0x7f2e44100fb0 2023-10-07T00:12:58.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.249+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e441085f0 con 0x7f2e44100fb0 2023-10-07T00:12:58.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.251+0000 7f2e417fa700 1 -- 172.21.15.5:0/379438014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2e3400bab0 con 0x7f2e44100fb0 2023-10-07T00:12:58.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.253+0000 7f2e417fa700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2e2c0a1500 0x7f2e2c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:58.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.253+0000 7f2e417fa700 1 -- 172.21.15.5:0/379438014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2e340cce80 con 0x7f2e44100fb0 2023-10-07T00:12:58.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.253+0000 7f2e437fe700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2e2c0a1500 0x7f2e2c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:58.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.253+0000 7f2e437fe700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2e2c0a1500 0x7f2e2c0a39c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2e38006010 tx=0x7f2e38009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.257+0000 7f2e417fa700 1 -- 172.21.15.5:0/379438014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2e34096460 con 0x7f2e44100fb0 2023-10-07T00:12:58.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.464+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e4402d390 con 0x7f2e2c0a1500 2023-10-07T00:12:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.476+0000 7f2e417fa700 1 -- 172.21.15.5:0/379438014 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344574 (secure 0 0 0) 0x7f2e4402d390 con 0x7f2e2c0a1500 2023-10-07T00:12:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2e2c0a1500 msgr2=0x7f2e2c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2e2c0a1500 0x7f2e2c0a39c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2e38006010 tx=0x7f2e38009f10 comp rx=0 tx=0).stop 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e44100fb0 msgr2=0x7f2e44196bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e44100fb0 0x7f2e44196bf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400d980 tx=0x7f2e3400dc90 comp rx=0 tx=0).stop 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 shutdown_connections 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2e2c0a1500 0x7f2e2c0a39c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e44102b40 0x7f2e4419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e44100fb0 0x7f2e44196bf0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 --2- 172.21.15.5:0/379438014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e441021a0 0x7f2e44197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 >> 172.21.15.5:0/379438014 conn(0x7f2e440fc520 msgr2=0x7f2e44105730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 shutdown_connections 2023-10-07T00:12:58.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.481+0000 7f2e4a7ff700 1 -- 172.21.15.5:0/379438014 wait complete. 2023-10-07T00:12:58.487 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-07T00:12:58.502 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2023-10-07T00:12:57.669484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656751,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1112,"num_read_kb":677,"num_write":433,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1238300,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335924,"kb_used_data":11732,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605900,"statfs":{"total":1151940427776,"available":1151596441600,"internally_reserved":0,"allocated":12013568,"data_stored":7475553,"data_compressed":186885,"data_compressed_allocated":245760,"data_compressed_original":2019328,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2885,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":62,"num_write":19,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003500"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.700840+0000","last_change":"2023-10-07T00:11:13.845315+0000","last_active":"2023-10-07T00:12:49.700840+0000","last_peered":"2023-10-07T00:12:49.700840+0000","last_clean":"2023-10-07T00:12:49.700840+0000","last_became_active":"2023-10-07T00:11:13.844330+0000","last_became_peered":"2023-10-07T00:11:13.844330+0000","last_unstale":"2023-10-07T00:12:49.700840+0000","last_undegraded":"2023-10-07T00:12:49.700840+0000","last_fullsized":"2023-10-07T00:12:49.700840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:26.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694353+0000","last_change":"2023-10-07T00:11:13.842602+0000","last_active":"2023-10-07T00:12:49.694353+0000","last_peered":"2023-10-07T00:12:49.694353+0000","last_clean":"2023-10-07T00:12:49.694353+0000","last_became_active":"2023-10-07T00:11:13.842296+0000","last_became_peered":"2023-10-07T00:11:13.842296+0000","last_unstale":"2023-10-07T00:12:49.694353+0000","last_undegraded":"2023-10-07T00:12:49.694353+0000","last_fullsized":"2023-10-07T00:12:49.694353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:51.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699118+0000","last_change":"2023-10-07T00:11:13.850567+0000","last_active":"2023-10-07T00:12:49.699118+0000","last_peered":"2023-10-07T00:12:49.699118+0000","last_clean":"2023-10-07T00:12:49.699118+0000","last_became_active":"2023-10-07T00:11:13.850212+0000","last_became_peered":"2023-10-07T00:11:13.850212+0000","last_unstale":"2023-10-07T00:12:49.699118+0000","last_undegraded":"2023-10-07T00:12:49.699118+0000","last_fullsized":"2023-10-07T00:12:49.699118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:51.539752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.672512+0000","last_change":"2023-10-07T00:11:13.839742+0000","last_active":"2023-10-07T00:12:49.672512+0000","last_peered":"2023-10-07T00:12:49.672512+0000","last_clean":"2023-10-07T00:12:49.672512+0000","last_became_active":"2023-10-07T00:11:13.839041+0000","last_became_peered":"2023-10-07T00:11:13.839041+0000","last_unstale":"2023-10-07T00:12:49.672512+0000","last_undegraded":"2023-10-07T00:12:49.672512+0000","last_fullsized":"2023-10-07T00:12:49.672512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:59.241248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.670248+0000","last_change":"2023-10-07T00:11:13.834839+0000","last_active":"2023-10-07T00:12:49.670248+0000","last_peered":"2023-10-07T00:12:49.670248+0000","last_clean":"2023-10-07T00:12:49.670248+0000","last_became_active":"2023-10-07T00:11:13.834529+0000","last_became_peered":"2023-10-07T00:11:13.834529+0000","last_unstale":"2023-10-07T00:12:49.670248+0000","last_undegraded":"2023-10-07T00:12:49.670248+0000","last_fullsized":"2023-10-07T00:12:49.670248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:23.831424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.682684+0000","last_change":"2023-10-07T00:11:13.835102+0000","last_active":"2023-10-07T00:12:49.682684+0000","last_peered":"2023-10-07T00:12:49.682684+0000","last_clean":"2023-10-07T00:12:49.682684+0000","last_became_active":"2023-10-07T00:11:13.834781+0000","last_became_peered":"2023-10-07T00:11:13.834781+0000","last_unstale":"2023-10-07T00:12:49.682684+0000","last_undegraded":"2023-10-07T00:12:49.682684+0000","last_fullsized":"2023-10-07T00:12:49.682684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:16:55.912464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.697844+0000","last_change":"2023-10-07T00:11:50.781822+0000","last_active":"2023-10-07T00:12:49.697844+0000","last_peered":"2023-10-07T00:12:49.697844+0000","last_clean":"2023-10-07T00:12:49.697844+0000","last_became_active":"2023-10-07T00:11:50.781261+0000","last_became_peered":"2023-10-07T00:11:50.781261+0000","last_unstale":"2023-10-07T00:12:49.697844+0000","last_undegraded":"2023-10-07T00:12:49.697844+0000","last_fullsized":"2023-10-07T00:12:49.697844+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:16.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689182+0000","last_change":"2023-10-07T00:11:13.842772+0000","last_active":"2023-10-07T00:12:49.689182+0000","last_peered":"2023-10-07T00:12:49.689182+0000","last_clean":"2023-10-07T00:12:49.689182+0000","last_became_active":"2023-10-07T00:11:13.841610+0000","last_became_peered":"2023-10-07T00:11:13.841610+0000","last_unstale":"2023-10-07T00:12:49.689182+0000","last_undegraded":"2023-10-07T00:12:49.689182+0000","last_fullsized":"2023-10-07T00:12:49.689182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:04:51.988705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693881+0000","last_change":"2023-10-07T00:11:13.836990+0000","last_active":"2023-10-07T00:12:49.693881+0000","last_peered":"2023-10-07T00:12:49.693881+0000","last_clean":"2023-10-07T00:12:49.693881+0000","last_became_active":"2023-10-07T00:11:13.836699+0000","last_became_peered":"2023-10-07T00:11:13.836699+0000","last_unstale":"2023-10-07T00:12:49.693881+0000","last_undegraded":"2023-10-07T00:12:49.693881+0000","last_fullsized":"2023-10-07T00:12:49.693881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:18:20.450573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695597+0000","last_change":"2023-10-07T00:11:50.736801+0000","last_active":"2023-10-07T00:12:49.695597+0000","last_peered":"2023-10-07T00:12:49.695597+0000","last_clean":"2023-10-07T00:12:49.695597+0000","last_became_active":"2023-10-07T00:11:50.736256+0000","last_became_peered":"2023-10-07T00:11:50.736256+0000","last_unstale":"2023-10-07T00:12:49.695597+0000","last_undegraded":"2023-10-07T00:12:49.695597+0000","last_fullsized":"2023-10-07T00:12:49.695597+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:35.622108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701841+0000","last_change":"2023-10-07T00:11:13.841699+0000","last_active":"2023-10-07T00:12:49.701841+0000","last_peered":"2023-10-07T00:12:49.701841+0000","last_clean":"2023-10-07T00:12:49.701841+0000","last_became_active":"2023-10-07T00:11:13.841295+0000","last_became_peered":"2023-10-07T00:11:13.841295+0000","last_unstale":"2023-10-07T00:12:49.701841+0000","last_undegraded":"2023-10-07T00:12:49.701841+0000","last_fullsized":"2023-10-07T00:12:49.701841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:24:56.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.683142+0000","last_change":"2023-10-07T00:11:13.839951+0000","last_active":"2023-10-07T00:12:49.683142+0000","last_peered":"2023-10-07T00:12:49.683142+0000","last_clean":"2023-10-07T00:12:49.683142+0000","last_became_active":"2023-10-07T00:11:13.839473+0000","last_became_peered":"2023-10-07T00:11:13.839473+0000","last_unstale":"2023-10-07T00:12:49.683142+0000","last_undegraded":"2023-10-07T00:12:49.683142+0000","last_fullsized":"2023-10-07T00:12:49.683142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687310+0000","last_change":"2023-10-07T00:11:13.838714+0000","last_active":"2023-10-07T00:12:49.687310+0000","last_peered":"2023-10-07T00:12:49.687310+0000","last_clean":"2023-10-07T00:12:49.687310+0000","last_became_active":"2023-10-07T00:11:13.838222+0000","last_became_peered":"2023-10-07T00:11:13.838222+0000","last_unstale":"2023-10-07T00:12:49.687310+0000","last_undegraded":"2023-10-07T00:12:49.687310+0000","last_fullsized":"2023-10-07T00:12:49.687310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:11:43.194204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694768+0000","last_change":"2023-10-07T00:11:13.843075+0000","last_active":"2023-10-07T00:12:49.694768+0000","last_peered":"2023-10-07T00:12:49.694768+0000","last_clean":"2023-10-07T00:12:49.694768+0000","last_became_active":"2023-10-07T00:11:13.842742+0000","last_became_peered":"2023-10-07T00:11:13.842742+0000","last_unstale":"2023-10-07T00:12:49.694768+0000","last_undegraded":"2023-10-07T00:12:49.694768+0000","last_fullsized":"2023-10-07T00:12:49.694768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:53:12.713979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.692979+0000","last_change":"2023-10-07T00:11:13.841635+0000","last_active":"2023-10-07T00:12:49.692979+0000","last_peered":"2023-10-07T00:12:49.692979+0000","last_clean":"2023-10-07T00:12:49.692979+0000","last_became_active":"2023-10-07T00:11:13.841291+0000","last_became_peered":"2023-10-07T00:11:13.841291+0000","last_unstale":"2023-10-07T00:12:49.692979+0000","last_undegraded":"2023-10-07T00:12:49.692979+0000","last_fullsized":"2023-10-07T00:12:49.692979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:48:38.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701753+0000","last_change":"2023-10-07T00:11:13.842365+0000","last_active":"2023-10-07T00:12:49.701753+0000","last_peered":"2023-10-07T00:12:49.701753+0000","last_clean":"2023-10-07T00:12:49.701753+0000","last_became_active":"2023-10-07T00:11:13.842057+0000","last_became_peered":"2023-10-07T00:11:13.842057+0000","last_unstale":"2023-10-07T00:12:49.701753+0000","last_undegraded":"2023-10-07T00:12:49.701753+0000","last_fullsized":"2023-10-07T00:12:49.701753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:36.575712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701353+0000","last_change":"2023-10-07T00:11:13.845746+0000","last_active":"2023-10-07T00:12:49.701353+0000","last_peered":"2023-10-07T00:12:49.701353+0000","last_clean":"2023-10-07T00:12:49.701353+0000","last_became_active":"2023-10-07T00:11:13.844828+0000","last_became_peered":"2023-10-07T00:11:13.844828+0000","last_unstale":"2023-10-07T00:12:49.701353+0000","last_undegraded":"2023-10-07T00:12:49.701353+0000","last_fullsized":"2023-10-07T00:12:49.701353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:34:00.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698936+0000","last_change":"2023-10-07T00:11:13.837749+0000","last_active":"2023-10-07T00:12:49.698936+0000","last_peered":"2023-10-07T00:12:49.698936+0000","last_clean":"2023-10-07T00:12:49.698936+0000","last_became_active":"2023-10-07T00:11:13.837400+0000","last_became_peered":"2023-10-07T00:11:13.837400+0000","last_unstale":"2023-10-07T00:12:49.698936+0000","last_undegraded":"2023-10-07T00:12:49.698936+0000","last_fullsized":"2023-10-07T00:12:49.698936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:40.190065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.683546+0000","last_change":"2023-10-07T00:11:13.833086+0000","last_active":"2023-10-07T00:12:49.683546+0000","last_peered":"2023-10-07T00:12:49.683546+0000","last_clean":"2023-10-07T00:12:49.683546+0000","last_became_active":"2023-10-07T00:11:13.832748+0000","last_became_peered":"2023-10-07T00:11:13.832748+0000","last_unstale":"2023-10-07T00:12:49.683546+0000","last_undegraded":"2023-10-07T00:12:49.683546+0000","last_fullsized":"2023-10-07T00:12:49.683546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:29.176224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.825126+0000","last_change":"2023-10-07T00:11:12.835440+0000","last_active":"2023-10-07T00:12:52.825126+0000","last_peered":"2023-10-07T00:12:52.825126+0000","last_clean":"2023-10-07T00:12:52.825126+0000","last_became_active":"2023-10-07T00:11:12.835094+0000","last_became_peered":"2023-10-07T00:11:12.835094+0000","last_unstale":"2023-10-07T00:12:52.825126+0000","last_undegraded":"2023-10-07T00:12:52.825126+0000","last_fullsized":"2023-10-07T00:12:52.825126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:13.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.680178+0000","last_change":"2023-10-07T00:11:13.847832+0000","last_active":"2023-10-07T00:12:49.680178+0000","last_peered":"2023-10-07T00:12:49.680178+0000","last_clean":"2023-10-07T00:12:49.680178+0000","last_became_active":"2023-10-07T00:11:13.847436+0000","last_became_peered":"2023-10-07T00:11:13.847436+0000","last_unstale":"2023-10-07T00:12:49.680178+0000","last_undegraded":"2023-10-07T00:12:49.680178+0000","last_fullsized":"2023-10-07T00:12:49.680178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:47:07.409132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732015+0000","last_change":"2023-10-07T00:11:12.842832+0000","last_active":"2023-10-07T00:11:49.732015+0000","last_peered":"2023-10-07T00:11:49.732015+0000","last_clean":"2023-10-07T00:11:49.732015+0000","last_became_active":"2023-10-07T00:11:12.842296+0000","last_became_peered":"2023-10-07T00:11:12.842296+0000","last_unstale":"2023-10-07T00:11:49.732015+0000","last_undegraded":"2023-10-07T00:11:49.732015+0000","last_fullsized":"2023-10-07T00:11:49.732015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:00.968303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699705+0000","last_change":"2023-10-07T00:11:13.851259+0000","last_active":"2023-10-07T00:12:49.699705+0000","last_peered":"2023-10-07T00:12:49.699705+0000","last_clean":"2023-10-07T00:12:49.699705+0000","last_became_active":"2023-10-07T00:11:13.850963+0000","last_became_peered":"2023-10-07T00:11:13.850963+0000","last_unstale":"2023-10-07T00:12:49.699705+0000","last_undegraded":"2023-10-07T00:12:49.699705+0000","last_fullsized":"2023-10-07T00:12:49.699705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:52.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726990+0000","last_change":"2023-10-07T00:11:12.835286+0000","last_active":"2023-10-07T00:11:49.726990+0000","last_peered":"2023-10-07T00:11:49.726990+0000","last_clean":"2023-10-07T00:11:49.726990+0000","last_became_active":"2023-10-07T00:11:12.834890+0000","last_became_peered":"2023-10-07T00:11:12.834890+0000","last_unstale":"2023-10-07T00:11:49.726990+0000","last_undegraded":"2023-10-07T00:11:49.726990+0000","last_fullsized":"2023-10-07T00:11:49.726990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:06:05.225849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699004+0000","last_change":"2023-10-07T00:11:13.831174+0000","last_active":"2023-10-07T00:12:49.699004+0000","last_peered":"2023-10-07T00:12:49.699004+0000","last_clean":"2023-10-07T00:12:49.699004+0000","last_became_active":"2023-10-07T00:11:13.830868+0000","last_became_peered":"2023-10-07T00:11:13.830868+0000","last_unstale":"2023-10-07T00:12:49.699004+0000","last_undegraded":"2023-10-07T00:12:49.699004+0000","last_fullsized":"2023-10-07T00:12:49.699004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:20.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726737+0000","last_change":"2023-10-07T00:11:12.835740+0000","last_active":"2023-10-07T00:11:49.726737+0000","last_peered":"2023-10-07T00:11:49.726737+0000","last_clean":"2023-10-07T00:11:49.726737+0000","last_became_active":"2023-10-07T00:11:12.835035+0000","last_became_peered":"2023-10-07T00:11:12.835035+0000","last_unstale":"2023-10-07T00:11:49.726737+0000","last_undegraded":"2023-10-07T00:11:49.726737+0000","last_fullsized":"2023-10-07T00:11:49.726737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:36:07.447748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693850+0000","last_change":"2023-10-07T00:11:13.847940+0000","last_active":"2023-10-07T00:12:49.693850+0000","last_peered":"2023-10-07T00:12:49.693850+0000","last_clean":"2023-10-07T00:12:49.693850+0000","last_became_active":"2023-10-07T00:11:13.847595+0000","last_became_peered":"2023-10-07T00:11:13.847595+0000","last_unstale":"2023-10-07T00:12:49.693850+0000","last_undegraded":"2023-10-07T00:12:49.693850+0000","last_fullsized":"2023-10-07T00:12:49.693850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:28.004429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.844277+0000","last_change":"2023-10-07T00:11:50.743813+0000","last_active":"2023-10-07T00:12:52.844277+0000","last_peered":"2023-10-07T00:12:52.844277+0000","last_clean":"2023-10-07T00:12:52.844277+0000","last_became_active":"2023-10-07T00:11:50.739205+0000","last_became_peered":"2023-10-07T00:11:50.739205+0000","last_unstale":"2023-10-07T00:12:52.844277+0000","last_undegraded":"2023-10-07T00:12:52.844277+0000","last_fullsized":"2023-10-07T00:12:52.844277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:26.630097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1652,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686629+0000","last_change":"2023-10-07T00:11:13.838732+0000","last_active":"2023-10-07T00:12:49.686629+0000","last_peered":"2023-10-07T00:12:49.686629+0000","last_clean":"2023-10-07T00:12:49.686629+0000","last_became_active":"2023-10-07T00:11:13.838408+0000","last_became_peered":"2023-10-07T00:11:13.838408+0000","last_unstale":"2023-10-07T00:12:49.686629+0000","last_undegraded":"2023-10-07T00:12:49.686629+0000","last_fullsized":"2023-10-07T00:12:49.686629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:55:55.039399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736631+0000","last_change":"2023-10-07T00:11:12.831778+0000","last_active":"2023-10-07T00:11:49.736631+0000","last_peered":"2023-10-07T00:11:49.736631+0000","last_clean":"2023-10-07T00:11:49.736631+0000","last_became_active":"2023-10-07T00:11:12.831479+0000","last_became_peered":"2023-10-07T00:11:12.831479+0000","last_unstale":"2023-10-07T00:11:49.736631+0000","last_undegraded":"2023-10-07T00:11:49.736631+0000","last_fullsized":"2023-10-07T00:11:49.736631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:12:57.994585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.680858+0000","last_change":"2023-10-07T00:11:50.745021+0000","last_active":"2023-10-07T00:12:49.680858+0000","last_peered":"2023-10-07T00:12:49.680858+0000","last_clean":"2023-10-07T00:12:49.680858+0000","last_became_active":"2023-10-07T00:11:50.744570+0000","last_became_peered":"2023-10-07T00:11:50.744570+0000","last_unstale":"2023-10-07T00:12:49.680858+0000","last_undegraded":"2023-10-07T00:12:49.680858+0000","last_fullsized":"2023-10-07T00:12:49.680858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:54.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728874+0000","last_change":"2023-10-07T00:11:12.825556+0000","last_active":"2023-10-07T00:11:49.728874+0000","last_peered":"2023-10-07T00:11:49.728874+0000","last_clean":"2023-10-07T00:11:49.728874+0000","last_became_active":"2023-10-07T00:11:12.825189+0000","last_became_peered":"2023-10-07T00:11:12.825189+0000","last_unstale":"2023-10-07T00:11:49.728874+0000","last_undegraded":"2023-10-07T00:11:49.728874+0000","last_fullsized":"2023-10-07T00:11:49.728874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:20:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.691428+0000","last_change":"2023-10-07T00:11:50.781935+0000","last_active":"2023-10-07T00:12:49.691428+0000","last_peered":"2023-10-07T00:12:49.691428+0000","last_clean":"2023-10-07T00:12:49.691428+0000","last_became_active":"2023-10-07T00:11:50.781541+0000","last_became_peered":"2023-10-07T00:11:50.781541+0000","last_unstale":"2023-10-07T00:12:49.691428+0000","last_undegraded":"2023-10-07T00:12:49.691428+0000","last_fullsized":"2023-10-07T00:12:49.691428+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:29:18.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729367+0000","last_change":"2023-10-07T00:11:12.835239+0000","last_active":"2023-10-07T00:11:49.729367+0000","last_peered":"2023-10-07T00:11:49.729367+0000","last_clean":"2023-10-07T00:11:49.729367+0000","last_became_active":"2023-10-07T00:11:12.834912+0000","last_became_peered":"2023-10-07T00:11:12.834912+0000","last_unstale":"2023-10-07T00:11:49.729367+0000","last_undegraded":"2023-10-07T00:11:49.729367+0000","last_fullsized":"2023-10-07T00:11:49.729367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:32:44.097208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688131+0000","last_change":"2023-10-07T00:11:13.837642+0000","last_active":"2023-10-07T00:12:49.688131+0000","last_peered":"2023-10-07T00:12:49.688131+0000","last_clean":"2023-10-07T00:12:49.688131+0000","last_became_active":"2023-10-07T00:11:13.837291+0000","last_became_peered":"2023-10-07T00:11:13.837291+0000","last_unstale":"2023-10-07T00:12:49.688131+0000","last_undegraded":"2023-10-07T00:12:49.688131+0000","last_fullsized":"2023-10-07T00:12:49.688131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:19:14.445816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":213,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.814513+0000","last_change":"2023-10-07T00:11:12.826373+0000","last_active":"2023-10-07T00:12:54.814513+0000","last_peered":"2023-10-07T00:12:54.814513+0000","last_clean":"2023-10-07T00:12:54.814513+0000","last_became_active":"2023-10-07T00:11:12.826017+0000","last_became_peered":"2023-10-07T00:11:12.826017+0000","last_unstale":"2023-10-07T00:12:54.814513+0000","last_undegraded":"2023-10-07T00:12:54.814513+0000","last_fullsized":"2023-10-07T00:12:54.814513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:52:03.101632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":192,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699405+0000","last_change":"2023-10-07T00:11:13.830879+0000","last_active":"2023-10-07T00:12:49.699405+0000","last_peered":"2023-10-07T00:12:49.699405+0000","last_clean":"2023-10-07T00:12:49.699405+0000","last_became_active":"2023-10-07T00:11:13.830571+0000","last_became_peered":"2023-10-07T00:11:13.830571+0000","last_unstale":"2023-10-07T00:12:49.699405+0000","last_undegraded":"2023-10-07T00:12:49.699405+0000","last_fullsized":"2023-10-07T00:12:49.699405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:36.703499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726148+0000","last_change":"2023-10-07T00:11:12.833952+0000","last_active":"2023-10-07T00:11:49.726148+0000","last_peered":"2023-10-07T00:11:49.726148+0000","last_clean":"2023-10-07T00:11:49.726148+0000","last_became_active":"2023-10-07T00:11:12.833545+0000","last_became_peered":"2023-10-07T00:11:12.833545+0000","last_unstale":"2023-10-07T00:11:49.726148+0000","last_undegraded":"2023-10-07T00:11:49.726148+0000","last_fullsized":"2023-10-07T00:11:49.726148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:28:12.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695546+0000","last_change":"2023-10-07T00:11:13.843758+0000","last_active":"2023-10-07T00:12:49.695546+0000","last_peered":"2023-10-07T00:12:49.695546+0000","last_clean":"2023-10-07T00:12:49.695546+0000","last_became_active":"2023-10-07T00:11:13.843443+0000","last_became_peered":"2023-10-07T00:11:13.843443+0000","last_unstale":"2023-10-07T00:12:49.695546+0000","last_undegraded":"2023-10-07T00:12:49.695546+0000","last_fullsized":"2023-10-07T00:12:49.695546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:07:28.610304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729780+0000","last_change":"2023-10-07T00:11:12.833043+0000","last_active":"2023-10-07T00:11:49.729780+0000","last_peered":"2023-10-07T00:11:49.729780+0000","last_clean":"2023-10-07T00:11:49.729780+0000","last_became_active":"2023-10-07T00:11:12.832632+0000","last_became_peered":"2023-10-07T00:11:12.832632+0000","last_unstale":"2023-10-07T00:11:49.729780+0000","last_undegraded":"2023-10-07T00:11:49.729780+0000","last_fullsized":"2023-10-07T00:11:49.729780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:14:25.148603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.697495+0000","last_change":"2023-10-07T00:11:13.831129+0000","last_active":"2023-10-07T00:12:49.697495+0000","last_peered":"2023-10-07T00:12:49.697495+0000","last_clean":"2023-10-07T00:12:49.697495+0000","last_became_active":"2023-10-07T00:11:13.830365+0000","last_became_peered":"2023-10-07T00:11:13.830365+0000","last_unstale":"2023-10-07T00:12:49.697495+0000","last_undegraded":"2023-10-07T00:12:49.697495+0000","last_fullsized":"2023-10-07T00:12:49.697495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:22:00.580441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'32","reported_seq":270,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.893773+0000","last_change":"2023-10-07T00:11:50.782182+0000","last_active":"2023-10-07T00:12:54.893773+0000","last_peered":"2023-10-07T00:12:54.893773+0000","last_clean":"2023-10-07T00:12:54.893773+0000","last_became_active":"2023-10-07T00:11:50.774767+0000","last_became_peered":"2023-10-07T00:11:50.774767+0000","last_unstale":"2023-10-07T00:12:54.893773+0000","last_undegraded":"2023-10-07T00:12:54.893773+0000","last_fullsized":"2023-10-07T00:12:54.893773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:28:39.403496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57188,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":191,"num_read_kb":150,"num_write":34,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":56440,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688619+0000","last_change":"2023-10-07T00:11:13.832332+0000","last_active":"2023-10-07T00:12:49.688619+0000","last_peered":"2023-10-07T00:12:49.688619+0000","last_clean":"2023-10-07T00:12:49.688619+0000","last_became_active":"2023-10-07T00:11:13.832000+0000","last_became_peered":"2023-10-07T00:11:13.832000+0000","last_unstale":"2023-10-07T00:12:49.688619+0000","last_undegraded":"2023-10-07T00:12:49.688619+0000","last_fullsized":"2023-10-07T00:12:49.688619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:39.913331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733497+0000","last_change":"2023-10-07T00:11:12.839399+0000","last_active":"2023-10-07T00:11:49.733497+0000","last_peered":"2023-10-07T00:11:49.733497+0000","last_clean":"2023-10-07T00:11:49.733497+0000","last_became_active":"2023-10-07T00:11:12.838997+0000","last_became_peered":"2023-10-07T00:11:12.838997+0000","last_unstale":"2023-10-07T00:11:49.733497+0000","last_undegraded":"2023-10-07T00:11:49.733497+0000","last_fullsized":"2023-10-07T00:11:49.733497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:11.194224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690098+0000","last_change":"2023-10-07T00:11:13.830832+0000","last_active":"2023-10-07T00:12:49.690098+0000","last_peered":"2023-10-07T00:12:49.690098+0000","last_clean":"2023-10-07T00:12:49.690098+0000","last_became_active":"2023-10-07T00:11:13.830373+0000","last_became_peered":"2023-10-07T00:11:13.830373+0000","last_unstale":"2023-10-07T00:12:49.690098+0000","last_undegraded":"2023-10-07T00:12:49.690098+0000","last_fullsized":"2023-10-07T00:12:49.690098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:08.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729861+0000","last_change":"2023-10-07T00:11:12.834543+0000","last_active":"2023-10-07T00:11:49.729861+0000","last_peered":"2023-10-07T00:11:49.729861+0000","last_clean":"2023-10-07T00:11:49.729861+0000","last_became_active":"2023-10-07T00:11:12.834213+0000","last_became_peered":"2023-10-07T00:11:12.834213+0000","last_unstale":"2023-10-07T00:11:49.729861+0000","last_undegraded":"2023-10-07T00:11:49.729861+0000","last_fullsized":"2023-10-07T00:11:49.729861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:57:35.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699342+0000","last_change":"2023-10-07T00:11:13.830645+0000","last_active":"2023-10-07T00:12:49.699342+0000","last_peered":"2023-10-07T00:12:49.699342+0000","last_clean":"2023-10-07T00:12:49.699342+0000","last_became_active":"2023-10-07T00:11:13.830331+0000","last_became_peered":"2023-10-07T00:11:13.830331+0000","last_unstale":"2023-10-07T00:12:49.699342+0000","last_undegraded":"2023-10-07T00:12:49.699342+0000","last_fullsized":"2023-10-07T00:12:49.699342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:19:55.226177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.812336+0000","last_change":"2023-10-07T00:11:12.830062+0000","last_active":"2023-10-07T00:12:52.812336+0000","last_peered":"2023-10-07T00:12:52.812336+0000","last_clean":"2023-10-07T00:12:52.812336+0000","last_became_active":"2023-10-07T00:11:12.829734+0000","last_became_peered":"2023-10-07T00:11:12.829734+0000","last_unstale":"2023-10-07T00:12:52.812336+0000","last_undegraded":"2023-10-07T00:12:52.812336+0000","last_fullsized":"2023-10-07T00:12:52.812336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:59.658154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689518+0000","last_change":"2023-10-07T00:11:13.840915+0000","last_active":"2023-10-07T00:12:49.689518+0000","last_peered":"2023-10-07T00:12:49.689518+0000","last_clean":"2023-10-07T00:12:49.689518+0000","last_became_active":"2023-10-07T00:11:13.840584+0000","last_became_peered":"2023-10-07T00:11:13.840584+0000","last_unstale":"2023-10-07T00:12:49.689518+0000","last_undegraded":"2023-10-07T00:12:49.689518+0000","last_fullsized":"2023-10-07T00:12:49.689518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:27:58.672800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726440+0000","last_change":"2023-10-07T00:11:12.829034+0000","last_active":"2023-10-07T00:11:49.726440+0000","last_peered":"2023-10-07T00:11:49.726440+0000","last_clean":"2023-10-07T00:11:49.726440+0000","last_became_active":"2023-10-07T00:11:12.828671+0000","last_became_peered":"2023-10-07T00:11:12.828671+0000","last_unstale":"2023-10-07T00:11:49.726440+0000","last_undegraded":"2023-10-07T00:11:49.726440+0000","last_fullsized":"2023-10-07T00:11:49.726440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:09:14.203804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.691491+0000","last_change":"2023-10-07T00:11:13.843029+0000","last_active":"2023-10-07T00:12:49.691491+0000","last_peered":"2023-10-07T00:12:49.691491+0000","last_clean":"2023-10-07T00:12:49.691491+0000","last_became_active":"2023-10-07T00:11:13.842714+0000","last_became_peered":"2023-10-07T00:11:13.842714+0000","last_unstale":"2023-10-07T00:12:49.691491+0000","last_undegraded":"2023-10-07T00:12:49.691491+0000","last_fullsized":"2023-10-07T00:12:49.691491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:46.147059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.727162+0000","last_change":"2023-10-07T00:11:12.830887+0000","last_active":"2023-10-07T00:11:49.727162+0000","last_peered":"2023-10-07T00:11:49.727162+0000","last_clean":"2023-10-07T00:11:49.727162+0000","last_became_active":"2023-10-07T00:11:12.830500+0000","last_became_peered":"2023-10-07T00:11:12.830500+0000","last_unstale":"2023-10-07T00:11:49.727162+0000","last_undegraded":"2023-10-07T00:11:49.727162+0000","last_fullsized":"2023-10-07T00:11:49.727162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:39.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686183+0000","last_change":"2023-10-07T00:11:13.838823+0000","last_active":"2023-10-07T00:12:49.686183+0000","last_peered":"2023-10-07T00:12:49.686183+0000","last_clean":"2023-10-07T00:12:49.686183+0000","last_became_active":"2023-10-07T00:11:13.838491+0000","last_became_peered":"2023-10-07T00:11:13.838491+0000","last_unstale":"2023-10-07T00:12:49.686183+0000","last_undegraded":"2023-10-07T00:12:49.686183+0000","last_fullsized":"2023-10-07T00:12:49.686183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:29:31.340686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728495+0000","last_change":"2023-10-07T00:11:12.838303+0000","last_active":"2023-10-07T00:11:49.728495+0000","last_peered":"2023-10-07T00:11:49.728495+0000","last_clean":"2023-10-07T00:11:49.728495+0000","last_became_active":"2023-10-07T00:11:12.837891+0000","last_became_peered":"2023-10-07T00:11:12.837891+0000","last_unstale":"2023-10-07T00:11:49.728495+0000","last_undegraded":"2023-10-07T00:11:49.728495+0000","last_fullsized":"2023-10-07T00:11:49.728495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:56.957653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687785+0000","last_change":"2023-10-07T00:11:13.840109+0000","last_active":"2023-10-07T00:12:49.687785+0000","last_peered":"2023-10-07T00:12:49.687785+0000","last_clean":"2023-10-07T00:12:49.687785+0000","last_became_active":"2023-10-07T00:11:13.839767+0000","last_became_peered":"2023-10-07T00:11:13.839767+0000","last_unstale":"2023-10-07T00:12:49.687785+0000","last_undegraded":"2023-10-07T00:12:49.687785+0000","last_fullsized":"2023-10-07T00:12:49.687785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:24.236839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.830402+0000","last_change":"2023-10-07T00:11:12.837365+0000","last_active":"2023-10-07T00:12:54.830402+0000","last_peered":"2023-10-07T00:12:54.830402+0000","last_clean":"2023-10-07T00:12:54.830402+0000","last_became_active":"2023-10-07T00:11:12.836992+0000","last_became_peered":"2023-10-07T00:11:12.836992+0000","last_unstale":"2023-10-07T00:12:54.830402+0000","last_undegraded":"2023-10-07T00:12:54.830402+0000","last_fullsized":"2023-10-07T00:12:54.830402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:24:09.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687278+0000","last_change":"2023-10-07T00:11:13.851151+0000","last_active":"2023-10-07T00:12:49.687278+0000","last_peered":"2023-10-07T00:12:49.687278+0000","last_clean":"2023-10-07T00:12:49.687278+0000","last_became_active":"2023-10-07T00:11:13.850807+0000","last_became_peered":"2023-10-07T00:11:13.850807+0000","last_unstale":"2023-10-07T00:12:49.687278+0000","last_undegraded":"2023-10-07T00:12:49.687278+0000","last_fullsized":"2023-10-07T00:12:49.687278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:17:42.857720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.684619+0000","last_change":"2023-10-07T00:11:13.844143+0000","last_active":"2023-10-07T00:12:49.684619+0000","last_peered":"2023-10-07T00:12:49.684619+0000","last_clean":"2023-10-07T00:12:49.684619+0000","last_became_active":"2023-10-07T00:11:13.843633+0000","last_became_peered":"2023-10-07T00:11:13.843633+0000","last_unstale":"2023-10-07T00:12:49.684619+0000","last_undegraded":"2023-10-07T00:12:49.684619+0000","last_fullsized":"2023-10-07T00:12:49.684619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:42:20.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.814862+0000","last_change":"2023-10-07T00:11:12.836076+0000","last_active":"2023-10-07T00:12:54.814862+0000","last_peered":"2023-10-07T00:12:54.814862+0000","last_clean":"2023-10-07T00:12:54.814862+0000","last_became_active":"2023-10-07T00:11:12.835709+0000","last_became_peered":"2023-10-07T00:11:12.835709+0000","last_unstale":"2023-10-07T00:12:54.814862+0000","last_undegraded":"2023-10-07T00:12:54.814862+0000","last_fullsized":"2023-10-07T00:12:54.814862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.096103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698483+0000","last_change":"2023-10-07T00:11:50.738891+0000","last_active":"2023-10-07T00:12:49.698483+0000","last_peered":"2023-10-07T00:12:49.698483+0000","last_clean":"2023-10-07T00:12:49.698483+0000","last_became_active":"2023-10-07T00:11:50.738516+0000","last_became_peered":"2023-10-07T00:11:50.738516+0000","last_unstale":"2023-10-07T00:12:49.698483+0000","last_undegraded":"2023-10-07T00:12:49.698483+0000","last_fullsized":"2023-10-07T00:12:49.698483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:22:10.840002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734497+0000","last_change":"2023-10-07T00:11:12.839717+0000","last_active":"2023-10-07T00:11:49.734497+0000","last_peered":"2023-10-07T00:11:49.734497+0000","last_clean":"2023-10-07T00:11:49.734497+0000","last_became_active":"2023-10-07T00:11:12.839287+0000","last_became_peered":"2023-10-07T00:11:12.839287+0000","last_unstale":"2023-10-07T00:11:49.734497+0000","last_undegraded":"2023-10-07T00:11:49.734497+0000","last_fullsized":"2023-10-07T00:11:49.734497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:11.170207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":314,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.733191+0000","last_change":"2023-10-07T00:09:53.652919+0000","last_active":"2023-10-07T00:11:50.733191+0000","last_peered":"2023-10-07T00:11:50.733191+0000","last_clean":"2023-10-07T00:11:50.733191+0000","last_became_active":"2023-10-07T00:09:53.652407+0000","last_became_peered":"2023-10-07T00:09:53.652407+0000","last_unstale":"2023-10-07T00:11:50.733191+0000","last_undegraded":"2023-10-07T00:11:50.733191+0000","last_fullsized":"2023-10-07T00:11:50.733191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_clean_scrub_stamp":"2023-10-07T00:06:22.557862+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:33:55.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.677729+0000","last_change":"2023-10-07T00:11:13.830797+0000","last_active":"2023-10-07T00:12:49.677729+0000","last_peered":"2023-10-07T00:12:49.677729+0000","last_clean":"2023-10-07T00:12:49.677729+0000","last_became_active":"2023-10-07T00:11:13.830467+0000","last_became_peered":"2023-10-07T00:11:13.830467+0000","last_unstale":"2023-10-07T00:12:49.677729+0000","last_undegraded":"2023-10-07T00:12:49.677729+0000","last_fullsized":"2023-10-07T00:12:49.677729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:48.545184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726436+0000","last_change":"2023-10-07T00:11:12.836000+0000","last_active":"2023-10-07T00:11:49.726436+0000","last_peered":"2023-10-07T00:11:49.726436+0000","last_clean":"2023-10-07T00:11:49.726436+0000","last_became_active":"2023-10-07T00:11:12.835588+0000","last_became_peered":"2023-10-07T00:11:12.835588+0000","last_unstale":"2023-10-07T00:11:49.726436+0000","last_undegraded":"2023-10-07T00:11:49.726436+0000","last_fullsized":"2023-10-07T00:11:49.726436+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:55:54.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.750173+0000","last_change":"2023-10-07T00:11:50.749694+0000","last_active":"2023-10-07T00:11:50.750173+0000","last_peered":"2023-10-07T00:11:50.750173+0000","last_clean":"2023-10-07T00:11:50.750173+0000","last_became_active":"2023-10-07T00:11:50.740568+0000","last_became_peered":"2023-10-07T00:11:50.740568+0000","last_unstale":"2023-10-07T00:11:50.750173+0000","last_undegraded":"2023-10-07T00:11:50.750173+0000","last_fullsized":"2023-10-07T00:11:50.750173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:19:31.414655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.678283+0000","last_change":"2023-10-07T00:11:13.828373+0000","last_active":"2023-10-07T00:12:49.678283+0000","last_peered":"2023-10-07T00:12:49.678283+0000","last_clean":"2023-10-07T00:12:49.678283+0000","last_became_active":"2023-10-07T00:11:13.827999+0000","last_became_peered":"2023-10-07T00:11:13.827999+0000","last_unstale":"2023-10-07T00:12:49.678283+0000","last_undegraded":"2023-10-07T00:12:49.678283+0000","last_fullsized":"2023-10-07T00:12:49.678283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:43.551348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.757662+0000","last_change":"2023-10-07T00:11:50.757226+0000","last_active":"2023-10-07T00:11:50.757662+0000","last_peered":"2023-10-07T00:11:50.757662+0000","last_clean":"2023-10-07T00:11:50.757662+0000","last_became_active":"2023-10-07T00:11:50.742238+0000","last_became_peered":"2023-10-07T00:11:50.742238+0000","last_unstale":"2023-10-07T00:11:50.757662+0000","last_undegraded":"2023-10-07T00:11:50.757662+0000","last_fullsized":"2023-10-07T00:11:50.757662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:26:20.609537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693199+0000","last_change":"2023-10-07T00:11:13.838814+0000","last_active":"2023-10-07T00:12:49.693199+0000","last_peered":"2023-10-07T00:12:49.693199+0000","last_clean":"2023-10-07T00:12:49.693199+0000","last_became_active":"2023-10-07T00:11:13.838468+0000","last_became_peered":"2023-10-07T00:11:13.838468+0000","last_unstale":"2023-10-07T00:12:49.693199+0000","last_undegraded":"2023-10-07T00:12:49.693199+0000","last_fullsized":"2023-10-07T00:12:49.693199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:29:38.944450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734231+0000","last_change":"2023-10-07T00:11:12.837042+0000","last_active":"2023-10-07T00:11:49.734231+0000","last_peered":"2023-10-07T00:11:49.734231+0000","last_clean":"2023-10-07T00:11:49.734231+0000","last_became_active":"2023-10-07T00:11:12.836605+0000","last_became_peered":"2023-10-07T00:11:12.836605+0000","last_unstale":"2023-10-07T00:11:49.734231+0000","last_undegraded":"2023-10-07T00:11:49.734231+0000","last_fullsized":"2023-10-07T00:11:49.734231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:30:13.684063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699537+0000","last_change":"2023-10-07T00:11:13.840778+0000","last_active":"2023-10-07T00:12:49.699537+0000","last_peered":"2023-10-07T00:12:49.699537+0000","last_clean":"2023-10-07T00:12:49.699537+0000","last_became_active":"2023-10-07T00:11:13.840472+0000","last_became_peered":"2023-10-07T00:11:13.840472+0000","last_unstale":"2023-10-07T00:12:49.699537+0000","last_undegraded":"2023-10-07T00:12:49.699537+0000","last_fullsized":"2023-10-07T00:12:49.699537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:59.088416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732547+0000","last_change":"2023-10-07T00:11:12.838534+0000","last_active":"2023-10-07T00:11:49.732547+0000","last_peered":"2023-10-07T00:11:49.732547+0000","last_clean":"2023-10-07T00:11:49.732547+0000","last_became_active":"2023-10-07T00:11:12.838220+0000","last_became_peered":"2023-10-07T00:11:12.838220+0000","last_unstale":"2023-10-07T00:11:49.732547+0000","last_undegraded":"2023-10-07T00:11:49.732547+0000","last_fullsized":"2023-10-07T00:11:49.732547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:16:47.170815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.645517+0000","last_change":"2023-10-07T00:11:13.831506+0000","last_active":"2023-10-07T00:12:49.645517+0000","last_peered":"2023-10-07T00:12:49.645517+0000","last_clean":"2023-10-07T00:12:49.645517+0000","last_became_active":"2023-10-07T00:11:13.831093+0000","last_became_peered":"2023-10-07T00:11:13.831093+0000","last_unstale":"2023-10-07T00:12:49.645517+0000","last_undegraded":"2023-10-07T00:12:49.645517+0000","last_fullsized":"2023-10-07T00:12:49.645517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:02.749470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731114+0000","last_change":"2023-10-07T00:11:12.841662+0000","last_active":"2023-10-07T00:11:49.731114+0000","last_peered":"2023-10-07T00:11:49.731114+0000","last_clean":"2023-10-07T00:11:49.731114+0000","last_became_active":"2023-10-07T00:11:12.841207+0000","last_became_peered":"2023-10-07T00:11:12.841207+0000","last_unstale":"2023-10-07T00:11:49.731114+0000","last_undegraded":"2023-10-07T00:11:49.731114+0000","last_fullsized":"2023-10-07T00:11:49.731114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:10.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699542+0000","last_change":"2023-10-07T00:11:13.844943+0000","last_active":"2023-10-07T00:12:49.699542+0000","last_peered":"2023-10-07T00:12:49.699542+0000","last_clean":"2023-10-07T00:12:49.699542+0000","last_became_active":"2023-10-07T00:11:13.844387+0000","last_became_peered":"2023-10-07T00:11:13.844387+0000","last_unstale":"2023-10-07T00:12:49.699542+0000","last_undegraded":"2023-10-07T00:12:49.699542+0000","last_fullsized":"2023-10-07T00:12:49.699542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:35.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'5","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.386382+0000","last_change":"2023-10-07T00:11:12.838191+0000","last_active":"2023-10-07T00:12:52.386382+0000","last_peered":"2023-10-07T00:12:52.386382+0000","last_clean":"2023-10-07T00:12:52.386382+0000","last_became_active":"2023-10-07T00:11:12.837821+0000","last_became_peered":"2023-10-07T00:11:12.837821+0000","last_unstale":"2023-10-07T00:12:52.386382+0000","last_undegraded":"2023-10-07T00:12:52.386382+0000","last_fullsized":"2023-10-07T00:12:52.386382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:16:38.519554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699516+0000","last_change":"2023-10-07T00:11:13.841478+0000","last_active":"2023-10-07T00:12:49.699516+0000","last_peered":"2023-10-07T00:12:49.699516+0000","last_clean":"2023-10-07T00:12:49.699516+0000","last_became_active":"2023-10-07T00:11:13.841085+0000","last_became_peered":"2023-10-07T00:11:13.841085+0000","last_unstale":"2023-10-07T00:12:49.699516+0000","last_undegraded":"2023-10-07T00:12:49.699516+0000","last_fullsized":"2023-10-07T00:12:49.699516+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:54:03.100980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726585+0000","last_change":"2023-10-07T00:11:12.831175+0000","last_active":"2023-10-07T00:11:49.726585+0000","last_peered":"2023-10-07T00:11:49.726585+0000","last_clean":"2023-10-07T00:11:49.726585+0000","last_became_active":"2023-10-07T00:11:12.830859+0000","last_became_peered":"2023-10-07T00:11:12.830859+0000","last_unstale":"2023-10-07T00:11:49.726585+0000","last_undegraded":"2023-10-07T00:11:49.726585+0000","last_fullsized":"2023-10-07T00:11:49.726585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:07.072334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.702192+0000","last_change":"2023-10-07T00:11:13.834163+0000","last_active":"2023-10-07T00:12:49.702192+0000","last_peered":"2023-10-07T00:12:49.702192+0000","last_clean":"2023-10-07T00:12:49.702192+0000","last_became_active":"2023-10-07T00:11:13.833807+0000","last_became_peered":"2023-10-07T00:11:13.833807+0000","last_unstale":"2023-10-07T00:12:49.702192+0000","last_undegraded":"2023-10-07T00:12:49.702192+0000","last_fullsized":"2023-10-07T00:12:49.702192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:12:18.606936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:53.813384+0000","last_change":"2023-10-07T00:11:12.835598+0000","last_active":"2023-10-07T00:12:53.813384+0000","last_peered":"2023-10-07T00:12:53.813384+0000","last_clean":"2023-10-07T00:12:53.813384+0000","last_became_active":"2023-10-07T00:11:12.835295+0000","last_became_peered":"2023-10-07T00:11:12.835295+0000","last_unstale":"2023-10-07T00:12:53.813384+0000","last_undegraded":"2023-10-07T00:12:53.813384+0000","last_fullsized":"2023-10-07T00:12:53.813384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:40:52.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701721+0000","last_change":"2023-10-07T00:11:13.837918+0000","last_active":"2023-10-07T00:12:49.701721+0000","last_peered":"2023-10-07T00:12:49.701721+0000","last_clean":"2023-10-07T00:12:49.701721+0000","last_became_active":"2023-10-07T00:11:13.834284+0000","last_became_peered":"2023-10-07T00:11:13.834284+0000","last_unstale":"2023-10-07T00:12:49.701721+0000","last_undegraded":"2023-10-07T00:12:49.701721+0000","last_fullsized":"2023-10-07T00:12:49.701721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:49:47.081395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729507+0000","last_change":"2023-10-07T00:11:12.839362+0000","last_active":"2023-10-07T00:11:49.729507+0000","last_peered":"2023-10-07T00:11:49.729507+0000","last_clean":"2023-10-07T00:11:49.729507+0000","last_became_active":"2023-10-07T00:11:12.838902+0000","last_became_peered":"2023-10-07T00:11:12.838902+0000","last_unstale":"2023-10-07T00:11:49.729507+0000","last_undegraded":"2023-10-07T00:11:49.729507+0000","last_fullsized":"2023-10-07T00:11:49.729507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:05:34.649556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687538+0000","last_change":"2023-10-07T00:11:13.839356+0000","last_active":"2023-10-07T00:12:49.687538+0000","last_peered":"2023-10-07T00:12:49.687538+0000","last_clean":"2023-10-07T00:12:49.687538+0000","last_became_active":"2023-10-07T00:11:13.838936+0000","last_became_peered":"2023-10-07T00:11:13.838936+0000","last_unstale":"2023-10-07T00:12:49.687538+0000","last_undegraded":"2023-10-07T00:12:49.687538+0000","last_fullsized":"2023-10-07T00:12:49.687538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:02.860174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728045+0000","last_change":"2023-10-07T00:11:12.839966+0000","last_active":"2023-10-07T00:11:49.728045+0000","last_peered":"2023-10-07T00:11:49.728045+0000","last_clean":"2023-10-07T00:11:49.728045+0000","last_became_active":"2023-10-07T00:11:12.839505+0000","last_became_peered":"2023-10-07T00:11:12.839505+0000","last_unstale":"2023-10-07T00:11:49.728045+0000","last_undegraded":"2023-10-07T00:11:49.728045+0000","last_fullsized":"2023-10-07T00:11:49.728045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:45:50.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689376+0000","last_change":"2023-10-07T00:11:13.839478+0000","last_active":"2023-10-07T00:12:49.689376+0000","last_peered":"2023-10-07T00:12:49.689376+0000","last_clean":"2023-10-07T00:12:49.689376+0000","last_became_active":"2023-10-07T00:11:13.839097+0000","last_became_peered":"2023-10-07T00:11:13.839097+0000","last_unstale":"2023-10-07T00:12:49.689376+0000","last_undegraded":"2023-10-07T00:12:49.689376+0000","last_fullsized":"2023-10-07T00:12:49.689376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:55.668486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694303+0000","last_change":"2023-10-07T00:11:13.839518+0000","last_active":"2023-10-07T00:12:49.694303+0000","last_peered":"2023-10-07T00:12:49.694303+0000","last_clean":"2023-10-07T00:12:49.694303+0000","last_became_active":"2023-10-07T00:11:13.839189+0000","last_became_peered":"2023-10-07T00:11:13.839189+0000","last_unstale":"2023-10-07T00:12:49.694303+0000","last_undegraded":"2023-10-07T00:12:49.694303+0000","last_fullsized":"2023-10-07T00:12:49.694303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:30:34.647955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.681399+0000","last_change":"2023-10-07T00:11:50.738694+0000","last_active":"2023-10-07T00:12:49.681399+0000","last_peered":"2023-10-07T00:12:49.681399+0000","last_clean":"2023-10-07T00:12:49.681399+0000","last_became_active":"2023-10-07T00:11:50.738045+0000","last_became_peered":"2023-10-07T00:11:50.738045+0000","last_unstale":"2023-10-07T00:12:49.681399+0000","last_undegraded":"2023-10-07T00:12:49.681399+0000","last_fullsized":"2023-10-07T00:12:49.681399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:50.348821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695853+0000","last_change":"2023-10-07T00:11:13.841371+0000","last_active":"2023-10-07T00:12:49.695853+0000","last_peered":"2023-10-07T00:12:49.695853+0000","last_clean":"2023-10-07T00:12:49.695853+0000","last_became_active":"2023-10-07T00:11:13.840986+0000","last_became_peered":"2023-10-07T00:11:13.840986+0000","last_unstale":"2023-10-07T00:12:49.695853+0000","last_undegraded":"2023-10-07T00:12:49.695853+0000","last_fullsized":"2023-10-07T00:12:49.695853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:49.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698526+0000","last_change":"2023-10-07T00:11:13.844865+0000","last_active":"2023-10-07T00:12:49.698526+0000","last_peered":"2023-10-07T00:12:49.698526+0000","last_clean":"2023-10-07T00:12:49.698526+0000","last_became_active":"2023-10-07T00:11:13.844495+0000","last_became_peered":"2023-10-07T00:11:13.844495+0000","last_unstale":"2023-10-07T00:12:49.698526+0000","last_undegraded":"2023-10-07T00:12:49.698526+0000","last_fullsized":"2023-10-07T00:12:49.698526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:00:29.862865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690534+0000","last_change":"2023-10-07T00:11:13.841126+0000","last_active":"2023-10-07T00:12:49.690534+0000","last_peered":"2023-10-07T00:12:49.690534+0000","last_clean":"2023-10-07T00:12:49.690534+0000","last_became_active":"2023-10-07T00:11:13.840748+0000","last_became_peered":"2023-10-07T00:11:13.840748+0000","last_unstale":"2023-10-07T00:12:49.690534+0000","last_undegraded":"2023-10-07T00:12:49.690534+0000","last_fullsized":"2023-10-07T00:12:49.690534+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:55.444456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.685683+0000","last_change":"2023-10-07T00:11:13.840320+0000","last_active":"2023-10-07T00:12:49.685683+0000","last_peered":"2023-10-07T00:12:49.685683+0000","last_clean":"2023-10-07T00:12:49.685683+0000","last_became_active":"2023-10-07T00:11:13.839993+0000","last_became_peered":"2023-10-07T00:11:13.839993+0000","last_unstale":"2023-10-07T00:12:49.685683+0000","last_undegraded":"2023-10-07T00:12:49.685683+0000","last_fullsized":"2023-10-07T00:12:49.685683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:29:39.843550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690506+0000","last_change":"2023-10-07T00:11:13.830436+0000","last_active":"2023-10-07T00:12:49.690506+0000","last_peered":"2023-10-07T00:12:49.690506+0000","last_clean":"2023-10-07T00:12:49.690506+0000","last_became_active":"2023-10-07T00:11:13.827974+0000","last_became_peered":"2023-10-07T00:11:13.827974+0000","last_unstale":"2023-10-07T00:12:49.690506+0000","last_undegraded":"2023-10-07T00:12:49.690506+0000","last_fullsized":"2023-10-07T00:12:49.690506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:46.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.679783+0000","last_change":"2023-10-07T00:11:13.833929+0000","last_active":"2023-10-07T00:12:49.679783+0000","last_peered":"2023-10-07T00:12:49.679783+0000","last_clean":"2023-10-07T00:12:49.679783+0000","last_became_active":"2023-10-07T00:11:13.833539+0000","last_became_peered":"2023-10-07T00:11:13.833539+0000","last_unstale":"2023-10-07T00:12:49.679783+0000","last_undegraded":"2023-10-07T00:12:49.679783+0000","last_fullsized":"2023-10-07T00:12:49.679783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:46:04.981559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686627+0000","last_change":"2023-10-07T00:11:13.837959+0000","last_active":"2023-10-07T00:12:49.686627+0000","last_peered":"2023-10-07T00:12:49.686627+0000","last_clean":"2023-10-07T00:12:49.686627+0000","last_became_active":"2023-10-07T00:11:13.837650+0000","last_became_peered":"2023-10-07T00:11:13.837650+0000","last_unstale":"2023-10-07T00:12:49.686627+0000","last_undegraded":"2023-10-07T00:12:49.686627+0000","last_fullsized":"2023-10-07T00:12:49.686627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:41.068847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688004+0000","last_change":"2023-10-07T00:11:13.847348+0000","last_active":"2023-10-07T00:12:49.688004+0000","last_peered":"2023-10-07T00:12:49.688004+0000","last_clean":"2023-10-07T00:12:49.688004+0000","last_became_active":"2023-10-07T00:11:13.846988+0000","last_became_peered":"2023-10-07T00:11:13.846988+0000","last_unstale":"2023-10-07T00:12:49.688004+0000","last_undegraded":"2023-10-07T00:12:49.688004+0000","last_fullsized":"2023-10-07T00:12:49.688004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.960128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699333+0000","last_change":"2023-10-07T00:11:13.831801+0000","last_active":"2023-10-07T00:12:49.699333+0000","last_peered":"2023-10-07T00:12:49.699333+0000","last_clean":"2023-10-07T00:12:49.699333+0000","last_became_active":"2023-10-07T00:11:13.831497+0000","last_became_peered":"2023-10-07T00:11:13.831497+0000","last_unstale":"2023-10-07T00:12:49.699333+0000","last_undegraded":"2023-10-07T00:12:49.699333+0000","last_fullsized":"2023-10-07T00:12:49.699333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:43.802252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695811+0000","last_change":"2023-10-07T00:11:13.841423+0000","last_active":"2023-10-07T00:12:49.695811+0000","last_peered":"2023-10-07T00:12:49.695811+0000","last_clean":"2023-10-07T00:12:49.695811+0000","last_became_active":"2023-10-07T00:11:13.841115+0000","last_became_peered":"2023-10-07T00:11:13.841115+0000","last_unstale":"2023-10-07T00:12:49.695811+0000","last_undegraded":"2023-10-07T00:12:49.695811+0000","last_fullsized":"2023-10-07T00:12:49.695811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:32.355577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687407+0000","last_change":"2023-10-07T00:11:13.840162+0000","last_active":"2023-10-07T00:12:49.687407+0000","last_peered":"2023-10-07T00:12:49.687407+0000","last_clean":"2023-10-07T00:12:49.687407+0000","last_became_active":"2023-10-07T00:11:13.839760+0000","last_became_peered":"2023-10-07T00:11:13.839760+0000","last_unstale":"2023-10-07T00:12:49.687407+0000","last_undegraded":"2023-10-07T00:12:49.687407+0000","last_fullsized":"2023-10-07T00:12:49.687407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.727027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248175,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66137,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":986,"num_read_kb":568,"num_write":250,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":57564,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":198411,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460729,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.83699999999999997,"5min":1.018,"15min":1.018},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91800000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.76400000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.877,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.46000000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82999999999999996,"15min":0.82599999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.752},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0509999999999999,"5min":1.105,"15min":1.105},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.018,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97099999999999997,"5min":1.133,"15min":1.133},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91600000000000004,"15min":0.92200000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0840000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.71399999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.159,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.044,"5min":1.306,"15min":1.306},"last":0.88300000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.871}]},{"osd":9,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.998,"15min":1.0029999999999999},"min":{"1min":0.72699999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2110000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.77300000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.86199999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94799999999999995,"15min":0.94299999999999995},"min":{"1min":0.72799999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1739999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.018,"15min":1.022},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1799999999999999,"5min":2.286,"15min":2.286},"last":0.94899999999999995}]}]},{"osd":10,"up_from":73,"seq":313532612648,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1108840,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.2379999999999995,"5min":9.2379999999999995,"15min":9.2379999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":9.1910000000000007,"5min":9.1910000000000007,"15min":9.1910000000000007},"last":0.59899999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.499},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79400000000000004,"5min":1.161,"15min":1.161},"last":0.79400000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89100000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.55100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89600000000000002,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.877,"5min":9.3580000000000005,"15min":9.3580000000000005},"last":0.621}]},{"osd":4,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86699999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68600000000000005,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":1.226,"15min":1.226},"last":0.86899999999999999}]},{"osd":5,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.87},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94999999999999996,"5min":1.29,"15min":1.29},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.88200000000000001},"min":{"1min":0.625,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.995,"5min":3.101,"15min":3.101},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.88300000000000001,"15min":0.92300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.93100000000000005,"5min":1.242,"15min":1.242},"last":0.93100000000000005}]},{"osd":7,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56499999999999995}]},{"osd":8,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.97999999999999998,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.92100000000000004,"15min":0.95499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.042,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0309999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.96999999999999997,"15min":0.99199999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.01,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93999999999999995,"15min":0.96299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0780000000000001,"5min":3.25,"15min":3.25},"last":1.0780000000000001}]},{"osd":11,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95999999999999996,"15min":0.96499999999999997},"min":{"1min":0.745,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.1379999999999999,"5min":1.294,"15min":1.294},"last":1.054},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90200000000000002,"15min":0.90000000000000002},"min":{"1min":0.76100000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.159,"5min":1.165,"15min":1.165},"last":0.998}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":460048,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.89300000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.73499999999999999,"15min":0.76700000000000002},"min":{"1min":0.48299999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71999999999999997},"min":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0429999999999999,"5min":1.137,"15min":1.137},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98899999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.60299999999999998}]},{"osd":3,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.012,"5min":2.198,"15min":2.198},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.83699999999999997,"5min":1.982,"15min":1.982},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.59899999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.89700000000000002,"15min":0.90900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.962,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.59599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0780000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84199999999999997,"15min":0.871},"min":{"1min":0.61199999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96999999999999997,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.84299999999999997,"15min":0.89100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90000000000000002,"5min":2.214,"15min":2.214},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.86199999999999999,"15min":0.90400000000000003},"min":{"1min":0.47599999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96199999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.048,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.94699999999999995,"15min":0.98299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.087,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.80100000000000005}]},{"osd":8,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.93500000000000005,"15min":0.96699999999999997},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.091,"5min":1.591,"15min":1.591},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.69899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1439999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.0229999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.96399999999999997,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.746},{"interface":"front","average":{"1min":0.875,"5min":0.95599999999999996,"15min":0.96099999999999997},"min":{"1min":0.63200000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.343,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.101}]},{"osd":11,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.1479999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037811,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":460314,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.032,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.53200000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0489999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.72199999999999998,"15min":0.70099999999999996},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.95099999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.44,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92100000000000004,"5min":1.073,"15min":1.073},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1830000000000001,"5min":1.498,"15min":1.498},"last":0.52800000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.76600000000000001,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.92000000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.58899999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.54000000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0429999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.67700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.389,"15min":1.389},"last":0.96699999999999997}]},{"osd":7,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.88600000000000001,"15min":0.86499999999999999},"min":{"1min":0.73299999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1919999999999999,"5min":1.391,"15min":1.391},"last":1.012},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.83699999999999997,"15min":0.83299999999999996},"min":{"1min":0.66200000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.095,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85599999999999998}]},{"osd":9,"last update":"Sat Oct 7 00:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.88500000000000001,"15min":0.86899999999999999},"min":{"1min":0.76000000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.05},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.133,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80300000000000005}]},{"osd":10,"last update":"Sat Oct 7 00:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.69999999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.89700000000000002},"min":{"1min":0.71899999999999997,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2030000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.095}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":1.032},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.071}]}]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1054256,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.52700000000000002},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68200000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.163,"15min":1.163},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.68400000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95799999999999996,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94999999999999996,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.65600000000000003,"15min":0.67900000000000005},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.443}]},{"osd":5,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0760000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.68200000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0609999999999999,"5min":1.891,"15min":1.891},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":0.92700000000000005,"5min":1.147,"15min":1.147},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.83199999999999996,"15min":0.85199999999999998},"min":{"1min":0.54900000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.018,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.63600000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.80100000000000005},"min":{"1min":0.72999999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0089999999999999,"5min":1.252,"15min":1.252},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.84099999999999997,"15min":0.81299999999999994},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1639999999999999,"5min":1.234,"15min":1.234},"last":0.83599999999999997}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":0.95599999999999996,"15min":0.90000000000000002},"min":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":9.6829999999999998,"5min":9.6829999999999998,"15min":9.6829999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.86699999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.256,"5min":1.849,"15min":1.849},"last":0.81699999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.208,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.92700000000000005,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0980000000000001,"5min":1.919,"15min":1.919},"last":0.91200000000000003}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.879},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.89500000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462973,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460270,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.55000000000000004,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":8.1240000000000006,"5min":8.1240000000000006,"15min":8.1240000000000006},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.77700000000000002,"15min":0.74099999999999999},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.6790000000000003,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.495,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.66400000000000003}]},{"osd":2,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72599999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91800000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.82499999999999996,"15min":0.78300000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.75900000000000001,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":8.0500000000000007,"5min":8.0500000000000007,"15min":8.0500000000000007},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":4.0430000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0569999999999999,"5min":1.325,"15min":1.325},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.143,"5min":0.88500000000000001,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.8799999999999999,"5min":7.8799999999999999,"15min":7.8799999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.78400000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.9239999999999999,"5min":3.9239999999999999,"15min":3.9239999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.81899999999999995,"15min":0.84899999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97199999999999998,"5min":1.292,"15min":1.292},"last":0.746}]},{"osd":7,"last update":"Sat Oct 7 00:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.61299999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98299999999999998,"5min":1.419,"15min":1.419},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.157,"5min":0.90700000000000003,"15min":0.85599999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":7.9370000000000003,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":0.86199999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.89100000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2150000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.87}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.96899999999999997,"15min":0.96399999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":8.0860000000000003,"5min":8.0860000000000003,"15min":8.0860000000000003},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.972,"5min":3.972,"15min":3.972},"last":0.84699999999999998}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.90800000000000003,"15min":0.92800000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3029999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.873,"5min":1.0349999999999999,"15min":1.0209999999999999},"min":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0509999999999999,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":519744,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.32700000000000001},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":3.851,"5min":3.851,"15min":3.851},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.72599999999999998,"15min":0.60199999999999998},"min":{"1min":0.65200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.69999999999999996,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.077,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.86699999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.70699999999999996,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.505},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89700000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.59499999999999997,"15min":0.52700000000000002},"min":{"1min":0.44600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.79100000000000004,"15min":0.70299999999999996},"min":{"1min":0.66900000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.163,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.754},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.752,"15min":0.68500000000000005},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0309999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":0.85199999999999998,"15min":0.76600000000000001},"min":{"1min":0.69599999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.76800000000000002,"15min":0.69799999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.8959999999999999,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.89200000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71499999999999997,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.96899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":1.079},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84499999999999997,"15min":0.80500000000000005},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.038}]},{"osd":8,"last update":"Sat Oct 7 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.88100000000000001,"15min":0.84499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.79500000000000004,"15min":0.76900000000000002},"min":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0169999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.60199999999999998,"5min":0.503,"15min":0.503},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.89300000000000002,"15min":0.86699999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.94999999999999996}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.85999999999999999,"15min":0.84999999999999998},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.141},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.872,"15min":0.85799999999999998},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.123}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.103},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0549999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":461330,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 00:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.59799999999999998},"min":{"1min":0.36399999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":0.98499999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.48599999999999999,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.94599999999999995}]},{"osd":2,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.53100000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.002,"5min":0.70199999999999996,"15min":0.65300000000000002},"min":{"1min":0.48699999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.97099999999999997}]},{"osd":3,"last update":"Sat Oct 7 00:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.746,"15min":0.68000000000000005},"min":{"1min":0.58499999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":1.054},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.68200000000000005,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.0880000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0629999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.747},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.77200000000000002,"15min":0.73199999999999998},"min":{"1min":0.55800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":1.022}]},{"osd":6,"last update":"Sat Oct 7 00:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.64100000000000001,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.169,"5min":0.78500000000000003,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.4290000000000003,"5min":7.4290000000000003,"15min":7.4290000000000003},"last":0.875}]},{"osd":7,"last update":"Sat Oct 7 00:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.60999999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.85999999999999999,"15min":0.83299999999999996},"min":{"1min":0.65200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":1.177},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.82999999999999996,"15min":0.80900000000000005},"min":{"1min":0.63600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.1539999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":0.95999999999999996,"15min":0.91700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":9.0359999999999996,"5min":9.0359999999999996,"15min":9.0359999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0900000000000001,"5min":0.89400000000000002,"15min":0.879},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.6509999999999998,"5min":5.6509999999999998,"15min":5.6509999999999998},"last":1.21}]},{"osd":10,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.95799999999999996,"15min":0.92800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":1.274},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.71399999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.2969999999999999}]},{"osd":11,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.88400000000000001},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.109},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.92400000000000004,"15min":0.90400000000000003},"min":{"1min":0.68999999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.254}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":460775,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.372,"5min":0.312,"15min":0.312},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.59199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70799999999999996,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.69399999999999995,"15min":0.624},"min":{"1min":0.443,"5min":0.378,"15min":0.378},"max":{"1min":1.0389999999999999,"5min":1.115,"15min":1.115},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.48199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.0189999999999999,"5min":1.022,"15min":1.022},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.63800000000000001},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66000000000000003}]},{"osd":4,"last update":"Sat Oct 7 00:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.48599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.002}]},{"osd":5,"last update":"Sat Oct 7 00:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.57299999999999995},"min":{"1min":0.54800000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69199999999999995,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0069999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.501}]},{"osd":6,"last update":"Sat Oct 7 00:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.76400000000000001,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.85699999999999998}]},{"osd":7,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.60099999999999998}]},{"osd":8,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.51000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.54800000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1240000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77800000000000002}]},{"osd":9,"last update":"Sat Oct 7 00:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.86099999999999999,"15min":0.83499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.155,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.82599999999999996,"15min":0.80600000000000005},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.129,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.873}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85099999999999998,"15min":0.82899999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.109,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.89800000000000002},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.141,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.89600000000000002}]},{"osd":11,"last update":"Sat Oct 7 00:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.73199999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":459271,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79600000000000004,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.48899999999999999,"15min":0.44500000000000001},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.65800000000000003,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":1.042,"15min":1.042},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69599999999999995,"15min":0.629},"min":{"1min":0.51800000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94499999999999995,"5min":1.647,"15min":1.647},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88200000000000001,"5min":1.284,"15min":1.284},"last":0.88200000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72999999999999998,"15min":0.68400000000000005},"min":{"1min":0.46999999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.753,"15min":0.69799999999999995},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.70999999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.68799999999999994},"min":{"1min":0.48699999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.93300000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.72599999999999998,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.69599999999999995},"min":{"1min":0.43099999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.621}]},{"osd":7,"last update":"Sat Oct 7 00:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76500000000000001,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0109999999999999,"5min":1.167,"15min":1.167},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.56200000000000006,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.748}]},{"osd":8,"last update":"Sat Oct 7 00:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.89400000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.052,"5min":1.103,"15min":1.103},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.746}]},{"osd":9,"last update":"Sat Oct 7 00:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":0.873},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.1950000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91900000000000004,"15min":0.95599999999999996},"min":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.194,"5min":1.272,"15min":1.272},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.74099999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0780000000000001,"5min":1.252,"15min":1.252},"last":0.86599999999999999}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.83899999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888136,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":517040,"data_compressed":14696,"data_compressed_allocated":20480,"data_compressed_original":69632,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56100000000000005,"15min":0.54300000000000004},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.49099999999999999,"15min":0.47799999999999998},"min":{"1min":0.35199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95499999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.82899999999999996}]},{"osd":3,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67900000000000005,"15min":0.65200000000000002},"min":{"1min":0.46800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88400000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72099999999999997,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0669999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0309999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.752},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98599999999999999,"5min":1.069,"15min":1.069},"last":0.78200000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71599999999999997,"15min":0.67000000000000004},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.746,"15min":0.70799999999999996},"min":{"1min":0.57699999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0049999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82399999999999995,"15min":0.81599999999999995},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.81899999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1279999999999999,"5min":1.212,"15min":1.212},"last":1.0369999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.94699999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.86099999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.98099999999999998}]},{"osd":11,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.091},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.0580000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":1052936,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.68500000000000005,"15min":0.59899999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.633,"5min":4.633,"15min":4.633},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94899999999999995,"5min":1.147,"15min":1.147},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.80800000000000005},"min":{"1min":0.47099999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":5.96,"15min":5.96},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.49299999999999999},"min":{"1min":0.38700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55100000000000005,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70899999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.69799999999999995,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.44},"max":{"1min":4.7060000000000004,"5min":4.7060000000000004,"15min":4.7060000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63300000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72999999999999998,"15min":0.68600000000000005},"min":{"1min":0.52200000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.083,"5min":1.093,"15min":1.093},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.89800000000000002},"min":{"1min":0.504,"5min":0.437,"15min":0.437},"max":{"1min":0.94399999999999995,"5min":5.9100000000000001,"15min":5.9100000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97099999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.90400000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79500000000000004,"15min":0.77400000000000002},"min":{"1min":0.59199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0249999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.64600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.48299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0289999999999999,"5min":1.083,"15min":1.083},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.56799999999999995,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.874}]},{"osd":9,"last update":"Sat Oct 7 00:12:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":0.93000000000000005,"15min":0.88500000000000001},"min":{"1min":0.70499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":4.6609999999999996,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.208},"last":0.88800000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88600000000000001,"15min":0.89200000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":61091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":58387,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T00:12:58.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T00:12:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3834089827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 msgr2=0x7f9eb810b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3834089827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 0x7f9eb810b300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000b0a0 tx=0x7f9eb000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3834089827 shutdown_connections 2023-10-07T00:12:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3834089827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 0x7f9eb810b300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3834089827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9eb8074e90 0x7f9eb80732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3834089827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9eb80738b0 0x7f9eb8073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3834089827 >> 172.21.15.5:0/3834089827 conn(0x7f9eb80fc530 msgr2=0x7f9eb80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3834089827 shutdown_connections 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.743+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3834089827 wait complete. 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.744+0000 7f9ebdfff700 1 Processor -- start 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.744+0000 7f9ebdfff700 1 -- start start 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9ebdfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9eb80738b0 0x7f9eb8198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9ebdfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9eb8074e90 0x7f9eb81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9ebdfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 0x7f9eb81a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9ebdfff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb81a09f0 con 0x7f9eb8108e90 2023-10-07T00:12:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9ebdfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb81a0b30 con 0x7f9eb80738b0 2023-10-07T00:12:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9ebdfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb81a0cc0 con 0x7f9eb8074e90 2023-10-07T00:12:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 0x7f9eb81a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9eb80738b0 0x7f9eb8198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 0x7f9eb81a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60320/0 (socket says 172.21.15.5:60320) 2023-10-07T00:12:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb7fff700 1 -- 172.21.15.5:0/3315335868 learned_addr learned my addr 172.21.15.5:0/3315335868 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb6ffd700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9eb8074e90 0x7f9eb81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb7fff700 1 -- 172.21.15.5:0/3315335868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9eb8074e90 msgr2=0x7f9eb81993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb7fff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9eb8074e90 0x7f9eb81993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb7fff700 1 -- 172.21.15.5:0/3315335868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9eb80738b0 msgr2=0x7f9eb8198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb7fff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9eb80738b0 0x7f9eb8198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.745+0000 7f9eb7fff700 1 -- 172.21.15.5:0/3315335868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0009d00 con 0x7f9eb8108e90 2023-10-07T00:12:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.746+0000 7f9eb7fff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 0x7f9eb81a0420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000b780 tx=0x7f9eb000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.749+0000 7f9eb4ff9700 1 -- 172.21.15.5:0/3315335868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000e040 con 0x7f9eb8108e90 2023-10-07T00:12:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.749+0000 7f9eb4ff9700 1 -- 172.21.15.5:0/3315335868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9eb0004e60 con 0x7f9eb8108e90 2023-10-07T00:12:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.749+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb81a0f40 con 0x7f9eb8108e90 2023-10-07T00:12:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.749+0000 7f9eb4ff9700 1 -- 172.21.15.5:0/3315335868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00052a0 con 0x7f9eb8108e90 2023-10-07T00:12:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.749+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb81a1370 con 0x7f9eb8108e90 2023-10-07T00:12:58.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.750+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb8107590 con 0x7f9eb8108e90 2023-10-07T00:12:58.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.752+0000 7f9eb4ff9700 1 -- 172.21.15.5:0/3315335868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9eb001d470 con 0x7f9eb8108e90 2023-10-07T00:12:58.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.753+0000 7f9eb4ff9700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9ea00a1500 0x7f9ea00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:58.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.753+0000 7f9eb4ff9700 1 -- 172.21.15.5:0/3315335868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9eb00ce230 con 0x7f9eb8108e90 2023-10-07T00:12:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.753+0000 7f9eb77fe700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9ea00a1500 0x7f9ea00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.754+0000 7f9eb77fe700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9ea00a1500 0x7f9ea00a39c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009c60 tx=0x7f9ea8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.757+0000 7f9eb4ff9700 1 -- 172.21.15.5:0/3315335868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9eb00978a0 con 0x7f9eb8108e90 2023-10-07T00:12:58.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:58 smithi005 ceph-mon[129406]: pgmap v352: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:12:58.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:58 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/359527918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.967+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9eb802d1f0 con 0x7f9ea00a1500 2023-10-07T00:12:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.978+0000 7f9eb4ff9700 1 -- 172.21.15.5:0/3315335868 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344574 (secure 0 0 0) 0x7f9eb802d1f0 con 0x7f9ea00a1500 2023-10-07T00:12:58.983 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9ea00a1500 msgr2=0x7f9ea00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9ea00a1500 0x7f9ea00a39c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009c60 tx=0x7f9ea8009260 comp rx=0 tx=0).stop 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 msgr2=0x7f9eb81a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 0x7f9eb81a0420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000b780 tx=0x7f9eb000bd40 comp rx=0 tx=0).stop 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 shutdown_connections 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9ea00a1500 0x7f9ea00a39c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb8108e90 0x7f9eb81a0420 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9eb80738b0 0x7f9eb8198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 --2- 172.21.15.5:0/3315335868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9eb8074e90 0x7f9eb81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 >> 172.21.15.5:0/3315335868 conn(0x7f9eb80fc530 msgr2=0x7f9eb80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 shutdown_connections 2023-10-07T00:12:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:58.982+0000 7f9ebdfff700 1 -- 172.21.15.5:0/3315335868 wait complete. 2023-10-07T00:12:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-07T00:12:59.002 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2023-10-07T00:12:57.669484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656751,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1112,"num_read_kb":677,"num_write":433,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1238300,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335924,"kb_used_data":11732,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605900,"statfs":{"total":1151940427776,"available":1151596441600,"internally_reserved":0,"allocated":12013568,"data_stored":7475553,"data_compressed":186885,"data_compressed_allocated":245760,"data_compressed_original":2019328,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2885,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":62,"num_write":19,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003500"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.700840+0000","last_change":"2023-10-07T00:11:13.845315+0000","last_active":"2023-10-07T00:12:49.700840+0000","last_peered":"2023-10-07T00:12:49.700840+0000","last_clean":"2023-10-07T00:12:49.700840+0000","last_became_active":"2023-10-07T00:11:13.844330+0000","last_became_peered":"2023-10-07T00:11:13.844330+0000","last_unstale":"2023-10-07T00:12:49.700840+0000","last_undegraded":"2023-10-07T00:12:49.700840+0000","last_fullsized":"2023-10-07T00:12:49.700840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:26.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694353+0000","last_change":"2023-10-07T00:11:13.842602+0000","last_active":"2023-10-07T00:12:49.694353+0000","last_peered":"2023-10-07T00:12:49.694353+0000","last_clean":"2023-10-07T00:12:49.694353+0000","last_became_active":"2023-10-07T00:11:13.842296+0000","last_became_peered":"2023-10-07T00:11:13.842296+0000","last_unstale":"2023-10-07T00:12:49.694353+0000","last_undegraded":"2023-10-07T00:12:49.694353+0000","last_fullsized":"2023-10-07T00:12:49.694353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:51.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699118+0000","last_change":"2023-10-07T00:11:13.850567+0000","last_active":"2023-10-07T00:12:49.699118+0000","last_peered":"2023-10-07T00:12:49.699118+0000","last_clean":"2023-10-07T00:12:49.699118+0000","last_became_active":"2023-10-07T00:11:13.850212+0000","last_became_peered":"2023-10-07T00:11:13.850212+0000","last_unstale":"2023-10-07T00:12:49.699118+0000","last_undegraded":"2023-10-07T00:12:49.699118+0000","last_fullsized":"2023-10-07T00:12:49.699118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:51.539752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.672512+0000","last_change":"2023-10-07T00:11:13.839742+0000","last_active":"2023-10-07T00:12:49.672512+0000","last_peered":"2023-10-07T00:12:49.672512+0000","last_clean":"2023-10-07T00:12:49.672512+0000","last_became_active":"2023-10-07T00:11:13.839041+0000","last_became_peered":"2023-10-07T00:11:13.839041+0000","last_unstale":"2023-10-07T00:12:49.672512+0000","last_undegraded":"2023-10-07T00:12:49.672512+0000","last_fullsized":"2023-10-07T00:12:49.672512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:59.241248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.670248+0000","last_change":"2023-10-07T00:11:13.834839+0000","last_active":"2023-10-07T00:12:49.670248+0000","last_peered":"2023-10-07T00:12:49.670248+0000","last_clean":"2023-10-07T00:12:49.670248+0000","last_became_active":"2023-10-07T00:11:13.834529+0000","last_became_peered":"2023-10-07T00:11:13.834529+0000","last_unstale":"2023-10-07T00:12:49.670248+0000","last_undegraded":"2023-10-07T00:12:49.670248+0000","last_fullsized":"2023-10-07T00:12:49.670248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:23.831424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.682684+0000","last_change":"2023-10-07T00:11:13.835102+0000","last_active":"2023-10-07T00:12:49.682684+0000","last_peered":"2023-10-07T00:12:49.682684+0000","last_clean":"2023-10-07T00:12:49.682684+0000","last_became_active":"2023-10-07T00:11:13.834781+0000","last_became_peered":"2023-10-07T00:11:13.834781+0000","last_unstale":"2023-10-07T00:12:49.682684+0000","last_undegraded":"2023-10-07T00:12:49.682684+0000","last_fullsized":"2023-10-07T00:12:49.682684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:16:55.912464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.697844+0000","last_change":"2023-10-07T00:11:50.781822+0000","last_active":"2023-10-07T00:12:49.697844+0000","last_peered":"2023-10-07T00:12:49.697844+0000","last_clean":"2023-10-07T00:12:49.697844+0000","last_became_active":"2023-10-07T00:11:50.781261+0000","last_became_peered":"2023-10-07T00:11:50.781261+0000","last_unstale":"2023-10-07T00:12:49.697844+0000","last_undegraded":"2023-10-07T00:12:49.697844+0000","last_fullsized":"2023-10-07T00:12:49.697844+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:16.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689182+0000","last_change":"2023-10-07T00:11:13.842772+0000","last_active":"2023-10-07T00:12:49.689182+0000","last_peered":"2023-10-07T00:12:49.689182+0000","last_clean":"2023-10-07T00:12:49.689182+0000","last_became_active":"2023-10-07T00:11:13.841610+0000","last_became_peered":"2023-10-07T00:11:13.841610+0000","last_unstale":"2023-10-07T00:12:49.689182+0000","last_undegraded":"2023-10-07T00:12:49.689182+0000","last_fullsized":"2023-10-07T00:12:49.689182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:04:51.988705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693881+0000","last_change":"2023-10-07T00:11:13.836990+0000","last_active":"2023-10-07T00:12:49.693881+0000","last_peered":"2023-10-07T00:12:49.693881+0000","last_clean":"2023-10-07T00:12:49.693881+0000","last_became_active":"2023-10-07T00:11:13.836699+0000","last_became_peered":"2023-10-07T00:11:13.836699+0000","last_unstale":"2023-10-07T00:12:49.693881+0000","last_undegraded":"2023-10-07T00:12:49.693881+0000","last_fullsized":"2023-10-07T00:12:49.693881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:18:20.450573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695597+0000","last_change":"2023-10-07T00:11:50.736801+0000","last_active":"2023-10-07T00:12:49.695597+0000","last_peered":"2023-10-07T00:12:49.695597+0000","last_clean":"2023-10-07T00:12:49.695597+0000","last_became_active":"2023-10-07T00:11:50.736256+0000","last_became_peered":"2023-10-07T00:11:50.736256+0000","last_unstale":"2023-10-07T00:12:49.695597+0000","last_undegraded":"2023-10-07T00:12:49.695597+0000","last_fullsized":"2023-10-07T00:12:49.695597+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:35.622108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701841+0000","last_change":"2023-10-07T00:11:13.841699+0000","last_active":"2023-10-07T00:12:49.701841+0000","last_peered":"2023-10-07T00:12:49.701841+0000","last_clean":"2023-10-07T00:12:49.701841+0000","last_became_active":"2023-10-07T00:11:13.841295+0000","last_became_peered":"2023-10-07T00:11:13.841295+0000","last_unstale":"2023-10-07T00:12:49.701841+0000","last_undegraded":"2023-10-07T00:12:49.701841+0000","last_fullsized":"2023-10-07T00:12:49.701841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:24:56.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.683142+0000","last_change":"2023-10-07T00:11:13.839951+0000","last_active":"2023-10-07T00:12:49.683142+0000","last_peered":"2023-10-07T00:12:49.683142+0000","last_clean":"2023-10-07T00:12:49.683142+0000","last_became_active":"2023-10-07T00:11:13.839473+0000","last_became_peered":"2023-10-07T00:11:13.839473+0000","last_unstale":"2023-10-07T00:12:49.683142+0000","last_undegraded":"2023-10-07T00:12:49.683142+0000","last_fullsized":"2023-10-07T00:12:49.683142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687310+0000","last_change":"2023-10-07T00:11:13.838714+0000","last_active":"2023-10-07T00:12:49.687310+0000","last_peered":"2023-10-07T00:12:49.687310+0000","last_clean":"2023-10-07T00:12:49.687310+0000","last_became_active":"2023-10-07T00:11:13.838222+0000","last_became_peered":"2023-10-07T00:11:13.838222+0000","last_unstale":"2023-10-07T00:12:49.687310+0000","last_undegraded":"2023-10-07T00:12:49.687310+0000","last_fullsized":"2023-10-07T00:12:49.687310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:11:43.194204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694768+0000","last_change":"2023-10-07T00:11:13.843075+0000","last_active":"2023-10-07T00:12:49.694768+0000","last_peered":"2023-10-07T00:12:49.694768+0000","last_clean":"2023-10-07T00:12:49.694768+0000","last_became_active":"2023-10-07T00:11:13.842742+0000","last_became_peered":"2023-10-07T00:11:13.842742+0000","last_unstale":"2023-10-07T00:12:49.694768+0000","last_undegraded":"2023-10-07T00:12:49.694768+0000","last_fullsized":"2023-10-07T00:12:49.694768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:53:12.713979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.692979+0000","last_change":"2023-10-07T00:11:13.841635+0000","last_active":"2023-10-07T00:12:49.692979+0000","last_peered":"2023-10-07T00:12:49.692979+0000","last_clean":"2023-10-07T00:12:49.692979+0000","last_became_active":"2023-10-07T00:11:13.841291+0000","last_became_peered":"2023-10-07T00:11:13.841291+0000","last_unstale":"2023-10-07T00:12:49.692979+0000","last_undegraded":"2023-10-07T00:12:49.692979+0000","last_fullsized":"2023-10-07T00:12:49.692979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:48:38.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701753+0000","last_change":"2023-10-07T00:11:13.842365+0000","last_active":"2023-10-07T00:12:49.701753+0000","last_peered":"2023-10-07T00:12:49.701753+0000","last_clean":"2023-10-07T00:12:49.701753+0000","last_became_active":"2023-10-07T00:11:13.842057+0000","last_became_peered":"2023-10-07T00:11:13.842057+0000","last_unstale":"2023-10-07T00:12:49.701753+0000","last_undegraded":"2023-10-07T00:12:49.701753+0000","last_fullsized":"2023-10-07T00:12:49.701753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:36.575712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701353+0000","last_change":"2023-10-07T00:11:13.845746+0000","last_active":"2023-10-07T00:12:49.701353+0000","last_peered":"2023-10-07T00:12:49.701353+0000","last_clean":"2023-10-07T00:12:49.701353+0000","last_became_active":"2023-10-07T00:11:13.844828+0000","last_became_peered":"2023-10-07T00:11:13.844828+0000","last_unstale":"2023-10-07T00:12:49.701353+0000","last_undegraded":"2023-10-07T00:12:49.701353+0000","last_fullsized":"2023-10-07T00:12:49.701353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:34:00.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698936+0000","last_change":"2023-10-07T00:11:13.837749+0000","last_active":"2023-10-07T00:12:49.698936+0000","last_peered":"2023-10-07T00:12:49.698936+0000","last_clean":"2023-10-07T00:12:49.698936+0000","last_became_active":"2023-10-07T00:11:13.837400+0000","last_became_peered":"2023-10-07T00:11:13.837400+0000","last_unstale":"2023-10-07T00:12:49.698936+0000","last_undegraded":"2023-10-07T00:12:49.698936+0000","last_fullsized":"2023-10-07T00:12:49.698936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:40.190065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.683546+0000","last_change":"2023-10-07T00:11:13.833086+0000","last_active":"2023-10-07T00:12:49.683546+0000","last_peered":"2023-10-07T00:12:49.683546+0000","last_clean":"2023-10-07T00:12:49.683546+0000","last_became_active":"2023-10-07T00:11:13.832748+0000","last_became_peered":"2023-10-07T00:11:13.832748+0000","last_unstale":"2023-10-07T00:12:49.683546+0000","last_undegraded":"2023-10-07T00:12:49.683546+0000","last_fullsized":"2023-10-07T00:12:49.683546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:29.176224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.825126+0000","last_change":"2023-10-07T00:11:12.835440+0000","last_active":"2023-10-07T00:12:52.825126+0000","last_peered":"2023-10-07T00:12:52.825126+0000","last_clean":"2023-10-07T00:12:52.825126+0000","last_became_active":"2023-10-07T00:11:12.835094+0000","last_became_peered":"2023-10-07T00:11:12.835094+0000","last_unstale":"2023-10-07T00:12:52.825126+0000","last_undegraded":"2023-10-07T00:12:52.825126+0000","last_fullsized":"2023-10-07T00:12:52.825126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:13.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.680178+0000","last_change":"2023-10-07T00:11:13.847832+0000","last_active":"2023-10-07T00:12:49.680178+0000","last_peered":"2023-10-07T00:12:49.680178+0000","last_clean":"2023-10-07T00:12:49.680178+0000","last_became_active":"2023-10-07T00:11:13.847436+0000","last_became_peered":"2023-10-07T00:11:13.847436+0000","last_unstale":"2023-10-07T00:12:49.680178+0000","last_undegraded":"2023-10-07T00:12:49.680178+0000","last_fullsized":"2023-10-07T00:12:49.680178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:47:07.409132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732015+0000","last_change":"2023-10-07T00:11:12.842832+0000","last_active":"2023-10-07T00:11:49.732015+0000","last_peered":"2023-10-07T00:11:49.732015+0000","last_clean":"2023-10-07T00:11:49.732015+0000","last_became_active":"2023-10-07T00:11:12.842296+0000","last_became_peered":"2023-10-07T00:11:12.842296+0000","last_unstale":"2023-10-07T00:11:49.732015+0000","last_undegraded":"2023-10-07T00:11:49.732015+0000","last_fullsized":"2023-10-07T00:11:49.732015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:00.968303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699705+0000","last_change":"2023-10-07T00:11:13.851259+0000","last_active":"2023-10-07T00:12:49.699705+0000","last_peered":"2023-10-07T00:12:49.699705+0000","last_clean":"2023-10-07T00:12:49.699705+0000","last_became_active":"2023-10-07T00:11:13.850963+0000","last_became_peered":"2023-10-07T00:11:13.850963+0000","last_unstale":"2023-10-07T00:12:49.699705+0000","last_undegraded":"2023-10-07T00:12:49.699705+0000","last_fullsized":"2023-10-07T00:12:49.699705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:52.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726990+0000","last_change":"2023-10-07T00:11:12.835286+0000","last_active":"2023-10-07T00:11:49.726990+0000","last_peered":"2023-10-07T00:11:49.726990+0000","last_clean":"2023-10-07T00:11:49.726990+0000","last_became_active":"2023-10-07T00:11:12.834890+0000","last_became_peered":"2023-10-07T00:11:12.834890+0000","last_unstale":"2023-10-07T00:11:49.726990+0000","last_undegraded":"2023-10-07T00:11:49.726990+0000","last_fullsized":"2023-10-07T00:11:49.726990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:06:05.225849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699004+0000","last_change":"2023-10-07T00:11:13.831174+0000","last_active":"2023-10-07T00:12:49.699004+0000","last_peered":"2023-10-07T00:12:49.699004+0000","last_clean":"2023-10-07T00:12:49.699004+0000","last_became_active":"2023-10-07T00:11:13.830868+0000","last_became_peered":"2023-10-07T00:11:13.830868+0000","last_unstale":"2023-10-07T00:12:49.699004+0000","last_undegraded":"2023-10-07T00:12:49.699004+0000","last_fullsized":"2023-10-07T00:12:49.699004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:20.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726737+0000","last_change":"2023-10-07T00:11:12.835740+0000","last_active":"2023-10-07T00:11:49.726737+0000","last_peered":"2023-10-07T00:11:49.726737+0000","last_clean":"2023-10-07T00:11:49.726737+0000","last_became_active":"2023-10-07T00:11:12.835035+0000","last_became_peered":"2023-10-07T00:11:12.835035+0000","last_unstale":"2023-10-07T00:11:49.726737+0000","last_undegraded":"2023-10-07T00:11:49.726737+0000","last_fullsized":"2023-10-07T00:11:49.726737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:36:07.447748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693850+0000","last_change":"2023-10-07T00:11:13.847940+0000","last_active":"2023-10-07T00:12:49.693850+0000","last_peered":"2023-10-07T00:12:49.693850+0000","last_clean":"2023-10-07T00:12:49.693850+0000","last_became_active":"2023-10-07T00:11:13.847595+0000","last_became_peered":"2023-10-07T00:11:13.847595+0000","last_unstale":"2023-10-07T00:12:49.693850+0000","last_undegraded":"2023-10-07T00:12:49.693850+0000","last_fullsized":"2023-10-07T00:12:49.693850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:28.004429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.844277+0000","last_change":"2023-10-07T00:11:50.743813+0000","last_active":"2023-10-07T00:12:52.844277+0000","last_peered":"2023-10-07T00:12:52.844277+0000","last_clean":"2023-10-07T00:12:52.844277+0000","last_became_active":"2023-10-07T00:11:50.739205+0000","last_became_peered":"2023-10-07T00:11:50.739205+0000","last_unstale":"2023-10-07T00:12:52.844277+0000","last_undegraded":"2023-10-07T00:12:52.844277+0000","last_fullsized":"2023-10-07T00:12:52.844277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:26.630097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1652,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686629+0000","last_change":"2023-10-07T00:11:13.838732+0000","last_active":"2023-10-07T00:12:49.686629+0000","last_peered":"2023-10-07T00:12:49.686629+0000","last_clean":"2023-10-07T00:12:49.686629+0000","last_became_active":"2023-10-07T00:11:13.838408+0000","last_became_peered":"2023-10-07T00:11:13.838408+0000","last_unstale":"2023-10-07T00:12:49.686629+0000","last_undegraded":"2023-10-07T00:12:49.686629+0000","last_fullsized":"2023-10-07T00:12:49.686629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:55:55.039399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736631+0000","last_change":"2023-10-07T00:11:12.831778+0000","last_active":"2023-10-07T00:11:49.736631+0000","last_peered":"2023-10-07T00:11:49.736631+0000","last_clean":"2023-10-07T00:11:49.736631+0000","last_became_active":"2023-10-07T00:11:12.831479+0000","last_became_peered":"2023-10-07T00:11:12.831479+0000","last_unstale":"2023-10-07T00:11:49.736631+0000","last_undegraded":"2023-10-07T00:11:49.736631+0000","last_fullsized":"2023-10-07T00:11:49.736631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:12:57.994585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.680858+0000","last_change":"2023-10-07T00:11:50.745021+0000","last_active":"2023-10-07T00:12:49.680858+0000","last_peered":"2023-10-07T00:12:49.680858+0000","last_clean":"2023-10-07T00:12:49.680858+0000","last_became_active":"2023-10-07T00:11:50.744570+0000","last_became_peered":"2023-10-07T00:11:50.744570+0000","last_unstale":"2023-10-07T00:12:49.680858+0000","last_undegraded":"2023-10-07T00:12:49.680858+0000","last_fullsized":"2023-10-07T00:12:49.680858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:54.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728874+0000","last_change":"2023-10-07T00:11:12.825556+0000","last_active":"2023-10-07T00:11:49.728874+0000","last_peered":"2023-10-07T00:11:49.728874+0000","last_clean":"2023-10-07T00:11:49.728874+0000","last_became_active":"2023-10-07T00:11:12.825189+0000","last_became_peered":"2023-10-07T00:11:12.825189+0000","last_unstale":"2023-10-07T00:11:49.728874+0000","last_undegraded":"2023-10-07T00:11:49.728874+0000","last_fullsized":"2023-10-07T00:11:49.728874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:20:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.691428+0000","last_change":"2023-10-07T00:11:50.781935+0000","last_active":"2023-10-07T00:12:49.691428+0000","last_peered":"2023-10-07T00:12:49.691428+0000","last_clean":"2023-10-07T00:12:49.691428+0000","last_became_active":"2023-10-07T00:11:50.781541+0000","last_became_peered":"2023-10-07T00:11:50.781541+0000","last_unstale":"2023-10-07T00:12:49.691428+0000","last_undegraded":"2023-10-07T00:12:49.691428+0000","last_fullsized":"2023-10-07T00:12:49.691428+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:29:18.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729367+0000","last_change":"2023-10-07T00:11:12.835239+0000","last_active":"2023-10-07T00:11:49.729367+0000","last_peered":"2023-10-07T00:11:49.729367+0000","last_clean":"2023-10-07T00:11:49.729367+0000","last_became_active":"2023-10-07T00:11:12.834912+0000","last_became_peered":"2023-10-07T00:11:12.834912+0000","last_unstale":"2023-10-07T00:11:49.729367+0000","last_undegraded":"2023-10-07T00:11:49.729367+0000","last_fullsized":"2023-10-07T00:11:49.729367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:32:44.097208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688131+0000","last_change":"2023-10-07T00:11:13.837642+0000","last_active":"2023-10-07T00:12:49.688131+0000","last_peered":"2023-10-07T00:12:49.688131+0000","last_clean":"2023-10-07T00:12:49.688131+0000","last_became_active":"2023-10-07T00:11:13.837291+0000","last_became_peered":"2023-10-07T00:11:13.837291+0000","last_unstale":"2023-10-07T00:12:49.688131+0000","last_undegraded":"2023-10-07T00:12:49.688131+0000","last_fullsized":"2023-10-07T00:12:49.688131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:19:14.445816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":213,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.814513+0000","last_change":"2023-10-07T00:11:12.826373+0000","last_active":"2023-10-07T00:12:54.814513+0000","last_peered":"2023-10-07T00:12:54.814513+0000","last_clean":"2023-10-07T00:12:54.814513+0000","last_became_active":"2023-10-07T00:11:12.826017+0000","last_became_peered":"2023-10-07T00:11:12.826017+0000","last_unstale":"2023-10-07T00:12:54.814513+0000","last_undegraded":"2023-10-07T00:12:54.814513+0000","last_fullsized":"2023-10-07T00:12:54.814513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:52:03.101632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":192,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699405+0000","last_change":"2023-10-07T00:11:13.830879+0000","last_active":"2023-10-07T00:12:49.699405+0000","last_peered":"2023-10-07T00:12:49.699405+0000","last_clean":"2023-10-07T00:12:49.699405+0000","last_became_active":"2023-10-07T00:11:13.830571+0000","last_became_peered":"2023-10-07T00:11:13.830571+0000","last_unstale":"2023-10-07T00:12:49.699405+0000","last_undegraded":"2023-10-07T00:12:49.699405+0000","last_fullsized":"2023-10-07T00:12:49.699405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:36.703499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726148+0000","last_change":"2023-10-07T00:11:12.833952+0000","last_active":"2023-10-07T00:11:49.726148+0000","last_peered":"2023-10-07T00:11:49.726148+0000","last_clean":"2023-10-07T00:11:49.726148+0000","last_became_active":"2023-10-07T00:11:12.833545+0000","last_became_peered":"2023-10-07T00:11:12.833545+0000","last_unstale":"2023-10-07T00:11:49.726148+0000","last_undegraded":"2023-10-07T00:11:49.726148+0000","last_fullsized":"2023-10-07T00:11:49.726148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:28:12.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695546+0000","last_change":"2023-10-07T00:11:13.843758+0000","last_active":"2023-10-07T00:12:49.695546+0000","last_peered":"2023-10-07T00:12:49.695546+0000","last_clean":"2023-10-07T00:12:49.695546+0000","last_became_active":"2023-10-07T00:11:13.843443+0000","last_became_peered":"2023-10-07T00:11:13.843443+0000","last_unstale":"2023-10-07T00:12:49.695546+0000","last_undegraded":"2023-10-07T00:12:49.695546+0000","last_fullsized":"2023-10-07T00:12:49.695546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:07:28.610304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729780+0000","last_change":"2023-10-07T00:11:12.833043+0000","last_active":"2023-10-07T00:11:49.729780+0000","last_peered":"2023-10-07T00:11:49.729780+0000","last_clean":"2023-10-07T00:11:49.729780+0000","last_became_active":"2023-10-07T00:11:12.832632+0000","last_became_peered":"2023-10-07T00:11:12.832632+0000","last_unstale":"2023-10-07T00:11:49.729780+0000","last_undegraded":"2023-10-07T00:11:49.729780+0000","last_fullsized":"2023-10-07T00:11:49.729780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:14:25.148603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.697495+0000","last_change":"2023-10-07T00:11:13.831129+0000","last_active":"2023-10-07T00:12:49.697495+0000","last_peered":"2023-10-07T00:12:49.697495+0000","last_clean":"2023-10-07T00:12:49.697495+0000","last_became_active":"2023-10-07T00:11:13.830365+0000","last_became_peered":"2023-10-07T00:11:13.830365+0000","last_unstale":"2023-10-07T00:12:49.697495+0000","last_undegraded":"2023-10-07T00:12:49.697495+0000","last_fullsized":"2023-10-07T00:12:49.697495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:22:00.580441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'32","reported_seq":270,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.893773+0000","last_change":"2023-10-07T00:11:50.782182+0000","last_active":"2023-10-07T00:12:54.893773+0000","last_peered":"2023-10-07T00:12:54.893773+0000","last_clean":"2023-10-07T00:12:54.893773+0000","last_became_active":"2023-10-07T00:11:50.774767+0000","last_became_peered":"2023-10-07T00:11:50.774767+0000","last_unstale":"2023-10-07T00:12:54.893773+0000","last_undegraded":"2023-10-07T00:12:54.893773+0000","last_fullsized":"2023-10-07T00:12:54.893773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:28:39.403496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57188,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":191,"num_read_kb":150,"num_write":34,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":56440,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688619+0000","last_change":"2023-10-07T00:11:13.832332+0000","last_active":"2023-10-07T00:12:49.688619+0000","last_peered":"2023-10-07T00:12:49.688619+0000","last_clean":"2023-10-07T00:12:49.688619+0000","last_became_active":"2023-10-07T00:11:13.832000+0000","last_became_peered":"2023-10-07T00:11:13.832000+0000","last_unstale":"2023-10-07T00:12:49.688619+0000","last_undegraded":"2023-10-07T00:12:49.688619+0000","last_fullsized":"2023-10-07T00:12:49.688619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:39.913331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733497+0000","last_change":"2023-10-07T00:11:12.839399+0000","last_active":"2023-10-07T00:11:49.733497+0000","last_peered":"2023-10-07T00:11:49.733497+0000","last_clean":"2023-10-07T00:11:49.733497+0000","last_became_active":"2023-10-07T00:11:12.838997+0000","last_became_peered":"2023-10-07T00:11:12.838997+0000","last_unstale":"2023-10-07T00:11:49.733497+0000","last_undegraded":"2023-10-07T00:11:49.733497+0000","last_fullsized":"2023-10-07T00:11:49.733497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:11.194224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690098+0000","last_change":"2023-10-07T00:11:13.830832+0000","last_active":"2023-10-07T00:12:49.690098+0000","last_peered":"2023-10-07T00:12:49.690098+0000","last_clean":"2023-10-07T00:12:49.690098+0000","last_became_active":"2023-10-07T00:11:13.830373+0000","last_became_peered":"2023-10-07T00:11:13.830373+0000","last_unstale":"2023-10-07T00:12:49.690098+0000","last_undegraded":"2023-10-07T00:12:49.690098+0000","last_fullsized":"2023-10-07T00:12:49.690098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:08.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729861+0000","last_change":"2023-10-07T00:11:12.834543+0000","last_active":"2023-10-07T00:11:49.729861+0000","last_peered":"2023-10-07T00:11:49.729861+0000","last_clean":"2023-10-07T00:11:49.729861+0000","last_became_active":"2023-10-07T00:11:12.834213+0000","last_became_peered":"2023-10-07T00:11:12.834213+0000","last_unstale":"2023-10-07T00:11:49.729861+0000","last_undegraded":"2023-10-07T00:11:49.729861+0000","last_fullsized":"2023-10-07T00:11:49.729861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:57:35.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699342+0000","last_change":"2023-10-07T00:11:13.830645+0000","last_active":"2023-10-07T00:12:49.699342+0000","last_peered":"2023-10-07T00:12:49.699342+0000","last_clean":"2023-10-07T00:12:49.699342+0000","last_became_active":"2023-10-07T00:11:13.830331+0000","last_became_peered":"2023-10-07T00:11:13.830331+0000","last_unstale":"2023-10-07T00:12:49.699342+0000","last_undegraded":"2023-10-07T00:12:49.699342+0000","last_fullsized":"2023-10-07T00:12:49.699342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:19:55.226177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.812336+0000","last_change":"2023-10-07T00:11:12.830062+0000","last_active":"2023-10-07T00:12:52.812336+0000","last_peered":"2023-10-07T00:12:52.812336+0000","last_clean":"2023-10-07T00:12:52.812336+0000","last_became_active":"2023-10-07T00:11:12.829734+0000","last_became_peered":"2023-10-07T00:11:12.829734+0000","last_unstale":"2023-10-07T00:12:52.812336+0000","last_undegraded":"2023-10-07T00:12:52.812336+0000","last_fullsized":"2023-10-07T00:12:52.812336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:59.658154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689518+0000","last_change":"2023-10-07T00:11:13.840915+0000","last_active":"2023-10-07T00:12:49.689518+0000","last_peered":"2023-10-07T00:12:49.689518+0000","last_clean":"2023-10-07T00:12:49.689518+0000","last_became_active":"2023-10-07T00:11:13.840584+0000","last_became_peered":"2023-10-07T00:11:13.840584+0000","last_unstale":"2023-10-07T00:12:49.689518+0000","last_undegraded":"2023-10-07T00:12:49.689518+0000","last_fullsized":"2023-10-07T00:12:49.689518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:27:58.672800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726440+0000","last_change":"2023-10-07T00:11:12.829034+0000","last_active":"2023-10-07T00:11:49.726440+0000","last_peered":"2023-10-07T00:11:49.726440+0000","last_clean":"2023-10-07T00:11:49.726440+0000","last_became_active":"2023-10-07T00:11:12.828671+0000","last_became_peered":"2023-10-07T00:11:12.828671+0000","last_unstale":"2023-10-07T00:11:49.726440+0000","last_undegraded":"2023-10-07T00:11:49.726440+0000","last_fullsized":"2023-10-07T00:11:49.726440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:09:14.203804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.691491+0000","last_change":"2023-10-07T00:11:13.843029+0000","last_active":"2023-10-07T00:12:49.691491+0000","last_peered":"2023-10-07T00:12:49.691491+0000","last_clean":"2023-10-07T00:12:49.691491+0000","last_became_active":"2023-10-07T00:11:13.842714+0000","last_became_peered":"2023-10-07T00:11:13.842714+0000","last_unstale":"2023-10-07T00:12:49.691491+0000","last_undegraded":"2023-10-07T00:12:49.691491+0000","last_fullsized":"2023-10-07T00:12:49.691491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:46.147059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.727162+0000","last_change":"2023-10-07T00:11:12.830887+0000","last_active":"2023-10-07T00:11:49.727162+0000","last_peered":"2023-10-07T00:11:49.727162+0000","last_clean":"2023-10-07T00:11:49.727162+0000","last_became_active":"2023-10-07T00:11:12.830500+0000","last_became_peered":"2023-10-07T00:11:12.830500+0000","last_unstale":"2023-10-07T00:11:49.727162+0000","last_undegraded":"2023-10-07T00:11:49.727162+0000","last_fullsized":"2023-10-07T00:11:49.727162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:39.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686183+0000","last_change":"2023-10-07T00:11:13.838823+0000","last_active":"2023-10-07T00:12:49.686183+0000","last_peered":"2023-10-07T00:12:49.686183+0000","last_clean":"2023-10-07T00:12:49.686183+0000","last_became_active":"2023-10-07T00:11:13.838491+0000","last_became_peered":"2023-10-07T00:11:13.838491+0000","last_unstale":"2023-10-07T00:12:49.686183+0000","last_undegraded":"2023-10-07T00:12:49.686183+0000","last_fullsized":"2023-10-07T00:12:49.686183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:29:31.340686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728495+0000","last_change":"2023-10-07T00:11:12.838303+0000","last_active":"2023-10-07T00:11:49.728495+0000","last_peered":"2023-10-07T00:11:49.728495+0000","last_clean":"2023-10-07T00:11:49.728495+0000","last_became_active":"2023-10-07T00:11:12.837891+0000","last_became_peered":"2023-10-07T00:11:12.837891+0000","last_unstale":"2023-10-07T00:11:49.728495+0000","last_undegraded":"2023-10-07T00:11:49.728495+0000","last_fullsized":"2023-10-07T00:11:49.728495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:56.957653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687785+0000","last_change":"2023-10-07T00:11:13.840109+0000","last_active":"2023-10-07T00:12:49.687785+0000","last_peered":"2023-10-07T00:12:49.687785+0000","last_clean":"2023-10-07T00:12:49.687785+0000","last_became_active":"2023-10-07T00:11:13.839767+0000","last_became_peered":"2023-10-07T00:11:13.839767+0000","last_unstale":"2023-10-07T00:12:49.687785+0000","last_undegraded":"2023-10-07T00:12:49.687785+0000","last_fullsized":"2023-10-07T00:12:49.687785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:24.236839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.830402+0000","last_change":"2023-10-07T00:11:12.837365+0000","last_active":"2023-10-07T00:12:54.830402+0000","last_peered":"2023-10-07T00:12:54.830402+0000","last_clean":"2023-10-07T00:12:54.830402+0000","last_became_active":"2023-10-07T00:11:12.836992+0000","last_became_peered":"2023-10-07T00:11:12.836992+0000","last_unstale":"2023-10-07T00:12:54.830402+0000","last_undegraded":"2023-10-07T00:12:54.830402+0000","last_fullsized":"2023-10-07T00:12:54.830402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:24:09.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687278+0000","last_change":"2023-10-07T00:11:13.851151+0000","last_active":"2023-10-07T00:12:49.687278+0000","last_peered":"2023-10-07T00:12:49.687278+0000","last_clean":"2023-10-07T00:12:49.687278+0000","last_became_active":"2023-10-07T00:11:13.850807+0000","last_became_peered":"2023-10-07T00:11:13.850807+0000","last_unstale":"2023-10-07T00:12:49.687278+0000","last_undegraded":"2023-10-07T00:12:49.687278+0000","last_fullsized":"2023-10-07T00:12:49.687278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:17:42.857720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.684619+0000","last_change":"2023-10-07T00:11:13.844143+0000","last_active":"2023-10-07T00:12:49.684619+0000","last_peered":"2023-10-07T00:12:49.684619+0000","last_clean":"2023-10-07T00:12:49.684619+0000","last_became_active":"2023-10-07T00:11:13.843633+0000","last_became_peered":"2023-10-07T00:11:13.843633+0000","last_unstale":"2023-10-07T00:12:49.684619+0000","last_undegraded":"2023-10-07T00:12:49.684619+0000","last_fullsized":"2023-10-07T00:12:49.684619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:42:20.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.814862+0000","last_change":"2023-10-07T00:11:12.836076+0000","last_active":"2023-10-07T00:12:54.814862+0000","last_peered":"2023-10-07T00:12:54.814862+0000","last_clean":"2023-10-07T00:12:54.814862+0000","last_became_active":"2023-10-07T00:11:12.835709+0000","last_became_peered":"2023-10-07T00:11:12.835709+0000","last_unstale":"2023-10-07T00:12:54.814862+0000","last_undegraded":"2023-10-07T00:12:54.814862+0000","last_fullsized":"2023-10-07T00:12:54.814862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.096103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698483+0000","last_change":"2023-10-07T00:11:50.738891+0000","last_active":"2023-10-07T00:12:49.698483+0000","last_peered":"2023-10-07T00:12:49.698483+0000","last_clean":"2023-10-07T00:12:49.698483+0000","last_became_active":"2023-10-07T00:11:50.738516+0000","last_became_peered":"2023-10-07T00:11:50.738516+0000","last_unstale":"2023-10-07T00:12:49.698483+0000","last_undegraded":"2023-10-07T00:12:49.698483+0000","last_fullsized":"2023-10-07T00:12:49.698483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:22:10.840002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734497+0000","last_change":"2023-10-07T00:11:12.839717+0000","last_active":"2023-10-07T00:11:49.734497+0000","last_peered":"2023-10-07T00:11:49.734497+0000","last_clean":"2023-10-07T00:11:49.734497+0000","last_became_active":"2023-10-07T00:11:12.839287+0000","last_became_peered":"2023-10-07T00:11:12.839287+0000","last_unstale":"2023-10-07T00:11:49.734497+0000","last_undegraded":"2023-10-07T00:11:49.734497+0000","last_fullsized":"2023-10-07T00:11:49.734497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:11.170207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":314,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.733191+0000","last_change":"2023-10-07T00:09:53.652919+0000","last_active":"2023-10-07T00:11:50.733191+0000","last_peered":"2023-10-07T00:11:50.733191+0000","last_clean":"2023-10-07T00:11:50.733191+0000","last_became_active":"2023-10-07T00:09:53.652407+0000","last_became_peered":"2023-10-07T00:09:53.652407+0000","last_unstale":"2023-10-07T00:11:50.733191+0000","last_undegraded":"2023-10-07T00:11:50.733191+0000","last_fullsized":"2023-10-07T00:11:50.733191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_clean_scrub_stamp":"2023-10-07T00:06:22.557862+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:33:55.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.677729+0000","last_change":"2023-10-07T00:11:13.830797+0000","last_active":"2023-10-07T00:12:49.677729+0000","last_peered":"2023-10-07T00:12:49.677729+0000","last_clean":"2023-10-07T00:12:49.677729+0000","last_became_active":"2023-10-07T00:11:13.830467+0000","last_became_peered":"2023-10-07T00:11:13.830467+0000","last_unstale":"2023-10-07T00:12:49.677729+0000","last_undegraded":"2023-10-07T00:12:49.677729+0000","last_fullsized":"2023-10-07T00:12:49.677729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:48.545184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726436+0000","last_change":"2023-10-07T00:11:12.836000+0000","last_active":"2023-10-07T00:11:49.726436+0000","last_peered":"2023-10-07T00:11:49.726436+0000","last_clean":"2023-10-07T00:11:49.726436+0000","last_became_active":"2023-10-07T00:11:12.835588+0000","last_became_peered":"2023-10-07T00:11:12.835588+0000","last_unstale":"2023-10-07T00:11:49.726436+0000","last_undegraded":"2023-10-07T00:11:49.726436+0000","last_fullsized":"2023-10-07T00:11:49.726436+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:55:54.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.750173+0000","last_change":"2023-10-07T00:11:50.749694+0000","last_active":"2023-10-07T00:11:50.750173+0000","last_peered":"2023-10-07T00:11:50.750173+0000","last_clean":"2023-10-07T00:11:50.750173+0000","last_became_active":"2023-10-07T00:11:50.740568+0000","last_became_peered":"2023-10-07T00:11:50.740568+0000","last_unstale":"2023-10-07T00:11:50.750173+0000","last_undegraded":"2023-10-07T00:11:50.750173+0000","last_fullsized":"2023-10-07T00:11:50.750173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:19:31.414655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.678283+0000","last_change":"2023-10-07T00:11:13.828373+0000","last_active":"2023-10-07T00:12:49.678283+0000","last_peered":"2023-10-07T00:12:49.678283+0000","last_clean":"2023-10-07T00:12:49.678283+0000","last_became_active":"2023-10-07T00:11:13.827999+0000","last_became_peered":"2023-10-07T00:11:13.827999+0000","last_unstale":"2023-10-07T00:12:49.678283+0000","last_undegraded":"2023-10-07T00:12:49.678283+0000","last_fullsized":"2023-10-07T00:12:49.678283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:43.551348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.757662+0000","last_change":"2023-10-07T00:11:50.757226+0000","last_active":"2023-10-07T00:11:50.757662+0000","last_peered":"2023-10-07T00:11:50.757662+0000","last_clean":"2023-10-07T00:11:50.757662+0000","last_became_active":"2023-10-07T00:11:50.742238+0000","last_became_peered":"2023-10-07T00:11:50.742238+0000","last_unstale":"2023-10-07T00:11:50.757662+0000","last_undegraded":"2023-10-07T00:11:50.757662+0000","last_fullsized":"2023-10-07T00:11:50.757662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:26:20.609537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693199+0000","last_change":"2023-10-07T00:11:13.838814+0000","last_active":"2023-10-07T00:12:49.693199+0000","last_peered":"2023-10-07T00:12:49.693199+0000","last_clean":"2023-10-07T00:12:49.693199+0000","last_became_active":"2023-10-07T00:11:13.838468+0000","last_became_peered":"2023-10-07T00:11:13.838468+0000","last_unstale":"2023-10-07T00:12:49.693199+0000","last_undegraded":"2023-10-07T00:12:49.693199+0000","last_fullsized":"2023-10-07T00:12:49.693199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:29:38.944450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734231+0000","last_change":"2023-10-07T00:11:12.837042+0000","last_active":"2023-10-07T00:11:49.734231+0000","last_peered":"2023-10-07T00:11:49.734231+0000","last_clean":"2023-10-07T00:11:49.734231+0000","last_became_active":"2023-10-07T00:11:12.836605+0000","last_became_peered":"2023-10-07T00:11:12.836605+0000","last_unstale":"2023-10-07T00:11:49.734231+0000","last_undegraded":"2023-10-07T00:11:49.734231+0000","last_fullsized":"2023-10-07T00:11:49.734231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:30:13.684063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699537+0000","last_change":"2023-10-07T00:11:13.840778+0000","last_active":"2023-10-07T00:12:49.699537+0000","last_peered":"2023-10-07T00:12:49.699537+0000","last_clean":"2023-10-07T00:12:49.699537+0000","last_became_active":"2023-10-07T00:11:13.840472+0000","last_became_peered":"2023-10-07T00:11:13.840472+0000","last_unstale":"2023-10-07T00:12:49.699537+0000","last_undegraded":"2023-10-07T00:12:49.699537+0000","last_fullsized":"2023-10-07T00:12:49.699537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:59.088416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732547+0000","last_change":"2023-10-07T00:11:12.838534+0000","last_active":"2023-10-07T00:11:49.732547+0000","last_peered":"2023-10-07T00:11:49.732547+0000","last_clean":"2023-10-07T00:11:49.732547+0000","last_became_active":"2023-10-07T00:11:12.838220+0000","last_became_peered":"2023-10-07T00:11:12.838220+0000","last_unstale":"2023-10-07T00:11:49.732547+0000","last_undegraded":"2023-10-07T00:11:49.732547+0000","last_fullsized":"2023-10-07T00:11:49.732547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:16:47.170815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.645517+0000","last_change":"2023-10-07T00:11:13.831506+0000","last_active":"2023-10-07T00:12:49.645517+0000","last_peered":"2023-10-07T00:12:49.645517+0000","last_clean":"2023-10-07T00:12:49.645517+0000","last_became_active":"2023-10-07T00:11:13.831093+0000","last_became_peered":"2023-10-07T00:11:13.831093+0000","last_unstale":"2023-10-07T00:12:49.645517+0000","last_undegraded":"2023-10-07T00:12:49.645517+0000","last_fullsized":"2023-10-07T00:12:49.645517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:02.749470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731114+0000","last_change":"2023-10-07T00:11:12.841662+0000","last_active":"2023-10-07T00:11:49.731114+0000","last_peered":"2023-10-07T00:11:49.731114+0000","last_clean":"2023-10-07T00:11:49.731114+0000","last_became_active":"2023-10-07T00:11:12.841207+0000","last_became_peered":"2023-10-07T00:11:12.841207+0000","last_unstale":"2023-10-07T00:11:49.731114+0000","last_undegraded":"2023-10-07T00:11:49.731114+0000","last_fullsized":"2023-10-07T00:11:49.731114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:10.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699542+0000","last_change":"2023-10-07T00:11:13.844943+0000","last_active":"2023-10-07T00:12:49.699542+0000","last_peered":"2023-10-07T00:12:49.699542+0000","last_clean":"2023-10-07T00:12:49.699542+0000","last_became_active":"2023-10-07T00:11:13.844387+0000","last_became_peered":"2023-10-07T00:11:13.844387+0000","last_unstale":"2023-10-07T00:12:49.699542+0000","last_undegraded":"2023-10-07T00:12:49.699542+0000","last_fullsized":"2023-10-07T00:12:49.699542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:35.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'5","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.386382+0000","last_change":"2023-10-07T00:11:12.838191+0000","last_active":"2023-10-07T00:12:52.386382+0000","last_peered":"2023-10-07T00:12:52.386382+0000","last_clean":"2023-10-07T00:12:52.386382+0000","last_became_active":"2023-10-07T00:11:12.837821+0000","last_became_peered":"2023-10-07T00:11:12.837821+0000","last_unstale":"2023-10-07T00:12:52.386382+0000","last_undegraded":"2023-10-07T00:12:52.386382+0000","last_fullsized":"2023-10-07T00:12:52.386382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:16:38.519554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699516+0000","last_change":"2023-10-07T00:11:13.841478+0000","last_active":"2023-10-07T00:12:49.699516+0000","last_peered":"2023-10-07T00:12:49.699516+0000","last_clean":"2023-10-07T00:12:49.699516+0000","last_became_active":"2023-10-07T00:11:13.841085+0000","last_became_peered":"2023-10-07T00:11:13.841085+0000","last_unstale":"2023-10-07T00:12:49.699516+0000","last_undegraded":"2023-10-07T00:12:49.699516+0000","last_fullsized":"2023-10-07T00:12:49.699516+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:54:03.100980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726585+0000","last_change":"2023-10-07T00:11:12.831175+0000","last_active":"2023-10-07T00:11:49.726585+0000","last_peered":"2023-10-07T00:11:49.726585+0000","last_clean":"2023-10-07T00:11:49.726585+0000","last_became_active":"2023-10-07T00:11:12.830859+0000","last_became_peered":"2023-10-07T00:11:12.830859+0000","last_unstale":"2023-10-07T00:11:49.726585+0000","last_undegraded":"2023-10-07T00:11:49.726585+0000","last_fullsized":"2023-10-07T00:11:49.726585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:07.072334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.702192+0000","last_change":"2023-10-07T00:11:13.834163+0000","last_active":"2023-10-07T00:12:49.702192+0000","last_peered":"2023-10-07T00:12:49.702192+0000","last_clean":"2023-10-07T00:12:49.702192+0000","last_became_active":"2023-10-07T00:11:13.833807+0000","last_became_peered":"2023-10-07T00:11:13.833807+0000","last_unstale":"2023-10-07T00:12:49.702192+0000","last_undegraded":"2023-10-07T00:12:49.702192+0000","last_fullsized":"2023-10-07T00:12:49.702192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:12:18.606936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:53.813384+0000","last_change":"2023-10-07T00:11:12.835598+0000","last_active":"2023-10-07T00:12:53.813384+0000","last_peered":"2023-10-07T00:12:53.813384+0000","last_clean":"2023-10-07T00:12:53.813384+0000","last_became_active":"2023-10-07T00:11:12.835295+0000","last_became_peered":"2023-10-07T00:11:12.835295+0000","last_unstale":"2023-10-07T00:12:53.813384+0000","last_undegraded":"2023-10-07T00:12:53.813384+0000","last_fullsized":"2023-10-07T00:12:53.813384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:40:52.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701721+0000","last_change":"2023-10-07T00:11:13.837918+0000","last_active":"2023-10-07T00:12:49.701721+0000","last_peered":"2023-10-07T00:12:49.701721+0000","last_clean":"2023-10-07T00:12:49.701721+0000","last_became_active":"2023-10-07T00:11:13.834284+0000","last_became_peered":"2023-10-07T00:11:13.834284+0000","last_unstale":"2023-10-07T00:12:49.701721+0000","last_undegraded":"2023-10-07T00:12:49.701721+0000","last_fullsized":"2023-10-07T00:12:49.701721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:49:47.081395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729507+0000","last_change":"2023-10-07T00:11:12.839362+0000","last_active":"2023-10-07T00:11:49.729507+0000","last_peered":"2023-10-07T00:11:49.729507+0000","last_clean":"2023-10-07T00:11:49.729507+0000","last_became_active":"2023-10-07T00:11:12.838902+0000","last_became_peered":"2023-10-07T00:11:12.838902+0000","last_unstale":"2023-10-07T00:11:49.729507+0000","last_undegraded":"2023-10-07T00:11:49.729507+0000","last_fullsized":"2023-10-07T00:11:49.729507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:05:34.649556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687538+0000","last_change":"2023-10-07T00:11:13.839356+0000","last_active":"2023-10-07T00:12:49.687538+0000","last_peered":"2023-10-07T00:12:49.687538+0000","last_clean":"2023-10-07T00:12:49.687538+0000","last_became_active":"2023-10-07T00:11:13.838936+0000","last_became_peered":"2023-10-07T00:11:13.838936+0000","last_unstale":"2023-10-07T00:12:49.687538+0000","last_undegraded":"2023-10-07T00:12:49.687538+0000","last_fullsized":"2023-10-07T00:12:49.687538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:02.860174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728045+0000","last_change":"2023-10-07T00:11:12.839966+0000","last_active":"2023-10-07T00:11:49.728045+0000","last_peered":"2023-10-07T00:11:49.728045+0000","last_clean":"2023-10-07T00:11:49.728045+0000","last_became_active":"2023-10-07T00:11:12.839505+0000","last_became_peered":"2023-10-07T00:11:12.839505+0000","last_unstale":"2023-10-07T00:11:49.728045+0000","last_undegraded":"2023-10-07T00:11:49.728045+0000","last_fullsized":"2023-10-07T00:11:49.728045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:45:50.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689376+0000","last_change":"2023-10-07T00:11:13.839478+0000","last_active":"2023-10-07T00:12:49.689376+0000","last_peered":"2023-10-07T00:12:49.689376+0000","last_clean":"2023-10-07T00:12:49.689376+0000","last_became_active":"2023-10-07T00:11:13.839097+0000","last_became_peered":"2023-10-07T00:11:13.839097+0000","last_unstale":"2023-10-07T00:12:49.689376+0000","last_undegraded":"2023-10-07T00:12:49.689376+0000","last_fullsized":"2023-10-07T00:12:49.689376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:55.668486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694303+0000","last_change":"2023-10-07T00:11:13.839518+0000","last_active":"2023-10-07T00:12:49.694303+0000","last_peered":"2023-10-07T00:12:49.694303+0000","last_clean":"2023-10-07T00:12:49.694303+0000","last_became_active":"2023-10-07T00:11:13.839189+0000","last_became_peered":"2023-10-07T00:11:13.839189+0000","last_unstale":"2023-10-07T00:12:49.694303+0000","last_undegraded":"2023-10-07T00:12:49.694303+0000","last_fullsized":"2023-10-07T00:12:49.694303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:30:34.647955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.681399+0000","last_change":"2023-10-07T00:11:50.738694+0000","last_active":"2023-10-07T00:12:49.681399+0000","last_peered":"2023-10-07T00:12:49.681399+0000","last_clean":"2023-10-07T00:12:49.681399+0000","last_became_active":"2023-10-07T00:11:50.738045+0000","last_became_peered":"2023-10-07T00:11:50.738045+0000","last_unstale":"2023-10-07T00:12:49.681399+0000","last_undegraded":"2023-10-07T00:12:49.681399+0000","last_fullsized":"2023-10-07T00:12:49.681399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:50.348821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695853+0000","last_change":"2023-10-07T00:11:13.841371+0000","last_active":"2023-10-07T00:12:49.695853+0000","last_peered":"2023-10-07T00:12:49.695853+0000","last_clean":"2023-10-07T00:12:49.695853+0000","last_became_active":"2023-10-07T00:11:13.840986+0000","last_became_peered":"2023-10-07T00:11:13.840986+0000","last_unstale":"2023-10-07T00:12:49.695853+0000","last_undegraded":"2023-10-07T00:12:49.695853+0000","last_fullsized":"2023-10-07T00:12:49.695853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:49.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698526+0000","last_change":"2023-10-07T00:11:13.844865+0000","last_active":"2023-10-07T00:12:49.698526+0000","last_peered":"2023-10-07T00:12:49.698526+0000","last_clean":"2023-10-07T00:12:49.698526+0000","last_became_active":"2023-10-07T00:11:13.844495+0000","last_became_peered":"2023-10-07T00:11:13.844495+0000","last_unstale":"2023-10-07T00:12:49.698526+0000","last_undegraded":"2023-10-07T00:12:49.698526+0000","last_fullsized":"2023-10-07T00:12:49.698526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:00:29.862865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690534+0000","last_change":"2023-10-07T00:11:13.841126+0000","last_active":"2023-10-07T00:12:49.690534+0000","last_peered":"2023-10-07T00:12:49.690534+0000","last_clean":"2023-10-07T00:12:49.690534+0000","last_became_active":"2023-10-07T00:11:13.840748+0000","last_became_peered":"2023-10-07T00:11:13.840748+0000","last_unstale":"2023-10-07T00:12:49.690534+0000","last_undegraded":"2023-10-07T00:12:49.690534+0000","last_fullsized":"2023-10-07T00:12:49.690534+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:55.444456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.685683+0000","last_change":"2023-10-07T00:11:13.840320+0000","last_active":"2023-10-07T00:12:49.685683+0000","last_peered":"2023-10-07T00:12:49.685683+0000","last_clean":"2023-10-07T00:12:49.685683+0000","last_became_active":"2023-10-07T00:11:13.839993+0000","last_became_peered":"2023-10-07T00:11:13.839993+0000","last_unstale":"2023-10-07T00:12:49.685683+0000","last_undegraded":"2023-10-07T00:12:49.685683+0000","last_fullsized":"2023-10-07T00:12:49.685683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:29:39.843550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690506+0000","last_change":"2023-10-07T00:11:13.830436+0000","last_active":"2023-10-07T00:12:49.690506+0000","last_peered":"2023-10-07T00:12:49.690506+0000","last_clean":"2023-10-07T00:12:49.690506+0000","last_became_active":"2023-10-07T00:11:13.827974+0000","last_became_peered":"2023-10-07T00:11:13.827974+0000","last_unstale":"2023-10-07T00:12:49.690506+0000","last_undegraded":"2023-10-07T00:12:49.690506+0000","last_fullsized":"2023-10-07T00:12:49.690506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:46.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.679783+0000","last_change":"2023-10-07T00:11:13.833929+0000","last_active":"2023-10-07T00:12:49.679783+0000","last_peered":"2023-10-07T00:12:49.679783+0000","last_clean":"2023-10-07T00:12:49.679783+0000","last_became_active":"2023-10-07T00:11:13.833539+0000","last_became_peered":"2023-10-07T00:11:13.833539+0000","last_unstale":"2023-10-07T00:12:49.679783+0000","last_undegraded":"2023-10-07T00:12:49.679783+0000","last_fullsized":"2023-10-07T00:12:49.679783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:46:04.981559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686627+0000","last_change":"2023-10-07T00:11:13.837959+0000","last_active":"2023-10-07T00:12:49.686627+0000","last_peered":"2023-10-07T00:12:49.686627+0000","last_clean":"2023-10-07T00:12:49.686627+0000","last_became_active":"2023-10-07T00:11:13.837650+0000","last_became_peered":"2023-10-07T00:11:13.837650+0000","last_unstale":"2023-10-07T00:12:49.686627+0000","last_undegraded":"2023-10-07T00:12:49.686627+0000","last_fullsized":"2023-10-07T00:12:49.686627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:41.068847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688004+0000","last_change":"2023-10-07T00:11:13.847348+0000","last_active":"2023-10-07T00:12:49.688004+0000","last_peered":"2023-10-07T00:12:49.688004+0000","last_clean":"2023-10-07T00:12:49.688004+0000","last_became_active":"2023-10-07T00:11:13.846988+0000","last_became_peered":"2023-10-07T00:11:13.846988+0000","last_unstale":"2023-10-07T00:12:49.688004+0000","last_undegraded":"2023-10-07T00:12:49.688004+0000","last_fullsized":"2023-10-07T00:12:49.688004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.960128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699333+0000","last_change":"2023-10-07T00:11:13.831801+0000","last_active":"2023-10-07T00:12:49.699333+0000","last_peered":"2023-10-07T00:12:49.699333+0000","last_clean":"2023-10-07T00:12:49.699333+0000","last_became_active":"2023-10-07T00:11:13.831497+0000","last_became_peered":"2023-10-07T00:11:13.831497+0000","last_unstale":"2023-10-07T00:12:49.699333+0000","last_undegraded":"2023-10-07T00:12:49.699333+0000","last_fullsized":"2023-10-07T00:12:49.699333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:43.802252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695811+0000","last_change":"2023-10-07T00:11:13.841423+0000","last_active":"2023-10-07T00:12:49.695811+0000","last_peered":"2023-10-07T00:12:49.695811+0000","last_clean":"2023-10-07T00:12:49.695811+0000","last_became_active":"2023-10-07T00:11:13.841115+0000","last_became_peered":"2023-10-07T00:11:13.841115+0000","last_unstale":"2023-10-07T00:12:49.695811+0000","last_undegraded":"2023-10-07T00:12:49.695811+0000","last_fullsized":"2023-10-07T00:12:49.695811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:32.355577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687407+0000","last_change":"2023-10-07T00:11:13.840162+0000","last_active":"2023-10-07T00:12:49.687407+0000","last_peered":"2023-10-07T00:12:49.687407+0000","last_clean":"2023-10-07T00:12:49.687407+0000","last_became_active":"2023-10-07T00:11:13.839760+0000","last_became_peered":"2023-10-07T00:11:13.839760+0000","last_unstale":"2023-10-07T00:12:49.687407+0000","last_undegraded":"2023-10-07T00:12:49.687407+0000","last_fullsized":"2023-10-07T00:12:49.687407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.727027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248175,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66137,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":986,"num_read_kb":568,"num_write":250,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":57564,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":198411,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460729,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.83699999999999997,"5min":1.018,"15min":1.018},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91800000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.76400000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.877,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.46000000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82999999999999996,"15min":0.82599999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.752},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0509999999999999,"5min":1.105,"15min":1.105},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.018,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97099999999999997,"5min":1.133,"15min":1.133},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91600000000000004,"15min":0.92200000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0840000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.71399999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.159,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.044,"5min":1.306,"15min":1.306},"last":0.88300000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.871}]},{"osd":9,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.998,"15min":1.0029999999999999},"min":{"1min":0.72699999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2110000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.77300000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.86199999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94799999999999995,"15min":0.94299999999999995},"min":{"1min":0.72799999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1739999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.018,"15min":1.022},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1799999999999999,"5min":2.286,"15min":2.286},"last":0.94899999999999995}]}]},{"osd":10,"up_from":73,"seq":313532612648,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1108840,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.2379999999999995,"5min":9.2379999999999995,"15min":9.2379999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":9.1910000000000007,"5min":9.1910000000000007,"15min":9.1910000000000007},"last":0.59899999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.499},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79400000000000004,"5min":1.161,"15min":1.161},"last":0.79400000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89100000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.55100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89600000000000002,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.877,"5min":9.3580000000000005,"15min":9.3580000000000005},"last":0.621}]},{"osd":4,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86699999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68600000000000005,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":1.226,"15min":1.226},"last":0.86899999999999999}]},{"osd":5,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.87},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94999999999999996,"5min":1.29,"15min":1.29},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.88200000000000001},"min":{"1min":0.625,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.995,"5min":3.101,"15min":3.101},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.88300000000000001,"15min":0.92300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.93100000000000005,"5min":1.242,"15min":1.242},"last":0.93100000000000005}]},{"osd":7,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56499999999999995}]},{"osd":8,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.97999999999999998,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.92100000000000004,"15min":0.95499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.042,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0309999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.96999999999999997,"15min":0.99199999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.01,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93999999999999995,"15min":0.96299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0780000000000001,"5min":3.25,"15min":3.25},"last":1.0780000000000001}]},{"osd":11,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95999999999999996,"15min":0.96499999999999997},"min":{"1min":0.745,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.1379999999999999,"5min":1.294,"15min":1.294},"last":1.054},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90200000000000002,"15min":0.90000000000000002},"min":{"1min":0.76100000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.159,"5min":1.165,"15min":1.165},"last":0.998}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":460048,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.89300000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.73499999999999999,"15min":0.76700000000000002},"min":{"1min":0.48299999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71999999999999997},"min":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0429999999999999,"5min":1.137,"15min":1.137},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98899999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.60299999999999998}]},{"osd":3,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.012,"5min":2.198,"15min":2.198},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.83699999999999997,"5min":1.982,"15min":1.982},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.59899999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.89700000000000002,"15min":0.90900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.962,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.59599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0780000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84199999999999997,"15min":0.871},"min":{"1min":0.61199999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96999999999999997,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.84299999999999997,"15min":0.89100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90000000000000002,"5min":2.214,"15min":2.214},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.86199999999999999,"15min":0.90400000000000003},"min":{"1min":0.47599999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96199999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.048,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.94699999999999995,"15min":0.98299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.087,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.80100000000000005}]},{"osd":8,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.93500000000000005,"15min":0.96699999999999997},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.091,"5min":1.591,"15min":1.591},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.69899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1439999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.0229999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.96399999999999997,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.746},{"interface":"front","average":{"1min":0.875,"5min":0.95599999999999996,"15min":0.96099999999999997},"min":{"1min":0.63200000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.343,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.101}]},{"osd":11,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.1479999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037811,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":460314,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.032,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.53200000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0489999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.72199999999999998,"15min":0.70099999999999996},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.95099999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.44,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92100000000000004,"5min":1.073,"15min":1.073},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1830000000000001,"5min":1.498,"15min":1.498},"last":0.52800000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.76600000000000001,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.92000000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.58899999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.54000000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0429999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.67700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.389,"15min":1.389},"last":0.96699999999999997}]},{"osd":7,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.88600000000000001,"15min":0.86499999999999999},"min":{"1min":0.73299999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1919999999999999,"5min":1.391,"15min":1.391},"last":1.012},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.83699999999999997,"15min":0.83299999999999996},"min":{"1min":0.66200000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.095,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85599999999999998}]},{"osd":9,"last update":"Sat Oct 7 00:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.88500000000000001,"15min":0.86899999999999999},"min":{"1min":0.76000000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.05},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.133,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80300000000000005}]},{"osd":10,"last update":"Sat Oct 7 00:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.69999999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.89700000000000002},"min":{"1min":0.71899999999999997,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2030000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.095}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":1.032},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.071}]}]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1054256,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.52700000000000002},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68200000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.163,"15min":1.163},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.68400000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95799999999999996,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94999999999999996,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.65600000000000003,"15min":0.67900000000000005},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.443}]},{"osd":5,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0760000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.68200000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0609999999999999,"5min":1.891,"15min":1.891},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":0.92700000000000005,"5min":1.147,"15min":1.147},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.83199999999999996,"15min":0.85199999999999998},"min":{"1min":0.54900000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.018,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.63600000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.80100000000000005},"min":{"1min":0.72999999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0089999999999999,"5min":1.252,"15min":1.252},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.84099999999999997,"15min":0.81299999999999994},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1639999999999999,"5min":1.234,"15min":1.234},"last":0.83599999999999997}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":0.95599999999999996,"15min":0.90000000000000002},"min":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":9.6829999999999998,"5min":9.6829999999999998,"15min":9.6829999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.86699999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.256,"5min":1.849,"15min":1.849},"last":0.81699999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.208,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.92700000000000005,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0980000000000001,"5min":1.919,"15min":1.919},"last":0.91200000000000003}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.879},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.89500000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462973,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460270,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.55000000000000004,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":8.1240000000000006,"5min":8.1240000000000006,"15min":8.1240000000000006},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.77700000000000002,"15min":0.74099999999999999},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.6790000000000003,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.495,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.66400000000000003}]},{"osd":2,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72599999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91800000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.82499999999999996,"15min":0.78300000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.75900000000000001,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":8.0500000000000007,"5min":8.0500000000000007,"15min":8.0500000000000007},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":4.0430000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0569999999999999,"5min":1.325,"15min":1.325},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.143,"5min":0.88500000000000001,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.8799999999999999,"5min":7.8799999999999999,"15min":7.8799999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.78400000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.9239999999999999,"5min":3.9239999999999999,"15min":3.9239999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.81899999999999995,"15min":0.84899999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97199999999999998,"5min":1.292,"15min":1.292},"last":0.746}]},{"osd":7,"last update":"Sat Oct 7 00:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.61299999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98299999999999998,"5min":1.419,"15min":1.419},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.157,"5min":0.90700000000000003,"15min":0.85599999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":7.9370000000000003,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":0.86199999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.89100000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2150000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.87}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.96899999999999997,"15min":0.96399999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":8.0860000000000003,"5min":8.0860000000000003,"15min":8.0860000000000003},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.972,"5min":3.972,"15min":3.972},"last":0.84699999999999998}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.90800000000000003,"15min":0.92800000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3029999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.873,"5min":1.0349999999999999,"15min":1.0209999999999999},"min":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0509999999999999,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":519744,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.32700000000000001},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":3.851,"5min":3.851,"15min":3.851},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.72599999999999998,"15min":0.60199999999999998},"min":{"1min":0.65200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.69999999999999996,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.077,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.86699999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.70699999999999996,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.505},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89700000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.59499999999999997,"15min":0.52700000000000002},"min":{"1min":0.44600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.79100000000000004,"15min":0.70299999999999996},"min":{"1min":0.66900000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.163,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.754},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.752,"15min":0.68500000000000005},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0309999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":0.85199999999999998,"15min":0.76600000000000001},"min":{"1min":0.69599999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.76800000000000002,"15min":0.69799999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.8959999999999999,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.89200000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71499999999999997,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.96899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":1.079},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84499999999999997,"15min":0.80500000000000005},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.038}]},{"osd":8,"last update":"Sat Oct 7 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.88100000000000001,"15min":0.84499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.79500000000000004,"15min":0.76900000000000002},"min":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0169999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.60199999999999998,"5min":0.503,"15min":0.503},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.89300000000000002,"15min":0.86699999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.94999999999999996}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.85999999999999999,"15min":0.84999999999999998},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.141},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.872,"15min":0.85799999999999998},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.123}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.103},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0549999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":461330,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 00:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.59799999999999998},"min":{"1min":0.36399999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":0.98499999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.48599999999999999,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.94599999999999995}]},{"osd":2,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.53100000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.002,"5min":0.70199999999999996,"15min":0.65300000000000002},"min":{"1min":0.48699999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.97099999999999997}]},{"osd":3,"last update":"Sat Oct 7 00:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.746,"15min":0.68000000000000005},"min":{"1min":0.58499999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":1.054},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.68200000000000005,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.0880000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0629999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.747},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.77200000000000002,"15min":0.73199999999999998},"min":{"1min":0.55800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":1.022}]},{"osd":6,"last update":"Sat Oct 7 00:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.64100000000000001,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.169,"5min":0.78500000000000003,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.4290000000000003,"5min":7.4290000000000003,"15min":7.4290000000000003},"last":0.875}]},{"osd":7,"last update":"Sat Oct 7 00:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.60999999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.85999999999999999,"15min":0.83299999999999996},"min":{"1min":0.65200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":1.177},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.82999999999999996,"15min":0.80900000000000005},"min":{"1min":0.63600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.1539999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":0.95999999999999996,"15min":0.91700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":9.0359999999999996,"5min":9.0359999999999996,"15min":9.0359999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0900000000000001,"5min":0.89400000000000002,"15min":0.879},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.6509999999999998,"5min":5.6509999999999998,"15min":5.6509999999999998},"last":1.21}]},{"osd":10,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.95799999999999996,"15min":0.92800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":1.274},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.71399999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.2969999999999999}]},{"osd":11,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.88400000000000001},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.109},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.92400000000000004,"15min":0.90400000000000003},"min":{"1min":0.68999999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.254}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":460775,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.372,"5min":0.312,"15min":0.312},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.59199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70799999999999996,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.69399999999999995,"15min":0.624},"min":{"1min":0.443,"5min":0.378,"15min":0.378},"max":{"1min":1.0389999999999999,"5min":1.115,"15min":1.115},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.48199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.0189999999999999,"5min":1.022,"15min":1.022},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.63800000000000001},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66000000000000003}]},{"osd":4,"last update":"Sat Oct 7 00:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.48599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.002}]},{"osd":5,"last update":"Sat Oct 7 00:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.57299999999999995},"min":{"1min":0.54800000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69199999999999995,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0069999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.501}]},{"osd":6,"last update":"Sat Oct 7 00:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.76400000000000001,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.85699999999999998}]},{"osd":7,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.60099999999999998}]},{"osd":8,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.51000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.54800000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1240000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77800000000000002}]},{"osd":9,"last update":"Sat Oct 7 00:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.86099999999999999,"15min":0.83499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.155,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.82599999999999996,"15min":0.80600000000000005},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.129,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.873}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85099999999999998,"15min":0.82899999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.109,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.89800000000000002},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.141,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.89600000000000002}]},{"osd":11,"last update":"Sat Oct 7 00:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.73199999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":459271,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79600000000000004,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.48899999999999999,"15min":0.44500000000000001},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.65800000000000003,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":1.042,"15min":1.042},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69599999999999995,"15min":0.629},"min":{"1min":0.51800000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94499999999999995,"5min":1.647,"15min":1.647},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88200000000000001,"5min":1.284,"15min":1.284},"last":0.88200000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72999999999999998,"15min":0.68400000000000005},"min":{"1min":0.46999999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.753,"15min":0.69799999999999995},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.70999999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.68799999999999994},"min":{"1min":0.48699999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.93300000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.72599999999999998,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.69599999999999995},"min":{"1min":0.43099999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.621}]},{"osd":7,"last update":"Sat Oct 7 00:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76500000000000001,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0109999999999999,"5min":1.167,"15min":1.167},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.56200000000000006,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.748}]},{"osd":8,"last update":"Sat Oct 7 00:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.89400000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.052,"5min":1.103,"15min":1.103},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.746}]},{"osd":9,"last update":"Sat Oct 7 00:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":0.873},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.1950000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91900000000000004,"15min":0.95599999999999996},"min":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.194,"5min":1.272,"15min":1.272},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.74099999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0780000000000001,"5min":1.252,"15min":1.252},"last":0.86599999999999999}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.83899999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888136,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":517040,"data_compressed":14696,"data_compressed_allocated":20480,"data_compressed_original":69632,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56100000000000005,"15min":0.54300000000000004},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.49099999999999999,"15min":0.47799999999999998},"min":{"1min":0.35199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95499999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.82899999999999996}]},{"osd":3,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67900000000000005,"15min":0.65200000000000002},"min":{"1min":0.46800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88400000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72099999999999997,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0669999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0309999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.752},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98599999999999999,"5min":1.069,"15min":1.069},"last":0.78200000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71599999999999997,"15min":0.67000000000000004},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.746,"15min":0.70799999999999996},"min":{"1min":0.57699999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0049999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82399999999999995,"15min":0.81599999999999995},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.81899999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1279999999999999,"5min":1.212,"15min":1.212},"last":1.0369999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.94699999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.86099999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.98099999999999998}]},{"osd":11,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.091},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.0580000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":1052936,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.68500000000000005,"15min":0.59899999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.633,"5min":4.633,"15min":4.633},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94899999999999995,"5min":1.147,"15min":1.147},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.80800000000000005},"min":{"1min":0.47099999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":5.96,"15min":5.96},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.49299999999999999},"min":{"1min":0.38700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55100000000000005,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70899999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.69799999999999995,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.44},"max":{"1min":4.7060000000000004,"5min":4.7060000000000004,"15min":4.7060000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63300000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72999999999999998,"15min":0.68600000000000005},"min":{"1min":0.52200000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.083,"5min":1.093,"15min":1.093},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.89800000000000002},"min":{"1min":0.504,"5min":0.437,"15min":0.437},"max":{"1min":0.94399999999999995,"5min":5.9100000000000001,"15min":5.9100000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97099999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.90400000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79500000000000004,"15min":0.77400000000000002},"min":{"1min":0.59199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0249999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.64600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.48299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0289999999999999,"5min":1.083,"15min":1.083},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.56799999999999995,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.874}]},{"osd":9,"last update":"Sat Oct 7 00:12:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":0.93000000000000005,"15min":0.88500000000000001},"min":{"1min":0.70499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":4.6609999999999996,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.208},"last":0.88800000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88600000000000001,"15min":0.89200000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":61091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":58387,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T00:12:59.010 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-07T00:12:59.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T00:12:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:58 smithi088 ceph-mon[103111]: pgmap v352: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:12:59.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:58 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/359527918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.244+0000 7f1299fff700 1 -- 172.21.15.5:0/1889278634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294073910 msgr2=0x7f1294073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.244+0000 7f1299fff700 1 --2- 172.21.15.5:0/1889278634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294073910 0x7f1294073d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1288009990 tx=0x7f1288009ca0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.244+0000 7f1299fff700 1 -- 172.21.15.5:0/1889278634 shutdown_connections 2023-10-07T00:12:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.244+0000 7f1299fff700 1 --2- 172.21.15.5:0/1889278634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1294108e70 0x7f129410b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.244+0000 7f1299fff700 1 --2- 172.21.15.5:0/1889278634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1294074ef0 0x7f1294073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.244+0000 7f1299fff700 1 --2- 172.21.15.5:0/1889278634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294073910 0x7f1294073d90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.244+0000 7f1299fff700 1 -- 172.21.15.5:0/1889278634 >> 172.21.15.5:0/1889278634 conn(0x7f12940fc520 msgr2=0x7f12940fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.245+0000 7f1299fff700 1 -- 172.21.15.5:0/1889278634 shutdown_connections 2023-10-07T00:12:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.245+0000 7f1299fff700 1 -- 172.21.15.5:0/1889278634 wait complete. 2023-10-07T00:12:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:58 smithi112 ceph-mon[133548]: pgmap v352: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:12:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:58 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/359527918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:12:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1299fff700 1 Processor -- start 2023-10-07T00:12:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1299fff700 1 -- start start 2023-10-07T00:12:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1299fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1294073910 0x7f1294198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1299fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1294074ef0 0x7f12941993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1299fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294108e70 0x7f12941a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1299fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12941a0a30 con 0x7f1294108e70 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1299fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12941a0b70 con 0x7f1294074ef0 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1299fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12941a0d00 con 0x7f1294073910 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f12937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1294073910 0x7f1294198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1293fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294108e70 0x7f12941a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f12937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1294073910 0x7f1294198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53626/0 (socket says 172.21.15.5:53626) 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f12937fe700 1 -- 172.21.15.5:0/963257255 learned_addr learned my addr 172.21.15.5:0/963257255 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.246+0000 7f1292ffd700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1294074ef0 0x7f12941993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1293fff700 1 -- 172.21.15.5:0/963257255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1294073910 msgr2=0x7f1294198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1293fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1294073910 0x7f1294198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1293fff700 1 -- 172.21.15.5:0/963257255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1294074ef0 msgr2=0x7f12941993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1293fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1294074ef0 0x7f12941993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1293fff700 1 -- 172.21.15.5:0/963257255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12880095f0 con 0x7f1294108e70 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1293fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294108e70 0x7f12941a0460 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f128c007f10 tx=0x7f128c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1290ff9700 1 -- 172.21.15.5:0/963257255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c004db0 con 0x7f1294108e70 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1290ff9700 1 -- 172.21.15.5:0/963257255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f128c00f040 con 0x7f1294108e70 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12941a0fe0 con 0x7f1294108e70 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1290ff9700 1 -- 172.21.15.5:0/963257255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c005960 con 0x7f1294108e70 2023-10-07T00:12:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.247+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12941a1460 con 0x7f1294108e70 2023-10-07T00:12:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.248+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1294107520 con 0x7f1294108e70 2023-10-07T00:12:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.250+0000 7f1290ff9700 1 -- 172.21.15.5:0/963257255 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f128c00db20 con 0x7f1294108e70 2023-10-07T00:12:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.252+0000 7f1290ff9700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f127c0a1500 0x7f127c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.252+0000 7f1290ff9700 1 -- 172.21.15.5:0/963257255 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f128c0cc4e0 con 0x7f1294108e70 2023-10-07T00:12:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.252+0000 7f12937fe700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f127c0a1500 0x7f127c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:59.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.253+0000 7f12937fe700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f127c0a1500 0x7f127c0a39c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1284005950 tx=0x7f128400b500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.256+0000 7f1290ff9700 1 -- 172.21.15.5:0/963257255 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f128c04f100 con 0x7f1294108e70 2023-10-07T00:12:59.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.462+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 --> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f129402d230 con 0x7f127c0a1500 2023-10-07T00:12:59.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.473+0000 7f1290ff9700 1 -- 172.21.15.5:0/963257255 <== mgr.14150 v2:172.21.15.5:6800/227111979 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344574 (secure 0 0 0) 0x7f129402d230 con 0x7f127c0a1500 2023-10-07T00:12:59.479 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f127c0a1500 msgr2=0x7f127c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f127c0a1500 0x7f127c0a39c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1284005950 tx=0x7f128400b500 comp rx=0 tx=0).stop 2023-10-07T00:12:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294108e70 msgr2=0x7f12941a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294108e70 0x7f12941a0460 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f128c007f10 tx=0x7f128c00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 shutdown_connections 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f127c0a1500 0x7f127c0a39c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1294108e70 0x7f12941a0460 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1294073910 0x7f1294198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 --2- 172.21.15.5:0/963257255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1294074ef0 0x7f12941993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 >> 172.21.15.5:0/963257255 conn(0x7f12940fc520 msgr2=0x7f12940fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 shutdown_connections 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.478+0000 7f1299fff700 1 -- 172.21.15.5:0/963257255 wait complete. 2023-10-07T00:12:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-07T00:12:59.498 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2023-10-07T00:12:57.669484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656751,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1112,"num_read_kb":677,"num_write":433,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1238300,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335924,"kb_used_data":11732,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605900,"statfs":{"total":1151940427776,"available":1151596441600,"internally_reserved":0,"allocated":12013568,"data_stored":7475553,"data_compressed":186885,"data_compressed_allocated":245760,"data_compressed_original":2019328,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2885,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":62,"num_write":19,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003500"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.700840+0000","last_change":"2023-10-07T00:11:13.845315+0000","last_active":"2023-10-07T00:12:49.700840+0000","last_peered":"2023-10-07T00:12:49.700840+0000","last_clean":"2023-10-07T00:12:49.700840+0000","last_became_active":"2023-10-07T00:11:13.844330+0000","last_became_peered":"2023-10-07T00:11:13.844330+0000","last_unstale":"2023-10-07T00:12:49.700840+0000","last_undegraded":"2023-10-07T00:12:49.700840+0000","last_fullsized":"2023-10-07T00:12:49.700840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:26.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694353+0000","last_change":"2023-10-07T00:11:13.842602+0000","last_active":"2023-10-07T00:12:49.694353+0000","last_peered":"2023-10-07T00:12:49.694353+0000","last_clean":"2023-10-07T00:12:49.694353+0000","last_became_active":"2023-10-07T00:11:13.842296+0000","last_became_peered":"2023-10-07T00:11:13.842296+0000","last_unstale":"2023-10-07T00:12:49.694353+0000","last_undegraded":"2023-10-07T00:12:49.694353+0000","last_fullsized":"2023-10-07T00:12:49.694353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:51.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699118+0000","last_change":"2023-10-07T00:11:13.850567+0000","last_active":"2023-10-07T00:12:49.699118+0000","last_peered":"2023-10-07T00:12:49.699118+0000","last_clean":"2023-10-07T00:12:49.699118+0000","last_became_active":"2023-10-07T00:11:13.850212+0000","last_became_peered":"2023-10-07T00:11:13.850212+0000","last_unstale":"2023-10-07T00:12:49.699118+0000","last_undegraded":"2023-10-07T00:12:49.699118+0000","last_fullsized":"2023-10-07T00:12:49.699118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:51.539752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.672512+0000","last_change":"2023-10-07T00:11:13.839742+0000","last_active":"2023-10-07T00:12:49.672512+0000","last_peered":"2023-10-07T00:12:49.672512+0000","last_clean":"2023-10-07T00:12:49.672512+0000","last_became_active":"2023-10-07T00:11:13.839041+0000","last_became_peered":"2023-10-07T00:11:13.839041+0000","last_unstale":"2023-10-07T00:12:49.672512+0000","last_undegraded":"2023-10-07T00:12:49.672512+0000","last_fullsized":"2023-10-07T00:12:49.672512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:51:59.241248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.670248+0000","last_change":"2023-10-07T00:11:13.834839+0000","last_active":"2023-10-07T00:12:49.670248+0000","last_peered":"2023-10-07T00:12:49.670248+0000","last_clean":"2023-10-07T00:12:49.670248+0000","last_became_active":"2023-10-07T00:11:13.834529+0000","last_became_peered":"2023-10-07T00:11:13.834529+0000","last_unstale":"2023-10-07T00:12:49.670248+0000","last_undegraded":"2023-10-07T00:12:49.670248+0000","last_fullsized":"2023-10-07T00:12:49.670248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:40:23.831424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.682684+0000","last_change":"2023-10-07T00:11:13.835102+0000","last_active":"2023-10-07T00:12:49.682684+0000","last_peered":"2023-10-07T00:12:49.682684+0000","last_clean":"2023-10-07T00:12:49.682684+0000","last_became_active":"2023-10-07T00:11:13.834781+0000","last_became_peered":"2023-10-07T00:11:13.834781+0000","last_unstale":"2023-10-07T00:12:49.682684+0000","last_undegraded":"2023-10-07T00:12:49.682684+0000","last_fullsized":"2023-10-07T00:12:49.682684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:16:55.912464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.697844+0000","last_change":"2023-10-07T00:11:50.781822+0000","last_active":"2023-10-07T00:12:49.697844+0000","last_peered":"2023-10-07T00:12:49.697844+0000","last_clean":"2023-10-07T00:12:49.697844+0000","last_became_active":"2023-10-07T00:11:50.781261+0000","last_became_peered":"2023-10-07T00:11:50.781261+0000","last_unstale":"2023-10-07T00:12:49.697844+0000","last_undegraded":"2023-10-07T00:12:49.697844+0000","last_fullsized":"2023-10-07T00:12:49.697844+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:16.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689182+0000","last_change":"2023-10-07T00:11:13.842772+0000","last_active":"2023-10-07T00:12:49.689182+0000","last_peered":"2023-10-07T00:12:49.689182+0000","last_clean":"2023-10-07T00:12:49.689182+0000","last_became_active":"2023-10-07T00:11:13.841610+0000","last_became_peered":"2023-10-07T00:11:13.841610+0000","last_unstale":"2023-10-07T00:12:49.689182+0000","last_undegraded":"2023-10-07T00:12:49.689182+0000","last_fullsized":"2023-10-07T00:12:49.689182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:04:51.988705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693881+0000","last_change":"2023-10-07T00:11:13.836990+0000","last_active":"2023-10-07T00:12:49.693881+0000","last_peered":"2023-10-07T00:12:49.693881+0000","last_clean":"2023-10-07T00:12:49.693881+0000","last_became_active":"2023-10-07T00:11:13.836699+0000","last_became_peered":"2023-10-07T00:11:13.836699+0000","last_unstale":"2023-10-07T00:12:49.693881+0000","last_undegraded":"2023-10-07T00:12:49.693881+0000","last_fullsized":"2023-10-07T00:12:49.693881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:18:20.450573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695597+0000","last_change":"2023-10-07T00:11:50.736801+0000","last_active":"2023-10-07T00:12:49.695597+0000","last_peered":"2023-10-07T00:12:49.695597+0000","last_clean":"2023-10-07T00:12:49.695597+0000","last_became_active":"2023-10-07T00:11:50.736256+0000","last_became_peered":"2023-10-07T00:11:50.736256+0000","last_unstale":"2023-10-07T00:12:49.695597+0000","last_undegraded":"2023-10-07T00:12:49.695597+0000","last_fullsized":"2023-10-07T00:12:49.695597+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:07:35.622108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701841+0000","last_change":"2023-10-07T00:11:13.841699+0000","last_active":"2023-10-07T00:12:49.701841+0000","last_peered":"2023-10-07T00:12:49.701841+0000","last_clean":"2023-10-07T00:12:49.701841+0000","last_became_active":"2023-10-07T00:11:13.841295+0000","last_became_peered":"2023-10-07T00:11:13.841295+0000","last_unstale":"2023-10-07T00:12:49.701841+0000","last_undegraded":"2023-10-07T00:12:49.701841+0000","last_fullsized":"2023-10-07T00:12:49.701841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:24:56.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.683142+0000","last_change":"2023-10-07T00:11:13.839951+0000","last_active":"2023-10-07T00:12:49.683142+0000","last_peered":"2023-10-07T00:12:49.683142+0000","last_clean":"2023-10-07T00:12:49.683142+0000","last_became_active":"2023-10-07T00:11:13.839473+0000","last_became_peered":"2023-10-07T00:11:13.839473+0000","last_unstale":"2023-10-07T00:12:49.683142+0000","last_undegraded":"2023-10-07T00:12:49.683142+0000","last_fullsized":"2023-10-07T00:12:49.683142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:09.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687310+0000","last_change":"2023-10-07T00:11:13.838714+0000","last_active":"2023-10-07T00:12:49.687310+0000","last_peered":"2023-10-07T00:12:49.687310+0000","last_clean":"2023-10-07T00:12:49.687310+0000","last_became_active":"2023-10-07T00:11:13.838222+0000","last_became_peered":"2023-10-07T00:11:13.838222+0000","last_unstale":"2023-10-07T00:12:49.687310+0000","last_undegraded":"2023-10-07T00:12:49.687310+0000","last_fullsized":"2023-10-07T00:12:49.687310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:11:43.194204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694768+0000","last_change":"2023-10-07T00:11:13.843075+0000","last_active":"2023-10-07T00:12:49.694768+0000","last_peered":"2023-10-07T00:12:49.694768+0000","last_clean":"2023-10-07T00:12:49.694768+0000","last_became_active":"2023-10-07T00:11:13.842742+0000","last_became_peered":"2023-10-07T00:11:13.842742+0000","last_unstale":"2023-10-07T00:12:49.694768+0000","last_undegraded":"2023-10-07T00:12:49.694768+0000","last_fullsized":"2023-10-07T00:12:49.694768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:53:12.713979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.692979+0000","last_change":"2023-10-07T00:11:13.841635+0000","last_active":"2023-10-07T00:12:49.692979+0000","last_peered":"2023-10-07T00:12:49.692979+0000","last_clean":"2023-10-07T00:12:49.692979+0000","last_became_active":"2023-10-07T00:11:13.841291+0000","last_became_peered":"2023-10-07T00:11:13.841291+0000","last_unstale":"2023-10-07T00:12:49.692979+0000","last_undegraded":"2023-10-07T00:12:49.692979+0000","last_fullsized":"2023-10-07T00:12:49.692979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:48:38.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701753+0000","last_change":"2023-10-07T00:11:13.842365+0000","last_active":"2023-10-07T00:12:49.701753+0000","last_peered":"2023-10-07T00:12:49.701753+0000","last_clean":"2023-10-07T00:12:49.701753+0000","last_became_active":"2023-10-07T00:11:13.842057+0000","last_became_peered":"2023-10-07T00:11:13.842057+0000","last_unstale":"2023-10-07T00:12:49.701753+0000","last_undegraded":"2023-10-07T00:12:49.701753+0000","last_fullsized":"2023-10-07T00:12:49.701753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:36.575712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701353+0000","last_change":"2023-10-07T00:11:13.845746+0000","last_active":"2023-10-07T00:12:49.701353+0000","last_peered":"2023-10-07T00:12:49.701353+0000","last_clean":"2023-10-07T00:12:49.701353+0000","last_became_active":"2023-10-07T00:11:13.844828+0000","last_became_peered":"2023-10-07T00:11:13.844828+0000","last_unstale":"2023-10-07T00:12:49.701353+0000","last_undegraded":"2023-10-07T00:12:49.701353+0000","last_fullsized":"2023-10-07T00:12:49.701353+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:34:00.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698936+0000","last_change":"2023-10-07T00:11:13.837749+0000","last_active":"2023-10-07T00:12:49.698936+0000","last_peered":"2023-10-07T00:12:49.698936+0000","last_clean":"2023-10-07T00:12:49.698936+0000","last_became_active":"2023-10-07T00:11:13.837400+0000","last_became_peered":"2023-10-07T00:11:13.837400+0000","last_unstale":"2023-10-07T00:12:49.698936+0000","last_undegraded":"2023-10-07T00:12:49.698936+0000","last_fullsized":"2023-10-07T00:12:49.698936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:38:40.190065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.683546+0000","last_change":"2023-10-07T00:11:13.833086+0000","last_active":"2023-10-07T00:12:49.683546+0000","last_peered":"2023-10-07T00:12:49.683546+0000","last_clean":"2023-10-07T00:12:49.683546+0000","last_became_active":"2023-10-07T00:11:13.832748+0000","last_became_peered":"2023-10-07T00:11:13.832748+0000","last_unstale":"2023-10-07T00:12:49.683546+0000","last_undegraded":"2023-10-07T00:12:49.683546+0000","last_fullsized":"2023-10-07T00:12:49.683546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:29.176224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.825126+0000","last_change":"2023-10-07T00:11:12.835440+0000","last_active":"2023-10-07T00:12:52.825126+0000","last_peered":"2023-10-07T00:12:52.825126+0000","last_clean":"2023-10-07T00:12:52.825126+0000","last_became_active":"2023-10-07T00:11:12.835094+0000","last_became_peered":"2023-10-07T00:11:12.835094+0000","last_unstale":"2023-10-07T00:12:52.825126+0000","last_undegraded":"2023-10-07T00:12:52.825126+0000","last_fullsized":"2023-10-07T00:12:52.825126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:13.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.680178+0000","last_change":"2023-10-07T00:11:13.847832+0000","last_active":"2023-10-07T00:12:49.680178+0000","last_peered":"2023-10-07T00:12:49.680178+0000","last_clean":"2023-10-07T00:12:49.680178+0000","last_became_active":"2023-10-07T00:11:13.847436+0000","last_became_peered":"2023-10-07T00:11:13.847436+0000","last_unstale":"2023-10-07T00:12:49.680178+0000","last_undegraded":"2023-10-07T00:12:49.680178+0000","last_fullsized":"2023-10-07T00:12:49.680178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:47:07.409132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732015+0000","last_change":"2023-10-07T00:11:12.842832+0000","last_active":"2023-10-07T00:11:49.732015+0000","last_peered":"2023-10-07T00:11:49.732015+0000","last_clean":"2023-10-07T00:11:49.732015+0000","last_became_active":"2023-10-07T00:11:12.842296+0000","last_became_peered":"2023-10-07T00:11:12.842296+0000","last_unstale":"2023-10-07T00:11:49.732015+0000","last_undegraded":"2023-10-07T00:11:49.732015+0000","last_fullsized":"2023-10-07T00:11:49.732015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:22:00.968303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699705+0000","last_change":"2023-10-07T00:11:13.851259+0000","last_active":"2023-10-07T00:12:49.699705+0000","last_peered":"2023-10-07T00:12:49.699705+0000","last_clean":"2023-10-07T00:12:49.699705+0000","last_became_active":"2023-10-07T00:11:13.850963+0000","last_became_peered":"2023-10-07T00:11:13.850963+0000","last_unstale":"2023-10-07T00:12:49.699705+0000","last_undegraded":"2023-10-07T00:12:49.699705+0000","last_fullsized":"2023-10-07T00:12:49.699705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:52.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726990+0000","last_change":"2023-10-07T00:11:12.835286+0000","last_active":"2023-10-07T00:11:49.726990+0000","last_peered":"2023-10-07T00:11:49.726990+0000","last_clean":"2023-10-07T00:11:49.726990+0000","last_became_active":"2023-10-07T00:11:12.834890+0000","last_became_peered":"2023-10-07T00:11:12.834890+0000","last_unstale":"2023-10-07T00:11:49.726990+0000","last_undegraded":"2023-10-07T00:11:49.726990+0000","last_fullsized":"2023-10-07T00:11:49.726990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:06:05.225849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699004+0000","last_change":"2023-10-07T00:11:13.831174+0000","last_active":"2023-10-07T00:12:49.699004+0000","last_peered":"2023-10-07T00:12:49.699004+0000","last_clean":"2023-10-07T00:12:49.699004+0000","last_became_active":"2023-10-07T00:11:13.830868+0000","last_became_peered":"2023-10-07T00:11:13.830868+0000","last_unstale":"2023-10-07T00:12:49.699004+0000","last_undegraded":"2023-10-07T00:12:49.699004+0000","last_fullsized":"2023-10-07T00:12:49.699004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:20.727747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726737+0000","last_change":"2023-10-07T00:11:12.835740+0000","last_active":"2023-10-07T00:11:49.726737+0000","last_peered":"2023-10-07T00:11:49.726737+0000","last_clean":"2023-10-07T00:11:49.726737+0000","last_became_active":"2023-10-07T00:11:12.835035+0000","last_became_peered":"2023-10-07T00:11:12.835035+0000","last_unstale":"2023-10-07T00:11:49.726737+0000","last_undegraded":"2023-10-07T00:11:49.726737+0000","last_fullsized":"2023-10-07T00:11:49.726737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:36:07.447748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693850+0000","last_change":"2023-10-07T00:11:13.847940+0000","last_active":"2023-10-07T00:12:49.693850+0000","last_peered":"2023-10-07T00:12:49.693850+0000","last_clean":"2023-10-07T00:12:49.693850+0000","last_became_active":"2023-10-07T00:11:13.847595+0000","last_became_peered":"2023-10-07T00:11:13.847595+0000","last_unstale":"2023-10-07T00:12:49.693850+0000","last_undegraded":"2023-10-07T00:12:49.693850+0000","last_fullsized":"2023-10-07T00:12:49.693850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:56:28.004429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.844277+0000","last_change":"2023-10-07T00:11:50.743813+0000","last_active":"2023-10-07T00:12:52.844277+0000","last_peered":"2023-10-07T00:12:52.844277+0000","last_clean":"2023-10-07T00:12:52.844277+0000","last_became_active":"2023-10-07T00:11:50.739205+0000","last_became_peered":"2023-10-07T00:11:50.739205+0000","last_unstale":"2023-10-07T00:12:52.844277+0000","last_undegraded":"2023-10-07T00:12:52.844277+0000","last_fullsized":"2023-10-07T00:12:52.844277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:26.630097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1652,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686629+0000","last_change":"2023-10-07T00:11:13.838732+0000","last_active":"2023-10-07T00:12:49.686629+0000","last_peered":"2023-10-07T00:12:49.686629+0000","last_clean":"2023-10-07T00:12:49.686629+0000","last_became_active":"2023-10-07T00:11:13.838408+0000","last_became_peered":"2023-10-07T00:11:13.838408+0000","last_unstale":"2023-10-07T00:12:49.686629+0000","last_undegraded":"2023-10-07T00:12:49.686629+0000","last_fullsized":"2023-10-07T00:12:49.686629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:55:55.039399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.736631+0000","last_change":"2023-10-07T00:11:12.831778+0000","last_active":"2023-10-07T00:11:49.736631+0000","last_peered":"2023-10-07T00:11:49.736631+0000","last_clean":"2023-10-07T00:11:49.736631+0000","last_became_active":"2023-10-07T00:11:12.831479+0000","last_became_peered":"2023-10-07T00:11:12.831479+0000","last_unstale":"2023-10-07T00:11:49.736631+0000","last_undegraded":"2023-10-07T00:11:49.736631+0000","last_fullsized":"2023-10-07T00:11:49.736631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:12:57.994585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.680858+0000","last_change":"2023-10-07T00:11:50.745021+0000","last_active":"2023-10-07T00:12:49.680858+0000","last_peered":"2023-10-07T00:12:49.680858+0000","last_clean":"2023-10-07T00:12:49.680858+0000","last_became_active":"2023-10-07T00:11:50.744570+0000","last_became_peered":"2023-10-07T00:11:50.744570+0000","last_unstale":"2023-10-07T00:12:49.680858+0000","last_undegraded":"2023-10-07T00:12:49.680858+0000","last_fullsized":"2023-10-07T00:12:49.680858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:54.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728874+0000","last_change":"2023-10-07T00:11:12.825556+0000","last_active":"2023-10-07T00:11:49.728874+0000","last_peered":"2023-10-07T00:11:49.728874+0000","last_clean":"2023-10-07T00:11:49.728874+0000","last_became_active":"2023-10-07T00:11:12.825189+0000","last_became_peered":"2023-10-07T00:11:12.825189+0000","last_unstale":"2023-10-07T00:11:49.728874+0000","last_undegraded":"2023-10-07T00:11:49.728874+0000","last_fullsized":"2023-10-07T00:11:49.728874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:20:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.691428+0000","last_change":"2023-10-07T00:11:50.781935+0000","last_active":"2023-10-07T00:12:49.691428+0000","last_peered":"2023-10-07T00:12:49.691428+0000","last_clean":"2023-10-07T00:12:49.691428+0000","last_became_active":"2023-10-07T00:11:50.781541+0000","last_became_peered":"2023-10-07T00:11:50.781541+0000","last_unstale":"2023-10-07T00:12:49.691428+0000","last_undegraded":"2023-10-07T00:12:49.691428+0000","last_fullsized":"2023-10-07T00:12:49.691428+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:29:18.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729367+0000","last_change":"2023-10-07T00:11:12.835239+0000","last_active":"2023-10-07T00:11:49.729367+0000","last_peered":"2023-10-07T00:11:49.729367+0000","last_clean":"2023-10-07T00:11:49.729367+0000","last_became_active":"2023-10-07T00:11:12.834912+0000","last_became_peered":"2023-10-07T00:11:12.834912+0000","last_unstale":"2023-10-07T00:11:49.729367+0000","last_undegraded":"2023-10-07T00:11:49.729367+0000","last_fullsized":"2023-10-07T00:11:49.729367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:32:44.097208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688131+0000","last_change":"2023-10-07T00:11:13.837642+0000","last_active":"2023-10-07T00:12:49.688131+0000","last_peered":"2023-10-07T00:12:49.688131+0000","last_clean":"2023-10-07T00:12:49.688131+0000","last_became_active":"2023-10-07T00:11:13.837291+0000","last_became_peered":"2023-10-07T00:11:13.837291+0000","last_unstale":"2023-10-07T00:12:49.688131+0000","last_undegraded":"2023-10-07T00:12:49.688131+0000","last_fullsized":"2023-10-07T00:12:49.688131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:19:14.445816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":213,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.814513+0000","last_change":"2023-10-07T00:11:12.826373+0000","last_active":"2023-10-07T00:12:54.814513+0000","last_peered":"2023-10-07T00:12:54.814513+0000","last_clean":"2023-10-07T00:12:54.814513+0000","last_became_active":"2023-10-07T00:11:12.826017+0000","last_became_peered":"2023-10-07T00:11:12.826017+0000","last_unstale":"2023-10-07T00:12:54.814513+0000","last_undegraded":"2023-10-07T00:12:54.814513+0000","last_fullsized":"2023-10-07T00:12:54.814513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:52:03.101632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":192,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699405+0000","last_change":"2023-10-07T00:11:13.830879+0000","last_active":"2023-10-07T00:12:49.699405+0000","last_peered":"2023-10-07T00:12:49.699405+0000","last_clean":"2023-10-07T00:12:49.699405+0000","last_became_active":"2023-10-07T00:11:13.830571+0000","last_became_peered":"2023-10-07T00:11:13.830571+0000","last_unstale":"2023-10-07T00:12:49.699405+0000","last_undegraded":"2023-10-07T00:12:49.699405+0000","last_fullsized":"2023-10-07T00:12:49.699405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:36.703499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726148+0000","last_change":"2023-10-07T00:11:12.833952+0000","last_active":"2023-10-07T00:11:49.726148+0000","last_peered":"2023-10-07T00:11:49.726148+0000","last_clean":"2023-10-07T00:11:49.726148+0000","last_became_active":"2023-10-07T00:11:12.833545+0000","last_became_peered":"2023-10-07T00:11:12.833545+0000","last_unstale":"2023-10-07T00:11:49.726148+0000","last_undegraded":"2023-10-07T00:11:49.726148+0000","last_fullsized":"2023-10-07T00:11:49.726148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:28:12.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695546+0000","last_change":"2023-10-07T00:11:13.843758+0000","last_active":"2023-10-07T00:12:49.695546+0000","last_peered":"2023-10-07T00:12:49.695546+0000","last_clean":"2023-10-07T00:12:49.695546+0000","last_became_active":"2023-10-07T00:11:13.843443+0000","last_became_peered":"2023-10-07T00:11:13.843443+0000","last_unstale":"2023-10-07T00:12:49.695546+0000","last_undegraded":"2023-10-07T00:12:49.695546+0000","last_fullsized":"2023-10-07T00:12:49.695546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:07:28.610304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729780+0000","last_change":"2023-10-07T00:11:12.833043+0000","last_active":"2023-10-07T00:11:49.729780+0000","last_peered":"2023-10-07T00:11:49.729780+0000","last_clean":"2023-10-07T00:11:49.729780+0000","last_became_active":"2023-10-07T00:11:12.832632+0000","last_became_peered":"2023-10-07T00:11:12.832632+0000","last_unstale":"2023-10-07T00:11:49.729780+0000","last_undegraded":"2023-10-07T00:11:49.729780+0000","last_fullsized":"2023-10-07T00:11:49.729780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:14:25.148603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.697495+0000","last_change":"2023-10-07T00:11:13.831129+0000","last_active":"2023-10-07T00:12:49.697495+0000","last_peered":"2023-10-07T00:12:49.697495+0000","last_clean":"2023-10-07T00:12:49.697495+0000","last_became_active":"2023-10-07T00:11:13.830365+0000","last_became_peered":"2023-10-07T00:11:13.830365+0000","last_unstale":"2023-10-07T00:12:49.697495+0000","last_undegraded":"2023-10-07T00:12:49.697495+0000","last_fullsized":"2023-10-07T00:12:49.697495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:22:00.580441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'32","reported_seq":270,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.893773+0000","last_change":"2023-10-07T00:11:50.782182+0000","last_active":"2023-10-07T00:12:54.893773+0000","last_peered":"2023-10-07T00:12:54.893773+0000","last_clean":"2023-10-07T00:12:54.893773+0000","last_became_active":"2023-10-07T00:11:50.774767+0000","last_became_peered":"2023-10-07T00:11:50.774767+0000","last_unstale":"2023-10-07T00:12:54.893773+0000","last_undegraded":"2023-10-07T00:12:54.893773+0000","last_fullsized":"2023-10-07T00:12:54.893773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:28:39.403496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57188,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":191,"num_read_kb":150,"num_write":34,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":56440,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688619+0000","last_change":"2023-10-07T00:11:13.832332+0000","last_active":"2023-10-07T00:12:49.688619+0000","last_peered":"2023-10-07T00:12:49.688619+0000","last_clean":"2023-10-07T00:12:49.688619+0000","last_became_active":"2023-10-07T00:11:13.832000+0000","last_became_peered":"2023-10-07T00:11:13.832000+0000","last_unstale":"2023-10-07T00:12:49.688619+0000","last_undegraded":"2023-10-07T00:12:49.688619+0000","last_fullsized":"2023-10-07T00:12:49.688619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:28:39.913331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.733497+0000","last_change":"2023-10-07T00:11:12.839399+0000","last_active":"2023-10-07T00:11:49.733497+0000","last_peered":"2023-10-07T00:11:49.733497+0000","last_clean":"2023-10-07T00:11:49.733497+0000","last_became_active":"2023-10-07T00:11:12.838997+0000","last_became_peered":"2023-10-07T00:11:12.838997+0000","last_unstale":"2023-10-07T00:11:49.733497+0000","last_undegraded":"2023-10-07T00:11:49.733497+0000","last_fullsized":"2023-10-07T00:11:49.733497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:11.194224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690098+0000","last_change":"2023-10-07T00:11:13.830832+0000","last_active":"2023-10-07T00:12:49.690098+0000","last_peered":"2023-10-07T00:12:49.690098+0000","last_clean":"2023-10-07T00:12:49.690098+0000","last_became_active":"2023-10-07T00:11:13.830373+0000","last_became_peered":"2023-10-07T00:11:13.830373+0000","last_unstale":"2023-10-07T00:12:49.690098+0000","last_undegraded":"2023-10-07T00:12:49.690098+0000","last_fullsized":"2023-10-07T00:12:49.690098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:08.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729861+0000","last_change":"2023-10-07T00:11:12.834543+0000","last_active":"2023-10-07T00:11:49.729861+0000","last_peered":"2023-10-07T00:11:49.729861+0000","last_clean":"2023-10-07T00:11:49.729861+0000","last_became_active":"2023-10-07T00:11:12.834213+0000","last_became_peered":"2023-10-07T00:11:12.834213+0000","last_unstale":"2023-10-07T00:11:49.729861+0000","last_undegraded":"2023-10-07T00:11:49.729861+0000","last_fullsized":"2023-10-07T00:11:49.729861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:57:35.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699342+0000","last_change":"2023-10-07T00:11:13.830645+0000","last_active":"2023-10-07T00:12:49.699342+0000","last_peered":"2023-10-07T00:12:49.699342+0000","last_clean":"2023-10-07T00:12:49.699342+0000","last_became_active":"2023-10-07T00:11:13.830331+0000","last_became_peered":"2023-10-07T00:11:13.830331+0000","last_unstale":"2023-10-07T00:12:49.699342+0000","last_undegraded":"2023-10-07T00:12:49.699342+0000","last_fullsized":"2023-10-07T00:12:49.699342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:19:55.226177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.812336+0000","last_change":"2023-10-07T00:11:12.830062+0000","last_active":"2023-10-07T00:12:52.812336+0000","last_peered":"2023-10-07T00:12:52.812336+0000","last_clean":"2023-10-07T00:12:52.812336+0000","last_became_active":"2023-10-07T00:11:12.829734+0000","last_became_peered":"2023-10-07T00:11:12.829734+0000","last_unstale":"2023-10-07T00:12:52.812336+0000","last_undegraded":"2023-10-07T00:12:52.812336+0000","last_fullsized":"2023-10-07T00:12:52.812336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:14:59.658154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689518+0000","last_change":"2023-10-07T00:11:13.840915+0000","last_active":"2023-10-07T00:12:49.689518+0000","last_peered":"2023-10-07T00:12:49.689518+0000","last_clean":"2023-10-07T00:12:49.689518+0000","last_became_active":"2023-10-07T00:11:13.840584+0000","last_became_peered":"2023-10-07T00:11:13.840584+0000","last_unstale":"2023-10-07T00:12:49.689518+0000","last_undegraded":"2023-10-07T00:12:49.689518+0000","last_fullsized":"2023-10-07T00:12:49.689518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:27:58.672800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726440+0000","last_change":"2023-10-07T00:11:12.829034+0000","last_active":"2023-10-07T00:11:49.726440+0000","last_peered":"2023-10-07T00:11:49.726440+0000","last_clean":"2023-10-07T00:11:49.726440+0000","last_became_active":"2023-10-07T00:11:12.828671+0000","last_became_peered":"2023-10-07T00:11:12.828671+0000","last_unstale":"2023-10-07T00:11:49.726440+0000","last_undegraded":"2023-10-07T00:11:49.726440+0000","last_fullsized":"2023-10-07T00:11:49.726440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:09:14.203804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.691491+0000","last_change":"2023-10-07T00:11:13.843029+0000","last_active":"2023-10-07T00:12:49.691491+0000","last_peered":"2023-10-07T00:12:49.691491+0000","last_clean":"2023-10-07T00:12:49.691491+0000","last_became_active":"2023-10-07T00:11:13.842714+0000","last_became_peered":"2023-10-07T00:11:13.842714+0000","last_unstale":"2023-10-07T00:12:49.691491+0000","last_undegraded":"2023-10-07T00:12:49.691491+0000","last_fullsized":"2023-10-07T00:12:49.691491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:46.147059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.727162+0000","last_change":"2023-10-07T00:11:12.830887+0000","last_active":"2023-10-07T00:11:49.727162+0000","last_peered":"2023-10-07T00:11:49.727162+0000","last_clean":"2023-10-07T00:11:49.727162+0000","last_became_active":"2023-10-07T00:11:12.830500+0000","last_became_peered":"2023-10-07T00:11:12.830500+0000","last_unstale":"2023-10-07T00:11:49.727162+0000","last_undegraded":"2023-10-07T00:11:49.727162+0000","last_fullsized":"2023-10-07T00:11:49.727162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:39.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686183+0000","last_change":"2023-10-07T00:11:13.838823+0000","last_active":"2023-10-07T00:12:49.686183+0000","last_peered":"2023-10-07T00:12:49.686183+0000","last_clean":"2023-10-07T00:12:49.686183+0000","last_became_active":"2023-10-07T00:11:13.838491+0000","last_became_peered":"2023-10-07T00:11:13.838491+0000","last_unstale":"2023-10-07T00:12:49.686183+0000","last_undegraded":"2023-10-07T00:12:49.686183+0000","last_fullsized":"2023-10-07T00:12:49.686183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:29:31.340686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728495+0000","last_change":"2023-10-07T00:11:12.838303+0000","last_active":"2023-10-07T00:11:49.728495+0000","last_peered":"2023-10-07T00:11:49.728495+0000","last_clean":"2023-10-07T00:11:49.728495+0000","last_became_active":"2023-10-07T00:11:12.837891+0000","last_became_peered":"2023-10-07T00:11:12.837891+0000","last_unstale":"2023-10-07T00:11:49.728495+0000","last_undegraded":"2023-10-07T00:11:49.728495+0000","last_fullsized":"2023-10-07T00:11:49.728495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:56.957653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687785+0000","last_change":"2023-10-07T00:11:13.840109+0000","last_active":"2023-10-07T00:12:49.687785+0000","last_peered":"2023-10-07T00:12:49.687785+0000","last_clean":"2023-10-07T00:12:49.687785+0000","last_became_active":"2023-10-07T00:11:13.839767+0000","last_became_peered":"2023-10-07T00:11:13.839767+0000","last_unstale":"2023-10-07T00:12:49.687785+0000","last_undegraded":"2023-10-07T00:12:49.687785+0000","last_fullsized":"2023-10-07T00:12:49.687785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:24.236839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.830402+0000","last_change":"2023-10-07T00:11:12.837365+0000","last_active":"2023-10-07T00:12:54.830402+0000","last_peered":"2023-10-07T00:12:54.830402+0000","last_clean":"2023-10-07T00:12:54.830402+0000","last_became_active":"2023-10-07T00:11:12.836992+0000","last_became_peered":"2023-10-07T00:11:12.836992+0000","last_unstale":"2023-10-07T00:12:54.830402+0000","last_undegraded":"2023-10-07T00:12:54.830402+0000","last_fullsized":"2023-10-07T00:12:54.830402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:24:09.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687278+0000","last_change":"2023-10-07T00:11:13.851151+0000","last_active":"2023-10-07T00:12:49.687278+0000","last_peered":"2023-10-07T00:12:49.687278+0000","last_clean":"2023-10-07T00:12:49.687278+0000","last_became_active":"2023-10-07T00:11:13.850807+0000","last_became_peered":"2023-10-07T00:11:13.850807+0000","last_unstale":"2023-10-07T00:12:49.687278+0000","last_undegraded":"2023-10-07T00:12:49.687278+0000","last_fullsized":"2023-10-07T00:12:49.687278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:17:42.857720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.684619+0000","last_change":"2023-10-07T00:11:13.844143+0000","last_active":"2023-10-07T00:12:49.684619+0000","last_peered":"2023-10-07T00:12:49.684619+0000","last_clean":"2023-10-07T00:12:49.684619+0000","last_became_active":"2023-10-07T00:11:13.843633+0000","last_became_peered":"2023-10-07T00:11:13.843633+0000","last_unstale":"2023-10-07T00:12:49.684619+0000","last_undegraded":"2023-10-07T00:12:49.684619+0000","last_fullsized":"2023-10-07T00:12:49.684619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:42:20.058037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:54.814862+0000","last_change":"2023-10-07T00:11:12.836076+0000","last_active":"2023-10-07T00:12:54.814862+0000","last_peered":"2023-10-07T00:12:54.814862+0000","last_clean":"2023-10-07T00:12:54.814862+0000","last_became_active":"2023-10-07T00:11:12.835709+0000","last_became_peered":"2023-10-07T00:11:12.835709+0000","last_unstale":"2023-10-07T00:12:54.814862+0000","last_undegraded":"2023-10-07T00:12:54.814862+0000","last_fullsized":"2023-10-07T00:12:54.814862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:25.096103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698483+0000","last_change":"2023-10-07T00:11:50.738891+0000","last_active":"2023-10-07T00:12:49.698483+0000","last_peered":"2023-10-07T00:12:49.698483+0000","last_clean":"2023-10-07T00:12:49.698483+0000","last_became_active":"2023-10-07T00:11:50.738516+0000","last_became_peered":"2023-10-07T00:11:50.738516+0000","last_unstale":"2023-10-07T00:12:49.698483+0000","last_undegraded":"2023-10-07T00:12:49.698483+0000","last_fullsized":"2023-10-07T00:12:49.698483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:22:10.840002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734497+0000","last_change":"2023-10-07T00:11:12.839717+0000","last_active":"2023-10-07T00:11:49.734497+0000","last_peered":"2023-10-07T00:11:49.734497+0000","last_clean":"2023-10-07T00:11:49.734497+0000","last_became_active":"2023-10-07T00:11:12.839287+0000","last_became_peered":"2023-10-07T00:11:12.839287+0000","last_unstale":"2023-10-07T00:11:49.734497+0000","last_undegraded":"2023-10-07T00:11:49.734497+0000","last_fullsized":"2023-10-07T00:11:49.734497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:44:11.170207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":314,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.733191+0000","last_change":"2023-10-07T00:09:53.652919+0000","last_active":"2023-10-07T00:11:50.733191+0000","last_peered":"2023-10-07T00:11:50.733191+0000","last_clean":"2023-10-07T00:11:50.733191+0000","last_became_active":"2023-10-07T00:09:53.652407+0000","last_became_peered":"2023-10-07T00:09:53.652407+0000","last_unstale":"2023-10-07T00:11:50.733191+0000","last_undegraded":"2023-10-07T00:11:50.733191+0000","last_fullsized":"2023-10-07T00:11:50.733191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:06:22.557862+0000","last_clean_scrub_stamp":"2023-10-07T00:06:22.557862+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:33:55.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.677729+0000","last_change":"2023-10-07T00:11:13.830797+0000","last_active":"2023-10-07T00:12:49.677729+0000","last_peered":"2023-10-07T00:12:49.677729+0000","last_clean":"2023-10-07T00:12:49.677729+0000","last_became_active":"2023-10-07T00:11:13.830467+0000","last_became_peered":"2023-10-07T00:11:13.830467+0000","last_unstale":"2023-10-07T00:12:49.677729+0000","last_undegraded":"2023-10-07T00:12:49.677729+0000","last_fullsized":"2023-10-07T00:12:49.677729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:48.545184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726436+0000","last_change":"2023-10-07T00:11:12.836000+0000","last_active":"2023-10-07T00:11:49.726436+0000","last_peered":"2023-10-07T00:11:49.726436+0000","last_clean":"2023-10-07T00:11:49.726436+0000","last_became_active":"2023-10-07T00:11:12.835588+0000","last_became_peered":"2023-10-07T00:11:12.835588+0000","last_unstale":"2023-10-07T00:11:49.726436+0000","last_undegraded":"2023-10-07T00:11:49.726436+0000","last_fullsized":"2023-10-07T00:11:49.726436+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:55:54.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.750173+0000","last_change":"2023-10-07T00:11:50.749694+0000","last_active":"2023-10-07T00:11:50.750173+0000","last_peered":"2023-10-07T00:11:50.750173+0000","last_clean":"2023-10-07T00:11:50.750173+0000","last_became_active":"2023-10-07T00:11:50.740568+0000","last_became_peered":"2023-10-07T00:11:50.740568+0000","last_unstale":"2023-10-07T00:11:50.750173+0000","last_undegraded":"2023-10-07T00:11:50.750173+0000","last_fullsized":"2023-10-07T00:11:50.750173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:19:31.414655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.678283+0000","last_change":"2023-10-07T00:11:13.828373+0000","last_active":"2023-10-07T00:12:49.678283+0000","last_peered":"2023-10-07T00:12:49.678283+0000","last_clean":"2023-10-07T00:12:49.678283+0000","last_became_active":"2023-10-07T00:11:13.827999+0000","last_became_peered":"2023-10-07T00:11:13.827999+0000","last_unstale":"2023-10-07T00:12:49.678283+0000","last_undegraded":"2023-10-07T00:12:49.678283+0000","last_fullsized":"2023-10-07T00:12:49.678283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:43.551348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:11:50.757662+0000","last_change":"2023-10-07T00:11:50.757226+0000","last_active":"2023-10-07T00:11:50.757662+0000","last_peered":"2023-10-07T00:11:50.757662+0000","last_clean":"2023-10-07T00:11:50.757662+0000","last_became_active":"2023-10-07T00:11:50.742238+0000","last_became_peered":"2023-10-07T00:11:50.742238+0000","last_unstale":"2023-10-07T00:11:50.757662+0000","last_undegraded":"2023-10-07T00:11:50.757662+0000","last_fullsized":"2023-10-07T00:11:50.757662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:26:20.609537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.693199+0000","last_change":"2023-10-07T00:11:13.838814+0000","last_active":"2023-10-07T00:12:49.693199+0000","last_peered":"2023-10-07T00:12:49.693199+0000","last_clean":"2023-10-07T00:12:49.693199+0000","last_became_active":"2023-10-07T00:11:13.838468+0000","last_became_peered":"2023-10-07T00:11:13.838468+0000","last_unstale":"2023-10-07T00:12:49.693199+0000","last_undegraded":"2023-10-07T00:12:49.693199+0000","last_fullsized":"2023-10-07T00:12:49.693199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:29:38.944450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.734231+0000","last_change":"2023-10-07T00:11:12.837042+0000","last_active":"2023-10-07T00:11:49.734231+0000","last_peered":"2023-10-07T00:11:49.734231+0000","last_clean":"2023-10-07T00:11:49.734231+0000","last_became_active":"2023-10-07T00:11:12.836605+0000","last_became_peered":"2023-10-07T00:11:12.836605+0000","last_unstale":"2023-10-07T00:11:49.734231+0000","last_undegraded":"2023-10-07T00:11:49.734231+0000","last_fullsized":"2023-10-07T00:11:49.734231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:30:13.684063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699537+0000","last_change":"2023-10-07T00:11:13.840778+0000","last_active":"2023-10-07T00:12:49.699537+0000","last_peered":"2023-10-07T00:12:49.699537+0000","last_clean":"2023-10-07T00:12:49.699537+0000","last_became_active":"2023-10-07T00:11:13.840472+0000","last_became_peered":"2023-10-07T00:11:13.840472+0000","last_unstale":"2023-10-07T00:12:49.699537+0000","last_undegraded":"2023-10-07T00:12:49.699537+0000","last_fullsized":"2023-10-07T00:12:49.699537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:59.088416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.732547+0000","last_change":"2023-10-07T00:11:12.838534+0000","last_active":"2023-10-07T00:11:49.732547+0000","last_peered":"2023-10-07T00:11:49.732547+0000","last_clean":"2023-10-07T00:11:49.732547+0000","last_became_active":"2023-10-07T00:11:12.838220+0000","last_became_peered":"2023-10-07T00:11:12.838220+0000","last_unstale":"2023-10-07T00:11:49.732547+0000","last_undegraded":"2023-10-07T00:11:49.732547+0000","last_fullsized":"2023-10-07T00:11:49.732547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:16:47.170815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.645517+0000","last_change":"2023-10-07T00:11:13.831506+0000","last_active":"2023-10-07T00:12:49.645517+0000","last_peered":"2023-10-07T00:12:49.645517+0000","last_clean":"2023-10-07T00:12:49.645517+0000","last_became_active":"2023-10-07T00:11:13.831093+0000","last_became_peered":"2023-10-07T00:11:13.831093+0000","last_unstale":"2023-10-07T00:12:49.645517+0000","last_undegraded":"2023-10-07T00:12:49.645517+0000","last_fullsized":"2023-10-07T00:12:49.645517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:02.749470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.731114+0000","last_change":"2023-10-07T00:11:12.841662+0000","last_active":"2023-10-07T00:11:49.731114+0000","last_peered":"2023-10-07T00:11:49.731114+0000","last_clean":"2023-10-07T00:11:49.731114+0000","last_became_active":"2023-10-07T00:11:12.841207+0000","last_became_peered":"2023-10-07T00:11:12.841207+0000","last_unstale":"2023-10-07T00:11:49.731114+0000","last_undegraded":"2023-10-07T00:11:49.731114+0000","last_fullsized":"2023-10-07T00:11:49.731114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:10.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699542+0000","last_change":"2023-10-07T00:11:13.844943+0000","last_active":"2023-10-07T00:12:49.699542+0000","last_peered":"2023-10-07T00:12:49.699542+0000","last_clean":"2023-10-07T00:12:49.699542+0000","last_became_active":"2023-10-07T00:11:13.844387+0000","last_became_peered":"2023-10-07T00:11:13.844387+0000","last_unstale":"2023-10-07T00:12:49.699542+0000","last_undegraded":"2023-10-07T00:12:49.699542+0000","last_fullsized":"2023-10-07T00:12:49.699542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:40:35.340914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'5","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:52.386382+0000","last_change":"2023-10-07T00:11:12.838191+0000","last_active":"2023-10-07T00:12:52.386382+0000","last_peered":"2023-10-07T00:12:52.386382+0000","last_clean":"2023-10-07T00:12:52.386382+0000","last_became_active":"2023-10-07T00:11:12.837821+0000","last_became_peered":"2023-10-07T00:11:12.837821+0000","last_unstale":"2023-10-07T00:12:52.386382+0000","last_undegraded":"2023-10-07T00:12:52.386382+0000","last_fullsized":"2023-10-07T00:12:52.386382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:16:38.519554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699516+0000","last_change":"2023-10-07T00:11:13.841478+0000","last_active":"2023-10-07T00:12:49.699516+0000","last_peered":"2023-10-07T00:12:49.699516+0000","last_clean":"2023-10-07T00:12:49.699516+0000","last_became_active":"2023-10-07T00:11:13.841085+0000","last_became_peered":"2023-10-07T00:11:13.841085+0000","last_unstale":"2023-10-07T00:12:49.699516+0000","last_undegraded":"2023-10-07T00:12:49.699516+0000","last_fullsized":"2023-10-07T00:12:49.699516+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:54:03.100980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.726585+0000","last_change":"2023-10-07T00:11:12.831175+0000","last_active":"2023-10-07T00:11:49.726585+0000","last_peered":"2023-10-07T00:11:49.726585+0000","last_clean":"2023-10-07T00:11:49.726585+0000","last_became_active":"2023-10-07T00:11:12.830859+0000","last_became_peered":"2023-10-07T00:11:12.830859+0000","last_unstale":"2023-10-07T00:11:49.726585+0000","last_undegraded":"2023-10-07T00:11:49.726585+0000","last_fullsized":"2023-10-07T00:11:49.726585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:07.072334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.702192+0000","last_change":"2023-10-07T00:11:13.834163+0000","last_active":"2023-10-07T00:12:49.702192+0000","last_peered":"2023-10-07T00:12:49.702192+0000","last_clean":"2023-10-07T00:12:49.702192+0000","last_became_active":"2023-10-07T00:11:13.833807+0000","last_became_peered":"2023-10-07T00:11:13.833807+0000","last_unstale":"2023-10-07T00:12:49.702192+0000","last_undegraded":"2023-10-07T00:12:49.702192+0000","last_fullsized":"2023-10-07T00:12:49.702192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:12:18.606936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:53.813384+0000","last_change":"2023-10-07T00:11:12.835598+0000","last_active":"2023-10-07T00:12:53.813384+0000","last_peered":"2023-10-07T00:12:53.813384+0000","last_clean":"2023-10-07T00:12:53.813384+0000","last_became_active":"2023-10-07T00:11:12.835295+0000","last_became_peered":"2023-10-07T00:11:12.835295+0000","last_unstale":"2023-10-07T00:12:53.813384+0000","last_undegraded":"2023-10-07T00:12:53.813384+0000","last_fullsized":"2023-10-07T00:12:53.813384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:40:52.078850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.701721+0000","last_change":"2023-10-07T00:11:13.837918+0000","last_active":"2023-10-07T00:12:49.701721+0000","last_peered":"2023-10-07T00:12:49.701721+0000","last_clean":"2023-10-07T00:12:49.701721+0000","last_became_active":"2023-10-07T00:11:13.834284+0000","last_became_peered":"2023-10-07T00:11:13.834284+0000","last_unstale":"2023-10-07T00:12:49.701721+0000","last_undegraded":"2023-10-07T00:12:49.701721+0000","last_fullsized":"2023-10-07T00:12:49.701721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:49:47.081395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.729507+0000","last_change":"2023-10-07T00:11:12.839362+0000","last_active":"2023-10-07T00:11:49.729507+0000","last_peered":"2023-10-07T00:11:49.729507+0000","last_clean":"2023-10-07T00:11:49.729507+0000","last_became_active":"2023-10-07T00:11:12.838902+0000","last_became_peered":"2023-10-07T00:11:12.838902+0000","last_unstale":"2023-10-07T00:11:49.729507+0000","last_undegraded":"2023-10-07T00:11:49.729507+0000","last_fullsized":"2023-10-07T00:11:49.729507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:05:34.649556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687538+0000","last_change":"2023-10-07T00:11:13.839356+0000","last_active":"2023-10-07T00:12:49.687538+0000","last_peered":"2023-10-07T00:12:49.687538+0000","last_clean":"2023-10-07T00:12:49.687538+0000","last_became_active":"2023-10-07T00:11:13.838936+0000","last_became_peered":"2023-10-07T00:11:13.838936+0000","last_unstale":"2023-10-07T00:12:49.687538+0000","last_undegraded":"2023-10-07T00:12:49.687538+0000","last_fullsized":"2023-10-07T00:12:49.687538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:02.860174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-07T00:11:49.728045+0000","last_change":"2023-10-07T00:11:12.839966+0000","last_active":"2023-10-07T00:11:49.728045+0000","last_peered":"2023-10-07T00:11:49.728045+0000","last_clean":"2023-10-07T00:11:49.728045+0000","last_became_active":"2023-10-07T00:11:12.839505+0000","last_became_peered":"2023-10-07T00:11:12.839505+0000","last_unstale":"2023-10-07T00:11:49.728045+0000","last_undegraded":"2023-10-07T00:11:49.728045+0000","last_fullsized":"2023-10-07T00:11:49.728045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:11.793659+0000","last_clean_scrub_stamp":"2023-10-07T00:11:11.793659+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:45:50.278924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.689376+0000","last_change":"2023-10-07T00:11:13.839478+0000","last_active":"2023-10-07T00:12:49.689376+0000","last_peered":"2023-10-07T00:12:49.689376+0000","last_clean":"2023-10-07T00:12:49.689376+0000","last_became_active":"2023-10-07T00:11:13.839097+0000","last_became_peered":"2023-10-07T00:11:13.839097+0000","last_unstale":"2023-10-07T00:12:49.689376+0000","last_undegraded":"2023-10-07T00:12:49.689376+0000","last_fullsized":"2023-10-07T00:12:49.689376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:04:55.668486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.694303+0000","last_change":"2023-10-07T00:11:13.839518+0000","last_active":"2023-10-07T00:12:49.694303+0000","last_peered":"2023-10-07T00:12:49.694303+0000","last_clean":"2023-10-07T00:12:49.694303+0000","last_became_active":"2023-10-07T00:11:13.839189+0000","last_became_peered":"2023-10-07T00:11:13.839189+0000","last_unstale":"2023-10-07T00:12:49.694303+0000","last_undegraded":"2023-10-07T00:12:49.694303+0000","last_fullsized":"2023-10-07T00:12:49.694303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:30:34.647955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.681399+0000","last_change":"2023-10-07T00:11:50.738694+0000","last_active":"2023-10-07T00:12:49.681399+0000","last_peered":"2023-10-07T00:12:49.681399+0000","last_clean":"2023-10-07T00:12:49.681399+0000","last_became_active":"2023-10-07T00:11:50.738045+0000","last_became_peered":"2023-10-07T00:11:50.738045+0000","last_unstale":"2023-10-07T00:12:49.681399+0000","last_undegraded":"2023-10-07T00:12:49.681399+0000","last_fullsized":"2023-10-07T00:12:49.681399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:50.348821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695853+0000","last_change":"2023-10-07T00:11:13.841371+0000","last_active":"2023-10-07T00:12:49.695853+0000","last_peered":"2023-10-07T00:12:49.695853+0000","last_clean":"2023-10-07T00:12:49.695853+0000","last_became_active":"2023-10-07T00:11:13.840986+0000","last_became_peered":"2023-10-07T00:11:13.840986+0000","last_unstale":"2023-10-07T00:12:49.695853+0000","last_undegraded":"2023-10-07T00:12:49.695853+0000","last_fullsized":"2023-10-07T00:12:49.695853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:37:49.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.698526+0000","last_change":"2023-10-07T00:11:13.844865+0000","last_active":"2023-10-07T00:12:49.698526+0000","last_peered":"2023-10-07T00:12:49.698526+0000","last_clean":"2023-10-07T00:12:49.698526+0000","last_became_active":"2023-10-07T00:11:13.844495+0000","last_became_peered":"2023-10-07T00:11:13.844495+0000","last_unstale":"2023-10-07T00:12:49.698526+0000","last_undegraded":"2023-10-07T00:12:49.698526+0000","last_fullsized":"2023-10-07T00:12:49.698526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:00:29.862865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690534+0000","last_change":"2023-10-07T00:11:13.841126+0000","last_active":"2023-10-07T00:12:49.690534+0000","last_peered":"2023-10-07T00:12:49.690534+0000","last_clean":"2023-10-07T00:12:49.690534+0000","last_became_active":"2023-10-07T00:11:13.840748+0000","last_became_peered":"2023-10-07T00:11:13.840748+0000","last_unstale":"2023-10-07T00:12:49.690534+0000","last_undegraded":"2023-10-07T00:12:49.690534+0000","last_fullsized":"2023-10-07T00:12:49.690534+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:55.444456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.685683+0000","last_change":"2023-10-07T00:11:13.840320+0000","last_active":"2023-10-07T00:12:49.685683+0000","last_peered":"2023-10-07T00:12:49.685683+0000","last_clean":"2023-10-07T00:12:49.685683+0000","last_became_active":"2023-10-07T00:11:13.839993+0000","last_became_peered":"2023-10-07T00:11:13.839993+0000","last_unstale":"2023-10-07T00:12:49.685683+0000","last_undegraded":"2023-10-07T00:12:49.685683+0000","last_fullsized":"2023-10-07T00:12:49.685683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:29:39.843550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.690506+0000","last_change":"2023-10-07T00:11:13.830436+0000","last_active":"2023-10-07T00:12:49.690506+0000","last_peered":"2023-10-07T00:12:49.690506+0000","last_clean":"2023-10-07T00:12:49.690506+0000","last_became_active":"2023-10-07T00:11:13.827974+0000","last_became_peered":"2023-10-07T00:11:13.827974+0000","last_unstale":"2023-10-07T00:12:49.690506+0000","last_undegraded":"2023-10-07T00:12:49.690506+0000","last_fullsized":"2023-10-07T00:12:49.690506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:47:46.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.679783+0000","last_change":"2023-10-07T00:11:13.833929+0000","last_active":"2023-10-07T00:12:49.679783+0000","last_peered":"2023-10-07T00:12:49.679783+0000","last_clean":"2023-10-07T00:12:49.679783+0000","last_became_active":"2023-10-07T00:11:13.833539+0000","last_became_peered":"2023-10-07T00:11:13.833539+0000","last_unstale":"2023-10-07T00:12:49.679783+0000","last_undegraded":"2023-10-07T00:12:49.679783+0000","last_fullsized":"2023-10-07T00:12:49.679783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:46:04.981559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.686627+0000","last_change":"2023-10-07T00:11:13.837959+0000","last_active":"2023-10-07T00:12:49.686627+0000","last_peered":"2023-10-07T00:12:49.686627+0000","last_clean":"2023-10-07T00:12:49.686627+0000","last_became_active":"2023-10-07T00:11:13.837650+0000","last_became_peered":"2023-10-07T00:11:13.837650+0000","last_unstale":"2023-10-07T00:12:49.686627+0000","last_undegraded":"2023-10-07T00:12:49.686627+0000","last_fullsized":"2023-10-07T00:12:49.686627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:41.068847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.688004+0000","last_change":"2023-10-07T00:11:13.847348+0000","last_active":"2023-10-07T00:12:49.688004+0000","last_peered":"2023-10-07T00:12:49.688004+0000","last_clean":"2023-10-07T00:12:49.688004+0000","last_became_active":"2023-10-07T00:11:13.846988+0000","last_became_peered":"2023-10-07T00:11:13.846988+0000","last_unstale":"2023-10-07T00:12:49.688004+0000","last_undegraded":"2023-10-07T00:12:49.688004+0000","last_fullsized":"2023-10-07T00:12:49.688004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.960128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.699333+0000","last_change":"2023-10-07T00:11:13.831801+0000","last_active":"2023-10-07T00:12:49.699333+0000","last_peered":"2023-10-07T00:12:49.699333+0000","last_clean":"2023-10-07T00:12:49.699333+0000","last_became_active":"2023-10-07T00:11:13.831497+0000","last_became_peered":"2023-10-07T00:11:13.831497+0000","last_unstale":"2023-10-07T00:12:49.699333+0000","last_undegraded":"2023-10-07T00:12:49.699333+0000","last_fullsized":"2023-10-07T00:12:49.699333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:43.802252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.695811+0000","last_change":"2023-10-07T00:11:13.841423+0000","last_active":"2023-10-07T00:12:49.695811+0000","last_peered":"2023-10-07T00:12:49.695811+0000","last_clean":"2023-10-07T00:12:49.695811+0000","last_became_active":"2023-10-07T00:11:13.841115+0000","last_became_peered":"2023-10-07T00:11:13.841115+0000","last_unstale":"2023-10-07T00:12:49.695811+0000","last_undegraded":"2023-10-07T00:12:49.695811+0000","last_fullsized":"2023-10-07T00:12:49.695811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:38:32.355577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-07T00:12:49.687407+0000","last_change":"2023-10-07T00:11:13.840162+0000","last_active":"2023-10-07T00:12:49.687407+0000","last_peered":"2023-10-07T00:12:49.687407+0000","last_clean":"2023-10-07T00:12:49.687407+0000","last_became_active":"2023-10-07T00:11:13.839760+0000","last_became_peered":"2023-10-07T00:11:13.839760+0000","last_unstale":"2023-10-07T00:12:49.687407+0000","last_undegraded":"2023-10-07T00:12:49.687407+0000","last_fullsized":"2023-10-07T00:12:49.687407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T00:11:12.803931+0000","last_clean_scrub_stamp":"2023-10-07T00:11:12.803931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:15.727027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248175,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66137,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":986,"num_read_kb":568,"num_write":250,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":57564,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":198411,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460729,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.83699999999999997,"5min":1.018,"15min":1.018},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91800000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.76400000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.877,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.46000000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82999999999999996,"15min":0.82599999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.752},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0509999999999999,"5min":1.105,"15min":1.105},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.018,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97099999999999997,"5min":1.133,"15min":1.133},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91600000000000004,"15min":0.92200000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0840000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.71399999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.159,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.044,"5min":1.306,"15min":1.306},"last":0.88300000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.871}]},{"osd":9,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.998,"15min":1.0029999999999999},"min":{"1min":0.72699999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2110000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.77300000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.86199999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94799999999999995,"15min":0.94299999999999995},"min":{"1min":0.72799999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1739999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.018,"15min":1.022},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1799999999999999,"5min":2.286,"15min":2.286},"last":0.94899999999999995}]}]},{"osd":10,"up_from":73,"seq":313532612648,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1108840,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.2379999999999995,"5min":9.2379999999999995,"15min":9.2379999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":9.1910000000000007,"5min":9.1910000000000007,"15min":9.1910000000000007},"last":0.59899999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.499},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79400000000000004,"5min":1.161,"15min":1.161},"last":0.79400000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89100000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.55100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89600000000000002,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.877,"5min":9.3580000000000005,"15min":9.3580000000000005},"last":0.621}]},{"osd":4,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86699999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68600000000000005,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":1.226,"15min":1.226},"last":0.86899999999999999}]},{"osd":5,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.87},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94999999999999996,"5min":1.29,"15min":1.29},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.88200000000000001},"min":{"1min":0.625,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.995,"5min":3.101,"15min":3.101},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.88300000000000001,"15min":0.92300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.93100000000000005,"5min":1.242,"15min":1.242},"last":0.93100000000000005}]},{"osd":7,"last update":"Sat Oct 7 00:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56499999999999995}]},{"osd":8,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96999999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.97999999999999998,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.92100000000000004,"15min":0.95499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.042,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0309999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.96999999999999997,"15min":0.99199999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.01,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93999999999999995,"15min":0.96299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0780000000000001,"5min":3.25,"15min":3.25},"last":1.0780000000000001}]},{"osd":11,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95999999999999996,"15min":0.96499999999999997},"min":{"1min":0.745,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.1379999999999999,"5min":1.294,"15min":1.294},"last":1.054},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90200000000000002,"15min":0.90000000000000002},"min":{"1min":0.76100000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.159,"5min":1.165,"15min":1.165},"last":0.998}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":460048,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.89300000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.73499999999999999,"15min":0.76700000000000002},"min":{"1min":0.48299999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71999999999999997},"min":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0429999999999999,"5min":1.137,"15min":1.137},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98899999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.60299999999999998}]},{"osd":3,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.012,"5min":2.198,"15min":2.198},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.83699999999999997,"5min":1.982,"15min":1.982},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.59899999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.89700000000000002,"15min":0.90900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.962,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.59599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0780000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84199999999999997,"15min":0.871},"min":{"1min":0.61199999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96999999999999997,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.84299999999999997,"15min":0.89100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90000000000000002,"5min":2.214,"15min":2.214},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.86199999999999999,"15min":0.90400000000000003},"min":{"1min":0.47599999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96199999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.048,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.94699999999999995,"15min":0.98299999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.087,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.80100000000000005}]},{"osd":8,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.93500000000000005,"15min":0.96699999999999997},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.091,"5min":1.591,"15min":1.591},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.69899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1439999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.0229999999999999}]},{"osd":10,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.96399999999999997,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.746},{"interface":"front","average":{"1min":0.875,"5min":0.95599999999999996,"15min":0.96099999999999997},"min":{"1min":0.63200000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.343,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.101}]},{"osd":11,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.1479999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037811,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":460314,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.032,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.53200000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0489999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.72199999999999998,"15min":0.70099999999999996},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.95099999999999996}]},{"osd":2,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.44,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92100000000000004,"5min":1.073,"15min":1.073},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1830000000000001,"5min":1.498,"15min":1.498},"last":0.52800000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.76600000000000001,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.92000000000000004}]},{"osd":5,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.58899999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.54000000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0429999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.67700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.389,"15min":1.389},"last":0.96699999999999997}]},{"osd":7,"last update":"Sat Oct 7 00:12:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.88600000000000001,"15min":0.86499999999999999},"min":{"1min":0.73299999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1919999999999999,"5min":1.391,"15min":1.391},"last":1.012},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.83699999999999997,"15min":0.83299999999999996},"min":{"1min":0.66200000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.095,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85599999999999998}]},{"osd":9,"last update":"Sat Oct 7 00:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.88500000000000001,"15min":0.86899999999999999},"min":{"1min":0.76000000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.05},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.133,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80300000000000005}]},{"osd":10,"last update":"Sat Oct 7 00:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.69999999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.89700000000000002},"min":{"1min":0.71899999999999997,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2030000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.095}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":1.032},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.071}]}]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1054256,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.52700000000000002},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68200000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.163,"15min":1.163},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.68400000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95799999999999996,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94999999999999996,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.65600000000000003,"15min":0.67900000000000005},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.443}]},{"osd":5,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0760000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.68200000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0609999999999999,"5min":1.891,"15min":1.891},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Oct 7 00:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":0.92700000000000005,"5min":1.147,"15min":1.147},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.83199999999999996,"15min":0.85199999999999998},"min":{"1min":0.54900000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.018,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.63600000000000001}]},{"osd":8,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.80100000000000005},"min":{"1min":0.72999999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0089999999999999,"5min":1.252,"15min":1.252},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.84099999999999997,"15min":0.81299999999999994},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1639999999999999,"5min":1.234,"15min":1.234},"last":0.83599999999999997}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":0.95599999999999996,"15min":0.90000000000000002},"min":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":9.6829999999999998,"5min":9.6829999999999998,"15min":9.6829999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.86699999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.256,"5min":1.849,"15min":1.849},"last":0.81699999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.208,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.92700000000000005,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0980000000000001,"5min":1.919,"15min":1.919},"last":0.91200000000000003}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.879},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.89500000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462973,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460270,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.55000000000000004,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":8.1240000000000006,"5min":8.1240000000000006,"15min":8.1240000000000006},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.77700000000000002,"15min":0.74099999999999999},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.6790000000000003,"5min":4.6790000000000003,"15min":4.6790000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.495,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.66400000000000003}]},{"osd":2,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72599999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91800000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.82499999999999996,"15min":0.78300000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.75900000000000001,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":8.0500000000000007,"5min":8.0500000000000007,"15min":8.0500000000000007},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":4.0430000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0569999999999999,"5min":1.325,"15min":1.325},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.143,"5min":0.88500000000000001,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.8799999999999999,"5min":7.8799999999999999,"15min":7.8799999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.78400000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.9239999999999999,"5min":3.9239999999999999,"15min":3.9239999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.81899999999999995,"15min":0.84899999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97199999999999998,"5min":1.292,"15min":1.292},"last":0.746}]},{"osd":7,"last update":"Sat Oct 7 00:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.61299999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98299999999999998,"5min":1.419,"15min":1.419},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.157,"5min":0.90700000000000003,"15min":0.85599999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":7.9370000000000003,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":0.86199999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.89100000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2150000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.87}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.96899999999999997,"15min":0.96399999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":8.0860000000000003,"5min":8.0860000000000003,"15min":8.0860000000000003},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.972,"5min":3.972,"15min":3.972},"last":0.84699999999999998}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.90800000000000003,"15min":0.92800000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3029999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.873,"5min":1.0349999999999999,"15min":1.0209999999999999},"min":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0509999999999999,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":519744,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.32700000000000001},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":3.851,"5min":3.851,"15min":3.851},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.72599999999999998,"15min":0.60199999999999998},"min":{"1min":0.65200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.69999999999999996,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.077,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.86699999999999999}]},{"osd":3,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.70699999999999996,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Sat Oct 7 00:12:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.505},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89700000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.59499999999999997,"15min":0.52700000000000002},"min":{"1min":0.44600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 7 00:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.79100000000000004,"15min":0.70299999999999996},"min":{"1min":0.66900000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.163,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.754},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.752,"15min":0.68500000000000005},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0309999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":0.85199999999999998,"15min":0.76600000000000001},"min":{"1min":0.69599999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.76800000000000002,"15min":0.69799999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.8959999999999999,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.89200000000000002}]},{"osd":7,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71499999999999997,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.96899999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":1.079},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84499999999999997,"15min":0.80500000000000005},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.038}]},{"osd":8,"last update":"Sat Oct 7 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.88100000000000001,"15min":0.84499999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.79500000000000004,"15min":0.76900000000000002},"min":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0169999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.60199999999999998,"5min":0.503,"15min":0.503},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.89300000000000002,"15min":0.86699999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.94999999999999996}]},{"osd":10,"last update":"Sat Oct 7 00:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.85999999999999999,"15min":0.84999999999999998},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.141},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.872,"15min":0.85799999999999998},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.123}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.103},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0549999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":461330,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 00:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.59799999999999998},"min":{"1min":0.36399999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":0.98499999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.48599999999999999,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.94599999999999995}]},{"osd":2,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.53100000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.002,"5min":0.70199999999999996,"15min":0.65300000000000002},"min":{"1min":0.48699999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.97099999999999997}]},{"osd":3,"last update":"Sat Oct 7 00:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.746,"15min":0.68000000000000005},"min":{"1min":0.58499999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":1.054},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.68200000000000005,"15min":0.63400000000000001},"min":{"1min":0.48799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.0880000000000001}]},{"osd":5,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0629999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.747},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.77200000000000002,"15min":0.73199999999999998},"min":{"1min":0.55800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":1.022}]},{"osd":6,"last update":"Sat Oct 7 00:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.64100000000000001,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.169,"5min":0.78500000000000003,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.4290000000000003,"5min":7.4290000000000003,"15min":7.4290000000000003},"last":0.875}]},{"osd":7,"last update":"Sat Oct 7 00:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.60999999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.85999999999999999,"15min":0.83299999999999996},"min":{"1min":0.65200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":1.177},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.82999999999999996,"15min":0.80900000000000005},"min":{"1min":0.63600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.1539999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":0.95999999999999996,"15min":0.91700000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":9.0359999999999996,"5min":9.0359999999999996,"15min":9.0359999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0900000000000001,"5min":0.89400000000000002,"15min":0.879},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.6509999999999998,"5min":5.6509999999999998,"15min":5.6509999999999998},"last":1.21}]},{"osd":10,"last update":"Sat Oct 7 00:11:50 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.95799999999999996,"15min":0.92800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":1.274},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.71399999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.2969999999999999}]},{"osd":11,"last update":"Sat Oct 7 00:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.88400000000000001},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.109},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.92400000000000004,"15min":0.90400000000000003},"min":{"1min":0.68999999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.254}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":460775,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.372,"5min":0.312,"15min":0.312},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.59199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70799999999999996,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.69399999999999995,"15min":0.624},"min":{"1min":0.443,"5min":0.378,"15min":0.378},"max":{"1min":1.0389999999999999,"5min":1.115,"15min":1.115},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.48199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.0189999999999999,"5min":1.022,"15min":1.022},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.63800000000000001},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66000000000000003}]},{"osd":4,"last update":"Sat Oct 7 00:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.48599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.002}]},{"osd":5,"last update":"Sat Oct 7 00:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.61299999999999999,"15min":0.57299999999999995},"min":{"1min":0.54800000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69199999999999995,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0069999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.501}]},{"osd":6,"last update":"Sat Oct 7 00:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.76400000000000001,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94999999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.85699999999999998}]},{"osd":7,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.60099999999999998}]},{"osd":8,"last update":"Sat Oct 7 00:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.51000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.54800000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1240000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77800000000000002}]},{"osd":9,"last update":"Sat Oct 7 00:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.86099999999999999,"15min":0.83499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.155,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.82599999999999996,"15min":0.80600000000000005},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.129,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.873}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85099999999999998,"15min":0.82899999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.109,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.89800000000000002},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.141,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.89600000000000002}]},{"osd":11,"last update":"Sat Oct 7 00:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.73199999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":459271,"data_compressed":5792,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79600000000000004,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.48899999999999999,"15min":0.44500000000000001},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.65800000000000003,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":1.042,"15min":1.042},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69599999999999995,"15min":0.629},"min":{"1min":0.51800000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Oct 7 00:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94499999999999995,"5min":1.647,"15min":1.647},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88200000000000001,"5min":1.284,"15min":1.284},"last":0.88200000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72999999999999998,"15min":0.68400000000000005},"min":{"1min":0.46999999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.753,"15min":0.69799999999999995},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Oct 7 00:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.70999999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.68799999999999994},"min":{"1min":0.48699999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.93300000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.72599999999999998,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.69599999999999995},"min":{"1min":0.43099999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.621}]},{"osd":7,"last update":"Sat Oct 7 00:12:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76500000000000001,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0109999999999999,"5min":1.167,"15min":1.167},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.56200000000000006,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.748}]},{"osd":8,"last update":"Sat Oct 7 00:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.89400000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.052,"5min":1.103,"15min":1.103},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.746}]},{"osd":9,"last update":"Sat Oct 7 00:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":0.873},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.1950000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91900000000000004,"15min":0.95599999999999996},"min":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.194,"5min":1.272,"15min":1.272},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.74099999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0780000000000001,"5min":1.252,"15min":1.252},"last":0.86599999999999999}]},{"osd":11,"last update":"Sat Oct 7 00:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.83899999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888136,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":517040,"data_compressed":14696,"data_compressed_allocated":20480,"data_compressed_original":69632,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56100000000000005,"15min":0.54300000000000004},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.49099999999999999,"15min":0.47799999999999998},"min":{"1min":0.35199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95499999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.82899999999999996}]},{"osd":3,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67900000000000005,"15min":0.65200000000000002},"min":{"1min":0.46800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88400000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Oct 7 00:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72099999999999997,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0669999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0309999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.752},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98599999999999999,"5min":1.069,"15min":1.069},"last":0.78200000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71599999999999997,"15min":0.67000000000000004},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.746,"15min":0.70799999999999996},"min":{"1min":0.57699999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0049999999999999}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82399999999999995,"15min":0.81599999999999995},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83499999999999996,"15min":0.81899999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1279999999999999,"5min":1.212,"15min":1.212},"last":1.0369999999999999}]},{"osd":9,"last update":"Sat Oct 7 00:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.94699999999999995}]},{"osd":10,"last update":"Sat Oct 7 00:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.86099999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.98099999999999998}]},{"osd":11,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.091},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.0580000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":1052936,"data_compressed":41951,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.68500000000000005,"15min":0.59899999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.633,"5min":4.633,"15min":4.633},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94899999999999995,"5min":1.147,"15min":1.147},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.80800000000000005},"min":{"1min":0.47099999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.86499999999999999,"5min":5.96,"15min":5.96},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.49299999999999999},"min":{"1min":0.38700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55100000000000005,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70899999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.69799999999999995,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.44},"max":{"1min":4.7060000000000004,"5min":4.7060000000000004,"15min":4.7060000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63300000000000001}]},{"osd":4,"last update":"Sat Oct 7 00:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72999999999999998,"15min":0.68600000000000005},"min":{"1min":0.52200000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.083,"5min":1.093,"15min":1.093},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.89800000000000002},"min":{"1min":0.504,"5min":0.437,"15min":0.437},"max":{"1min":0.94399999999999995,"5min":5.9100000000000001,"15min":5.9100000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Oct 7 00:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97099999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.90400000000000003}]},{"osd":7,"last update":"Sat Oct 7 00:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79500000000000004,"15min":0.77400000000000002},"min":{"1min":0.59199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0249999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.64600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75}]},{"osd":8,"last update":"Sat Oct 7 00:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.48299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0289999999999999,"5min":1.083,"15min":1.083},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.56799999999999995,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.874}]},{"osd":9,"last update":"Sat Oct 7 00:12:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":0.93000000000000005,"15min":0.88500000000000001},"min":{"1min":0.70499999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":4.6609999999999996,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.208},"last":0.88800000000000001}]},{"osd":10,"last update":"Sat Oct 7 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88600000000000001,"15min":0.89200000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36159,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":61091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":58387,"data_compressed":8904,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-07T00:12:59.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:12:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 -- 172.21.15.5:0/3324238464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144108e70 msgr2=0x7fc14410b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/3324238464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144108e70 0x7fc14410b300 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00b0a0 tx=0x7fc13c00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 -- 172.21.15.5:0/3324238464 shutdown_connections 2023-10-07T00:12:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/3324238464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144108e70 0x7fc14410b300 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/3324238464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc144074ef0 0x7fc144073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/3324238464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc144073910 0x7fc144073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 -- 172.21.15.5:0/3324238464 >> 172.21.15.5:0/3324238464 conn(0x7fc1440fc520 msgr2=0x7fc1440fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 -- 172.21.15.5:0/3324238464 shutdown_connections 2023-10-07T00:12:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.744+0000 7fc14a3ff700 1 -- 172.21.15.5:0/3324238464 wait complete. 2023-10-07T00:12:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.745+0000 7fc14a3ff700 1 Processor -- start 2023-10-07T00:12:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc14a3ff700 1 -- start start 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc14a3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144073910 0x7fc144198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc14a3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc144074ef0 0x7fc144199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc14a3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc144108e70 0x7fc1441a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc14a3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1441a0a60 con 0x7fc144073910 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc14a3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1441a0ba0 con 0x7fc144108e70 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc14a3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1441a0d30 con 0x7fc144074ef0 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc143fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144073910 0x7fc144198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc143fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144073910 0x7fc144198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60370/0 (socket says 172.21.15.5:60370) 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc143fff700 1 -- 172.21.15.5:0/713359322 learned_addr learned my addr 172.21.15.5:0/713359322 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc13bfff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc144074ef0 0x7fc144199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.746+0000 7fc14899c700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc144108e70 0x7fc1441a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.747+0000 7fc143fff700 1 -- 172.21.15.5:0/713359322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc144074ef0 msgr2=0x7fc144199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.747+0000 7fc143fff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc144074ef0 0x7fc144199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.747+0000 7fc143fff700 1 -- 172.21.15.5:0/713359322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc144108e70 msgr2=0x7fc1441a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.747+0000 7fc143fff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc144108e70 0x7fc1441a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.747+0000 7fc143fff700 1 -- 172.21.15.5:0/713359322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c009d00 con 0x7fc144073910 2023-10-07T00:12:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.747+0000 7fc143fff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144073910 0x7fc144198ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc13400e9a0 tx=0x7fc13400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.750+0000 7fc141ffb700 1 -- 172.21.15.5:0/713359322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc134009790 con 0x7fc144073910 2023-10-07T00:12:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.750+0000 7fc141ffb700 1 -- 172.21.15.5:0/713359322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc134010430 con 0x7fc144073910 2023-10-07T00:12:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.750+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1441a0fb0 con 0x7fc144073910 2023-10-07T00:12:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.750+0000 7fc141ffb700 1 -- 172.21.15.5:0/713359322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13400cea0 con 0x7fc144073910 2023-10-07T00:12:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.750+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1441a1480 con 0x7fc144073910 2023-10-07T00:12:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.751+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc144107520 con 0x7fc144073910 2023-10-07T00:12:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.753+0000 7fc141ffb700 1 -- 172.21.15.5:0/713359322 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc1340105a0 con 0x7fc144073910 2023-10-07T00:12:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.755+0000 7fc141ffb700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1300a1500 0x7fc1300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:12:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.756+0000 7fc141ffb700 1 -- 172.21.15.5:0/713359322 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc134014070 con 0x7fc144073910 2023-10-07T00:12:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.756+0000 7fc13bfff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1300a1500 0x7fc1300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:12:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.756+0000 7fc13bfff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1300a1500 0x7fc1300a39c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc144074c10 tx=0x7fc12c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:12:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.760+0000 7fc141ffb700 1 -- 172.21.15.5:0/713359322 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc134052100 con 0x7fc144073910 2023-10-07T00:12:59.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.975+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc14410e9d0 con 0x7fc144073910 2023-10-07T00:12:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.976+0000 7fc141ffb700 1 -- 172.21.15.5:0/713359322 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7fc1340964a0 con 0x7fc144073910 2023-10-07T00:12:59.978 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:12:59.978 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:12:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1300a1500 msgr2=0x7fc1300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1300a1500 0x7fc1300a39c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc144074c10 tx=0x7fc12c009260 comp rx=0 tx=0).stop 2023-10-07T00:12:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144073910 msgr2=0x7fc144198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:12:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144073910 0x7fc144198ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc13400e9a0 tx=0x7fc13400ecb0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 shutdown_connections 2023-10-07T00:12:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1300a1500 0x7fc1300a39c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc144108e70 0x7fc1441a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc144073910 0x7fc144198ee0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 --2- 172.21.15.5:0/713359322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc144074ef0 0x7fc144199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:12:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 >> 172.21.15.5:0/713359322 conn(0x7fc1440fc520 msgr2=0x7fc1440fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:12:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 shutdown_connections 2023-10-07T00:12:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:12:59.979+0000 7fc14a3ff700 1 -- 172.21.15.5:0/713359322 wait complete. 2023-10-07T00:12:59.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:13:00.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:13:00.060 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:12:59 smithi005 ceph-mon[129406]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:00.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:12:59 smithi088 ceph-mon[103111]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.206+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/2220890834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 msgr2=0x7f4f141013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.206+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/2220890834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 0x7f4f141013e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4f100099c0 tx=0x7f4f10009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.206+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/2220890834 shutdown_connections 2023-10-07T00:13:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.206+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/2220890834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14102b50 0x7f4f14109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.206+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/2220890834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 0x7f4f141013e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.206+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/2220890834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f141021b0 0x7f4f14102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.206+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/2220890834 >> 172.21.15.5:0/2220890834 conn(0x7f4f140fc530 msgr2=0x7f4f140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:00.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.206+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/2220890834 shutdown_connections 2023-10-07T00:13:00.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.207+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/2220890834 wait complete. 2023-10-07T00:13:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.207+0000 7f4f1b3ff700 1 Processor -- start 2023-10-07T00:13:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.208+0000 7f4f1b3ff700 1 -- start start 2023-10-07T00:13:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.208+0000 7f4f1b3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 0x7f4f14196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.208+0000 7f4f1b3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f141021b0 0x7f4f14197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.208+0000 7f4f1b3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14102b50 0x7f4f1419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.208+0000 7f4f1b3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1419e770 con 0x7f4f14100fc0 2023-10-07T00:13:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.208+0000 7f4f1b3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1419e8b0 con 0x7f4f14102b50 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.208+0000 7f4f1b3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1419ea40 con 0x7f4f141021b0 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.208+0000 7f4f1919b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 0x7f4f14196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1919b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 0x7f4f14196bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60384/0 (socket says 172.21.15.5:60384) 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1919b700 1 -- 172.21.15.5:0/3593503394 learned_addr learned my addr 172.21.15.5:0/3593503394 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1999c700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14102b50 0x7f4f1419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1899a700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f141021b0 0x7f4f14197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1919b700 1 -- 172.21.15.5:0/3593503394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f141021b0 msgr2=0x7f4f14197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1919b700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f141021b0 0x7f4f14197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1919b700 1 -- 172.21.15.5:0/3593503394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14102b50 msgr2=0x7f4f1419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1919b700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14102b50 0x7f4f1419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1919b700 1 -- 172.21.15.5:0/3593503394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f100095f0 con 0x7f4f14100fc0 2023-10-07T00:13:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1899a700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f141021b0 0x7f4f14197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.209+0000 7f4f1919b700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 0x7f4f14196bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4f10000c00 tx=0x7f4f1000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.210+0000 7f4f0a7fc700 1 -- 172.21.15.5:0/3593503394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1001d070 con 0x7f4f14100fc0 2023-10-07T00:13:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.210+0000 7f4f0a7fc700 1 -- 172.21.15.5:0/3593503394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f1000fe70 con 0x7f4f14100fc0 2023-10-07T00:13:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.210+0000 7f4f0a7fc700 1 -- 172.21.15.5:0/3593503394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100173f0 con 0x7f4f14100fc0 2023-10-07T00:13:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.210+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1419ecc0 con 0x7f4f14100fc0 2023-10-07T00:13:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.210+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1419f090 con 0x7f4f14100fc0 2023-10-07T00:13:00.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.211+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1410c6d0 con 0x7f4f14100fc0 2023-10-07T00:13:00.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.214+0000 7f4f0a7fc700 1 -- 172.21.15.5:0/3593503394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4f10022470 con 0x7f4f14100fc0 2023-10-07T00:13:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.215+0000 7f4f0a7fc700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f000a1480 0x7f4f000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.216+0000 7f4f0a7fc700 1 -- 172.21.15.5:0/3593503394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4f100cddc0 con 0x7f4f14100fc0 2023-10-07T00:13:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.216+0000 7f4f1899a700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f000a1480 0x7f4f000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.216+0000 7f4f0a7fc700 1 -- 172.21.15.5:0/3593503394 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4f10097430 con 0x7f4f14100fc0 2023-10-07T00:13:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.216+0000 7f4f1899a700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f000a1480 0x7f4f000a3940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009cb0 tx=0x7f4f04009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:00.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:12:59 smithi112 ceph-mon[133548]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:00.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.428+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f14107f30 con 0x7f4f14100fc0 2023-10-07T00:13:00.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.429+0000 7f4f0a7fc700 1 -- 172.21.15.5:0/3593503394 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f1009aa50 con 0x7f4f14100fc0 2023-10-07T00:13:00.430 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:13:00.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f000a1480 msgr2=0x7f4f000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f000a1480 0x7f4f000a3940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009cb0 tx=0x7f4f04009260 comp rx=0 tx=0).stop 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 msgr2=0x7f4f14196bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 0x7f4f14196bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4f10000c00 tx=0x7f4f1000fa00 comp rx=0 tx=0).stop 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 shutdown_connections 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4f000a1480 0x7f4f000a3940 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f14102b50 0x7f4f1419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f14100fc0 0x7f4f14196bf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 --2- 172.21.15.5:0/3593503394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f141021b0 0x7f4f14197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 >> 172.21.15.5:0/3593503394 conn(0x7f4f140fc530 msgr2=0x7f4f140fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 shutdown_connections 2023-10-07T00:13:00.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.431+0000 7f4f1b3ff700 1 -- 172.21.15.5:0/3593503394 wait complete. 2023-10-07T00:13:00.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:13:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.656+0000 7f5cdadff700 1 -- 172.21.15.5:0/3703033532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4073910 msgr2=0x7f5cd4073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.656+0000 7f5cdadff700 1 --2- 172.21.15.5:0/3703033532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4073910 0x7f5cd4073d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009990 tx=0x7f5cc0009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.656+0000 7f5cdadff700 1 -- 172.21.15.5:0/3703033532 shutdown_connections 2023-10-07T00:13:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.656+0000 7f5cdadff700 1 --2- 172.21.15.5:0/3703033532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd4108e80 0x7f5cd410b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.656+0000 7f5cdadff700 1 --2- 172.21.15.5:0/3703033532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cd4074ef0 0x7f5cd4073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.656+0000 7f5cdadff700 1 --2- 172.21.15.5:0/3703033532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4073910 0x7f5cd4073d90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.657+0000 7f5cdadff700 1 -- 172.21.15.5:0/3703033532 >> 172.21.15.5:0/3703033532 conn(0x7f5cd40fc530 msgr2=0x7f5cd40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.657+0000 7f5cdadff700 1 -- 172.21.15.5:0/3703033532 shutdown_connections 2023-10-07T00:13:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.657+0000 7f5cdadff700 1 -- 172.21.15.5:0/3703033532 wait complete. 2023-10-07T00:13:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cdadff700 1 Processor -- start 2023-10-07T00:13:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cdadff700 1 -- start start 2023-10-07T00:13:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cdadff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd4073910 0x7f5cd4198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cdadff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4074ef0 0x7f5cd41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cdadff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cd4108e80 0x7f5cd41a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cdadff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41a09e0 con 0x7f5cd4074ef0 2023-10-07T00:13:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cdadff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41a0b20 con 0x7f5cd4108e80 2023-10-07T00:13:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cdadff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41a0cb0 con 0x7f5cd4073910 2023-10-07T00:13:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cd3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4074ef0 0x7f5cd41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cd3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4074ef0 0x7f5cd41993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60398/0 (socket says 172.21.15.5:60398) 2023-10-07T00:13:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.658+0000 7f5cd3fff700 1 -- 172.21.15.5:0/4200879019 learned_addr learned my addr 172.21.15.5:0/4200879019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd939c700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cd4108e80 0x7f5cd41a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd8b9b700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd4073910 0x7f5cd4198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd3fff700 1 -- 172.21.15.5:0/4200879019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd4073910 msgr2=0x7f5cd4198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd3fff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd4073910 0x7f5cd4198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd3fff700 1 -- 172.21.15.5:0/4200879019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cd4108e80 msgr2=0x7f5cd41a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd3fff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cd4108e80 0x7f5cd41a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd3fff700 1 -- 172.21.15.5:0/4200879019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc8009520 con 0x7f5cd4074ef0 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd3fff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4074ef0 0x7f5cd41993a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00059d0 tx=0x7f5cc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd1ffb700 1 -- 172.21.15.5:0/4200879019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc001d070 con 0x7f5cd4074ef0 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc00095f0 con 0x7f5cd4074ef0 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd1ffb700 1 -- 172.21.15.5:0/4200879019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5cc000be30 con 0x7f5cd4074ef0 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.659+0000 7f5cd1ffb700 1 -- 172.21.15.5:0/4200879019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0022df0 con 0x7f5cd4074ef0 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.660+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd41a11d0 con 0x7f5cd4074ef0 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.661+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd4107530 con 0x7f5cd4074ef0 2023-10-07T00:13:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.662+0000 7f5cd1ffb700 1 -- 172.21.15.5:0/4200879019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5cc0022570 con 0x7f5cd4074ef0 2023-10-07T00:13:00.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.664+0000 7f5cd1ffb700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5cc40a1480 0x7f5cc40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:00.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.664+0000 7f5cd1ffb700 1 -- 172.21.15.5:0/4200879019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5cc00ce820 con 0x7f5cd4074ef0 2023-10-07T00:13:00.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.664+0000 7f5cd8b9b700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5cc40a1480 0x7f5cc40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:00.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.665+0000 7f5cd8b9b700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5cc40a1480 0x7f5cc40a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8009d80 tx=0x7f5cc8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:00.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.666+0000 7f5cd1ffb700 1 -- 172.21.15.5:0/4200879019 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5cc0097e90 con 0x7f5cd4074ef0 2023-10-07T00:13:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.876+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5cd410e860 con 0x7f5cd4074ef0 2023-10-07T00:13:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.877+0000 7f5cd1ffb700 1 -- 172.21.15.5:0/4200879019 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5cc009b4b0 con 0x7f5cd4074ef0 2023-10-07T00:13:00.878 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:13:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.879+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5cc40a1480 msgr2=0x7f5cc40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.879+0000 7f5cdadff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5cc40a1480 0x7f5cc40a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8009d80 tx=0x7f5cc8009260 comp rx=0 tx=0).stop 2023-10-07T00:13:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4074ef0 msgr2=0x7f5cd41993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4074ef0 0x7f5cd41993a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00059d0 tx=0x7f5cc0004730 comp rx=0 tx=0).stop 2023-10-07T00:13:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 shutdown_connections 2023-10-07T00:13:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5cc40a1480 0x7f5cc40a3940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cd4108e80 0x7f5cd41a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd4073910 0x7f5cd4198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 --2- 172.21.15.5:0/4200879019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd4074ef0 0x7f5cd41993a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 >> 172.21.15.5:0/4200879019 conn(0x7f5cd40fc530 msgr2=0x7f5cd40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 shutdown_connections 2023-10-07T00:13:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:00.880+0000 7f5cdadff700 1 -- 172.21.15.5:0/4200879019 wait complete. 2023-10-07T00:13:00.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:13:01.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.103+0000 7fee837ff700 1 -- 172.21.15.5:0/1311353060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c100fc0 msgr2=0x7fee7c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.103+0000 7fee837ff700 1 --2- 172.21.15.5:0/1311353060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c100fc0 0x7fee7c1013e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fee780099c0 tx=0x7fee78009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.104+0000 7fee837ff700 1 -- 172.21.15.5:0/1311353060 shutdown_connections 2023-10-07T00:13:01.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.104+0000 7fee837ff700 1 --2- 172.21.15.5:0/1311353060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c102b50 0x7fee7c109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.104+0000 7fee837ff700 1 --2- 172.21.15.5:0/1311353060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c100fc0 0x7fee7c1013e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.104+0000 7fee837ff700 1 --2- 172.21.15.5:0/1311353060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee7c1021b0 0x7fee7c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.104+0000 7fee837ff700 1 -- 172.21.15.5:0/1311353060 >> 172.21.15.5:0/1311353060 conn(0x7fee7c0fc530 msgr2=0x7fee7c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:01.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.104+0000 7fee837ff700 1 -- 172.21.15.5:0/1311353060 shutdown_connections 2023-10-07T00:13:01.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.104+0000 7fee837ff700 1 -- 172.21.15.5:0/1311353060 wait complete. 2023-10-07T00:13:01.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.105+0000 7fee837ff700 1 Processor -- start 2023-10-07T00:13:01.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.105+0000 7fee837ff700 1 -- start start 2023-10-07T00:13:01.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee837ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee7c100fc0 0x7fee7c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee837ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c1021b0 0x7fee7c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee837ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c102b50 0x7fee7c19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee837ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c19e770 con 0x7fee7c1021b0 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee837ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c19e8e0 con 0x7fee7c102b50 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee837ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c19eaa0 con 0x7fee7c100fc0 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee80d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c1021b0 0x7fee7c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee80d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c1021b0 0x7fee7c1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60408/0 (socket says 172.21.15.5:60408) 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee80d9a700 1 -- 172.21.15.5:0/1266743819 learned_addr learned my addr 172.21.15.5:0/1266743819 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee81d9c700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c102b50 0x7fee7c19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee8159b700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee7c100fc0 0x7fee7c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:01.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee80d9a700 1 -- 172.21.15.5:0/1266743819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee7c100fc0 msgr2=0x7fee7c196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.106+0000 7fee80d9a700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee7c100fc0 0x7fee7c196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee80d9a700 1 -- 172.21.15.5:0/1266743819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c102b50 msgr2=0x7fee7c19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee80d9a700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c102b50 0x7fee7c19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee80d9a700 1 -- 172.21.15.5:0/1266743819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780095f0 con 0x7fee7c1021b0 2023-10-07T00:13:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee81d9c700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c102b50 0x7fee7c19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee8159b700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee7c100fc0 0x7fee7c196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee80d9a700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c1021b0 0x7fee7c1971c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00d950 tx=0x7fee6c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:01.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:00 smithi005 ceph-mon[129406]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:01.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:00 smithi005 ceph-mon[129406]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:01.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:00 smithi005 ceph-mon[129406]: pgmap v353: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-07T00:13:01.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:00 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/713359322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:13:01.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:00 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3593503394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:13:01.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee727fc700 1 -- 172.21.15.5:0/1266743819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c009b40 con 0x7fee7c1021b0 2023-10-07T00:13:01.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee727fc700 1 -- 172.21.15.5:0/1266743819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee6c009ca0 con 0x7fee7c1021b0 2023-10-07T00:13:01.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee727fc700 1 -- 172.21.15.5:0/1266743819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00f620 con 0x7fee7c1021b0 2023-10-07T00:13:01.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c19ed80 con 0x7fee7c1021b0 2023-10-07T00:13:01.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.107+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c19f180 con 0x7fee7c1021b0 2023-10-07T00:13:01.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.109+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c10c700 con 0x7fee7c1021b0 2023-10-07T00:13:01.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.110+0000 7fee727fc700 1 -- 172.21.15.5:0/1266743819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fee6c010460 con 0x7fee7c1021b0 2023-10-07T00:13:01.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.113+0000 7fee727fc700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fee680a1500 0x7fee680a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:01.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.113+0000 7fee727fc700 1 -- 172.21.15.5:0/1266743819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fee6c0ccff0 con 0x7fee7c1021b0 2023-10-07T00:13:01.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.113+0000 7fee8159b700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fee680a1500 0x7fee680a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:01.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.114+0000 7fee8159b700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fee680a1500 0x7fee680a39c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee7800b580 tx=0x7fee78005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:01.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.117+0000 7fee727fc700 1 -- 172.21.15.5:0/1266743819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fee6c096630 con 0x7fee7c1021b0 2023-10-07T00:13:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:00 smithi088 ceph-mon[103111]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:00 smithi088 ceph-mon[103111]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:01.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:00 smithi088 ceph-mon[103111]: pgmap v353: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-07T00:13:01.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:00 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/713359322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:13:01.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:00 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3593503394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:13:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:00 smithi112 ceph-mon[133548]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:00 smithi112 ceph-mon[133548]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-07T00:13:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:00 smithi112 ceph-mon[133548]: pgmap v353: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-07T00:13:01.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:00 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/713359322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:13:01.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:00 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3593503394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:13:01.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.327+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee7c107fe0 con 0x7fee7c1021b0 2023-10-07T00:13:01.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.327+0000 7fee727fc700 1 -- 172.21.15.5:0/1266743819 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee6c099c50 con 0x7fee7c1021b0 2023-10-07T00:13:01.329 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:13:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fee680a1500 msgr2=0x7fee680a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fee680a1500 0x7fee680a39c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee7800b580 tx=0x7fee78005fb0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c1021b0 msgr2=0x7fee7c1971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c1021b0 0x7fee7c1971c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00d950 tx=0x7fee6c00dd10 comp rx=0 tx=0).stop 2023-10-07T00:13:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 shutdown_connections 2023-10-07T00:13:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fee680a1500 0x7fee680a39c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c102b50 0x7fee7c19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee7c100fc0 0x7fee7c196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 --2- 172.21.15.5:0/1266743819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c1021b0 0x7fee7c1971c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 >> 172.21.15.5:0/1266743819 conn(0x7fee7c0fc530 msgr2=0x7fee7c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 shutdown_connections 2023-10-07T00:13:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.330+0000 7fee837ff700 1 -- 172.21.15.5:0/1266743819 wait complete. 2023-10-07T00:13:01.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:13:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 -- 172.21.15.5:0/1740933829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa288100fb0 msgr2=0x7fa2881013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/1740933829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa288100fb0 0x7fa2881013d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa2780099c0 tx=0x7fa278009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 -- 172.21.15.5:0/1740933829 shutdown_connections 2023-10-07T00:13:01.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/1740933829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa288102b40 0x7fa2881093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/1740933829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa288100fb0 0x7fa2881013d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/1740933829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2881021a0 0x7fa288102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 -- 172.21.15.5:0/1740933829 >> 172.21.15.5:0/1740933829 conn(0x7fa2880fc520 msgr2=0x7fa2880fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:01.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 -- 172.21.15.5:0/1740933829 shutdown_connections 2023-10-07T00:13:01.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.551+0000 7fa28e3ff700 1 -- 172.21.15.5:0/1740933829 wait complete. 2023-10-07T00:13:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.552+0000 7fa28e3ff700 1 Processor -- start 2023-10-07T00:13:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.552+0000 7fa28e3ff700 1 -- start start 2023-10-07T00:13:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.552+0000 7fa28e3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa288100fb0 0x7fa288198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.552+0000 7fa28e3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2881021a0 0x7fa288199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.552+0000 7fa28e3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa288102b40 0x7fa2881a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.552+0000 7fa28e3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2881a0960 con 0x7fa2881021a0 2023-10-07T00:13:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.552+0000 7fa28e3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2881a0aa0 con 0x7fa288100fb0 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.552+0000 7fa28e3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2881a0c30 con 0x7fa288102b40 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2881021a0 0x7fa288199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2881021a0 0x7fa288199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60438/0 (socket says 172.21.15.5:60438) 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 -- 172.21.15.5:0/2059240739 learned_addr learned my addr 172.21.15.5:0/2059240739 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa287fff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa288100fb0 0x7fa288198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa28c99c700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa288102b40 0x7fa2881a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 -- 172.21.15.5:0/2059240739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa288102b40 msgr2=0x7fa2881a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa288102b40 0x7fa2881a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 -- 172.21.15.5:0/2059240739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa288100fb0 msgr2=0x7fa288198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa288100fb0 0x7fa288198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 -- 172.21.15.5:0/2059240739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780095f0 con 0x7fa2881021a0 2023-10-07T00:13:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2877fe700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2881021a0 0x7fa288199320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00e9a0 tx=0x7fa27c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.553+0000 7fa2857fa700 1 -- 172.21.15.5:0/2059240739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c009790 con 0x7fa2881021a0 2023-10-07T00:13:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.554+0000 7fa2857fa700 1 -- 172.21.15.5:0/2059240739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa27c010430 con 0x7fa2881021a0 2023-10-07T00:13:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.554+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2881a0f10 con 0x7fa2881021a0 2023-10-07T00:13:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.554+0000 7fa2857fa700 1 -- 172.21.15.5:0/2059240739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00cea0 con 0x7fa2881021a0 2023-10-07T00:13:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.554+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2881a1390 con 0x7fa2881021a0 2023-10-07T00:13:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.555+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28810c6c0 con 0x7fa2881021a0 2023-10-07T00:13:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.557+0000 7fa2857fa700 1 -- 172.21.15.5:0/2059240739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa27c0105a0 con 0x7fa2881021a0 2023-10-07T00:13:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.559+0000 7fa2857fa700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa2700a1480 0x7fa2700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.559+0000 7fa2857fa700 1 -- 172.21.15.5:0/2059240739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa27c014070 con 0x7fa2881021a0 2023-10-07T00:13:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.559+0000 7fa287fff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa2700a1480 0x7fa2700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.560+0000 7fa287fff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa2700a1480 0x7fa2700a3940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa278000c00 tx=0x7fa2780058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.563+0000 7fa2857fa700 1 -- 172.21.15.5:0/2059240739 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa27c052100 con 0x7fa2881021a0 2023-10-07T00:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.821+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2881a1580 con 0x7fa2881021a0 2023-10-07T00:13:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.822+0000 7fa2857fa700 1 -- 172.21.15.5:0/2059240739 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7fa27c0964f0 con 0x7fa2881021a0 2023-10-07T00:13:01.823 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:13:01.824 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa2700a1480 msgr2=0x7fa2700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa2700a1480 0x7fa2700a3940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa278000c00 tx=0x7fa2780058e0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2881021a0 msgr2=0x7fa288199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2881021a0 0x7fa288199320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00e9a0 tx=0x7fa27c00ecb0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 shutdown_connections 2023-10-07T00:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa2700a1480 0x7fa2700a3940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa288102b40 0x7fa2881a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa288100fb0 0x7fa288198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 --2- 172.21.15.5:0/2059240739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2881021a0 0x7fa288199320 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 >> 172.21.15.5:0/2059240739 conn(0x7fa2880fc520 msgr2=0x7fa2880fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 shutdown_connections 2023-10-07T00:13:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:01.825+0000 7fa28e3ff700 1 -- 172.21.15.5:0/2059240739 wait complete. 2023-10-07T00:13:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:13:01.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:13:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 -- 172.21.15.5:0/94807660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c70102b40 msgr2=0x7f4c701093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 --2- 172.21.15.5:0/94807660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c70102b40 0x7f4c701093f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800b0d0 tx=0x7f4c6800b3e0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 -- 172.21.15.5:0/94807660 shutdown_connections 2023-10-07T00:13:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 --2- 172.21.15.5:0/94807660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c70102b40 0x7f4c701093f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 --2- 172.21.15.5:0/94807660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c70100fb0 0x7f4c701013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 --2- 172.21.15.5:0/94807660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c701021a0 0x7f4c70102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 -- 172.21.15.5:0/94807660 >> 172.21.15.5:0/94807660 conn(0x7f4c700fc520 msgr2=0x7f4c700fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 -- 172.21.15.5:0/94807660 shutdown_connections 2023-10-07T00:13:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.046+0000 7f4c77fff700 1 -- 172.21.15.5:0/94807660 wait complete. 2023-10-07T00:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.047+0000 7f4c77fff700 1 Processor -- start 2023-10-07T00:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.047+0000 7f4c77fff700 1 -- start start 2023-10-07T00:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.047+0000 7f4c77fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c70100fb0 0x7f4c70196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.047+0000 7f4c77fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c701021a0 0x7f4c701971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.047+0000 7f4c77fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c70102b40 0x7f4c7019e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.047+0000 7f4c77fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7019e7e0 con 0x7f4c701021a0 2023-10-07T00:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.047+0000 7f4c77fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7019e950 con 0x7f4c70102b40 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.047+0000 7f4c77fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7019eb10 con 0x7f4c70100fb0 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c701021a0 0x7f4c701971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c701021a0 0x7f4c701971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59130/0 (socket says 172.21.15.5:59130) 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 -- 172.21.15.5:0/1509317121 learned_addr learned my addr 172.21.15.5:0/1509317121 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c75d9b700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c70100fb0 0x7f4c70196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7659c700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c70102b40 0x7f4c7019e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 -- 172.21.15.5:0/1509317121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c70100fb0 msgr2=0x7f4c70196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c70100fb0 0x7f4c70196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 -- 172.21.15.5:0/1509317121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c70102b40 msgr2=0x7f4c7019e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c70102b40 0x7f4c7019e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 -- 172.21.15.5:0/1509317121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68009d00 con 0x7f4c701021a0 2023-10-07T00:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7659c700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c70102b40 0x7f4c7019e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.048+0000 7f4c7559a700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c701021a0 0x7f4c701971b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000e9a0 tx=0x7f4c6000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.049+0000 7f4c66ffd700 1 -- 172.21.15.5:0/1509317121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60009790 con 0x7f4c701021a0 2023-10-07T00:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.049+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7019edf0 con 0x7f4c701021a0 2023-10-07T00:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.049+0000 7f4c66ffd700 1 -- 172.21.15.5:0/1509317121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c6000cbd0 con 0x7f4c701021a0 2023-10-07T00:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.049+0000 7f4c66ffd700 1 -- 172.21.15.5:0/1509317121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60018680 con 0x7f4c701021a0 2023-10-07T00:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.049+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7019f280 con 0x7f4c701021a0 2023-10-07T00:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.050+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7010c630 con 0x7f4c701021a0 2023-10-07T00:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.052+0000 7f4c66ffd700 1 -- 172.21.15.5:0/1509317121 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4c6000cd40 con 0x7f4c701021a0 2023-10-07T00:13:02.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.053+0000 7f4c66ffd700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4c5c0a1480 0x7f4c5c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.053+0000 7f4c66ffd700 1 -- 172.21.15.5:0/1509317121 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4c60014070 con 0x7f4c701021a0 2023-10-07T00:13:02.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.053+0000 7f4c75d9b700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4c5c0a1480 0x7f4c5c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.054+0000 7f4c75d9b700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4c5c0a1480 0x7f4c5c0a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c005950 tx=0x7f4c6c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.055+0000 7f4c66ffd700 1 -- 172.21.15.5:0/1509317121 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4c60096870 con 0x7f4c701021a0 2023-10-07T00:13:02.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:01 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4200879019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:13:02.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:01 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1266743819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:13:02.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:01 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4200879019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:13:02.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:01 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1266743819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:13:02.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:01 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4200879019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:13:02.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:01 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1266743819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:13:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.274+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c7019f4a0 con 0x7f4c701021a0 2023-10-07T00:13:02.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.276+0000 7f4c66ffd700 1 -- 172.21.15.5:0/1509317121 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f4c60026020 con 0x7f4c701021a0 2023-10-07T00:13:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:13:02.277 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:13:02.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.278+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4c5c0a1480 msgr2=0x7f4c5c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.278+0000 7f4c77fff700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4c5c0a1480 0x7f4c5c0a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c005950 tx=0x7f4c6c0058e0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.278+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c701021a0 msgr2=0x7f4c701971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.278+0000 7f4c77fff700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c701021a0 0x7f4c701971b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000e9a0 tx=0x7f4c6000ed60 comp rx=0 tx=0).stop 2023-10-07T00:13:02.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.279+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 shutdown_connections 2023-10-07T00:13:02.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.279+0000 7f4c77fff700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4c5c0a1480 0x7f4c5c0a3940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.279+0000 7f4c77fff700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c70102b40 0x7f4c7019e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.279+0000 7f4c77fff700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c70100fb0 0x7f4c70196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.279+0000 7f4c77fff700 1 --2- 172.21.15.5:0/1509317121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c701021a0 0x7f4c701971b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.279+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 >> 172.21.15.5:0/1509317121 conn(0x7f4c700fc520 msgr2=0x7f4c700fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.279+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 shutdown_connections 2023-10-07T00:13:02.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.279+0000 7f4c77fff700 1 -- 172.21.15.5:0/1509317121 wait complete. 2023-10-07T00:13:02.299 DEBUG:tasks.fwd_scrub:Yielding 2023-10-07T00:13:02.299 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-07T00:13:02.310 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-10-07T00:13:02.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-07T00:13:02.310 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-07T00:13:02.311 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-07T00:13:02.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-07T00:13:02.315 INFO:teuthology.run_tasks:Running task workunit... 2023-10-07T00:13:02.384 INFO:tasks.workunit:Pulling workunits from ref 14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-07T00:13:02.385 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-07T00:13:02.385 INFO:tasks.workunit:timeout=3h 2023-10-07T00:13:02.385 INFO:tasks.workunit:cleanup=True 2023-10-07T00:13:02.385 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-07T00:13:02.432 INFO:teuthology.orchestra.run.smithi005.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-07T00:13:02.432 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-10-07T00:13:02.432 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 79h/121d Inode: 1 Links: 2 2023-10-07T00:13:02.433 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T00:13:02.433 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:fusefs_t:s0 2023-10-07T00:13:02.433 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-07 00:11:19.869601188 +0000 2023-10-07T00:13:02.433 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-07 00:11:19.869601188 +0000 2023-10-07T00:13:02.433 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-07 00:12:53.886680885 +0000 2023-10-07T00:13:02.433 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-07T00:13:02.433 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-07T00:13:02.433 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-07T00:13:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 -- 172.21.15.5:0/4053714687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102b50 msgr2=0x7fb464109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 --2- 172.21.15.5:0/4053714687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102b50 0x7fb464109400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00b0d0 tx=0x7fb45c00b3e0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 -- 172.21.15.5:0/4053714687 shutdown_connections 2023-10-07T00:13:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 --2- 172.21.15.5:0/4053714687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102b50 0x7fb464109400 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 --2- 172.21.15.5:0/4053714687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb464100fc0 0x7fb4641013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 --2- 172.21.15.5:0/4053714687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4641021b0 0x7fb464102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 -- 172.21.15.5:0/4053714687 >> 172.21.15.5:0/4053714687 conn(0x7fb4640fc530 msgr2=0x7fb4640fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 -- 172.21.15.5:0/4053714687 shutdown_connections 2023-10-07T00:13:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.526+0000 7fb469fff700 1 -- 172.21.15.5:0/4053714687 wait complete. 2023-10-07T00:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb469fff700 1 Processor -- start 2023-10-07T00:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb469fff700 1 -- start start 2023-10-07T00:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb469fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb464100fc0 0x7fb464198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb469fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4641021b0 0x7fb464199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb469fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb464102b50 0x7fb4641a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb469fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641a0a60 con 0x7fb4641021b0 2023-10-07T00:13:02.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb469fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641a0ba0 con 0x7fb464100fc0 2023-10-07T00:13:02.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb469fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641a0d30 con 0x7fb464102b50 2023-10-07T00:13:02.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb462ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4641021b0 0x7fb464199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb462ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4641021b0 0x7fb464199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59140/0 (socket says 172.21.15.5:59140) 2023-10-07T00:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb462ffd700 1 -- 172.21.15.5:0/1912457256 learned_addr learned my addr 172.21.15.5:0/1912457256 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.528+0000 7fb4637fe700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb464100fc0 0x7fb464198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb463fff700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb464102b50 0x7fb4641a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb462ffd700 1 -- 172.21.15.5:0/1912457256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb464102b50 msgr2=0x7fb4641a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb462ffd700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb464102b50 0x7fb4641a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb462ffd700 1 -- 172.21.15.5:0/1912457256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb464100fc0 msgr2=0x7fb464198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb462ffd700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb464100fc0 0x7fb464198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb462ffd700 1 -- 172.21.15.5:0/1912457256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c009d00 con 0x7fb4641021b0 2023-10-07T00:13:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb463fff700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb464102b50 0x7fb4641a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb462ffd700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4641021b0 0x7fb464199420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb45800d950 tx=0x7fb45800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb460ff9700 1 -- 172.21.15.5:0/1912457256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458009940 con 0x7fb4641021b0 2023-10-07T00:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb460ff9700 1 -- 172.21.15.5:0/1912457256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb458010460 con 0x7fb4641021b0 2023-10-07T00:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb469fff700 1 -- 172.21.15.5:0/1912457256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4641a0fb0 con 0x7fb4641021b0 2023-10-07T00:13:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.529+0000 7fb460ff9700 1 -- 172.21.15.5:0/1912457256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800f620 con 0x7fb4641021b0 2023-10-07T00:13:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.530+0000 7fb469fff700 1 -- 172.21.15.5:0/1912457256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4641a1490 con 0x7fb4641021b0 2023-10-07T00:13:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.533+0000 7fb460ff9700 1 -- 172.21.15.5:0/1912457256 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb4580105d0 con 0x7fb4641021b0 2023-10-07T00:13:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.534+0000 7fb460ff9700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb44c0a1480 0x7fb44c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.534+0000 7fb47d8abb80 1 Processor -- start 2023-10-07T00:13:02.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.534+0000 7fb460ff9700 1 -- 172.21.15.5:0/1912457256 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb4580ccbb0 con 0x7fb4641021b0 2023-10-07T00:13:02.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb47d8abb80 1 -- start start 2023-10-07T00:13:02.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb4637fe700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb44c0a1480 0x7fb44c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d43b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d43c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 0x55b17d43cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d3a34e0 con 0x55b17d43bc40 2023-10-07T00:13:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d394ca0 con 0x55b17d43cae0 2023-10-07T00:13:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d3925c0 con 0x55b17d43b2e0 2023-10-07T00:13:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb462ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d43c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb4637fe700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb44c0a1480 0x7fb44c0a3940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb464102010 tx=0x7fb45400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb462ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d43c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59142/0 (socket says 172.21.15.5:59142) 2023-10-07T00:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.535+0000 7fb462ffd700 1 -- 172.21.15.5:0/586182067 learned_addr learned my addr 172.21.15.5:0/586182067 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb4637fe700 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d43b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb463fff700 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 0x55b17d43cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb462ffd700 1 -- 172.21.15.5:0/586182067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 msgr2=0x55b17d43b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb462ffd700 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d43b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb462ffd700 1 -- 172.21.15.5:0/586182067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 msgr2=0x55b17d43cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb462ffd700 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 0x55b17d43cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb462ffd700 1 -- 172.21.15.5:0/586182067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b17d1b8e60 con 0x55b17d43bc40 2023-10-07T00:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb462ffd700 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d43c500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb458096350 tx=0x7fb4580997b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b32f2e78f075d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.536+0000 7fb449ffb700 1 -- 172.21.15.5:0/586182067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45809a550 con 0x55b17d43bc40 2023-10-07T00:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb449ffb700 1 -- 172.21.15.5:0/586182067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb458099e50 con 0x55b17d43bc40 2023-10-07T00:13:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb449ffb700 1 -- 172.21.15.5:0/586182067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4580995a0 con 0x55b17d43bc40 2023-10-07T00:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb47d8abb80 1 -- 172.21.15.5:0/586182067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 msgr2=0x55b17d43c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d43c500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb458096350 tx=0x7fb4580997b0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb47d8abb80 1 -- 172.21.15.5:0/586182067 shutdown_connections 2023-10-07T00:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 0x55b17d43cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d43b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/586182067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d43c500 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb47d8abb80 1 -- 172.21.15.5:0/586182067 >> 172.21.15.5:0/586182067 conn(0x55b17d3af2e0 msgr2=0x55b17d4361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.537+0000 7fb47d8abb80 1 -- 172.21.15.5:0/586182067 shutdown_connections 2023-10-07T00:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.538+0000 7fb47d8abb80 1 -- 172.21.15.5:0/586182067 wait complete. 2023-10-07T00:13:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.538+0000 7fb47d8abb80 1 -- start start 2023-10-07T00:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.538+0000 7fb47d8abb80 1 Processor -- start 2023-10-07T00:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43b2e0 0x55b17d445120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43bc40 0x55b17d445660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43cae0 0x55b17d44c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d38deb0 con 0x55b17d43b2e0 2023-10-07T00:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d32a790 con 0x55b17d43bc40 2023-10-07T00:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d32a430 con 0x55b17d43cae0 2023-10-07T00:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb47d8abb80 10 client.0 _ll_register_callbacks cb 0x55b17d187880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43b2e0 0x55b17d445120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43b2e0 0x55b17d445120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59154/0 (socket says 172.21.15.5:59154) 2023-10-07T00:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb4637fe700 1 -- 172.21.15.5:0/3865551433 learned_addr learned my addr 172.21.15.5:0/3865551433 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb463fff700 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43cae0 0x55b17d44c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb462ffd700 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43bc40 0x55b17d445660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb4637fe700 1 -- 172.21.15.5:0/3865551433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43cae0 msgr2=0x55b17d44c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.539+0000 7fb4637fe700 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43cae0 0x55b17d44c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb4637fe700 1 -- 172.21.15.5:0/3865551433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43bc40 msgr2=0x55b17d445660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb4637fe700 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43bc40 0x55b17d445660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb4637fe700 1 -- 172.21.15.5:0/3865551433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4641a1490 con 0x55b17d43b2e0 2023-10-07T00:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb4637fe700 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43b2e0 0x55b17d445120 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb4540116c0 tx=0x7fb4540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00bb48da0c9ff4b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb442ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb442ffd700 1 -- 172.21.15.5:0/3865551433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45401e830 con 0x55b17d43b2e0 2023-10-07T00:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3865551433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b17d42df90 con 0x55b17d43b2e0 2023-10-07T00:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb442ffd700 1 -- 172.21.15.5:0/3865551433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb454017070 con 0x55b17d43b2e0 2023-10-07T00:13:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb442ffd700 1 -- 172.21.15.5:0/3865551433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb454010ec0 con 0x55b17d43b2e0 2023-10-07T00:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb47d8abb80 10 client.15516 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.540+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3865551433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b17d1a1ce0 con 0x55b17d43b2e0 2023-10-07T00:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.541+0000 7fb442ffd700 1 -- 172.21.15.5:0/3865551433 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b17d42df90 con 0x55b17d43b2e0 2023-10-07T00:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.541+0000 7fb442ffd700 1 -- 172.21.15.5:0/3865551433 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb454031050 con 0x55b17d43b2e0 2023-10-07T00:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.541+0000 7fb47d8abb80 10 client.15516 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.541+0000 7fb47d8abb80 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.541+0000 7fb47d8abb80 20 client.15516 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.541+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b17d450f80 0x55b17d4533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.541+0000 7fb47d8abb80 4 client.15516 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.541+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3865551433 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b17d386e90 con 0x55b17d450f80 2023-10-07T00:13:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.542+0000 7fb462ffd700 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b17d450f80 0x55b17d4533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.542+0000 7fb462ffd700 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b17d450f80 0x55b17d4533a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb9037fa24587d8f server_cookie=cdfc5c57ae36db92 in_seq=0 out_seq=0 2023-10-07T00:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.542+0000 7fb442ffd700 10 client.15516 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb442ffd700 1 -- 172.21.15.5:0/3865551433 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b17d386e90 con 0x55b17d450f80 2023-10-07T00:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb442ffd700 10 client.15516 handle_command_reply: tid=0 2023-10-07T00:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 client.15516 shutdown 2023-10-07T00:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3865551433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43b2e0 msgr2=0x55b17d445120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43b2e0 0x55b17d445120 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb4540116c0 tx=0x7fb4540047c0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3865551433 shutdown_connections 2023-10-07T00:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b17d450f80 0x55b17d4533a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43cae0 0x55b17d44c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43b2e0 0x55b17d445120 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb442ffd700 0 client.15516 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3865551433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43bc40 0x55b17d445660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3865551433 >> 172.21.15.5:0/3865551433 conn(0x55b17d3af2e0 msgr2=0x55b17d435fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3865551433 shutdown_connections 2023-10-07T00:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.543+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3865551433 wait complete. 2023-10-07T00:13:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.544+0000 7fb47d8abb80 20 client.15516 trim_cache size 0 max 16384 2023-10-07T00:13:02.562 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-07T00:13:02.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.563+0000 7fb47d8abb80 1 Processor -- start 2023-10-07T00:13:02.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.563+0000 7fb47d8abb80 1 -- start start 2023-10-07T00:13:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.563+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43b2e0 0x55b17d435fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.563+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43bc40 0x55b17d44c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.563+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43cae0 0x55b17d43fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.563+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d20e9a0 con 0x55b17d43cae0 2023-10-07T00:13:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d4372f0 con 0x55b17d43b2e0 2023-10-07T00:13:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d432ac0 con 0x55b17d43bc40 2023-10-07T00:13:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb463fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43cae0 0x55b17d43fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb463fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43cae0 0x55b17d43fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59168/0 (socket says 172.21.15.5:59168) 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb463fff700 1 -- 172.21.15.5:0/3134908367 learned_addr learned my addr 172.21.15.5:0/3134908367 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb462ffd700 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43bc40 0x55b17d44c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb4637fe700 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43b2e0 0x55b17d435fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb463fff700 1 -- 172.21.15.5:0/3134908367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43bc40 msgr2=0x55b17d44c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb463fff700 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43bc40 0x55b17d44c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb463fff700 1 -- 172.21.15.5:0/3134908367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43b2e0 msgr2=0x55b17d435fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb463fff700 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43b2e0 0x55b17d435fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.564+0000 7fb463fff700 1 -- 172.21.15.5:0/3134908367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b17d1df2d0 con 0x55b17d43cae0 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.565+0000 7fb463fff700 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43cae0 0x55b17d43fa50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0075f0 tx=0x7fb45c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b65211beb5b4bc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.565+0000 7fb44a7fc700 1 -- 172.21.15.5:0/3134908367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00e040 con 0x55b17d43cae0 2023-10-07T00:13:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.565+0000 7fb44a7fc700 1 -- 172.21.15.5:0/3134908367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb45c004a50 con 0x55b17d43cae0 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.565+0000 7fb44a7fc700 1 -- 172.21.15.5:0/3134908367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c005610 con 0x55b17d43cae0 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3134908367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43cae0 msgr2=0x55b17d43fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43cae0 0x55b17d43fa50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0075f0 tx=0x7fb45c007620 comp rx=0 tx=0).stop 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3134908367 shutdown_connections 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43cae0 0x55b17d43fa50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43b2e0 0x55b17d435fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/3134908367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43bc40 0x55b17d44c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3134908367 >> 172.21.15.5:0/3134908367 conn(0x55b17d3af2e0 msgr2=0x55b17d4356e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3134908367 shutdown_connections 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 -- 172.21.15.5:0/3134908367 wait complete. 2023-10-07T00:13:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.566+0000 7fb47d8abb80 1 -- start start 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.567+0000 7fb47d8abb80 1 Processor -- start 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.567+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d44b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.567+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d44bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.567+0000 7fb47d8abb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 0x55b17d4a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.567+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d4a5410 con 0x55b17d43bc40 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.567+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d4a5550 con 0x55b17d43cae0 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.567+0000 7fb47d8abb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17d4a56e0 con 0x55b17d43b2e0 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.567+0000 7fb47d8abb80 10 client.0 _ll_register_callbacks cb 0x7fb454010d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d44bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d44bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59172/0 (socket says 172.21.15.5:59172) 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 -- 172.21.15.5:0/354997384 learned_addr learned my addr 172.21.15.5:0/354997384 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb463fff700 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 0x55b17d4a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb4637fe700 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d44b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 -- 172.21.15.5:0/354997384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 msgr2=0x55b17d44b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d44b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 -- 172.21.15.5:0/354997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 msgr2=0x55b17d4a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 0x55b17d4a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 -- 172.21.15.5:0/354997384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb464109d50 con 0x55b17d43bc40 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb4637fe700 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d44b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb462ffd700 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d44bdd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb4580961d0 tx=0x7fb458099fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5b1d4e52570986 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb442ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.568+0000 7fb442ffd700 1 -- 172.21.15.5:0/354997384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458097f90 con 0x55b17d43bc40 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb442ffd700 1 -- 172.21.15.5:0/354997384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb4580981f0 con 0x55b17d43bc40 2023-10-07T00:13:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 1 -- 172.21.15.5:0/354997384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb458099e50 con 0x55b17d43bc40 2023-10-07T00:13:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb442ffd700 1 -- 172.21.15.5:0/354997384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb458099340 con 0x55b17d43bc40 2023-10-07T00:13:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 10 client.15522 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 1 -- 172.21.15.5:0/354997384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b17d1b7330 con 0x55b17d43bc40 2023-10-07T00:13:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb442ffd700 1 -- 172.21.15.5:0/354997384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb458099e50 con 0x55b17d43bc40 2023-10-07T00:13:02.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb442ffd700 1 -- 172.21.15.5:0/354997384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb458095c40 con 0x55b17d43bc40 2023-10-07T00:13:02.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 10 client.15522 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 20 client.15522 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b17d4a6d50 0x55b17d4a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 4 client.15522 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.569+0000 7fb47d8abb80 1 -- 172.21.15.5:0/354997384 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b17d386bb0 con 0x55b17d4a6d50 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.570+0000 7fb4637fe700 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b17d4a6d50 0x55b17d4a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.570+0000 7fb4637fe700 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b17d4a6d50 0x55b17d4a9140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203ef25c0837c6f8 server_cookie=fabcca9b9644386d in_seq=0 out_seq=0 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.570+0000 7fb442ffd700 10 client.15522 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.571+0000 7fb442ffd700 1 -- 172.21.15.5:0/354997384 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b17d386bb0 con 0x55b17d4a6d50 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.571+0000 7fb442ffd700 10 client.15522 handle_command_reply: tid=0 2023-10-07T00:13:02.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.571+0000 7fb47d8abb80 1 client.15522 shutdown 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 -- 172.21.15.5:0/354997384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 msgr2=0x55b17d44bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d44bdd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb4580961d0 tx=0x7fb458099fc0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 -- 172.21.15.5:0/354997384 shutdown_connections 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b17d4a6d50 0x55b17d4a9140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b17d43cae0 0x55b17d4a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b17d43b2e0 0x55b17d44b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb442ffd700 0 client.15522 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 --2- 172.21.15.5:0/354997384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b17d43bc40 0x55b17d44bdd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 -- 172.21.15.5:0/354997384 >> 172.21.15.5:0/354997384 conn(0x55b17d3af2e0 msgr2=0x55b17d43fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 -- 172.21.15.5:0/354997384 shutdown_connections 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 1 -- 172.21.15.5:0/354997384 wait complete. 2023-10-07T00:13:02.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.572+0000 7fb47d8abb80 20 client.15522 trim_cache size 0 max 16384 2023-10-07T00:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2023-10-07T00:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "4115eb67-681b-419d-aee0-3bff3c65e393", 2023-10-07T00:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2023-10-07T00:13:02.579 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:13:02.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 -- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb44c0a1480 msgr2=0x7fb44c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb44c0a1480 0x7fb44c0a3940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb464102010 tx=0x7fb45400b410 comp rx=0 tx=0).stop 2023-10-07T00:13:02.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 -- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4641021b0 msgr2=0x7fb464199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4641021b0 0x7fb464199420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb45800d950 tx=0x7fb45800dc60 comp rx=0 tx=0).stop 2023-10-07T00:13:02.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 -- 172.21.15.5:0/1912457256 shutdown_connections 2023-10-07T00:13:02.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fb44c0a1480 0x7fb44c0a3940 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb464102b50 0x7fb4641a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb464100fc0 0x7fb464198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 --2- 172.21.15.5:0/1912457256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4641021b0 0x7fb464199420 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 -- 172.21.15.5:0/1912457256 >> 172.21.15.5:0/1912457256 conn(0x7fb4640fc530 msgr2=0x7fb4640fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.573+0000 7fb469fff700 1 -- 172.21.15.5:0/1912457256 shutdown_connections 2023-10-07T00:13:02.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.574+0000 7fb469fff700 1 -- 172.21.15.5:0/1912457256 wait complete. 2023-10-07T00:13:02.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:13:02.613 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-07T00:13:02.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 -- 172.21.15.5:0/965364012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b5410d590 msgr2=0x7f2b5410f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 --2- 172.21.15.5:0/965364012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b5410d590 0x7f2b5410f980 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00b0a0 tx=0x7f2b4c00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 -- 172.21.15.5:0/965364012 shutdown_connections 2023-10-07T00:13:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 --2- 172.21.15.5:0/965364012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b5410d590 0x7f2b5410f980 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 --2- 172.21.15.5:0/965364012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b54074ef0 0x7f2b54073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 --2- 172.21.15.5:0/965364012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b54073910 0x7f2b54073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 -- 172.21.15.5:0/965364012 >> 172.21.15.5:0/965364012 conn(0x7f2b540fc530 msgr2=0x7f2b540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 -- 172.21.15.5:0/965364012 shutdown_connections 2023-10-07T00:13:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.823+0000 7f2b5adff700 1 -- 172.21.15.5:0/965364012 wait complete. 2023-10-07T00:13:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.824+0000 7f2b5adff700 1 Processor -- start 2023-10-07T00:13:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.824+0000 7f2b5adff700 1 -- start start 2023-10-07T00:13:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.824+0000 7f2b5adff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b54073910 0x7f2b5419d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b5adff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54074ef0 0x7f2b5419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b5adff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b5410d590 0x7f2b541a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b5adff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b541a4e30 con 0x7f2b54074ef0 2023-10-07T00:13:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b5adff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b541a4f70 con 0x7f2b54073910 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b5adff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b541a5100 con 0x7f2b5410d590 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b53fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54074ef0 0x7f2b5419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b53fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54074ef0 0x7f2b5419d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59186/0 (socket says 172.21.15.5:59186) 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b53fff700 1 -- 172.21.15.5:0/1598319290 learned_addr learned my addr 172.21.15.5:0/1598319290 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b54073910 0x7f2b5419d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b5939c700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b5410d590 0x7f2b541a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b53fff700 1 -- 172.21.15.5:0/1598319290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b5410d590 msgr2=0x7f2b541a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b53fff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b5410d590 0x7f2b541a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b53fff700 1 -- 172.21.15.5:0/1598319290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b54073910 msgr2=0x7f2b5419d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b53fff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b54073910 0x7f2b5419d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.825+0000 7f2b53fff700 1 -- 172.21.15.5:0/1598319290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c009d00 con 0x7f2b54074ef0 2023-10-07T00:13:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.826+0000 7f2b53fff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54074ef0 0x7f2b5419d7f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000e970 tx=0x7f2b4000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.826+0000 7f2b51ffb700 1 -- 172.21.15.5:0/1598319290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40009790 con 0x7f2b54074ef0 2023-10-07T00:13:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.826+0000 7f2b5adff700 1 -- 172.21.15.5:0/1598319290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b541a53e0 con 0x7f2b54074ef0 2023-10-07T00:13:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.826+0000 7f2b51ffb700 1 -- 172.21.15.5:0/1598319290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b4000c7e0 con 0x7f2b54074ef0 2023-10-07T00:13:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.826+0000 7f2b51ffb700 1 -- 172.21.15.5:0/1598319290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40003bd0 con 0x7f2b54074ef0 2023-10-07T00:13:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.826+0000 7f2b5adff700 1 -- 172.21.15.5:0/1598319290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b541a58f0 con 0x7f2b54074ef0 2023-10-07T00:13:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.829+0000 7f2b51ffb700 1 -- 172.21.15.5:0/1598319290 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2b4000c950 con 0x7f2b54074ef0 2023-10-07T00:13:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.830+0000 7f2b6e68ab80 1 Processor -- start 2023-10-07T00:13:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b6e68ab80 1 -- start start 2023-10-07T00:13:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c95f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c960480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c960ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c8c7460 con 0x56515c95fbc0 2023-10-07T00:13:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c8b8c20 con 0x56515c960a60 2023-10-07T00:13:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c8b6540 con 0x56515c95f260 2023-10-07T00:13:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b51ffb700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2b440a1480 0x7f2b440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.831+0000 7f2b58b9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c960480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b58b9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c960480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59190/0 (socket says 172.21.15.5:59190) 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b5939c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c95f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b58b9b700 1 -- 172.21.15.5:0/447892750 learned_addr learned my addr 172.21.15.5:0/447892750 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b51ffb700 1 -- 172.21.15.5:0/1598319290 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2b40014070 con 0x7f2b54074ef0 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b53fff700 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c960ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b5939c700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2b440a1480 0x7f2b440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b58b9b700 1 -- 172.21.15.5:0/447892750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 msgr2=0x56515c95f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c95f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b58b9b700 1 -- 172.21.15.5:0/447892750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 msgr2=0x56515c960ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c960ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b58b9b700 1 -- 172.21.15.5:0/447892750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56515c6dcde0 con 0x56515c95fbc0 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b53fff700 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c960ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.832+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c960480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009d80 tx=0x7f2b48011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bee3a6f9ac87be server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b5939c700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2b440a1480 0x7f2b440a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c006130 tx=0x7f2b4c00b720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b3effd700 1 -- 172.21.15.5:0/447892750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48004230 con 0x56515c95fbc0 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b3effd700 1 -- 172.21.15.5:0/447892750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b48004390 con 0x56515c95fbc0 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b3effd700 1 -- 172.21.15.5:0/447892750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48019800 con 0x56515c95fbc0 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/447892750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 msgr2=0x56515c960480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c960480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009d80 tx=0x7f2b48011720 comp rx=0 tx=0).stop 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/447892750 shutdown_connections 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c960ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c95f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/447892750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c960480 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.833+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/447892750 >> 172.21.15.5:0/447892750 conn(0x56515c8d3260 msgr2=0x56515c95a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.834+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/447892750 shutdown_connections 2023-10-07T00:13:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.834+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/447892750 wait complete. 2023-10-07T00:13:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.834+0000 7f2b6e68ab80 1 -- start start 2023-10-07T00:13:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.834+0000 7f2b6e68ab80 1 Processor -- start 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c969010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95fbc0 0x56515c969550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c970590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c8b1e30 con 0x56515c960a60 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c84e710 con 0x56515c95fbc0 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c84e3b0 con 0x56515c95f260 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b6e68ab80 10 client.0 _ll_register_callbacks cb 0x56515c6ab800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b5939c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c970590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b5939c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c970590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59206/0 (socket says 172.21.15.5:59206) 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b5939c700 1 -- 172.21.15.5:0/3029247248 learned_addr learned my addr 172.21.15.5:0/3029247248 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b53fff700 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95fbc0 0x56515c969550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.835+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c969010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b5939c700 1 -- 172.21.15.5:0/3029247248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 msgr2=0x56515c969010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b5939c700 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c969010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b5939c700 1 -- 172.21.15.5:0/3029247248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95fbc0 msgr2=0x56515c969550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b5939c700 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95fbc0 0x56515c969550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b5939c700 1 -- 172.21.15.5:0/3029247248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b541a58f0 con 0x56515c960a60 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c969010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b5939c700 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c970590 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c007630 tx=0x7f2b4c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a30c68e07b46b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b33fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b33fff700 1 -- 172.21.15.5:0/3029247248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c027070 con 0x56515c960a60 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3029247248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56515c951f10 con 0x56515c960a60 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.836+0000 7f2b33fff700 1 -- 172.21.15.5:0/3029247248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2b4c01e460 con 0x56515c960a60 2023-10-07T00:13:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b33fff700 1 -- 172.21.15.5:0/3029247248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b4c00e040 con 0x56515c960a60 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b6e68ab80 10 client.15534 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3029247248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f2b480099e0 con 0x56515c960a60 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b33fff700 1 -- 172.21.15.5:0/3029247248 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56515c951f10 con 0x56515c960a60 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b33fff700 1 -- 172.21.15.5:0/3029247248 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2b4c0206e0 con 0x56515c960a60 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b6e68ab80 10 client.15534 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b6e68ab80 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b6e68ab80 20 client.15534 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56515c974e00 0x56515c977220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b6e68ab80 4 client.15534 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.837+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3029247248 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56515c8aae10 con 0x56515c974e00 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.838+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56515c974e00 0x56515c977220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.838+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56515c974e00 0x56515c977220 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3931e52910db053 server_cookie=c9142959f10060c3 in_seq=0 out_seq=0 2023-10-07T00:13:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.838+0000 7f2b33fff700 10 client.15534 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.839+0000 7f2b33fff700 1 -- 172.21.15.5:0/3029247248 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56515c8aae10 con 0x56515c974e00 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.839+0000 7f2b33fff700 10 client.15534 handle_command_reply: tid=0 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.839+0000 7f2b6e68ab80 1 client.15534 shutdown 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.839+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3029247248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 msgr2=0x56515c970590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.839+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c970590 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c007630 tx=0x7f2b4c00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3029247248 shutdown_connections 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56515c974e00 0x56515c977220 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c970590 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c969010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3029247248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95fbc0 0x56515c969550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3029247248 >> 172.21.15.5:0/3029247248 conn(0x56515c8d3260 msgr2=0x56515c959f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b33fff700 0 client.15534 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3029247248 shutdown_connections 2023-10-07T00:13:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3029247248 wait complete. 2023-10-07T00:13:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.840+0000 7f2b6e68ab80 20 client.15534 trim_cache size 0 max 16384 2023-10-07T00:13:02.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:02 smithi005 ceph-mon[129406]: pgmap v354: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2023-10-07T00:13:02.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:02 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2059240739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:02.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:02 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1509317121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:13:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:02 smithi005 ceph-mon[129406]: scrub queued for path: / 2023-10-07T00:13:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:02 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:02 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:13:02.859 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:02 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.858+0000 7f2b6e68ab80 1 Processor -- start 2023-10-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.858+0000 7f2b6e68ab80 1 -- start start 2023-10-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.858+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c963990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c963ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c9704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c732920 con 0x56515c95fbc0 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c95b8d0 con 0x56515c960a60 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c95b270 con 0x56515c95f260 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b53fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c963ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b58b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c963990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b58b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c963990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53746/0 (socket says 172.21.15.5:53746) 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b53fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c963ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59218/0 (socket says 172.21.15.5:59218) 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b58b9b700 1 -- 172.21.15.5:0/3268038865 learned_addr learned my addr 172.21.15.5:0/3268038865 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b5939c700 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c9704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b58b9b700 1 -- 172.21.15.5:0/3268038865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 msgr2=0x56515c9704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c9704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b58b9b700 1 -- 172.21.15.5:0/3268038865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 msgr2=0x56515c963ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c963ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b58b9b700 1 -- 172.21.15.5:0/3268038865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56515c6c5c60 con 0x56515c95f260 2023-10-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.859+0000 7f2b53fff700 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c963ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.860+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c963990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b4801b040 tx=0x7f2b48011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a29d4dad803af0a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.860+0000 7f2b3f7fe700 1 -- 172.21.15.5:0/3268038865 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48004230 con 0x56515c95f260 2023-10-07T00:13:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.860+0000 7f2b3f7fe700 1 -- 172.21.15.5:0/3268038865 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b480054d0 con 0x56515c95f260 2023-10-07T00:13:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.860+0000 7f2b3f7fe700 1 -- 172.21.15.5:0/3268038865 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4802b9e0 con 0x56515c95f260 2023-10-07T00:13:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3268038865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 msgr2=0x56515c963990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c963990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b4801b040 tx=0x7f2b48011720 comp rx=0 tx=0).stop 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3268038865 shutdown_connections 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c960a60 0x56515c9704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95f260 0x56515c963990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/3268038865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c95fbc0 0x56515c963ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3268038865 >> 172.21.15.5:0/3268038865 conn(0x56515c8d3260 msgr2=0x56515c970e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3268038865 shutdown_connections 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/3268038865 wait complete. 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 -- start start 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.861+0000 7f2b6e68ab80 1 Processor -- start 2023-10-07T00:13:02.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95f260 0x56515c96fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95fbc0 0x56515c970420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b6e68ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c96c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c96cf60 con 0x56515c960a60 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c96d0d0 con 0x56515c95f260 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b6e68ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515c96d290 con 0x56515c95fbc0 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b6e68ab80 10 client.0 _ll_register_callbacks cb 0x7f2b4c007ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b5939c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c96c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b5939c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c96c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59224/0 (socket says 172.21.15.5:59224) 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b5939c700 1 -- 172.21.15.5:0/2577272143 learned_addr learned my addr 172.21.15.5:0/2577272143 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.862+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95f260 0x56515c96fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b53fff700 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95fbc0 0x56515c970420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b5939c700 1 -- 172.21.15.5:0/2577272143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95fbc0 msgr2=0x56515c970420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b5939c700 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95fbc0 0x56515c970420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b5939c700 1 -- 172.21.15.5:0/2577272143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95f260 msgr2=0x56515c96fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b5939c700 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95f260 0x56515c96fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b5939c700 1 -- 172.21.15.5:0/2577272143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b541a53e0 con 0x56515c960a60 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b5939c700 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c96c980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0079c0 tx=0x7f2b4c009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42438ace378ed41d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b33fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:02.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b33fff700 1 -- 172.21.15.5:0/2577272143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c027070 con 0x56515c960a60 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/2577272143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b48004390 con 0x56515c960a60 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.863+0000 7f2b33fff700 1 -- 172.21.15.5:0/2577272143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2b4c01e460 con 0x56515c960a60 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b33fff700 1 -- 172.21.15.5:0/2577272143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b4c01e830 con 0x56515c960a60 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b6e68ab80 10 client.15540 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/2577272143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56515c6dcde0 con 0x56515c960a60 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b33fff700 1 -- 172.21.15.5:0/2577272143 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b48004390 con 0x56515c960a60 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b33fff700 1 -- 172.21.15.5:0/2577272143 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2b4c005480 con 0x56515c960a60 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b6e68ab80 10 client.15540 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b6e68ab80 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:02.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b6e68ab80 20 client.15540 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:02.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56515c9c9ed0 0x56515c9cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:02.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b6e68ab80 4 client.15540 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:13:02.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.864+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/2577272143 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56515c8aab30 con 0x56515c9c9ed0 2023-10-07T00:13:02.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.865+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56515c9c9ed0 0x56515c9cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:02.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.865+0000 7f2b58b9b700 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56515c9c9ed0 0x56515c9cc2f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ed1f7f7da980424 server_cookie=581fbb3535f9def5 in_seq=0 out_seq=0 2023-10-07T00:13:02.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.865+0000 7f2b33fff700 10 client.15540 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:02.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b33fff700 1 -- 172.21.15.5:0/2577272143 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56515c8aab30 con 0x56515c9c9ed0 2023-10-07T00:13:02.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b33fff700 10 client.15540 handle_command_reply: tid=0 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 client.15540 shutdown 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/2577272143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 msgr2=0x56515c96c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c96c980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0079c0 tx=0x7f2b4c009960 comp rx=0 tx=0).stop 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/2577272143 shutdown_connections 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56515c9c9ed0 0x56515c9cc2f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56515c960a60 0x56515c96c980 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56515c95f260 0x56515c96fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 --2- 172.21.15.5:0/2577272143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56515c95fbc0 0x56515c970420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/2577272143 >> 172.21.15.5:0/2577272143 conn(0x56515c8d3260 msgr2=0x56515c963990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b33fff700 0 client.15540 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:02.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/2577272143 shutdown_connections 2023-10-07T00:13:02.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 1 -- 172.21.15.5:0/2577272143 wait complete. 2023-10-07T00:13:02.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.866+0000 7f2b6e68ab80 20 client.15540 trim_cache size 0 max 16384 2023-10-07T00:13:02.873 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:13:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-07T00:13:02.873 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-07T00:13:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "4115eb67-681b-419d-aee0-3bff3c65e393": { 2023-10-07T00:13:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-07T00:13:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "4115eb67-681b-419d-aee0-3bff3c65e393", 2023-10-07T00:13:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-07T00:13:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:13:02.874 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:13:02.874 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:13:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 -- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2b440a1480 msgr2=0x7f2b440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2b440a1480 0x7f2b440a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c006130 tx=0x7f2b4c00b720 comp rx=0 tx=0).stop 2023-10-07T00:13:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 -- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54074ef0 msgr2=0x7f2b5419d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54074ef0 0x7f2b5419d7f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000e970 tx=0x7f2b4000ec80 comp rx=0 tx=0).stop 2023-10-07T00:13:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 -- 172.21.15.5:0/1598319290 shutdown_connections 2023-10-07T00:13:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2b440a1480 0x7f2b440a3940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b5410d590 0x7f2b541a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b54073910 0x7f2b5419d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 --2- 172.21.15.5:0/1598319290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54074ef0 0x7f2b5419d7f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:02.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 -- 172.21.15.5:0/1598319290 >> 172.21.15.5:0/1598319290 conn(0x7f2b540fc530 msgr2=0x7f2b540fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:02.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 -- 172.21.15.5:0/1598319290 shutdown_connections 2023-10-07T00:13:02.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:02.867+0000 7f2b5adff700 1 -- 172.21.15.5:0/1598319290 wait complete. 2023-10-07T00:13:02.886 INFO:tasks.cephfs.filesystem:scrub status for tag:4115eb67-681b-419d-aee0-3bff3c65e393 - {'path': '/', 'tag': '4115eb67-681b-419d-aee0-3bff3c65e393', 'options': 'recursive,force'} 2023-10-07T00:13:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:02 smithi088 ceph-mon[103111]: pgmap v354: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2023-10-07T00:13:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:02 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2059240739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:02 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1509317121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:13:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:02 smithi088 ceph-mon[103111]: scrub queued for path: / 2023-10-07T00:13:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:02 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:02 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:13:03.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:02 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:02 smithi112 ceph-mon[133548]: pgmap v354: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2023-10-07T00:13:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:02 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2059240739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:02 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1509317121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:13:03.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:02 smithi112 ceph-mon[133548]: scrub queued for path: / 2023-10-07T00:13:03.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:02 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:03.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:02 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:13:03.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:02 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:05.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:04 smithi005 ceph-mon[129406]: pgmap v355: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-07T00:13:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:04 smithi088 ceph-mon[103111]: pgmap v355: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-07T00:13:05.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:04 smithi112 ceph-mon[133548]: pgmap v355: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-07T00:13:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:06 smithi005 ceph-mon[129406]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2023-10-07T00:13:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:06 smithi088 ceph-mon[103111]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2023-10-07T00:13:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:06 smithi112 ceph-mon[133548]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2023-10-07T00:13:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:08 smithi005 ceph-mon[129406]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-10-07T00:13:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:08 smithi088 ceph-mon[103111]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-10-07T00:13:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:08 smithi112 ceph-mon[133548]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-10-07T00:13:11.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:10 smithi005 ceph-mon[129406]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-10-07T00:13:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:10 smithi088 ceph-mon[103111]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-10-07T00:13:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:10 smithi112 ceph-mon[133548]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-10-07T00:13:13.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:12 smithi005 ceph-mon[129406]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:13:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:12 smithi088 ceph-mon[103111]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:13:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:12 smithi112 ceph-mon[133548]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:13:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:14 smithi005 ceph-mon[129406]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2023-10-07T00:13:15.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:14 smithi088 ceph-mon[103111]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2023-10-07T00:13:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:14 smithi112 ceph-mon[133548]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2023-10-07T00:13:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 -- 172.21.15.5:0/2773868652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec100eb0 msgr2=0x7f6eec1012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/2773868652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec100eb0 0x7f6eec1012d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009990 tx=0x7f6edc009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 -- 172.21.15.5:0/2773868652 shutdown_connections 2023-10-07T00:13:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/2773868652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eec102a50 0x7f6eec109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/2773868652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec100eb0 0x7f6eec1012d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/2773868652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eec102090 0x7f6eec102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 -- 172.21.15.5:0/2773868652 >> 172.21.15.5:0/2773868652 conn(0x7f6eec0fc470 msgr2=0x7f6eec0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 -- 172.21.15.5:0/2773868652 shutdown_connections 2023-10-07T00:13:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.568+0000 7f6ef0dff700 1 -- 172.21.15.5:0/2773868652 wait complete. 2023-10-07T00:13:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.569+0000 7f6ef0dff700 1 Processor -- start 2023-10-07T00:13:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.569+0000 7f6ef0dff700 1 -- start start 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.569+0000 7f6ef0dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eec100eb0 0x7f6eec198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6ef0dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eec102090 0x7f6eec199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6ef0dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec102a50 0x7f6eec1a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6ef0dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec1a08c0 con 0x7f6eec102a50 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6ef0dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec1a0a00 con 0x7f6eec102090 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6ef0dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec1a0b90 con 0x7f6eec100eb0 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eea59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eec100eb0 0x7f6eec198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec102a50 0x7f6eec1a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6ee9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eec102090 0x7f6eec199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eea59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eec100eb0 0x7f6eec198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:35910/0 (socket says 172.21.15.5:35910) 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eea59c700 1 -- 172.21.15.5:0/3218522254 learned_addr learned my addr 172.21.15.5:0/3218522254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eead9d700 1 -- 172.21.15.5:0/3218522254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eec100eb0 msgr2=0x7f6eec198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eead9d700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eec100eb0 0x7f6eec198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eead9d700 1 -- 172.21.15.5:0/3218522254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eec102090 msgr2=0x7f6eec199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eead9d700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eec102090 0x7f6eec199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.570+0000 7f6eead9d700 1 -- 172.21.15.5:0/3218522254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc0095f0 con 0x7f6eec102a50 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.571+0000 7f6eead9d700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec102a50 0x7f6eec1a02f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4007f10 tx=0x7f6ee400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.571+0000 7f6edb7fe700 1 -- 172.21.15.5:0/3218522254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4004db0 con 0x7f6eec102a50 2023-10-07T00:13:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.571+0000 7f6edb7fe700 1 -- 172.21.15.5:0/3218522254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ee400f040 con 0x7f6eec102a50 2023-10-07T00:13:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.571+0000 7f6ef0dff700 1 -- 172.21.15.5:0/3218522254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec1a0e70 con 0x7f6eec102a50 2023-10-07T00:13:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.571+0000 7f6edb7fe700 1 -- 172.21.15.5:0/3218522254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4005960 con 0x7f6eec102a50 2023-10-07T00:13:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.571+0000 7f6ef0dff700 1 -- 172.21.15.5:0/3218522254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec1a12a0 con 0x7f6eec102a50 2023-10-07T00:13:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.574+0000 7f6edb7fe700 1 -- 172.21.15.5:0/3218522254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6ee400db20 con 0x7f6eec102a50 2023-10-07T00:13:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.575+0000 7f6f04712b80 1 Processor -- start 2023-10-07T00:13:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ed40a1480 0x7f6ed40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6f04712b80 1 -- start start 2023-10-07T00:13:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6edb7fe700 1 -- 172.21.15.5:0/3218522254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6ee40cc620 con 0x7f6eec102a50 2023-10-07T00:13:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba192e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba1a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba21220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6f04712b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b981400 con 0x55593ba18ec0 2023-10-07T00:13:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6f04712b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b972bc0 con 0x55593ba1a990 2023-10-07T00:13:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6f04712b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b9704e0 con 0x55593ba19fd0 2023-10-07T00:13:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ed40a1480 0x7f6ed40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6eea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba192e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6eea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba192e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45712/0 (socket says 172.21.15.5:45712) 2023-10-07T00:13:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.576+0000 7f6eea59c700 1 -- 172.21.15.5:0/784741137 learned_addr learned my addr 172.21.15.5:0/784741137 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba1a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6eead9d700 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba21220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6eea59c700 1 -- 172.21.15.5:0/784741137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 msgr2=0x55593ba1a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6eea59c700 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba1a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6eea59c700 1 -- 172.21.15.5:0/784741137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 msgr2=0x55593ba21220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6eea59c700 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba21220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6eea59c700 1 -- 172.21.15.5:0/784741137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55593b796d80 con 0x55593ba18ec0 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba1a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ed40a1480 0x7f6ed40a3940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6eec100bd0 tx=0x7f6ee0009f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6eea59c700 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba192e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6edc005ca0 tx=0x7f6edc005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57206195414d15af server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.577+0000 7f6ed8ff9700 1 -- 172.21.15.5:0/784741137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc01d070 con 0x55593ba18ec0 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6ed8ff9700 1 -- 172.21.15.5:0/784741137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6edc01e040 con 0x55593ba18ec0 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6ed8ff9700 1 -- 172.21.15.5:0/784741137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00b970 con 0x55593ba18ec0 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 -- 172.21.15.5:0/784741137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 msgr2=0x55593ba192e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba192e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6edc005ca0 tx=0x7f6edc005f00 comp rx=0 tx=0).stop 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 -- 172.21.15.5:0/784741137 shutdown_connections 2023-10-07T00:13:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba21220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba192e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 --2- 172.21.15.5:0/784741137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba1a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 -- 172.21.15.5:0/784741137 >> 172.21.15.5:0/784741137 conn(0x55593b98d200 msgr2=0x55593ba13bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 -- 172.21.15.5:0/784741137 shutdown_connections 2023-10-07T00:13:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.578+0000 7f6f04712b80 1 -- 172.21.15.5:0/784741137 wait complete. 2023-10-07T00:13:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.579+0000 7f6f04712b80 1 -- start start 2023-10-07T00:13:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.579+0000 7f6f04712b80 1 Processor -- start 2023-10-07T00:13:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba18ec0 0x55593ba22b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba23090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba2a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6f04712b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b96bdd0 con 0x55593ba19fd0 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6f04712b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b9086b0 con 0x55593ba1a990 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6f04712b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b908350 con 0x55593ba18ec0 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6f04712b80 10 client.0 _ll_register_callbacks cb 0x55593b7657a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6ee9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba23090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6ee9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba23090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45724/0 (socket says 172.21.15.5:45724) 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6ee9d9b700 1 -- 172.21.15.5:0/2852936073 learned_addr learned my addr 172.21.15.5:0/2852936073 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6eead9d700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba2a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6eea59c700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba18ec0 0x55593ba22b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6ee9d9b700 1 -- 172.21.15.5:0/2852936073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba18ec0 msgr2=0x55593ba22b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba18ec0 0x55593ba22b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6ee9d9b700 1 -- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 msgr2=0x55593ba2a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba2a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6ee9d9b700 1 -- 172.21.15.5:0/2852936073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec109ca0 con 0x55593ba19fd0 2023-10-07T00:13:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6eea59c700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba18ec0 0x55593ba22b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:13:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.580+0000 7f6eead9d700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba2a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba23090 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009c10 tx=0x7f6ee00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d994cff80b866f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6ed1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/2852936073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0018070 con 0x55593ba19fd0 2023-10-07T00:13:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6f04712b80 1 -- 172.21.15.5:0/2852936073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55593ba0bd50 con 0x55593ba19fd0 2023-10-07T00:13:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/2852936073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6ee0004220 con 0x55593ba19fd0 2023-10-07T00:13:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/2852936073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ee00043e0 con 0x55593ba19fd0 2023-10-07T00:13:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6f04712b80 10 client.15552 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6f04712b80 1 -- 172.21.15.5:0/2852936073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55593b77fc00 con 0x55593ba19fd0 2023-10-07T00:13:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.581+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/2852936073 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55593ba0bd50 con 0x55593ba19fd0 2023-10-07T00:13:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.582+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/2852936073 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6ee000f8b0 con 0x55593ba19fd0 2023-10-07T00:13:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.582+0000 7f6f04712b80 10 client.15552 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.582+0000 7f6f04712b80 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.582+0000 7f6f04712b80 20 client.15552 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.582+0000 7f6f04712b80 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55593ba2e9a0 0x55593ba30de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.582+0000 7f6f04712b80 4 client.15552 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.582+0000 7f6f04712b80 1 -- 172.21.15.5:0/2852936073 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55593b964db0 con 0x55593ba2e9a0 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.582+0000 7f6eea59c700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55593ba2e9a0 0x55593ba30de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.583+0000 7f6eea59c700 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55593ba2e9a0 0x55593ba30de0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e9f66942b9267f6 server_cookie=ebf1bccbe780bb20 in_seq=0 out_seq=0 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.583+0000 7f6ed1ffb700 10 client.15552 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/2852936073 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55593b964db0 con 0x55593ba2e9a0 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6ed1ffb700 10 client.15552 handle_command_reply: tid=0 2023-10-07T00:13:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 client.15552 shutdown 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 -- 172.21.15.5:0/2852936073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 msgr2=0x55593ba23090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba23090 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009c10 tx=0x7f6ee00047c0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 -- 172.21.15.5:0/2852936073 shutdown_connections 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55593ba2e9a0 0x55593ba30de0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba2a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba18ec0 0x55593ba22b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 --2- 172.21.15.5:0/2852936073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba23090 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6ed1ffb700 0 client.15552 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 -- 172.21.15.5:0/2852936073 >> 172.21.15.5:0/2852936073 conn(0x55593b98d200 msgr2=0x55593ba13250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 -- 172.21.15.5:0/2852936073 shutdown_connections 2023-10-07T00:13:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 1 -- 172.21.15.5:0/2852936073 wait complete. 2023-10-07T00:13:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.584+0000 7f6f04712b80 20 client.15552 trim_cache size 0 max 16384 2023-10-07T00:13:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6f04712b80 1 Processor -- start 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6f04712b80 1 -- start start 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba18ec0 0x55593ba218d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba1a990 0x55593ba20da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6f04712b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b7ec8c0 con 0x55593ba19fd0 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6f04712b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593ba21e10 con 0x55593ba18ec0 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6f04712b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593ba237d0 con 0x55593ba1a990 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6ee9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6ee9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba2a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45730/0 (socket says 172.21.15.5:45730) 2023-10-07T00:13:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.600+0000 7f6ee9d9b700 1 -- 172.21.15.5:0/1183934971 learned_addr learned my addr 172.21.15.5:0/1183934971 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6eead9d700 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba1a990 0x55593ba20da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6eea59c700 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba18ec0 0x55593ba218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ee9d9b700 1 -- 172.21.15.5:0/1183934971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba1a990 msgr2=0x55593ba20da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba1a990 0x55593ba20da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ee9d9b700 1 -- 172.21.15.5:0/1183934971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba18ec0 msgr2=0x55593ba218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba18ec0 0x55593ba218d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ee9d9b700 1 -- 172.21.15.5:0/1183934971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55593b7bd1f0 con 0x55593ba19fd0 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6eea59c700 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba18ec0 0x55593ba218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:13:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6eead9d700 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba1a990 0x55593ba20da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba2a090 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0014fd0 tx=0x7f6ee0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7defc27c1812bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ed97fa700 1 -- 172.21.15.5:0/1183934971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0018070 con 0x55593ba19fd0 2023-10-07T00:13:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ed97fa700 1 -- 172.21.15.5:0/1183934971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ee0004000 con 0x55593ba19fd0 2023-10-07T00:13:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.601+0000 7f6ed97fa700 1 -- 172.21.15.5:0/1183934971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0010ea0 con 0x55593ba19fd0 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 -- 172.21.15.5:0/1183934971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 msgr2=0x55593ba2a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba2a090 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0014fd0 tx=0x7f6ee0009370 comp rx=0 tx=0).stop 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 -- 172.21.15.5:0/1183934971 shutdown_connections 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba1a990 0x55593ba20da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba18ec0 0x55593ba218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 --2- 172.21.15.5:0/1183934971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba19fd0 0x55593ba2a090 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 -- 172.21.15.5:0/1183934971 >> 172.21.15.5:0/1183934971 conn(0x55593b98d200 msgr2=0x55593ba35780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 -- 172.21.15.5:0/1183934971 shutdown_connections 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 -- 172.21.15.5:0/1183934971 wait complete. 2023-10-07T00:13:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.602+0000 7f6f04712b80 1 -- start start 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6f04712b80 1 Processor -- start 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba27be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba28120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6f04712b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba29130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6f04712b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593ba29670 con 0x55593ba18ec0 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6f04712b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593ba297e0 con 0x55593ba1a990 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6f04712b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593ba299a0 con 0x55593ba19fd0 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6f04712b80 10 client.0 _ll_register_callbacks cb 0x7f6ee0009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6eea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba27be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6eea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba27be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45740/0 (socket says 172.21.15.5:45740) 2023-10-07T00:13:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6eea59c700 1 -- 172.21.15.5:0/3622354778 learned_addr learned my addr 172.21.15.5:0/3622354778 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.603+0000 7f6eead9d700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba29130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba28120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6eea59c700 1 -- 172.21.15.5:0/3622354778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 msgr2=0x55593ba28120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6eea59c700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba28120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6eea59c700 1 -- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 msgr2=0x55593ba29130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6eea59c700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba29130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6eea59c700 1 -- 172.21.15.5:0/3622354778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55593b77fc00 con 0x55593ba18ec0 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba28120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6eead9d700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba29130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6eea59c700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba27be0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6edc005ca0 tx=0x7f6edc0094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2401b0d1c5f8f94a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.604+0000 7f6ed1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/3622354778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc031070 con 0x55593ba18ec0 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 1 -- 172.21.15.5:0/3622354778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6edc01e040 con 0x55593ba18ec0 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/3622354778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6edc003a30 con 0x55593ba18ec0 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/3622354778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6edc01d040 con 0x55593ba18ec0 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 10 client.15558 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 1 -- 172.21.15.5:0/3622354778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55593b795250 con 0x55593ba18ec0 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/3622354778 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6edc01e040 con 0x55593ba18ec0 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/3622354778 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6edc00bc00 con 0x55593ba18ec0 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 10 client.15558 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 20 client.15558 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55593ba83110 0x55593ba85500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 4 client.15558 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:13:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.605+0000 7f6f04712b80 1 -- 172.21.15.5:0/3622354778 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55593b964ad0 con 0x55593ba83110 2023-10-07T00:13:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.606+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55593ba83110 0x55593ba85500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.606+0000 7f6ee9d9b700 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55593ba83110 0x55593ba85500 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd43c133e176445c server_cookie=e6d02f65c07262bb in_seq=0 out_seq=0 2023-10-07T00:13:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.606+0000 7f6ed1ffb700 10 client.15558 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6ed1ffb700 1 -- 172.21.15.5:0/3622354778 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55593b964ad0 con 0x55593ba83110 2023-10-07T00:13:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6ed1ffb700 10 client.15558 handle_command_reply: tid=0 2023-10-07T00:13:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 client.15558 shutdown 2023-10-07T00:13:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 -- 172.21.15.5:0/3622354778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 msgr2=0x55593ba27be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba27be0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6edc005ca0 tx=0x7f6edc0094b0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 -- 172.21.15.5:0/3622354778 shutdown_connections 2023-10-07T00:13:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55593ba83110 0x55593ba85500 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55593ba1a990 0x55593ba29130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593ba18ec0 0x55593ba27be0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6ed1ffb700 0 client.15558 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 --2- 172.21.15.5:0/3622354778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55593ba19fd0 0x55593ba28120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.619+0000 7f6f04712b80 1 -- 172.21.15.5:0/3622354778 >> 172.21.15.5:0/3622354778 conn(0x55593b98d200 msgr2=0x55593ba20da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.620+0000 7f6f04712b80 1 -- 172.21.15.5:0/3622354778 shutdown_connections 2023-10-07T00:13:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.620+0000 7f6f04712b80 1 -- 172.21.15.5:0/3622354778 wait complete. 2023-10-07T00:13:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.620+0000 7f6f04712b80 20 client.15558 trim_cache size 0 max 16384 2023-10-07T00:13:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:13:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:13:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:13:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:13:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.620+0000 7f6ef0dff700 1 -- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ed40a1480 msgr2=0x7f6ed40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.620+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ed40a1480 0x7f6ed40a3940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6eec100bd0 tx=0x7f6ee0009f90 comp rx=0 tx=0).stop 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.620+0000 7f6ef0dff700 1 -- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec102a50 msgr2=0x7f6eec1a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.620+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec102a50 0x7f6eec1a02f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4007f10 tx=0x7f6ee400d3b0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.621+0000 7f6ef0dff700 1 -- 172.21.15.5:0/3218522254 shutdown_connections 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.621+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6ed40a1480 0x7f6ed40a3940 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.621+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eec102a50 0x7f6eec1a02f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.621+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eec100eb0 0x7f6eec198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.621+0000 7f6ef0dff700 1 --2- 172.21.15.5:0/3218522254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6eec102090 0x7f6eec199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.621+0000 7f6ef0dff700 1 -- 172.21.15.5:0/3218522254 >> 172.21.15.5:0/3218522254 conn(0x7f6eec0fc470 msgr2=0x7f6eec107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.621+0000 7f6ef0dff700 1 -- 172.21.15.5:0/3218522254 shutdown_connections 2023-10-07T00:13:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:15.621+0000 7f6ef0dff700 1 -- 172.21.15.5:0/3218522254 wait complete. 2023-10-07T00:13:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:16 smithi005 ceph-mon[129406]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-07T00:13:17.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:16 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:13:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:16 smithi088 ceph-mon[103111]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-07T00:13:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:16 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:13:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:16 smithi112 ceph-mon[133548]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-07T00:13:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:16 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:13:19.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:18 smithi005 ceph-mon[129406]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-07T00:13:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:18 smithi088 ceph-mon[103111]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-07T00:13:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:18 smithi112 ceph-mon[133548]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-07T00:13:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:20 smithi005 ceph-mon[129406]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:13:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:20 smithi088 ceph-mon[103111]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:13:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:20 smithi112 ceph-mon[133548]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-07T00:13:22.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:21 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:13:22.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:21 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:13:22.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:21 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:13:23.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:22 smithi005 ceph-mon[129406]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 15 op/s 2023-10-07T00:13:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:22 smithi088 ceph-mon[103111]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 15 op/s 2023-10-07T00:13:23.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:22 smithi112 ceph-mon[133548]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 15 op/s 2023-10-07T00:13:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:24 smithi005 ceph-mon[129406]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-07T00:13:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:24 smithi088 ceph-mon[103111]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-07T00:13:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:24 smithi112 ceph-mon[133548]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-07T00:13:26.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.1 KiB/s wr, 16 op/s 2023-10-07T00:13:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:13:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:13:26.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.1 KiB/s wr, 16 op/s 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:13:26.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.1 KiB/s wr, 16 op/s 2023-10-07T00:13:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:13:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:13:26.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:13:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 -- 172.21.15.5:0/579544457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 msgr2=0x7f5bb0073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/579544457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 0x7f5bb0073d90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009990 tx=0x7f5ba0009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 -- 172.21.15.5:0/579544457 shutdown_connections 2023-10-07T00:13:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/579544457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0108dc0 0x7f5bb010b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/579544457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb0074ef0 0x7f5bb0073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/579544457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 0x7f5bb0073d90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 -- 172.21.15.5:0/579544457 >> 172.21.15.5:0/579544457 conn(0x7f5bb00fc470 msgr2=0x7f5bb00fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 -- 172.21.15.5:0/579544457 shutdown_connections 2023-10-07T00:13:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.780+0000 7f5bb85ff700 1 -- 172.21.15.5:0/579544457 wait complete. 2023-10-07T00:13:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.781+0000 7f5bb85ff700 1 Processor -- start 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.781+0000 7f5bb85ff700 1 -- start start 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.781+0000 7f5bb85ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 0x7f5bb0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb85ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0074ef0 0x7f5bb0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb85ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb0108dc0 0x7f5bb01a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb85ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01a0880 con 0x7f5bb0073910 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb85ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01a09f0 con 0x7f5bb0074ef0 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb85ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01a0bb0 con 0x7f5bb0108dc0 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb639b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 0x7f5bb0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb639b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 0x7f5bb0198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35920/0 (socket says 172.21.15.5:35920) 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb639b700 1 -- 172.21.15.5:0/3120263870 learned_addr learned my addr 172.21.15.5:0/3120263870 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb6b9c700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb0108dc0 0x7f5bb01a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb5b9a700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0074ef0 0x7f5bb0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb639b700 1 -- 172.21.15.5:0/3120263870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb0108dc0 msgr2=0x7f5bb01a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb639b700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb0108dc0 0x7f5bb01a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb639b700 1 -- 172.21.15.5:0/3120263870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0074ef0 msgr2=0x7f5bb0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb639b700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0074ef0 0x7f5bb0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.782+0000 7f5bb639b700 1 -- 172.21.15.5:0/3120263870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba00095f0 con 0x7f5bb0073910 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.783+0000 7f5bb639b700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 0x7f5bb0198d40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00e9a0 tx=0x7f5bac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.783+0000 7f5ba77fe700 1 -- 172.21.15.5:0/3120263870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac009790 con 0x7f5bb0073910 2023-10-07T00:13:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.783+0000 7f5ba77fe700 1 -- 172.21.15.5:0/3120263870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bac010430 con 0x7f5bb0073910 2023-10-07T00:13:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.783+0000 7f5bb85ff700 1 -- 172.21.15.5:0/3120263870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb01a0e90 con 0x7f5bb0073910 2023-10-07T00:13:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.783+0000 7f5ba77fe700 1 -- 172.21.15.5:0/3120263870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac00cea0 con 0x7f5bb0073910 2023-10-07T00:13:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.783+0000 7f5bb85ff700 1 -- 172.21.15.5:0/3120263870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb01a12c0 con 0x7f5bb0073910 2023-10-07T00:13:28.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.788+0000 7f5ba77fe700 1 -- 172.21.15.5:0/3120263870 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5bac0105a0 con 0x7f5bb0073910 2023-10-07T00:13:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.789+0000 7f5bcbf50b80 1 Processor -- start 2023-10-07T00:13:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.789+0000 7f5bcbf50b80 1 -- start start 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.789+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.789+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13402450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.789+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13409220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.789+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a13369400 con 0x557a13401fd0 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.789+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1335abc0 con 0x557a13402990 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.789+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a133584e0 con 0x557a13400ec0 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb639b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13402450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb6b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb6b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:47364/0 (socket says 172.21.15.5:47364) 2023-10-07T00:13:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb6b9c700 1 -- 172.21.15.5:0/3257473991 learned_addr learned my addr 172.21.15.5:0/3257473991 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb5b9a700 1 --2- 172.21.15.5:0/3257473991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13409220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5ba77fe700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b9c0a1500 0x7f5b9c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5ba77fe700 1 -- 172.21.15.5:0/3120263870 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5bac014070 con 0x7f5bb0073910 2023-10-07T00:13:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb6b9c700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b9c0a1500 0x7f5b9c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb639b700 1 -- 172.21.15.5:0/3257473991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 msgr2=0x557a134012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb639b700 1 --2- 172.21.15.5:0/3257473991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb639b700 1 -- 172.21.15.5:0/3257473991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 msgr2=0x557a13409220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb639b700 1 --2- 172.21.15.5:0/3257473991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13409220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.790+0000 7f5bb639b700 1 -- 172.21.15.5:0/3257473991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a1317ed80 con 0x557a13401fd0 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.791+0000 7f5bb639b700 1 --2- 172.21.15.5:0/3257473991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13402450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0ca990 tx=0x7f5bac010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5620e2c5b98e3e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.791+0000 7f5ba4bfe700 1 -- 172.21.15.5:0/3257473991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac099ca0 con 0x557a13401fd0 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.791+0000 7f5ba4bfe700 1 -- 172.21.15.5:0/3257473991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bac099ac0 con 0x557a13401fd0 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.791+0000 7f5bb6b9c700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b9c0a1500 0x7f5b9c0a39c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x557a13400c60 tx=0x7f5ba8004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.791+0000 7f5ba4bfe700 1 -- 172.21.15.5:0/3257473991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac09e340 con 0x557a13401fd0 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/3257473991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 msgr2=0x557a13402450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/3257473991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13402450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0ca990 tx=0x7f5bac010b80 comp rx=0 tx=0).stop 2023-10-07T00:13:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/3257473991 shutdown_connections 2023-10-07T00:13:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/3257473991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13409220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/3257473991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/3257473991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13402450 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/3257473991 >> 172.21.15.5:0/3257473991 conn(0x557a13375200 msgr2=0x557a133fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/3257473991 shutdown_connections 2023-10-07T00:13:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/3257473991 wait complete. 2023-10-07T00:13:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.792+0000 7f5bcbf50b80 1 -- start start 2023-10-07T00:13:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bcbf50b80 1 Processor -- start 2023-10-07T00:13:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a1340aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13401fd0 0x557a1340b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13412070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a13353dd0 con 0x557a13402990 2023-10-07T00:13:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a132f06b0 con 0x557a13401fd0 2023-10-07T00:13:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a132f0350 con 0x557a13400ec0 2023-10-07T00:13:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bcbf50b80 10 client.0 _ll_register_callbacks cb 0x557a1314d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.793+0000 7f5bb6b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13412070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb6b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13412070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35930/0 (socket says 172.21.15.5:35930) 2023-10-07T00:13:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb5b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13401fd0 0x557a1340b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb6b9c700 1 -- 172.21.15.5:0/2528481480 learned_addr learned my addr 172.21.15.5:0/2528481480 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb639b700 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a1340aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb5b9a700 1 -- 172.21.15.5:0/2528481480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 msgr2=0x557a1340aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb5b9a700 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a1340aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb5b9a700 1 -- 172.21.15.5:0/2528481480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 msgr2=0x557a13412070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb5b9a700 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13412070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb5b9a700 1 -- 172.21.15.5:0/2528481480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb01a12c0 con 0x557a13401fd0 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5bb5b9a700 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13401fd0 0x557a1340b030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0003f60 tx=0x7f5ba0005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67930a352ebbc4ce server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.794+0000 7f5b99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5b99ffb700 1 -- 172.21.15.5:0/2528481480 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba001d070 con 0x557a13401fd0 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/2528481480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a133f3d50 con 0x557a13401fd0 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5b99ffb700 1 -- 172.21.15.5:0/2528481480 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5ba0003c60 con 0x557a13401fd0 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5b99ffb700 1 -- 172.21.15.5:0/2528481480 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ba000b710 con 0x557a13401fd0 2023-10-07T00:13:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5bcbf50b80 10 client.25358 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/2528481480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a13167c00 con 0x557a13401fd0 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5b99ffb700 1 -- 172.21.15.5:0/2528481480 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a133f3d50 con 0x557a13401fd0 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5b99ffb700 1 -- 172.21.15.5:0/2528481480 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5ba0004790 con 0x557a13401fd0 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5bcbf50b80 10 client.25358 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5bcbf50b80 10 client.25358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.795+0000 7f5bcbf50b80 20 client.25358 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.796+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557a134169e0 0x557a13418e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.796+0000 7f5bcbf50b80 4 client.25358 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.796+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/2528481480 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a1334cdb0 con 0x557a134169e0 2023-10-07T00:13:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.796+0000 7f5bb639b700 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557a134169e0 0x557a13418e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.797+0000 7f5b99ffb700 10 client.25358 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.797+0000 7f5bb639b700 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557a134169e0 0x557a13418e00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23fa405c75469871 server_cookie=fa386e8fb4e7786d in_seq=0 out_seq=0 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.797+0000 7f5b99ffb700 1 -- 172.21.15.5:0/2528481480 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557a1334cdb0 con 0x557a134169e0 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.797+0000 7f5b99ffb700 10 client.25358 handle_command_reply: tid=0 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 client.25358 shutdown 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/2528481480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13401fd0 msgr2=0x557a1340b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13401fd0 0x557a1340b030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0003f60 tx=0x7f5ba0005800 comp rx=0 tx=0).stop 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/2528481480 shutdown_connections 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557a134169e0 0x557a13418e00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13412070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a1340aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5b99ffb700 0 client.25358 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/2528481480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13401fd0 0x557a1340b030 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/2528481480 >> 172.21.15.5:0/2528481480 conn(0x557a13375200 msgr2=0x557a133fb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/2528481480 shutdown_connections 2023-10-07T00:13:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/2528481480 wait complete. 2023-10-07T00:13:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.798+0000 7f5bcbf50b80 20 client.25358 trim_cache size 0 max 16384 2023-10-07T00:13:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.815+0000 7f5bcbf50b80 1 Processor -- start 2023-10-07T00:13:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.815+0000 7f5bcbf50b80 1 -- start start 2023-10-07T00:13:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13412030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13408da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a131d48c0 con 0x557a13401fd0 2023-10-07T00:13:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a134027b0 con 0x557a13402990 2023-10-07T00:13:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1340b770 con 0x557a13400ec0 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bb5b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13412030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bb639b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bb5b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13412030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35932/0 (socket says 172.21.15.5:35932) 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bb5b9a700 1 -- 172.21.15.5:0/579582876 learned_addr learned my addr 172.21.15.5:0/579582876 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bb639b700 1 -- 172.21.15.5:0/579582876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 msgr2=0x557a13408da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.816+0000 7f5bb6b9c700 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13408da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5bb639b700 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13408da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5bb639b700 1 -- 172.21.15.5:0/579582876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 msgr2=0x557a13412030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5bb639b700 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13412030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5bb639b700 1 -- 172.21.15.5:0/579582876 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a131a51f0 con 0x557a13400ec0 2023-10-07T00:13:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5bb5b9a700 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13412030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5bb6b9c700 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13408da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:13:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5bb639b700 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134097f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x557a13402f50 tx=0x7f5bac09a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939f2a059e85590e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5ba53ff700 1 -- 172.21.15.5:0/579582876 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac09a1d0 con 0x557a13400ec0 2023-10-07T00:13:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5ba53ff700 1 -- 172.21.15.5:0/579582876 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bac010880 con 0x557a13400ec0 2023-10-07T00:13:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.817+0000 7f5ba53ff700 1 -- 172.21.15.5:0/579582876 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac098500 con 0x557a13400ec0 2023-10-07T00:13:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/579582876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 msgr2=0x557a134097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134097f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x557a13402f50 tx=0x7f5bac09a160 comp rx=0 tx=0).stop 2023-10-07T00:13:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/579582876 shutdown_connections 2023-10-07T00:13:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13402990 0x557a13408da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13400ec0 0x557a134097f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/579582876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13401fd0 0x557a13412030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/579582876 >> 172.21.15.5:0/579582876 conn(0x557a13375200 msgr2=0x557a1341d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/579582876 shutdown_connections 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.818+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/579582876 wait complete. 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 1 -- start start 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 1 Processor -- start 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13400ec0 0x557a1340fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13401fd0 0x557a13410310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13411320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a13411860 con 0x557a13402990 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a134119d0 con 0x557a13400ec0 2023-10-07T00:13:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a13411b90 con 0x557a13401fd0 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.819+0000 7f5bcbf50b80 10 client.0 _ll_register_callbacks cb 0x7f5ba0005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb6b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13411320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb6b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13411320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35946/0 (socket says 172.21.15.5:35946) 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb6b9c700 1 -- 172.21.15.5:0/6654345 learned_addr learned my addr 172.21.15.5:0/6654345 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb5b9a700 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13401fd0 0x557a13410310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb639b700 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13400ec0 0x557a1340fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb6b9c700 1 -- 172.21.15.5:0/6654345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13401fd0 msgr2=0x557a13410310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb6b9c700 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13401fd0 0x557a13410310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb6b9c700 1 -- 172.21.15.5:0/6654345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13400ec0 msgr2=0x557a1340fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb6b9c700 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13400ec0 0x557a1340fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb6b9c700 1 -- 172.21.15.5:0/6654345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a13167c00 con 0x557a13402990 2023-10-07T00:13:28.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.820+0000 7f5bb5b9a700 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13401fd0 0x557a13410310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:28.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.821+0000 7f5bb6b9c700 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13411320 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8003fd0 tx=0x7f5ba8009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671aab1c7346bdbe server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:28.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.821+0000 7f5b99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:28.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.821+0000 7f5b99ffb700 1 -- 172.21.15.5:0/6654345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba801ae20 con 0x557a13402990 2023-10-07T00:13:28.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.821+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/6654345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5bac099ac0 con 0x557a13402990 2023-10-07T00:13:28.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.821+0000 7f5b99ffb700 1 -- 172.21.15.5:0/6654345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5ba8027400 con 0x557a13402990 2023-10-07T00:13:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.821+0000 7f5b99ffb700 1 -- 172.21.15.5:0/6654345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ba80275c0 con 0x557a13402990 2023-10-07T00:13:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.821+0000 7f5bcbf50b80 10 client.15576 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.821+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/6654345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a1317ed80 con 0x557a13402990 2023-10-07T00:13:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5b99ffb700 1 -- 172.21.15.5:0/6654345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ba8036020 con 0x557a13402990 2023-10-07T00:13:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5b99ffb700 1 -- 172.21.15.5:0/6654345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5ba80306c0 con 0x557a13402990 2023-10-07T00:13:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5bcbf50b80 10 client.15576 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5bcbf50b80 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5bcbf50b80 20 client.15576 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557a1346b770 0x557a1346dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5bcbf50b80 4 client.15576 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:13:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/6654345 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a1334cad0 con 0x557a1346b770 2023-10-07T00:13:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.822+0000 7f5bb639b700 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557a1346b770 0x557a1346dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.823+0000 7f5bb639b700 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557a1346b770 0x557a1346dbf0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4aa1c6d85bbaac8 server_cookie=1e12103c6f88077c in_seq=0 out_seq=0 2023-10-07T00:13:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.823+0000 7f5b99ffb700 10 client.15576 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.827+0000 7f5b99ffb700 1 -- 172.21.15.5:0/6654345 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a1334cad0 con 0x557a1346b770 2023-10-07T00:13:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.827+0000 7f5b99ffb700 10 client.15576 handle_command_reply: tid=0 2023-10-07T00:13:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.827+0000 7f5bcbf50b80 1 client.15576 shutdown 2023-10-07T00:13:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/6654345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 msgr2=0x557a13411320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13411320 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8003fd0 tx=0x7f5ba8009100 comp rx=0 tx=0).stop 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/6654345 shutdown_connections 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557a1346b770 0x557a1346dbf0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a13402990 0x557a13411320 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557a13400ec0 0x557a1340fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 --2- 172.21.15.5:0/6654345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a13401fd0 0x557a13410310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5b99ffb700 0 client.15576 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/6654345 >> 172.21.15.5:0/6654345 conn(0x557a13375200 msgr2=0x557a134097f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/6654345 shutdown_connections 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 1 -- 172.21.15.5:0/6654345 wait complete. 2023-10-07T00:13:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.828+0000 7f5bcbf50b80 20 client.15576 trim_cache size 0 max 16384 2023-10-07T00:13:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:13:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:13:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:13:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 -- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b9c0a1500 msgr2=0x7f5b9c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b9c0a1500 0x7f5b9c0a39c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x557a13400c60 tx=0x7f5ba8004b40 comp rx=0 tx=0).stop 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 -- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 msgr2=0x7f5bb0198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 0x7f5bb0198d40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00e9a0 tx=0x7f5bac00ecb0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 -- 172.21.15.5:0/3120263870 shutdown_connections 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f5b9c0a1500 0x7f5b9c0a39c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb0108dc0 0x7f5bb01a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bb0073910 0x7f5bb0198d40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 --2- 172.21.15.5:0/3120263870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bb0074ef0 0x7f5bb0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 -- 172.21.15.5:0/3120263870 >> 172.21.15.5:0/3120263870 conn(0x7f5bb00fc470 msgr2=0x7f5bb00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 -- 172.21.15.5:0/3120263870 shutdown_connections 2023-10-07T00:13:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:28.829+0000 7f5bb85ff700 1 -- 172.21.15.5:0/3120263870 wait complete. 2023-10-07T00:13:28.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:28 smithi112 ceph-mon[133548]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2023-10-07T00:13:29.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:28 smithi005 ceph-mon[129406]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2023-10-07T00:13:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:28 smithi088 ceph-mon[103111]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2023-10-07T00:13:30.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:30 smithi112 ceph-mon[133548]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-07T00:13:31.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:30 smithi005 ceph-mon[129406]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-07T00:13:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:30 smithi088 ceph-mon[103111]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-07T00:13:32.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:13:32.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:32 smithi112 ceph-mon[133548]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-10-07T00:13:33.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 -- 172.21.15.5:0/2425202609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084073910 msgr2=0x7f7084073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 --2- 172.21.15.5:0/2425202609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084073910 0x7f7084073d90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7078009990 tx=0x7f7078009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 -- 172.21.15.5:0/2425202609 shutdown_connections 2023-10-07T00:13:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 --2- 172.21.15.5:0/2425202609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084108e80 0x7f708410b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 --2- 172.21.15.5:0/2425202609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7084074ef0 0x7f7084073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 --2- 172.21.15.5:0/2425202609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084073910 0x7f7084073d90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 -- 172.21.15.5:0/2425202609 >> 172.21.15.5:0/2425202609 conn(0x7f70840fc530 msgr2=0x7f70840fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 -- 172.21.15.5:0/2425202609 shutdown_connections 2023-10-07T00:13:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.105+0000 7f70897ff700 1 -- 172.21.15.5:0/2425202609 wait complete. 2023-10-07T00:13:33.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.106+0000 7f70897ff700 1 Processor -- start 2023-10-07T00:13:33.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.106+0000 7f70897ff700 1 -- start start 2023-10-07T00:13:33.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70897ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084073910 0x7f7084198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70897ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7084074ef0 0x7f7084199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70897ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084108e80 0x7f70841a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70897ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70841a0990 con 0x7f7084108e80 2023-10-07T00:13:33.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70897ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70841a0ad0 con 0x7f7084074ef0 2023-10-07T00:13:33.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70897ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70841a0c60 con 0x7f7084073910 2023-10-07T00:13:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:32 smithi005 ceph-mon[129406]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-10-07T00:13:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084108e80 0x7f70841a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70827fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7084074ef0 0x7f7084199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084108e80 0x7f70841a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36160/0 (socket says 172.21.15.5:36160) 2023-10-07T00:13:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f70837fe700 1 -- 172.21.15.5:0/3075936487 learned_addr learned my addr 172.21.15.5:0/3075936487 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.107+0000 7f7082ffd700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084073910 0x7f7084198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f70837fe700 1 -- 172.21.15.5:0/3075936487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084073910 msgr2=0x7f7084198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f70837fe700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084073910 0x7f7084198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f70837fe700 1 -- 172.21.15.5:0/3075936487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7084074ef0 msgr2=0x7f7084199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f70837fe700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7084074ef0 0x7f7084199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f70837fe700 1 -- 172.21.15.5:0/3075936487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074009520 con 0x7f7084108e80 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f70837fe700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084108e80 0x7f70841a03c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f707c007ee0 tx=0x7f707c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f706bfff700 1 -- 172.21.15.5:0/3075936487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c017070 con 0x7f7084108e80 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f70897ff700 1 -- 172.21.15.5:0/3075936487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70780095f0 con 0x7f7084108e80 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f706bfff700 1 -- 172.21.15.5:0/3075936487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f707c00f040 con 0x7f7084108e80 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.108+0000 7f706bfff700 1 -- 172.21.15.5:0/3075936487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c005570 con 0x7f7084108e80 2023-10-07T00:13:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.109+0000 7f70897ff700 1 -- 172.21.15.5:0/3075936487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70841a1210 con 0x7f7084108e80 2023-10-07T00:13:33.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.113+0000 7f709d1eeb80 1 Processor -- start 2023-10-07T00:13:33.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.114+0000 7f706bfff700 1 -- 172.21.15.5:0/3075936487 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f707c00db20 con 0x7f7084108e80 2023-10-07T00:13:33.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.114+0000 7f709d1eeb80 1 -- start start 2023-10-07T00:13:33.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb493680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb494480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 0x5626fb494ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb3fb460 con 0x5626fb493bc0 2023-10-07T00:13:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb3ecc20 con 0x5626fb493260 2023-10-07T00:13:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb3ea540 con 0x5626fb494a60 2023-10-07T00:13:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f7082ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb494480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f7082ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb494480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36168/0 (socket says 172.21.15.5:36168) 2023-10-07T00:13:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f7082ffd700 1 -- 172.21.15.5:0/1635926319 learned_addr learned my addr 172.21.15.5:0/1635926319 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f70827fc700 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb493680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f70827fc700 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 0x5626fb494ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f7082ffd700 1 -- 172.21.15.5:0/1635926319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 msgr2=0x5626fb494ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f7082ffd700 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 0x5626fb494ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f7082ffd700 1 -- 172.21.15.5:0/1635926319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 msgr2=0x5626fb493680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f7082ffd700 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb493680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f7082ffd700 1 -- 172.21.15.5:0/1635926319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626fb210de0 con 0x5626fb493bc0 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.115+0000 7f70827fc700 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb493680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.116+0000 7f7082ffd700 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb494480 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7074009f10 tx=0x7f7074011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8109f38367e039 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.116+0000 7f706bfff700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f706c0a1480 0x7f706c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.116+0000 7f70697fa700 1 -- 172.21.15.5:0/1635926319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074019630 con 0x5626fb493bc0 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.116+0000 7f70697fa700 1 -- 172.21.15.5:0/1635926319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7074019c20 con 0x5626fb493bc0 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.116+0000 7f70697fa700 1 -- 172.21.15.5:0/1635926319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400ebd0 con 0x5626fb493bc0 2023-10-07T00:13:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.116+0000 7f706bfff700 1 -- 172.21.15.5:0/3075936487 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f707c0cc4c0 con 0x7f7084108e80 2023-10-07T00:13:33.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.116+0000 7f70827fc700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f706c0a1480 0x7f706c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1635926319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 msgr2=0x5626fb494480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb494480 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7074009f10 tx=0x7f7074011720 comp rx=0 tx=0).stop 2023-10-07T00:13:33.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f70827fc700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f706c0a1480 0x7f706c0a3940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7078005910 tx=0x7f707801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1635926319 shutdown_connections 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 0x5626fb494ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb493680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1635926319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb494480 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1635926319 >> 172.21.15.5:0/1635926319 conn(0x5626fb407260 msgr2=0x5626fb48e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1635926319 shutdown_connections 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.117+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1635926319 wait complete. 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.118+0000 7f709d1eeb80 1 -- start start 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.118+0000 7f709d1eeb80 1 Processor -- start 2023-10-07T00:13:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb49d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493bc0 0x5626fb49d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb494a60 0x5626fb4a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb3e5e30 con 0x5626fb494a60 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb382710 con 0x5626fb493260 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb3823b0 con 0x5626fb493bc0 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f709d1eeb80 10 client.0 _ll_register_callbacks cb 0x5626fb1df800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f70827fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493bc0 0x5626fb49d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f70827fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493bc0 0x5626fb49d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48626/0 (socket says 172.21.15.5:48626) 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f70827fc700 1 -- 172.21.15.5:0/1812731886 learned_addr learned my addr 172.21.15.5:0/1812731886 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f70837fe700 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb494a60 0x5626fb4a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.119+0000 7f7082ffd700 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb49d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f70837fe700 1 -- 172.21.15.5:0/1812731886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493bc0 msgr2=0x5626fb49d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f70837fe700 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493bc0 0x5626fb49d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f70837fe700 1 -- 172.21.15.5:0/1812731886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 msgr2=0x5626fb49d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f70837fe700 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb49d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f70837fe700 1 -- 172.21.15.5:0/1812731886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7074009b70 con 0x5626fb494a60 2023-10-07T00:13:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f70827fc700 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493bc0 0x5626fb49d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f70837fe700 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb494a60 0x5626fb4a45d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f707c0c9fa0 tx=0x7f707c099380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a66af4f8d9b055 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f7066ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f7066ff5700 1 -- 172.21.15.5:0/1812731886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c022250 con 0x5626fb494a60 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1812731886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626fb485f10 con 0x5626fb494a60 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.120+0000 7f7066ff5700 1 -- 172.21.15.5:0/1812731886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f707c00ddd0 con 0x5626fb494a60 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f7066ff5700 1 -- 172.21.15.5:0/1812731886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f707c099ec0 con 0x5626fb494a60 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f709d1eeb80 10 client.15588 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1812731886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5626fb1f9c60 con 0x5626fb494a60 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f7066ff5700 1 -- 172.21.15.5:0/1812731886 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5626fb485f10 con 0x5626fb494a60 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f7066ff5700 1 -- 172.21.15.5:0/1812731886 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f707c0cc0e0 con 0x5626fb494a60 2023-10-07T00:13:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f709d1eeb80 10 client.15588 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:33.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f709d1eeb80 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:33.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f709d1eeb80 20 client.15588 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:33.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5626fb4a8ef0 0x5626fb4ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f709d1eeb80 4 client.15588 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:33.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.121+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1812731886 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626fb3dee10 con 0x5626fb4a8ef0 2023-10-07T00:13:33.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.122+0000 7f7082ffd700 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5626fb4a8ef0 0x5626fb4ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.123+0000 7f7082ffd700 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5626fb4a8ef0 0x5626fb4ab310 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75547d7426a06020 server_cookie=728c724dfb18b24a in_seq=0 out_seq=0 2023-10-07T00:13:33.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.123+0000 7f7066ff5700 10 client.15588 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:33.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.123+0000 7f7066ff5700 1 -- 172.21.15.5:0/1812731886 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5626fb3dee10 con 0x5626fb4a8ef0 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.123+0000 7f7066ff5700 10 client.15588 handle_command_reply: tid=0 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.123+0000 7f709d1eeb80 1 client.15588 shutdown 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1812731886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb494a60 msgr2=0x5626fb4a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb494a60 0x5626fb4a45d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f707c0c9fa0 tx=0x7f707c099380 comp rx=0 tx=0).stop 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1812731886 shutdown_connections 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5626fb4a8ef0 0x5626fb4ab310 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb494a60 0x5626fb4a45d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb49d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/1812731886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493bc0 0x5626fb49d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1812731886 >> 172.21.15.5:0/1812731886 conn(0x5626fb407260 msgr2=0x5626fb48df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f7066ff5700 0 client.15588 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1812731886 shutdown_connections 2023-10-07T00:13:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 1 -- 172.21.15.5:0/1812731886 wait complete. 2023-10-07T00:13:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.124+0000 7f709d1eeb80 20 client.15588 trim_cache size 0 max 16384 2023-10-07T00:13:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.144+0000 7f709d1eeb80 1 Processor -- start 2023-10-07T00:13:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.145+0000 7f709d1eeb80 1 -- start start 2023-10-07T00:13:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.145+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493260 0x5626fb48cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.145+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.145+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb494a60 0x5626fb4aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.145+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb266920 con 0x5626fb493bc0 2023-10-07T00:13:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.145+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb493fa0 con 0x5626fb494a60 2023-10-07T00:13:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.145+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb494690 con 0x5626fb493260 2023-10-07T00:13:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.145+0000 7f70827fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f7082ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493260 0x5626fb48cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f70827fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36188/0 (socket says 172.21.15.5:36188) 2023-10-07T00:13:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f70827fc700 1 -- 172.21.15.5:0/2712335417 learned_addr learned my addr 172.21.15.5:0/2712335417 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f7082ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493260 0x5626fb48cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48642/0 (socket says 172.21.15.5:48642) 2023-10-07T00:13:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f70837fe700 1 --2- 172.21.15.5:0/2712335417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb494a60 0x5626fb4aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f7082ffd700 1 -- 172.21.15.5:0/2712335417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb494a60 msgr2=0x5626fb4aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f7082ffd700 1 --2- 172.21.15.5:0/2712335417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb494a60 0x5626fb4aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f7082ffd700 1 -- 172.21.15.5:0/2712335417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 msgr2=0x5626fb4a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f7082ffd700 1 --2- 172.21.15.5:0/2712335417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f7082ffd700 1 -- 172.21.15.5:0/2712335417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626fb237250 con 0x5626fb493260 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.146+0000 7f7082ffd700 1 --2- 172.21.15.5:0/2712335417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493260 0x5626fb48cbc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7074009870 tx=0x7f70740098e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbe4dcaaed16185a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f7069ffb700 1 -- 172.21.15.5:0/2712335417 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400e850 con 0x5626fb493260 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f7069ffb700 1 -- 172.21.15.5:0/2712335417 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70740050c0 con 0x5626fb493260 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f7069ffb700 1 -- 172.21.15.5:0/2712335417 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074011bd0 con 0x5626fb493260 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2712335417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493260 msgr2=0x5626fb48cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2712335417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493260 0x5626fb48cbc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7074009870 tx=0x7f70740098e0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2712335417 shutdown_connections 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2712335417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb494a60 0x5626fb4aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2712335417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb493260 0x5626fb48cbc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2712335417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2712335417 >> 172.21.15.5:0/2712335417 conn(0x5626fb407260 msgr2=0x5626fb49bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.147+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2712335417 shutdown_connections 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.148+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2712335417 wait complete. 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.148+0000 7f709d1eeb80 1 -- start start 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.148+0000 7f709d1eeb80 1 Processor -- start 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb49fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f709d1eeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 0x5626fb4a30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb4a3600 con 0x5626fb493bc0 2023-10-07T00:13:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb4a3770 con 0x5626fb493260 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f709d1eeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626fb4a3930 con 0x5626fb494a60 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f709d1eeb80 10 client.0 _ll_register_callbacks cb 0x7f707c099590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70827fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70827fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36202/0 (socket says 172.21.15.5:36202) 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70827fc700 1 -- 172.21.15.5:0/2902595291 learned_addr learned my addr 172.21.15.5:0/2902595291 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f7082ffd700 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb49fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70837fe700 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 0x5626fb4a30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70827fc700 1 -- 172.21.15.5:0/2902595291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 msgr2=0x5626fb4a30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70827fc700 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 0x5626fb4a30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70827fc700 1 -- 172.21.15.5:0/2902595291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 msgr2=0x5626fb49fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70827fc700 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb49fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.149+0000 7f70827fc700 1 -- 172.21.15.5:0/2902595291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626fb210de0 con 0x5626fb493bc0 2023-10-07T00:13:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.150+0000 7f70827fc700 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a0100 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7078003ec0 tx=0x7f707800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca2c7f3d3627737 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.150+0000 7f7066ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.150+0000 7f7066ff5700 1 -- 172.21.15.5:0/2902595291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707801d040 con 0x5626fb493bc0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.150+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2902595291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7074019c20 con 0x5626fb493bc0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.150+0000 7f7066ff5700 1 -- 172.21.15.5:0/2902595291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7078004810 con 0x5626fb493bc0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.150+0000 7f7066ff5700 1 -- 172.21.15.5:0/2902595291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70780049d0 con 0x5626fb493bc0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.150+0000 7f709d1eeb80 10 client.15594 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2902595291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5626fb20f2b0 con 0x5626fb493bc0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f7066ff5700 1 -- 172.21.15.5:0/2902595291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7078045020 con 0x5626fb493bc0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f7066ff5700 1 -- 172.21.15.5:0/2902595291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7078033070 con 0x5626fb493bc0 2023-10-07T00:13:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f709d1eeb80 10 client.15594 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f709d1eeb80 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f709d1eeb80 20 client.15594 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5626fb4fd5c0 0x5626fb4ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f709d1eeb80 4 client.15594 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.151+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2902595291 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5626fb3deb30 con 0x5626fb4fd5c0 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.152+0000 7f7082ffd700 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5626fb4fd5c0 0x5626fb4ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.152+0000 7f7082ffd700 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5626fb4fd5c0 0x5626fb4ff9e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaee16ff3e9ae5d3 server_cookie=73f4317079e49b34 in_seq=0 out_seq=0 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.152+0000 7f7066ff5700 10 client.15594 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.152+0000 7f7066ff5700 1 -- 172.21.15.5:0/2902595291 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5626fb3deb30 con 0x5626fb4fd5c0 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.152+0000 7f7066ff5700 10 client.15594 handle_command_reply: tid=0 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.152+0000 7f709d1eeb80 1 client.15594 shutdown 2023-10-07T00:13:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2902595291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 msgr2=0x5626fb4a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a0100 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7078003ec0 tx=0x7f707800b260 comp rx=0 tx=0).stop 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2902595291 shutdown_connections 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5626fb4fd5c0 0x5626fb4ff9e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626fb494a60 0x5626fb4a30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5626fb493260 0x5626fb49fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f7066ff5700 0 client.15594 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 --2- 172.21.15.5:0/2902595291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626fb493bc0 0x5626fb4a0100 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2902595291 >> 172.21.15.5:0/2902595291 conn(0x5626fb407260 msgr2=0x5626fb48cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2902595291 shutdown_connections 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 1 -- 172.21.15.5:0/2902595291 wait complete. 2023-10-07T00:13:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.153+0000 7f709d1eeb80 20 client.15594 trim_cache size 0 max 16384 2023-10-07T00:13:33.159 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:13:33.159 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2023-10-07T00:13:33.159 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2023-10-07T00:13:33.159 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.154+0000 7f70897ff700 1 -- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f706c0a1480 msgr2=0x7f706c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.154+0000 7f70897ff700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f706c0a1480 0x7f706c0a3940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7078005910 tx=0x7f707801a040 comp rx=0 tx=0).stop 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.154+0000 7f70897ff700 1 -- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084108e80 msgr2=0x7f70841a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.154+0000 7f70897ff700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084108e80 0x7f70841a03c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f707c007ee0 tx=0x7f707c00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.155+0000 7f70897ff700 1 -- 172.21.15.5:0/3075936487 shutdown_connections 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.155+0000 7f70897ff700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f706c0a1480 0x7f706c0a3940 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.155+0000 7f70897ff700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084108e80 0x7f70841a03c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.155+0000 7f70897ff700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084073910 0x7f7084198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.155+0000 7f70897ff700 1 --2- 172.21.15.5:0/3075936487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7084074ef0 0x7f7084199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.155+0000 7f70897ff700 1 -- 172.21.15.5:0/3075936487 >> 172.21.15.5:0/3075936487 conn(0x7f70840fc530 msgr2=0x7f70840fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.155+0000 7f70897ff700 1 -- 172.21.15.5:0/3075936487 shutdown_connections 2023-10-07T00:13:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.155+0000 7f70897ff700 1 -- 172.21.15.5:0/3075936487 wait complete. 2023-10-07T00:13:33.181 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-07T00:13:33.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:13:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:32 smithi088 ceph-mon[103111]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-10-07T00:13:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 -- 172.21.15.5:0/3833963528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 msgr2=0x7fc5c0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/3833963528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 0x7fc5c0102610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0099c0 tx=0x7fc5ac009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 -- 172.21.15.5:0/3833963528 shutdown_connections 2023-10-07T00:13:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/3833963528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c0102b50 0x7fc5c0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/3833963528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5c0100fc0 0x7fc5c01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/3833963528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 0x7fc5c0102610 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 -- 172.21.15.5:0/3833963528 >> 172.21.15.5:0/3833963528 conn(0x7fc5c00fc530 msgr2=0x7fc5c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 -- 172.21.15.5:0/3833963528 shutdown_connections 2023-10-07T00:13:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.393+0000 7fc5c6fff700 1 -- 172.21.15.5:0/3833963528 wait complete. 2023-10-07T00:13:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.394+0000 7fc5c6fff700 1 Processor -- start 2023-10-07T00:13:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.394+0000 7fc5c6fff700 1 -- start start 2023-10-07T00:13:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.394+0000 7fc5c6fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c0100fc0 0x7fc5c0074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.394+0000 7fc5c6fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 0x7fc5c00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.394+0000 7fc5c6fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5c0102b50 0x7fc5c00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.394+0000 7fc5c6fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0073f80 con 0x7fc5c01021b0 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.394+0000 7fc5c6fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c00740f0 con 0x7fc5c0102b50 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.394+0000 7fc5c6fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c01a0be0 con 0x7fc5c0100fc0 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 0x7fc5c00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 0x7fc5c00732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36232/0 (socket says 172.21.15.5:36232) 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 -- 172.21.15.5:0/601234832 learned_addr learned my addr 172.21.15.5:0/601234832 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5c4d9b700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c0100fc0 0x7fc5c0074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5c559c700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5c0102b50 0x7fc5c00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 -- 172.21.15.5:0/601234832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c0100fc0 msgr2=0x7fc5c0074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c0100fc0 0x7fc5c0074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 -- 172.21.15.5:0/601234832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5c0102b50 msgr2=0x7fc5c00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5c0102b50 0x7fc5c00737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 -- 172.21.15.5:0/601234832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0095f0 con 0x7fc5c01021b0 2023-10-07T00:13:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5c559c700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5c0102b50 0x7fc5c00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.395+0000 7fc5bffff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 0x7fc5c00732a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac000c00 tx=0x7fc5ac00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.396+0000 7fc5bdffb700 1 -- 172.21.15.5:0/601234832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac01d070 con 0x7fc5c01021b0 2023-10-07T00:13:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.396+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c01a0e60 con 0x7fc5c01021b0 2023-10-07T00:13:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.396+0000 7fc5bdffb700 1 -- 172.21.15.5:0/601234832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5ac00fe70 con 0x7fc5c01021b0 2023-10-07T00:13:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.396+0000 7fc5bdffb700 1 -- 172.21.15.5:0/601234832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac004bd0 con 0x7fc5c01021b0 2023-10-07T00:13:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.396+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c01a1280 con 0x7fc5c01021b0 2023-10-07T00:13:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.397+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c0107f40 con 0x7fc5c01021b0 2023-10-07T00:13:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.401+0000 7fc5bdffb700 1 -- 172.21.15.5:0/601234832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc5ac004d30 con 0x7fc5c01021b0 2023-10-07T00:13:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.403+0000 7fc5bdffb700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5b00a1480 0x7fc5b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.403+0000 7fc5bdffb700 1 -- 172.21.15.5:0/601234832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc5ac0cdba0 con 0x7fc5c01021b0 2023-10-07T00:13:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.403+0000 7fc5c4d9b700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5b00a1480 0x7fc5b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.404+0000 7fc5c4d9b700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5b00a1480 0x7fc5b00a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0102010 tx=0x7fc5b4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.408+0000 7fc5bdffb700 1 -- 172.21.15.5:0/601234832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc5ac097270 con 0x7fc5c01021b0 2023-10-07T00:13:33.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.686+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5c010c6e0 con 0x7fc5c01021b0 2023-10-07T00:13:33.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.687+0000 7fc5bdffb700 1 -- 172.21.15.5:0/601234832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7fc5ac09a890 con 0x7fc5c01021b0 2023-10-07T00:13:33.688 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:13:33.689 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:13:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5b00a1480 msgr2=0x7fc5b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5b00a1480 0x7fc5b00a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0102010 tx=0x7fc5b4009260 comp rx=0 tx=0).stop 2023-10-07T00:13:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 msgr2=0x7fc5c00732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 0x7fc5c00732a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac000c00 tx=0x7fc5ac00fa00 comp rx=0 tx=0).stop 2023-10-07T00:13:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 shutdown_connections 2023-10-07T00:13:33.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc5b00a1480 0x7fc5b00a3940 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5c0102b50 0x7fc5c00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5c0100fc0 0x7fc5c0074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 --2- 172.21.15.5:0/601234832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5c01021b0 0x7fc5c00732a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 >> 172.21.15.5:0/601234832 conn(0x7fc5c00fc530 msgr2=0x7fc5c00fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 shutdown_connections 2023-10-07T00:13:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.690+0000 7fc5c6fff700 1 -- 172.21.15.5:0/601234832 wait complete. 2023-10-07T00:13:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:13:33.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-07T00:13:33.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.935+0000 7fedb3fff700 1 -- 172.21.15.5:0/4084289209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac100fc0 msgr2=0x7fedac1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.935+0000 7fedb3fff700 1 --2- 172.21.15.5:0/4084289209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac100fc0 0x7fedac1013e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7feda80099c0 tx=0x7feda8009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.936+0000 7fedb3fff700 1 -- 172.21.15.5:0/4084289209 shutdown_connections 2023-10-07T00:13:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.936+0000 7fedb3fff700 1 --2- 172.21.15.5:0/4084289209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedac102b50 0x7fedac109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.936+0000 7fedb3fff700 1 --2- 172.21.15.5:0/4084289209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac100fc0 0x7fedac1013e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.936+0000 7fedb3fff700 1 --2- 172.21.15.5:0/4084289209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac1021b0 0x7fedac102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.936+0000 7fedb3fff700 1 -- 172.21.15.5:0/4084289209 >> 172.21.15.5:0/4084289209 conn(0x7fedac0fc550 msgr2=0x7fedac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.936+0000 7fedb3fff700 1 -- 172.21.15.5:0/4084289209 shutdown_connections 2023-10-07T00:13:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.936+0000 7fedb3fff700 1 -- 172.21.15.5:0/4084289209 wait complete. 2023-10-07T00:13:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.937+0000 7fedb3fff700 1 Processor -- start 2023-10-07T00:13:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.937+0000 7fedb3fff700 1 -- start start 2023-10-07T00:13:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.937+0000 7fedb3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedac100fc0 0x7fedac196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.937+0000 7fedb3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac1021b0 0x7fedac197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.937+0000 7fedb3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac102b50 0x7fedac19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.937+0000 7fedb3fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac19e760 con 0x7fedac1021b0 2023-10-07T00:13:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.937+0000 7fedb3fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac19e8a0 con 0x7fedac100fc0 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.937+0000 7fedb3fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac19ea30 con 0x7fedac102b50 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac1021b0 0x7fedac197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac1021b0 0x7fedac197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36254/0 (socket says 172.21.15.5:36254) 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 -- 172.21.15.5:0/1160059689 learned_addr learned my addr 172.21.15.5:0/1160059689 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedac100fc0 0x7fedac196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb259c700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac102b50 0x7fedac19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 -- 172.21.15.5:0/1160059689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac102b50 msgr2=0x7fedac19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac102b50 0x7fedac19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 -- 172.21.15.5:0/1160059689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedac100fc0 msgr2=0x7fedac196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedac100fc0 0x7fedac196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 -- 172.21.15.5:0/1160059689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80095f0 con 0x7fedac1021b0 2023-10-07T00:13:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.938+0000 7fedb159a700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac1021b0 0x7fedac197120 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00d950 tx=0x7fed9c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.939+0000 7feda2ffd700 1 -- 172.21.15.5:0/1160059689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c009940 con 0x7fedac1021b0 2023-10-07T00:13:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.939+0000 7fedb3fff700 1 -- 172.21.15.5:0/1160059689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac19ed10 con 0x7fedac1021b0 2023-10-07T00:13:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.939+0000 7feda2ffd700 1 -- 172.21.15.5:0/1160059689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed9c010460 con 0x7fedac1021b0 2023-10-07T00:13:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.939+0000 7feda2ffd700 1 -- 172.21.15.5:0/1160059689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00f620 con 0x7fedac1021b0 2023-10-07T00:13:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.939+0000 7fedb3fff700 1 -- 172.21.15.5:0/1160059689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac19f1d0 con 0x7fedac1021b0 2023-10-07T00:13:33.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.944+0000 7feda2ffd700 1 -- 172.21.15.5:0/1160059689 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fed9c0105d0 con 0x7fedac1021b0 2023-10-07T00:13:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.945+0000 7fedc78c2b80 1 Processor -- start 2023-10-07T00:13:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.945+0000 7fedc78c2b80 1 -- start start 2023-10-07T00:13:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.945+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0260 0x55d3856d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.945+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0bc0 0x55d3856d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.945+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 0x55d3856d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.945+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d385638460 con 0x55d3856d0260 2023-10-07T00:13:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.945+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d385629c20 con 0x55d3856d1a60 2023-10-07T00:13:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.945+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d385627540 con 0x55d3856d0bc0 2023-10-07T00:13:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0260 0x55d3856d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0260 0x55d3856d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36256/0 (socket says 172.21.15.5:36256) 2023-10-07T00:13:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 -- 172.21.15.5:0/1698728439 learned_addr learned my addr 172.21.15.5:0/1698728439 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7feda2ffd700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fed980a1480 0x7fed980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb159a700 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 0x55d3856d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0bc0 0x55d3856d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fed980a1480 0x7fed980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7feda2ffd700 1 -- 172.21.15.5:0/1160059689 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fed9c0ccb40 con 0x7fedac1021b0 2023-10-07T00:13:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 -- 172.21.15.5:0/1698728439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0bc0 msgr2=0x55d3856d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0bc0 0x55d3856d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 -- 172.21.15.5:0/1698728439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 msgr2=0x55d3856d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 0x55d3856d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.946+0000 7fedb259c700 1 -- 172.21.15.5:0/1698728439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d38544dde0 con 0x55d3856d0260 2023-10-07T00:13:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.947+0000 7fedb259c700 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0260 0x55d3856d0680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feda4007a20 tx=0x7feda4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e010ccf75dc15c5e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.947+0000 7fedb259c700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fed980a1480 0x7fed980a3940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feda401a000 tx=0x7feda401c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.947+0000 7fed97fff700 1 -- 172.21.15.5:0/1698728439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4009e30 con 0x55d3856d0260 2023-10-07T00:13:33.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.947+0000 7fed97fff700 1 -- 172.21.15.5:0/1698728439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feda400f030 con 0x55d3856d0260 2023-10-07T00:13:33.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.947+0000 7fed97fff700 1 -- 172.21.15.5:0/1698728439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4019660 con 0x55d3856d0260 2023-10-07T00:13:33.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1698728439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0260 msgr2=0x55d3856d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0260 0x55d3856d0680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feda4007a20 tx=0x7feda4007d30 comp rx=0 tx=0).stop 2023-10-07T00:13:33.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1698728439 shutdown_connections 2023-10-07T00:13:33.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 0x55d3856d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0260 0x55d3856d0680 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/1698728439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0bc0 0x55d3856d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1698728439 >> 172.21.15.5:0/1698728439 conn(0x55d385644260 msgr2=0x55d3856cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1698728439 shutdown_connections 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.948+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1698728439 wait complete. 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.949+0000 7fedc78c2b80 1 -- start start 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.949+0000 7fedc78c2b80 1 Processor -- start 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.949+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0260 0x55d3856de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 0x55d3856e5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d385622e30 con 0x55d3856d0bc0 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3855bf710 con 0x55d3856d1a60 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3855bf3b0 con 0x55d3856d0260 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedc78c2b80 10 client.0 _ll_register_callbacks cb 0x55d38541c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856de8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36258/0 (socket says 172.21.15.5:36258) 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb159a700 1 -- 172.21.15.5:0/4115454040 learned_addr learned my addr 172.21.15.5:0/4115454040 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0260 0x55d3856de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb259c700 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 0x55d3856e5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb159a700 1 -- 172.21.15.5:0/4115454040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0260 msgr2=0x55d3856de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb159a700 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0260 0x55d3856de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb159a700 1 -- 172.21.15.5:0/4115454040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 msgr2=0x55d3856e5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb159a700 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 0x55d3856e5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.950+0000 7fedb159a700 1 -- 172.21.15.5:0/4115454040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda4007600 con 0x55d3856d0bc0 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fedb159a700 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856de8e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fed9c010880 tx=0x7fed9c099a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bf8d1c0e96e5b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fed957fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fed957fa700 1 -- 172.21.15.5:0/4115454040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c09a2a0 con 0x55d3856d0bc0 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fed957fa700 1 -- 172.21.15.5:0/4115454040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fed9c09a540 con 0x55d3856d0bc0 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fedc78c2b80 1 -- 172.21.15.5:0/4115454040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3856c2f10 con 0x55d3856d0bc0 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fed957fa700 1 -- 172.21.15.5:0/4115454040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed9c099e40 con 0x55d3856d0bc0 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fedc78c2b80 10 client.15612 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:33.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fedc78c2b80 1 -- 172.21.15.5:0/4115454040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d385436c60 con 0x55d3856d0bc0 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.951+0000 7fed957fa700 1 -- 172.21.15.5:0/4115454040 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d3856c2f10 con 0x55d3856d0bc0 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.952+0000 7fed957fa700 1 -- 172.21.15.5:0/4115454040 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fed9c099450 con 0x55d3856d0bc0 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.952+0000 7fedc78c2b80 10 client.15612 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.952+0000 7fedc78c2b80 10 client.15612 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.952+0000 7fedc78c2b80 20 client.15612 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.952+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55d3856ea1c0 0x55d3856ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.952+0000 7fedc78c2b80 4 client.15612 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.952+0000 7fedc78c2b80 1 -- 172.21.15.5:0/4115454040 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d38561be10 con 0x55d3856ea1c0 2023-10-07T00:13:33.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.952+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55d3856ea1c0 0x55d3856ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.953+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55d3856ea1c0 0x55d3856ec5e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2409da91f5b28c78 server_cookie=48472bd1d0002fcb in_seq=0 out_seq=0 2023-10-07T00:13:33.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.953+0000 7fed957fa700 10 client.15612 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:13:33.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.953+0000 7fed957fa700 1 -- 172.21.15.5:0/4115454040 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d38561be10 con 0x55d3856ea1c0 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.953+0000 7fed957fa700 10 client.15612 handle_command_reply: tid=0 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 client.15612 shutdown 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 -- 172.21.15.5:0/4115454040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 msgr2=0x55d3856de8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856de8e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fed9c010880 tx=0x7fed9c099a00 comp rx=0 tx=0).stop 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 -- 172.21.15.5:0/4115454040 shutdown_connections 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55d3856ea1c0 0x55d3856ec5e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d1a60 0x55d3856e5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d0260 0x55d3856de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/4115454040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856de8e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 -- 172.21.15.5:0/4115454040 >> 172.21.15.5:0/4115454040 conn(0x55d385644260 msgr2=0x55d3856caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fed957fa700 0 client.15612 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:13:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 -- 172.21.15.5:0/4115454040 shutdown_connections 2023-10-07T00:13:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 1 -- 172.21.15.5:0/4115454040 wait complete. 2023-10-07T00:13:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.954+0000 7fedc78c2b80 20 client.15612 trim_cache size 0 max 16384 2023-10-07T00:13:33.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.970+0000 7fedc78c2b80 1 Processor -- start 2023-10-07T00:13:33.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.970+0000 7fedc78c2b80 1 -- start start 2023-10-07T00:13:33.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 0x55d3856de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3856ddf70 con 0x55d3856d0bc0 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3854a3920 con 0x55d3856d0260 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3856d1310 con 0x55d3856d1a60 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36262/0 (socket says 172.21.15.5:36262) 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb159a700 1 -- 172.21.15.5:0/1544089253 learned_addr learned my addr 172.21.15.5:0/1544089253 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb259c700 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 0x55d3856de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb159a700 1 -- 172.21.15.5:0/1544089253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 msgr2=0x55d3856de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb159a700 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 0x55d3856de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb159a700 1 -- 172.21.15.5:0/1544089253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 msgr2=0x55d3856caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb159a700 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb159a700 1 -- 172.21.15.5:0/1544089253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d385474250 con 0x55d3856d0bc0 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.971+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.972+0000 7fedb159a700 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e58b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fed9c095bc0 tx=0x7fed9c099ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925f237b7eaad5e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.972+0000 7feda0ff9700 1 -- 172.21.15.5:0/1544089253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c095fc0 con 0x55d3856d0bc0 2023-10-07T00:13:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.972+0000 7feda0ff9700 1 -- 172.21.15.5:0/1544089253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed9c09a540 con 0x55d3856d0bc0 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.972+0000 7feda0ff9700 1 -- 172.21.15.5:0/1544089253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c09a2e0 con 0x55d3856d0bc0 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1544089253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 msgr2=0x55d3856e58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e58b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fed9c095bc0 tx=0x7fed9c099ab0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1544089253 shutdown_connections 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 0x55d3856de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/1544089253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e58b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1544089253 >> 172.21.15.5:0/1544089253 conn(0x55d385644260 msgr2=0x55d3856e60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1544089253 shutdown_connections 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 -- 172.21.15.5:0/1544089253 wait complete. 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.973+0000 7fedc78c2b80 1 -- start start 2023-10-07T00:13:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.974+0000 7fedc78c2b80 1 Processor -- start 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.974+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856e1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.974+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.974+0000 7fedc78c2b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 0x55d3856e45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.974+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3856e4b10 con 0x55d3856d0bc0 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.974+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3856e4c80 con 0x55d3856d0260 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.974+0000 7fedc78c2b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3856e4e40 con 0x55d3856d1a60 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedc78c2b80 10 client.0 _ll_register_callbacks cb 0x7fed9c096240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36264/0 (socket says 172.21.15.5:36264) 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb159a700 1 -- 172.21.15.5:0/2050632037 learned_addr learned my addr 172.21.15.5:0/2050632037 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856e1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb259c700 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 0x55d3856e45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb1d9b700 1 -- 172.21.15.5:0/2050632037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 msgr2=0x55d3856e45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 0x55d3856e45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb1d9b700 1 -- 172.21.15.5:0/2050632037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 msgr2=0x55d3856e15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb1d9b700 1 -- 172.21.15.5:0/2050632037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d385436c60 con 0x55d3856d0260 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.975+0000 7fedb159a700 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.976+0000 7fedb1d9b700 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856e1070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feda80098e0 tx=0x7feda800bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=472a06b51395deea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.976+0000 7fed957fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:13:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.976+0000 7fed957fa700 1 -- 172.21.15.5:0/2050632037 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda801d040 con 0x55d3856d0260 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.976+0000 7fedc78c2b80 1 -- 172.21.15.5:0/2050632037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feda400f030 con 0x55d3856d0260 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.976+0000 7fed957fa700 1 -- 172.21.15.5:0/2050632037 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7feda8029cf0 con 0x55d3856d0260 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.976+0000 7fed957fa700 1 -- 172.21.15.5:0/2050632037 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7feda80290c0 con 0x55d3856d0260 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.976+0000 7fedc78c2b80 10 client.25403 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.976+0000 7fedc78c2b80 1 -- 172.21.15.5:0/2050632037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d38544c2b0 con 0x55d3856d0260 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fed957fa700 1 -- 172.21.15.5:0/2050632037 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feda400f030 con 0x55d3856d0260 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fed957fa700 1 -- 172.21.15.5:0/2050632037 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feda80099f0 con 0x55d3856d0260 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fedc78c2b80 10 client.25403 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fedc78c2b80 10 client.25403 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fedc78c2b80 20 client.25403 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:33.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55d38573e9a0 0x55d385740dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:33.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fedc78c2b80 4 client.25403 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:33.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fedc78c2b80 1 -- 172.21.15.5:0/2050632037 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d38561bb30 con 0x55d38573e9a0 2023-10-07T00:13:33.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.977+0000 7fedb159a700 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55d38573e9a0 0x55d385740dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:33.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedb159a700 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55d38573e9a0 0x55d385740dc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f794879912564d51 server_cookie=7093d87e3286ca24 in_seq=0 out_seq=0 2023-10-07T00:13:33.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fed957fa700 10 client.25403 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:13:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fed957fa700 1 -- 172.21.15.5:0/2050632037 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d38561bb30 con 0x55d38573e9a0 2023-10-07T00:13:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fed957fa700 10 client.25403 handle_command_reply: tid=0 2023-10-07T00:13:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 client.25403 shutdown 2023-10-07T00:13:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 -- 172.21.15.5:0/2050632037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 msgr2=0x55d3856e1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856e1070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feda80098e0 tx=0x7feda800bb10 comp rx=0 tx=0).stop 2023-10-07T00:13:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 -- 172.21.15.5:0/2050632037 shutdown_connections 2023-10-07T00:13:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d3856d1a60 0x55d3856e45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55d38573e9a0 0x55d385740dc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3856d0260 0x55d3856e1070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 --2- 172.21.15.5:0/2050632037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3856d0bc0 0x55d3856e15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fed957fa700 0 client.25403 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.978+0000 7fedc78c2b80 1 -- 172.21.15.5:0/2050632037 >> 172.21.15.5:0/2050632037 conn(0x55d385644260 msgr2=0x55d3856e60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedc78c2b80 1 -- 172.21.15.5:0/2050632037 shutdown_connections 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedc78c2b80 1 -- 172.21.15.5:0/2050632037 wait complete. 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedc78c2b80 20 client.25403 trim_cache size 0 max 16384 2023-10-07T00:13:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:33.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 -- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fed980a1480 msgr2=0x7fed980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fed980a1480 0x7fed980a3940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feda401a000 tx=0x7feda401c000 comp rx=0 tx=0).stop 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 -- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac1021b0 msgr2=0x7fedac197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac1021b0 0x7fedac197120 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00d950 tx=0x7fed9c00dc60 comp rx=0 tx=0).stop 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 -- 172.21.15.5:0/1160059689 shutdown_connections 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fed980a1480 0x7fed980a3940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac102b50 0x7fedac19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedac100fc0 0x7fedac196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 --2- 172.21.15.5:0/1160059689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedac1021b0 0x7fedac197120 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.979+0000 7fedb3fff700 1 -- 172.21.15.5:0/1160059689 >> 172.21.15.5:0/1160059689 conn(0x7fedac0fc550 msgr2=0x7fedac0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.980+0000 7fedb3fff700 1 -- 172.21.15.5:0/1160059689 shutdown_connections 2023-10-07T00:13:33.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:33.980+0000 7fedb3fff700 1 -- 172.21.15.5:0/1160059689 wait complete. 2023-10-07T00:13:33.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:33 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/601234832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:33.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:33 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/601234832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:33.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-07T00:13:34.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:33 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/601234832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 -- 172.21.15.5:0/497802410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba0100fc0 msgr2=0x7f3ba01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/497802410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba0100fc0 0x7f3ba01013e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b900099c0 tx=0x7f3b90009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 -- 172.21.15.5:0/497802410 shutdown_connections 2023-10-07T00:13:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/497802410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba0102b50 0x7f3ba0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/497802410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba0100fc0 0x7f3ba01013e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/497802410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba01021b0 0x7f3ba0102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 -- 172.21.15.5:0/497802410 >> 172.21.15.5:0/497802410 conn(0x7f3ba00fc530 msgr2=0x7f3ba00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 -- 172.21.15.5:0/497802410 shutdown_connections 2023-10-07T00:13:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.218+0000 7f3ba5dff700 1 -- 172.21.15.5:0/497802410 wait complete. 2023-10-07T00:13:34.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.219+0000 7f3ba5dff700 1 Processor -- start 2023-10-07T00:13:34.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3ba5dff700 1 -- start start 2023-10-07T00:13:34.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3ba5dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba0100fc0 0x7f3ba0198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3ba5dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba01021b0 0x7f3ba0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3ba5dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba0102b50 0x7f3ba01a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3ba5dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01a0990 con 0x7f3ba01021b0 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3ba5dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01a0ad0 con 0x7f3ba0102b50 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3ba5dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01a0c60 con 0x7f3ba0100fc0 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3b9effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba01021b0 0x7f3ba0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3b9f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba0100fc0 0x7f3ba0198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3b9effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba01021b0 0x7f3ba0199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36282/0 (socket says 172.21.15.5:36282) 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3b9effd700 1 -- 172.21.15.5:0/1758873977 learned_addr learned my addr 172.21.15.5:0/1758873977 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.220+0000 7f3b9ffff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba0102b50 0x7f3ba01a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.221+0000 7f3b9f7fe700 1 -- 172.21.15.5:0/1758873977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba0102b50 msgr2=0x7f3ba01a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.221+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba0102b50 0x7f3ba01a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.221+0000 7f3b9f7fe700 1 -- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba01021b0 msgr2=0x7f3ba0199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.221+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba01021b0 0x7f3ba0199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.221+0000 7f3b9f7fe700 1 -- 172.21.15.5:0/1758873977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900095f0 con 0x7f3ba0100fc0 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.221+0000 7f3b9effd700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba01021b0 0x7f3ba0199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.221+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba0100fc0 0x7f3ba0198e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000bf10 tx=0x7f3b9000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.222+0000 7f3b9cff9700 1 -- 172.21.15.5:0/1758873977 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9001d070 con 0x7f3ba0100fc0 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.222+0000 7f3ba5dff700 1 -- 172.21.15.5:0/1758873977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba01a0ee0 con 0x7f3ba0100fc0 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.222+0000 7f3b9cff9700 1 -- 172.21.15.5:0/1758873977 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b9000bcd0 con 0x7f3ba0100fc0 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.222+0000 7f3b9cff9700 1 -- 172.21.15.5:0/1758873977 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900173f0 con 0x7f3ba0100fc0 2023-10-07T00:13:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.222+0000 7f3ba5dff700 1 -- 172.21.15.5:0/1758873977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba01a12a0 con 0x7f3ba0100fc0 2023-10-07T00:13:34.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.225+0000 7f3b9cff9700 1 -- 172.21.15.5:0/1758873977 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3b90022470 con 0x7f3ba0100fc0 2023-10-07T00:13:34.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.226+0000 7f3bb9642b80 1 Processor -- start 2023-10-07T00:13:34.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3bb9642b80 1 -- start start 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af7260 0x560e67af7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3b9cff9700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b880a1500 0x7f3b880a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67af8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af8a60 0x560e67af8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67a5f460 con 0x560e67af7260 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67a50c20 con 0x560e67af8a60 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67a4e540 con 0x560e67af7bc0 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3b9cff9700 1 -- 172.21.15.5:0/1758873977 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3b900cdcb0 con 0x7f3ba0100fc0 2023-10-07T00:13:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.227+0000 7f3b9ffff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b880a1500 0x7f3b880a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67af8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af7260 0x560e67af7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67af8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48738/0 (socket says 172.21.15.5:48738) 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af7260 0x560e67af7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36292/0 (socket says 172.21.15.5:36292) 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9effd700 1 -- 172.21.15.5:0/1518770915 learned_addr learned my addr 172.21.15.5:0/1518770915 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9ffff700 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af8a60 0x560e67af8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9effd700 1 -- 172.21.15.5:0/1518770915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af8a60 msgr2=0x560e67af8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9effd700 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af8a60 0x560e67af8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9effd700 1 -- 172.21.15.5:0/1518770915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af7260 msgr2=0x560e67af7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9effd700 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af7260 0x560e67af7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9effd700 1 -- 172.21.15.5:0/1518770915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e67874de0 con 0x560e67af7bc0 2023-10-07T00:13:34.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af7260 0x560e67af7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:34.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.228+0000 7f3b9ffff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b880a1500 0x7f3b880a39c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009ec0 tx=0x7f3b9800fc40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.229+0000 7f3b9effd700 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67af8480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b940117e0 tx=0x7f3b94011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=261e6b8415d04a8e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.229+0000 7f3b85ffb700 1 -- 172.21.15.5:0/1518770915 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94019410 con 0x560e67af7bc0 2023-10-07T00:13:34.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.229+0000 7f3b85ffb700 1 -- 172.21.15.5:0/1518770915 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b94019a00 con 0x560e67af7bc0 2023-10-07T00:13:34.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.229+0000 7f3b85ffb700 1 -- 172.21.15.5:0/1518770915 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94018980 con 0x560e67af7bc0 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 -- 172.21.15.5:0/1518770915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 msgr2=0x560e67af8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67af8480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b940117e0 tx=0x7f3b94011af0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 -- 172.21.15.5:0/1518770915 shutdown_connections 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af8a60 0x560e67af8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af7260 0x560e67af7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/1518770915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67af8480 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 -- 172.21.15.5:0/1518770915 >> 172.21.15.5:0/1518770915 conn(0x560e67a6b260 msgr2=0x560e67af2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 -- 172.21.15.5:0/1518770915 shutdown_connections 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 -- 172.21.15.5:0/1518770915 wait complete. 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.230+0000 7f3bb9642b80 1 -- start start 2023-10-07T00:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.231+0000 7f3bb9642b80 1 Processor -- start 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.231+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b01050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.231+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b01590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.231+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.231+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67a49e30 con 0x560e67af8a60 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.231+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e679e6710 con 0x560e67af7bc0 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.231+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e679e63b0 con 0x560e67af7260 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.231+0000 7f3bb9642b80 10 client.0 _ll_register_callbacks cb 0x560e67843800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b01590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b01590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:57742/0 (socket says 172.21.15.5:57742) 2023-10-07T00:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b085d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36294/0 (socket says 172.21.15.5:36294) 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 -- 172.21.15.5:0/2748313426 learned_addr learned my addr 172.21.15.5:0/2748313426 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b01050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 -- 172.21.15.5:0/2748313426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 msgr2=0x560e67b01050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b01050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 -- 172.21.15.5:0/2748313426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 msgr2=0x560e67b085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 -- 172.21.15.5:0/2748313426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9009fe70 con 0x560e67af7bc0 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b9effd700 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b01590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b94018480 tx=0x7f3b940196c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19d00098e66ed35b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.232+0000 7f3b7effd700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.233+0000 7f3b7effd700 1 -- 172.21.15.5:0/2748313426 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94005280 con 0x560e67af7bc0 2023-10-07T00:13:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.233+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2748313426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e67ae9f10 con 0x560e67af7bc0 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.233+0000 7f3b7effd700 1 -- 172.21.15.5:0/2748313426 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3b940053e0 con 0x560e67af7bc0 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.233+0000 7f3b7effd700 1 -- 172.21.15.5:0/2748313426 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b940055a0 con 0x560e67af7bc0 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.233+0000 7f3bb9642b80 10 client.25415 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.233+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2748313426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f3b94011440 con 0x560e67af7bc0 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.233+0000 7f3b7effd700 1 -- 172.21.15.5:0/2748313426 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b94031020 con 0x560e67af7bc0 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.234+0000 7f3b7effd700 1 -- 172.21.15.5:0/2748313426 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b94003680 con 0x560e67af7bc0 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.234+0000 7f3bb9642b80 10 client.25415 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.234+0000 7f3bb9642b80 10 client.25415 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.234+0000 7f3bb9642b80 20 client.25415 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.234+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x560e67b0cd30 0x560e67b0f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.234+0000 7f3bb9642b80 4 client.25415 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.234+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2748313426 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e67a42e10 con 0x560e67b0cd30 2023-10-07T00:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.234+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x560e67b0cd30 0x560e67b0f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.235+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x560e67b0cd30 0x560e67b0f150 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fed6a7f802044d39 server_cookie=6aae8fca2a0ba410 in_seq=0 out_seq=0 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.235+0000 7f3b7effd700 10 client.25415 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.235+0000 7f3b7effd700 1 -- 172.21.15.5:0/2748313426 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e67a42e10 con 0x560e67b0cd30 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.235+0000 7f3b7effd700 10 client.25415 handle_command_reply: tid=0 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 client.25415 shutdown 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2748313426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 msgr2=0x560e67b01590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b01590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b94018480 tx=0x7f3b940196c0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2748313426 shutdown_connections 2023-10-07T00:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x560e67b0cd30 0x560e67b0f150 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b01050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2748313426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b01590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2748313426 >> 172.21.15.5:0/2748313426 conn(0x560e67a6b260 msgr2=0x560e67af1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3b7effd700 0 client.25415 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:13:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2748313426 shutdown_connections 2023-10-07T00:13:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2748313426 wait complete. 2023-10-07T00:13:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.236+0000 7f3bb9642b80 20 client.25415 trim_cache size 0 max 16384 2023-10-07T00:13:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.250+0000 7f3bb9642b80 1 Processor -- start 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.250+0000 7f3bb9642b80 1 -- start start 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.250+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7260 0x560e67afedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.250+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67b08590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67afb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67b00c20 con 0x560e67af8a60 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e678ca920 con 0x560e67af7260 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67b00500 con 0x560e67af7bc0 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67b08590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67afb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67b08590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48758/0 (socket says 172.21.15.5:48758) 2023-10-07T00:13:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9effd700 1 -- 172.21.15.5:0/503488203 learned_addr learned my addr 172.21.15.5:0/503488203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/503488203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7260 0x560e67afedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9effd700 1 -- 172.21.15.5:0/503488203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7260 msgr2=0x560e67afedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9effd700 1 --2- 172.21.15.5:0/503488203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7260 0x560e67afedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9effd700 1 -- 172.21.15.5:0/503488203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 msgr2=0x560e67afb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9effd700 1 --2- 172.21.15.5:0/503488203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67afb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.251+0000 7f3b9effd700 1 -- 172.21.15.5:0/503488203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e6785dc60 con 0x560e67af7bc0 2023-10-07T00:13:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.252+0000 7f3b9effd700 1 --2- 172.21.15.5:0/503488203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67b08590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b94011e40 tx=0x7f3b94011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=183b6e586aa58997 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.252+0000 7f3b867fc700 1 -- 172.21.15.5:0/503488203 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94005280 con 0x560e67af7bc0 2023-10-07T00:13:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.252+0000 7f3b867fc700 1 -- 172.21.15.5:0/503488203 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b94031070 con 0x560e67af7bc0 2023-10-07T00:13:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.252+0000 7f3b867fc700 1 -- 172.21.15.5:0/503488203 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94018e50 con 0x560e67af7bc0 2023-10-07T00:13:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 -- 172.21.15.5:0/503488203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 msgr2=0x560e67b08590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/503488203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67b08590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b94011e40 tx=0x7f3b94011af0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 -- 172.21.15.5:0/503488203 shutdown_connections 2023-10-07T00:13:34.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/503488203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67afb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/503488203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7260 0x560e67afedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/503488203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7bc0 0x560e67b08590 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 -- 172.21.15.5:0/503488203 >> 172.21.15.5:0/503488203 conn(0x560e67a6b260 msgr2=0x560e67af0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 -- 172.21.15.5:0/503488203 shutdown_connections 2023-10-07T00:13:34.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 -- 172.21.15.5:0/503488203 wait complete. 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.253+0000 7f3bb9642b80 1 -- start start 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.254+0000 7f3bb9642b80 1 Processor -- start 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.254+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b03e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.254+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b04370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.254+0000 7f3bb9642b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b07390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.254+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67b078d0 con 0x560e67af8a60 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.254+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67b07a40 con 0x560e67af7bc0 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.254+0000 7f3bb9642b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67b07c00 con 0x560e67af7260 2023-10-07T00:13:34.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.254+0000 7f3bb9642b80 10 client.0 _ll_register_callbacks cb 0x7f3b900094b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b03e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b03e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48770/0 (socket says 172.21.15.5:48770) 2023-10-07T00:13:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9f7fe700 1 -- 172.21.15.5:0/2348505249 learned_addr learned my addr 172.21.15.5:0/2348505249 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9ffff700 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b07390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9effd700 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b04370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9f7fe700 1 -- 172.21.15.5:0/2348505249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 msgr2=0x560e67b04370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b04370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9f7fe700 1 -- 172.21.15.5:0/2348505249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 msgr2=0x560e67b07390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b07390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.255+0000 7f3b9f7fe700 1 -- 172.21.15.5:0/2348505249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b94011440 con 0x560e67af7260 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3b9f7fe700 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b03e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009fd0 tx=0x7f3b9001a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=847eb76b247f1961 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3b7effd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3b7effd700 1 -- 172.21.15.5:0/2348505249 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9009f130 con 0x560e67af7260 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3b7effd700 1 -- 172.21.15.5:0/2348505249 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3b900a32e0 con 0x560e67af7260 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2348505249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b94019a00 con 0x560e67af7260 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3b7effd700 1 -- 172.21.15.5:0/2348505249 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b900b9210 con 0x560e67af7260 2023-10-07T00:13:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3bb9642b80 10 client.25405 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2348505249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560e6789b250 con 0x560e67af7260 2023-10-07T00:13:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.256+0000 7f3b7effd700 1 -- 172.21.15.5:0/2348505249 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b9007d080 con 0x560e67af7260 2023-10-07T00:13:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.257+0000 7f3b7effd700 1 -- 172.21.15.5:0/2348505249 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b9009a4d0 con 0x560e67af7260 2023-10-07T00:13:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.257+0000 7f3bb9642b80 10 client.25405 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.257+0000 7f3bb9642b80 10 client.25405 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:13:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.257+0000 7f3bb9642b80 20 client.25405 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.257+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x560e67b61150 0x560e67b63540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.257+0000 7f3bb9642b80 4 client.25405 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.257+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2348505249 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560e67a42b30 con 0x560e67b61150 2023-10-07T00:13:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.257+0000 7f3b9effd700 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x560e67b61150 0x560e67b63540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3b9effd700 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x560e67b61150 0x560e67b63540 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a1ca4bdac94d6fce server_cookie=260cbd338482815 in_seq=0 out_seq=0 2023-10-07T00:13:34.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3b7effd700 10 client.25405 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:13:34.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3b7effd700 1 -- 172.21.15.5:0/2348505249 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560e67a42b30 con 0x560e67b61150 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3b7effd700 10 client.25405 handle_command_reply: tid=0 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 client.25405 shutdown 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2348505249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 msgr2=0x560e67b03e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b03e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009fd0 tx=0x7f3b9001a040 comp rx=0 tx=0).stop 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2348505249 shutdown_connections 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x560e67b61150 0x560e67b63540 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e67af8a60 0x560e67b07390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560e67af7260 0x560e67b03e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 --2- 172.21.15.5:0/2348505249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560e67af7bc0 0x560e67b04370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3b7effd700 0 client.25405 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:13:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.258+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2348505249 >> 172.21.15.5:0/2348505249 conn(0x560e67a6b260 msgr2=0x560e67afedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2348505249 shutdown_connections 2023-10-07T00:13:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3bb9642b80 1 -- 172.21.15.5:0/2348505249 wait complete. 2023-10-07T00:13:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3bb9642b80 20 client.25405 trim_cache size 0 max 16384 2023-10-07T00:13:34.268 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 -- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b880a1500 msgr2=0x7f3b880a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b880a1500 0x7f3b880a39c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009ec0 tx=0x7f3b9800fc40 comp rx=0 tx=0).stop 2023-10-07T00:13:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 -- 172.21.15.5:0/1758873977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba0100fc0 msgr2=0x7f3ba0198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba0100fc0 0x7f3ba0198e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000bf10 tx=0x7f3b9000fa00 comp rx=0 tx=0).stop 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 -- 172.21.15.5:0/1758873977 shutdown_connections 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b880a1500 0x7f3b880a39c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba0102b50 0x7f3ba01a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba0100fc0 0x7f3ba0198e10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 --2- 172.21.15.5:0/1758873977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba01021b0 0x7f3ba0199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.259+0000 7f3ba5dff700 1 -- 172.21.15.5:0/1758873977 >> 172.21.15.5:0/1758873977 conn(0x7f3ba00fc530 msgr2=0x7f3ba00fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.260+0000 7f3ba5dff700 1 -- 172.21.15.5:0/1758873977 shutdown_connections 2023-10-07T00:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.260+0000 7f3ba5dff700 1 -- 172.21.15.5:0/1758873977 wait complete. 2023-10-07T00:13:34.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-07T00:13:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 -- 172.21.15.5:0/969749929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc464106d00 msgr2=0x7fc464109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/969749929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc464106d00 0x7fc464109110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009f90 tx=0x7fc45c00b330 comp rx=0 tx=0).stop 2023-10-07T00:13:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 -- 172.21.15.5:0/969749929 shutdown_connections 2023-10-07T00:13:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/969749929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc464106d00 0x7fc464109110 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/969749929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc464101aa0 0x7fc464103e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/969749929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4641043d0 0x7fc4641067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 -- 172.21.15.5:0/969749929 >> 172.21.15.5:0/969749929 conn(0x7fc4640fb450 msgr2=0x7fc4640fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 -- 172.21.15.5:0/969749929 shutdown_connections 2023-10-07T00:13:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.497+0000 7fc46b1ff700 1 -- 172.21.15.5:0/969749929 wait complete. 2023-10-07T00:13:34.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.498+0000 7fc46b1ff700 1 Processor -- start 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.498+0000 7fc46b1ff700 1 -- start start 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.498+0000 7fc46b1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc464101aa0 0x7fc464198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc46b1ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4641043d0 0x7fc464199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc46b1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc464106d00 0x7fc4641a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc46b1ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4641a0a50 con 0x7fc4641043d0 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc46b1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4641a0b90 con 0x7fc464101aa0 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc46b1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4641a0d20 con 0x7fc464106d00 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc463fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4641043d0 0x7fc464199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc463fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4641043d0 0x7fc464199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36320/0 (socket says 172.21.15.5:36320) 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc463fff700 1 -- 172.21.15.5:0/3806691766 learned_addr learned my addr 172.21.15.5:0/3806691766 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc46979c700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc464106d00 0x7fc4641a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc468f9b700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc464101aa0 0x7fc464198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc463fff700 1 -- 172.21.15.5:0/3806691766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc464106d00 msgr2=0x7fc4641a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc463fff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc464106d00 0x7fc4641a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc463fff700 1 -- 172.21.15.5:0/3806691766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc464101aa0 msgr2=0x7fc464198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.499+0000 7fc463fff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc464101aa0 0x7fc464198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc463fff700 1 -- 172.21.15.5:0/3806691766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458009520 con 0x7fc4641043d0 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc468f9b700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc464101aa0 0x7fc464198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc46979c700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc464106d00 0x7fc4641a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc463fff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4641043d0 0x7fc464199410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc45000ec10 tx=0x7fc45000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc461ffb700 1 -- 172.21.15.5:0/3806691766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45000cc90 con 0x7fc4641043d0 2023-10-07T00:13:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc46b1ff700 1 -- 172.21.15.5:0/3806691766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4500095f0 con 0x7fc4641043d0 2023-10-07T00:13:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc461ffb700 1 -- 172.21.15.5:0/3806691766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc45000cdf0 con 0x7fc4641043d0 2023-10-07T00:13:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc461ffb700 1 -- 172.21.15.5:0/3806691766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450003e80 con 0x7fc4641043d0 2023-10-07T00:13:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.500+0000 7fc46b1ff700 1 -- 172.21.15.5:0/3806691766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c009c40 con 0x7fc4641043d0 2023-10-07T00:13:34.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc47ea59b80 1 Processor -- start 2023-10-07T00:13:34.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc47ea59b80 1 -- start start 2023-10-07T00:13:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896ce9f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896ce9fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ce06460 con 0x55896ce9ebc0 2023-10-07T00:13:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896cdf7c20 con 0x55896ce9e260 2023-10-07T00:13:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896cdf5540 con 0x55896ce9fa60 2023-10-07T00:13:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.505+0000 7fc461ffb700 1 -- 172.21.15.5:0/3806691766 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc450003fe0 con 0x7fc4641043d0 2023-10-07T00:13:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc468f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896ce9f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc468f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896ce9f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36334/0 (socket says 172.21.15.5:36334) 2023-10-07T00:13:34.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc468f9b700 1 -- 172.21.15.5:0/560001335 learned_addr learned my addr 172.21.15.5:0/560001335 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc46979c700 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc463fff700 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896ce9fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc468f9b700 1 -- 172.21.15.5:0/560001335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 msgr2=0x55896ce9fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc468f9b700 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896ce9fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc468f9b700 1 -- 172.21.15.5:0/560001335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 msgr2=0x55896ce9e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc468f9b700 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc468f9b700 1 -- 172.21.15.5:0/560001335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55896cc1bde0 con 0x55896ce9ebc0 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc463fff700 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896ce9fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.506+0000 7fc46979c700 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.507+0000 7fc468f9b700 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896ce9f480 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc458011760 tx=0x7fc458011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19179b91d56f0998 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.507+0000 7fc44effd700 1 -- 172.21.15.5:0/560001335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45800f4e0 con 0x55896ce9ebc0 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.507+0000 7fc44effd700 1 -- 172.21.15.5:0/560001335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc45800fad0 con 0x55896ce9ebc0 2023-10-07T00:13:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.507+0000 7fc44effd700 1 -- 172.21.15.5:0/560001335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458019aa0 con 0x55896ce9ebc0 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.507+0000 7fc461ffb700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc4540a1480 0x7fc4540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.507+0000 7fc461ffb700 1 -- 172.21.15.5:0/3806691766 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc450014070 con 0x7fc4641043d0 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.507+0000 7fc46979c700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc4540a1480 0x7fc4540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 -- 172.21.15.5:0/560001335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 msgr2=0x55896ce9f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896ce9f480 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc458011760 tx=0x7fc458011a70 comp rx=0 tx=0).stop 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 -- 172.21.15.5:0/560001335 shutdown_connections 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896ce9fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/560001335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896ce9f480 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 -- 172.21.15.5:0/560001335 >> 172.21.15.5:0/560001335 conn(0x55896ce12260 msgr2=0x55896ce99140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 -- 172.21.15.5:0/560001335 shutdown_connections 2023-10-07T00:13:34.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc47ea59b80 1 -- 172.21.15.5:0/560001335 wait complete. 2023-10-07T00:13:34.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.508+0000 7fc46979c700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc4540a1480 0x7fc4540a3940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009790 tx=0x7fc45c0096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 1 -- start start 2023-10-07T00:13:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 1 Processor -- start 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9e260 0x55896cea8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896cea8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9fa60 0x55896ceaf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896cdf0e30 con 0x55896ce9ebc0 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896cd8d710 con 0x55896ce9fa60 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896cd8d3b0 con 0x55896ce9e260 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.509+0000 7fc47ea59b80 10 client.0 _ll_register_callbacks cb 0x55896cbea800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896cea8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896cea8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36348/0 (socket says 172.21.15.5:36348) 2023-10-07T00:13:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 -- 172.21.15.5:0/33365376 learned_addr learned my addr 172.21.15.5:0/33365376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc468f9b700 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9e260 0x55896cea8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc46979c700 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9fa60 0x55896ceaf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 -- 172.21.15.5:0/33365376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9e260 msgr2=0x55896cea8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9e260 0x55896cea8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 -- 172.21.15.5:0/33365376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9fa60 msgr2=0x55896ceaf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9fa60 0x55896ceaf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 -- 172.21.15.5:0/33365376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc464109d00 con 0x55896ce9ebc0 2023-10-07T00:13:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc463fff700 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896cea8570 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc450096ee0 tx=0x7fc45000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f8e4315eb9b44a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.510+0000 7fc443fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc443fff700 1 -- 172.21.15.5:0/33365376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45009ab70 con 0x55896ce9ebc0 2023-10-07T00:13:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 1 -- 172.21.15.5:0/33365376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55896ce90f10 con 0x55896ce9ebc0 2023-10-07T00:13:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc443fff700 1 -- 172.21.15.5:0/33365376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc45009a470 con 0x55896ce9ebc0 2023-10-07T00:13:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc443fff700 1 -- 172.21.15.5:0/33365376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc45009e5c0 con 0x55896ce9ebc0 2023-10-07T00:13:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 10 client.15648 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 1 -- 172.21.15.5:0/33365376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fc458011440 con 0x55896ce9ebc0 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc443fff700 1 -- 172.21.15.5:0/33365376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55896ce90f10 con 0x55896ce9ebc0 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc443fff700 1 -- 172.21.15.5:0/33365376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc45009e170 con 0x55896ce9ebc0 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 10 client.15648 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 10 client.15648 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 20 client.15648 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55896ceb3d20 0x55896ceb6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 4 client.15648 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.511+0000 7fc47ea59b80 1 -- 172.21.15.5:0/33365376 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55896cde9e10 con 0x55896ceb3d20 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.512+0000 7fc468f9b700 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55896ceb3d20 0x55896ceb6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.513+0000 7fc468f9b700 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55896ceb3d20 0x55896ceb6110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da3883787fa01aa9 server_cookie=22900db134a62eea in_seq=0 out_seq=0 2023-10-07T00:13:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.513+0000 7fc443fff700 10 client.15648 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc443fff700 1 -- 172.21.15.5:0/33365376 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55896cde9e10 con 0x55896ceb3d20 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc443fff700 10 client.15648 handle_command_reply: tid=0 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 client.15648 shutdown 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 -- 172.21.15.5:0/33365376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 msgr2=0x55896cea8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896cea8570 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc450096ee0 tx=0x7fc45000cf60 comp rx=0 tx=0).stop 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 -- 172.21.15.5:0/33365376 shutdown_connections 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55896ceb3d20 0x55896ceb6110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9fa60 0x55896ceaf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9e260 0x55896cea8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc443fff700 0 client.15648 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:13:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/33365376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9ebc0 0x55896cea8570 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 -- 172.21.15.5:0/33365376 >> 172.21.15.5:0/33365376 conn(0x55896ce12260 msgr2=0x55896ce98f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 -- 172.21.15.5:0/33365376 shutdown_connections 2023-10-07T00:13:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.514+0000 7fc47ea59b80 1 -- 172.21.15.5:0/33365376 wait complete. 2023-10-07T00:13:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.515+0000 7fc47ea59b80 20 client.15648 trim_cache size 0 max 16384 2023-10-07T00:13:34.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.528+0000 7fc47ea59b80 1 Processor -- start 2023-10-07T00:13:34.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.528+0000 7fc47ea59b80 1 -- start start 2023-10-07T00:13:34.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9ebc0 0x55896ceaf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9fa60 0x55896cea6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896cc71920 con 0x55896ce9fa60 2023-10-07T00:13:34.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ce9efa0 con 0x55896ce9e260 2023-10-07T00:13:34.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896cea8cb0 con 0x55896ce9ebc0 2023-10-07T00:13:34.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc46979c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9fa60 0x55896cea6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc46979c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9fa60 0x55896cea6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36358/0 (socket says 172.21.15.5:36358) 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc46979c700 1 -- 172.21.15.5:0/223690324 learned_addr learned my addr 172.21.15.5:0/223690324 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc468f9b700 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.529+0000 7fc463fff700 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9ebc0 0x55896ceaf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc468f9b700 1 -- 172.21.15.5:0/223690324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9ebc0 msgr2=0x55896ceaf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc468f9b700 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9ebc0 0x55896ceaf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc468f9b700 1 -- 172.21.15.5:0/223690324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9fa60 msgr2=0x55896cea6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc468f9b700 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9fa60 0x55896cea6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc468f9b700 1 -- 172.21.15.5:0/223690324 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55896cc04c60 con 0x55896ce9e260 2023-10-07T00:13:34.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc468f9b700 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9fe40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc458000c00 tx=0x7fc45800ff80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad8a56c1f49c7d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc44f7fe700 1 -- 172.21.15.5:0/223690324 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458005b00 con 0x55896ce9e260 2023-10-07T00:13:34.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc44f7fe700 1 -- 172.21.15.5:0/223690324 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4580194a0 con 0x55896ce9e260 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.530+0000 7fc44f7fe700 1 -- 172.21.15.5:0/223690324 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45800f740 con 0x55896ce9e260 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 -- 172.21.15.5:0/223690324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 msgr2=0x55896ce9fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9fe40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc458000c00 tx=0x7fc45800ff80 comp rx=0 tx=0).stop 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 -- 172.21.15.5:0/223690324 shutdown_connections 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9fa60 0x55896cea6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9e260 0x55896ce9fe40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/223690324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9ebc0 0x55896ceaf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 -- 172.21.15.5:0/223690324 >> 172.21.15.5:0/223690324 conn(0x55896ce12260 msgr2=0x55896cebaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 -- 172.21.15.5:0/223690324 shutdown_connections 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.531+0000 7fc47ea59b80 1 -- 172.21.15.5:0/223690324 wait complete. 2023-10-07T00:13:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.532+0000 7fc47ea59b80 1 -- start start 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.532+0000 7fc47ea59b80 1 Processor -- start 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.532+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9e260 0x55896ceaee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.532+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9ebc0 0x55896ceaf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc47ea59b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896cead480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ceadb60 con 0x55896ce9e260 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ceadcd0 con 0x55896ce9ebc0 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc47ea59b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ceade90 con 0x55896ce9fa60 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc47ea59b80 10 client.0 _ll_register_callbacks cb 0x55896cbea800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:34.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc468f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9e260 0x55896ceaee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc468f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9e260 0x55896ceaee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36362/0 (socket says 172.21.15.5:36362) 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc468f9b700 1 -- 172.21.15.5:0/1106087626 learned_addr learned my addr 172.21.15.5:0/1106087626 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc463fff700 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9ebc0 0x55896ceaf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc46979c700 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896cead480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc468f9b700 1 -- 172.21.15.5:0/1106087626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 msgr2=0x55896cead480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc468f9b700 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896cead480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc468f9b700 1 -- 172.21.15.5:0/1106087626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9ebc0 msgr2=0x55896ceaf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc468f9b700 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9ebc0 0x55896ceaf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc468f9b700 1 -- 172.21.15.5:0/1106087626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55896cc1bde0 con 0x55896ce9e260 2023-10-07T00:13:34.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.533+0000 7fc46979c700 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896cead480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.534+0000 7fc468f9b700 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9e260 0x55896ceaee70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc45801c040 tx=0x7fc458005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b804123f475a1f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.534+0000 7fc443fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.534+0000 7fc443fff700 1 -- 172.21.15.5:0/1106087626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580292d0 con 0x55896ce9e260 2023-10-07T00:13:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.534+0000 7fc47ea59b80 1 -- 172.21.15.5:0/1106087626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc45800fad0 con 0x55896ce9e260 2023-10-07T00:13:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.534+0000 7fc443fff700 1 -- 172.21.15.5:0/1106087626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc458029d50 con 0x55896ce9e260 2023-10-07T00:13:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.534+0000 7fc443fff700 1 -- 172.21.15.5:0/1106087626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc45800f4e0 con 0x55896ce9e260 2023-10-07T00:13:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.534+0000 7fc47ea59b80 10 client.15654 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.534+0000 7fc47ea59b80 1 -- 172.21.15.5:0/1106087626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55896cc42250 con 0x55896ce9e260 2023-10-07T00:13:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc443fff700 1 -- 172.21.15.5:0/1106087626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc458041080 con 0x55896ce9e260 2023-10-07T00:13:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc443fff700 1 -- 172.21.15.5:0/1106087626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc45803b030 con 0x55896ce9e260 2023-10-07T00:13:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc47ea59b80 10 client.15654 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc47ea59b80 10 client.15654 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:13:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc47ea59b80 20 client.15654 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55896cf08a10 0x55896cf0ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc47ea59b80 4 client.15654 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc47ea59b80 1 -- 172.21.15.5:0/1106087626 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55896cde9b30 con 0x55896cf08a10 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.535+0000 7fc463fff700 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55896cf08a10 0x55896cf0ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc463fff700 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55896cf08a10 0x55896cf0ae30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dee80630aa40524d server_cookie=39aad6c6174a25af in_seq=0 out_seq=0 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc443fff700 10 client.15654 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc443fff700 1 -- 172.21.15.5:0/1106087626 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55896cde9b30 con 0x55896cf08a10 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc443fff700 10 client.15654 handle_command_reply: tid=0 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 client.15654 shutdown 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 -- 172.21.15.5:0/1106087626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9e260 msgr2=0x55896ceaee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9e260 0x55896ceaee70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc45801c040 tx=0x7fc458005dc0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 -- 172.21.15.5:0/1106087626 shutdown_connections 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55896cf08a10 0x55896cf0ae30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55896ce9fa60 0x55896cead480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ce9e260 0x55896ceaee70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc443fff700 0 client.15654 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 --2- 172.21.15.5:0/1106087626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55896ce9ebc0 0x55896ceaf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.536+0000 7fc47ea59b80 1 -- 172.21.15.5:0/1106087626 >> 172.21.15.5:0/1106087626 conn(0x55896ce12260 msgr2=0x55896cea6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.537+0000 7fc47ea59b80 1 -- 172.21.15.5:0/1106087626 shutdown_connections 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.537+0000 7fc47ea59b80 1 -- 172.21.15.5:0/1106087626 wait complete. 2023-10-07T00:13:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.537+0000 7fc47ea59b80 20 client.15654 trim_cache size 0 max 16384 2023-10-07T00:13:34.544 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.537+0000 7fc46b1ff700 1 -- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc4540a1480 msgr2=0x7fc4540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.537+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc4540a1480 0x7fc4540a3940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009790 tx=0x7fc45c0096c0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.537+0000 7fc46b1ff700 1 -- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4641043d0 msgr2=0x7fc464199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.537+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4641043d0 0x7fc464199410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc45000ec10 tx=0x7fc45000ef20 comp rx=0 tx=0).stop 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.538+0000 7fc46b1ff700 1 -- 172.21.15.5:0/3806691766 shutdown_connections 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.538+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc4540a1480 0x7fc4540a3940 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.538+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc464106d00 0x7fc4641a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.538+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc464101aa0 0x7fc464198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.538+0000 7fc46b1ff700 1 --2- 172.21.15.5:0/3806691766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4641043d0 0x7fc464199410 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.538+0000 7fc46b1ff700 1 -- 172.21.15.5:0/3806691766 >> 172.21.15.5:0/3806691766 conn(0x7fc4640fb450 msgr2=0x7fc464102730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.538+0000 7fc46b1ff700 1 -- 172.21.15.5:0/3806691766 shutdown_connections 2023-10-07T00:13:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.538+0000 7fc46b1ff700 1 -- 172.21.15.5:0/3806691766 wait complete. 2023-10-07T00:13:34.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-07T00:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 -- 172.21.15.5:0/434251865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8104370 msgr2=0x7f37e8106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 --2- 172.21.15.5:0/434251865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8104370 0x7f37e8106760 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009990 tx=0x7f37d8009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 -- 172.21.15.5:0/434251865 shutdown_connections 2023-10-07T00:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 --2- 172.21.15.5:0/434251865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37e8106ca0 0x7f37e8109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 --2- 172.21.15.5:0/434251865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37e8101a40 0x7f37e8103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 --2- 172.21.15.5:0/434251865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8104370 0x7f37e8106760 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 -- 172.21.15.5:0/434251865 >> 172.21.15.5:0/434251865 conn(0x7f37e80fb450 msgr2=0x7f37e80fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 -- 172.21.15.5:0/434251865 shutdown_connections 2023-10-07T00:13:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.794+0000 7f37effff700 1 -- 172.21.15.5:0/434251865 wait complete. 2023-10-07T00:13:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.795+0000 7f37effff700 1 Processor -- start 2023-10-07T00:13:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.795+0000 7f37effff700 1 -- start start 2023-10-07T00:13:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37effff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8101a40 0x7f37e8198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37effff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37e8104370 0x7f37e8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37effff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37e8106ca0 0x7f37e81a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37effff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81a0960 con 0x7f37e8101a40 2023-10-07T00:13:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37effff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81a0aa0 con 0x7f37e8106ca0 2023-10-07T00:13:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37effff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81a0c30 con 0x7f37e8104370 2023-10-07T00:13:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8101a40 0x7f37e8198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8101a40 0x7f37e8198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36392/0 (socket says 172.21.15.5:36392) 2023-10-07T00:13:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37edd9b700 1 -- 172.21.15.5:0/3316251384 learned_addr learned my addr 172.21.15.5:0/3316251384 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37ee59c700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37e8106ca0 0x7f37e81a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.796+0000 7f37ed59a700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37e8104370 0x7f37e8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37edd9b700 1 -- 172.21.15.5:0/3316251384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37e8104370 msgr2=0x7f37e8199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37edd9b700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37e8104370 0x7f37e8199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37edd9b700 1 -- 172.21.15.5:0/3316251384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37e8106ca0 msgr2=0x7f37e81a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37edd9b700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37e8106ca0 0x7f37e81a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37edd9b700 1 -- 172.21.15.5:0/3316251384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d80095f0 con 0x7f37e8101a40 2023-10-07T00:13:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37ee59c700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37e8106ca0 0x7f37e81a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37ed59a700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37e8104370 0x7f37e8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37edd9b700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8101a40 0x7f37e8198de0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f37e400e9a0 tx=0x7f37e400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37deffd700 1 -- 172.21.15.5:0/3316251384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4009790 con 0x7f37e8101a40 2023-10-07T00:13:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37deffd700 1 -- 172.21.15.5:0/3316251384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37e400cbd0 con 0x7f37e8101a40 2023-10-07T00:13:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37effff700 1 -- 172.21.15.5:0/3316251384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e81a0f10 con 0x7f37e8101a40 2023-10-07T00:13:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37deffd700 1 -- 172.21.15.5:0/3316251384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4018680 con 0x7f37e8101a40 2023-10-07T00:13:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.797+0000 7f37effff700 1 -- 172.21.15.5:0/3316251384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e81a1330 con 0x7f37e8101a40 2023-10-07T00:13:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.801+0000 7f37deffd700 1 -- 172.21.15.5:0/3316251384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f37e400cd40 con 0x7f37e8101a40 2023-10-07T00:13:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.802+0000 7f37deffd700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f37d40a1480 0x7f37d40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.802+0000 7f37deffd700 1 -- 172.21.15.5:0/3316251384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f37e4014070 con 0x7f37e8101a40 2023-10-07T00:13:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.802+0000 7f37ed59a700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f37d40a1480 0x7f37d40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.803+0000 7f37ed59a700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f37d40a1480 0x7f37d40a3940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f37d800b2e0 tx=0x7f37d8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.804+0000 7f38038f3b80 1 Processor -- start 2023-10-07T00:13:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f38038f3b80 1 -- start start 2023-10-07T00:13:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115062b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062bbc0 0x56115062c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 0x56115062cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f38038f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561150593460 con 0x56115062b260 2023-10-07T00:13:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f38038f3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561150584c20 con 0x56115062ca60 2023-10-07T00:13:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f38038f3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561150582540 con 0x56115062bbc0 2023-10-07T00:13:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115062b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115062b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36408/0 (socket says 172.21.15.5:36408) 2023-10-07T00:13:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f37edd9b700 1 -- 172.21.15.5:0/1057862579 learned_addr learned my addr 172.21.15.5:0/1057862579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.805+0000 7f37ed59a700 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062bbc0 0x56115062c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37ee59c700 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 0x56115062cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37edd9b700 1 -- 172.21.15.5:0/1057862579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062bbc0 msgr2=0x56115062c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37edd9b700 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062bbc0 0x56115062c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37edd9b700 1 -- 172.21.15.5:0/1057862579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 msgr2=0x56115062cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37edd9b700 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 0x56115062cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37edd9b700 1 -- 172.21.15.5:0/1057862579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611503a8de0 con 0x56115062b260 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37edd9b700 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115062b680 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f37e4096820 tx=0x7f37e4099f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be2d303e18ccbe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37d3fff700 1 -- 172.21.15.5:0/1057862579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e409e470 con 0x56115062b260 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37d3fff700 1 -- 172.21.15.5:0/1057862579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37e40a26b0 con 0x56115062b260 2023-10-07T00:13:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.806+0000 7f37d3fff700 1 -- 172.21.15.5:0/1057862579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4099a70 con 0x56115062b260 2023-10-07T00:13:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.807+0000 7f38038f3b80 1 -- 172.21.15.5:0/1057862579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 msgr2=0x56115062b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.807+0000 7f38038f3b80 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115062b680 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f37e4096820 tx=0x7f37e4099f70 comp rx=0 tx=0).stop 2023-10-07T00:13:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.807+0000 7f38038f3b80 1 -- 172.21.15.5:0/1057862579 shutdown_connections 2023-10-07T00:13:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.807+0000 7f38038f3b80 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 0x56115062cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.807+0000 7f38038f3b80 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115062b680 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.807+0000 7f38038f3b80 1 --2- 172.21.15.5:0/1057862579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062bbc0 0x56115062c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.807+0000 7f38038f3b80 1 -- 172.21.15.5:0/1057862579 >> 172.21.15.5:0/1057862579 conn(0x56115059f260 msgr2=0x561150626140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.808+0000 7f38038f3b80 1 -- 172.21.15.5:0/1057862579 shutdown_connections 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.808+0000 7f38038f3b80 1 -- 172.21.15.5:0/1057862579 wait complete. 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.808+0000 7f38038f3b80 1 -- start start 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.809+0000 7f38038f3b80 1 Processor -- start 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.809+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x561150635080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.809+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x5611506355c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.809+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 0x56115063c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.809+0000 7f38038f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115057de30 con 0x56115062b260 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.809+0000 7f38038f3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115051a710 con 0x56115062bbc0 2023-10-07T00:13:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.809+0000 7f38038f3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115051a3b0 con 0x56115062ca60 2023-10-07T00:13:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.809+0000 7f38038f3b80 10 client.0 _ll_register_callbacks cb 0x561150377800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x561150635080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x561150635080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36420/0 (socket says 172.21.15.5:36420) 2023-10-07T00:13:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 -- 172.21.15.5:0/2191495472 learned_addr learned my addr 172.21.15.5:0/2191495472 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37ee59c700 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 0x56115063c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37ed59a700 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x5611506355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 -- 172.21.15.5:0/2191495472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 msgr2=0x56115063c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 0x56115063c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 -- 172.21.15.5:0/2191495472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 msgr2=0x5611506355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x5611506355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 -- 172.21.15.5:0/2191495472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e81a1330 con 0x56115062b260 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37ed59a700 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x5611506355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37edd9b700 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x561150635080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f37e40cab50 tx=0x7f37e409e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc21f109402a576a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.810+0000 7f37d17fa700 1 -- 172.21.15.5:0/2191495472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4096110 con 0x56115062b260 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f37d17fa700 1 -- 172.21.15.5:0/2191495472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f37e4062020 con 0x56115062b260 2023-10-07T00:13:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 1 -- 172.21.15.5:0/2191495472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56115061df10 con 0x56115062b260 2023-10-07T00:13:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f37d17fa700 1 -- 172.21.15.5:0/2191495472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37e4096270 con 0x56115062b260 2023-10-07T00:13:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 10 client.15666 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 1 -- 172.21.15.5:0/2191495472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561150391c60 con 0x56115062b260 2023-10-07T00:13:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f37d17fa700 1 -- 172.21.15.5:0/2191495472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56115061df10 con 0x56115062b260 2023-10-07T00:13:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f37d17fa700 1 -- 172.21.15.5:0/2191495472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f37e40b8180 con 0x56115062b260 2023-10-07T00:13:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 10 client.15666 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 10 client.15666 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:13:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 20 client.15666 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561150640bb0 0x561150642fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 4 client.15666 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.811+0000 7f38038f3b80 1 -- 172.21.15.5:0/2191495472 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561150576e10 con 0x561150640bb0 2023-10-07T00:13:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.812+0000 7f37ed59a700 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561150640bb0 0x561150642fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.812+0000 7f37ed59a700 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561150640bb0 0x561150642fd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4de9d1fc2c0bfd5c server_cookie=2a436360b355ca0b in_seq=0 out_seq=0 2023-10-07T00:13:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.812+0000 7f37d17fa700 10 client.15666 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:13:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f37d17fa700 1 -- 172.21.15.5:0/2191495472 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561150576e10 con 0x561150640bb0 2023-10-07T00:13:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f37d17fa700 10 client.15666 handle_command_reply: tid=0 2023-10-07T00:13:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 client.15666 shutdown 2023-10-07T00:13:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 -- 172.21.15.5:0/2191495472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 msgr2=0x561150635080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x561150635080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f37e40cab50 tx=0x7f37e409e470 comp rx=0 tx=0).stop 2023-10-07T00:13:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 -- 172.21.15.5:0/2191495472 shutdown_connections 2023-10-07T00:13:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561150640bb0 0x561150642fd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 0x56115063c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x561150635080 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f37d17fa700 0 client.15666 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:13:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2191495472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x5611506355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.813+0000 7f38038f3b80 1 -- 172.21.15.5:0/2191495472 >> 172.21.15.5:0/2191495472 conn(0x56115059f260 msgr2=0x561150625f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.814+0000 7f38038f3b80 1 -- 172.21.15.5:0/2191495472 shutdown_connections 2023-10-07T00:13:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.814+0000 7f38038f3b80 1 -- 172.21.15.5:0/2191495472 wait complete. 2023-10-07T00:13:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.814+0000 7f38038f3b80 20 client.15666 trim_cache size 0 max 16384 2023-10-07T00:13:34.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f38038f3b80 1 Processor -- start 2023-10-07T00:13:34.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f38038f3b80 1 -- start start 2023-10-07T00:13:34.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062b260 0x56115062ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062bbc0 0x56115063c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 0x561150624bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f38038f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611503fe920 con 0x56115062bbc0 2023-10-07T00:13:34.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f38038f3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115062aeb0 con 0x56115062ca60 2023-10-07T00:13:34.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f38038f3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561150620520 con 0x56115062b260 2023-10-07T00:13:34.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f37ed59a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062bbc0 0x56115063c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062b260 0x56115062ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062b260 0x56115062ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48860/0 (socket says 172.21.15.5:48860) 2023-10-07T00:13:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f37edd9b700 1 -- 172.21.15.5:0/3647083884 learned_addr learned my addr 172.21.15.5:0/3647083884 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.828+0000 7f37ed59a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062bbc0 0x56115063c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36428/0 (socket says 172.21.15.5:36428) 2023-10-07T00:13:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.829+0000 7f37ee59c700 1 --2- 172.21.15.5:0/3647083884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 0x561150624bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.829+0000 7f37ed59a700 1 -- 172.21.15.5:0/3647083884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062b260 msgr2=0x56115062ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.829+0000 7f37ed59a700 1 --2- 172.21.15.5:0/3647083884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062b260 0x56115062ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.829+0000 7f37ed59a700 1 -- 172.21.15.5:0/3647083884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 msgr2=0x561150624bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.829+0000 7f37ed59a700 1 --2- 172.21.15.5:0/3647083884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 0x561150624bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.829+0000 7f37ed59a700 1 -- 172.21.15.5:0/3647083884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611503cf250 con 0x56115062bbc0 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.829+0000 7f37ed59a700 1 --2- 172.21.15.5:0/3647083884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062bbc0 0x56115063c5c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000c00 tx=0x7f37d801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ac8100c22276 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.829+0000 7f37dcff9700 1 -- 172.21.15.5:0/3647083884 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d802b040 con 0x56115062bbc0 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f37dcff9700 1 -- 172.21.15.5:0/3647083884 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37d802c040 con 0x56115062bbc0 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f37dcff9700 1 -- 172.21.15.5:0/3647083884 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d800ba00 con 0x56115062bbc0 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 -- 172.21.15.5:0/3647083884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062bbc0 msgr2=0x56115063c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 --2- 172.21.15.5:0/3647083884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062bbc0 0x56115063c5c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000c00 tx=0x7f37d801f000 comp rx=0 tx=0).stop 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 -- 172.21.15.5:0/3647083884 shutdown_connections 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 --2- 172.21.15.5:0/3647083884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062ca60 0x561150624bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 --2- 172.21.15.5:0/3647083884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062b260 0x56115062ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 --2- 172.21.15.5:0/3647083884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062bbc0 0x56115063c5c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 -- 172.21.15.5:0/3647083884 >> 172.21.15.5:0/3647083884 conn(0x56115059f260 msgr2=0x561150647930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 -- 172.21.15.5:0/3647083884 shutdown_connections 2023-10-07T00:13:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.830+0000 7f38038f3b80 1 -- 172.21.15.5:0/3647083884 wait complete. 2023-10-07T00:13:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.831+0000 7f38038f3b80 1 -- start start 2023-10-07T00:13:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.831+0000 7f38038f3b80 1 Processor -- start 2023-10-07T00:13:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115063a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x56115063a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f38038f3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 0x56115063b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f38038f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115063bd30 con 0x56115062b260 2023-10-07T00:13:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f38038f3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115063bea0 con 0x56115062bbc0 2023-10-07T00:13:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f38038f3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115063c060 con 0x56115062ca60 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f38038f3b80 10 client.0 _ll_register_callbacks cb 0x7f37d8009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115063a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115063a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36436/0 (socket says 172.21.15.5:36436) 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37edd9b700 1 -- 172.21.15.5:0/2046328438 learned_addr learned my addr 172.21.15.5:0/2046328438 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37ed59a700 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x56115063a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37ee59c700 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 0x56115063b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37edd9b700 1 -- 172.21.15.5:0/2046328438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 msgr2=0x56115063b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37edd9b700 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 0x56115063b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37edd9b700 1 -- 172.21.15.5:0/2046328438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 msgr2=0x56115063a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37edd9b700 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x56115063a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.832+0000 7f37edd9b700 1 -- 172.21.15.5:0/2046328438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e8109d00 con 0x56115062b260 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.833+0000 7f37edd9b700 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115063a2a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f37e40cabe0 tx=0x7f37e40a2820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3016586755b3390b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.833+0000 7f37d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.833+0000 7f37d17fa700 1 -- 172.21.15.5:0/2046328438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e409e120 con 0x56115062b260 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.833+0000 7f37d17fa700 1 -- 172.21.15.5:0/2046328438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f37e4099280 con 0x56115062b260 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.833+0000 7f38038f3b80 1 -- 172.21.15.5:0/2046328438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37e40a26b0 con 0x56115062b260 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.833+0000 7f37d17fa700 1 -- 172.21.15.5:0/2046328438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37e409a0f0 con 0x56115062b260 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.833+0000 7f38038f3b80 10 client.15672 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.833+0000 7f38038f3b80 1 -- 172.21.15.5:0/2046328438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5611503a72b0 con 0x56115062b260 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f37d17fa700 1 -- 172.21.15.5:0/2046328438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37e40a26b0 con 0x56115062b260 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f37d17fa700 1 -- 172.21.15.5:0/2046328438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f37e40832a0 con 0x56115062b260 2023-10-07T00:13:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f38038f3b80 10 client.15672 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f38038f3b80 10 client.15672 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f38038f3b80 20 client.15672 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561150695350 0x561150697740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f38038f3b80 4 client.15672 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f38038f3b80 1 -- 172.21.15.5:0/2046328438 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561150576b30 con 0x561150695350 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.834+0000 7f37ed59a700 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561150695350 0x561150697740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f37ed59a700 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561150695350 0x561150697740 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=875a70d567e43499 server_cookie=2470e1314bddd3d7 in_seq=0 out_seq=0 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f37d17fa700 10 client.15672 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f37d17fa700 1 -- 172.21.15.5:0/2046328438 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561150576b30 con 0x561150695350 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f37d17fa700 10 client.15672 handle_command_reply: tid=0 2023-10-07T00:13:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 client.15672 shutdown 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 -- 172.21.15.5:0/2046328438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 msgr2=0x56115063a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115063a2a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f37e40cabe0 tx=0x7f37e40a2820 comp rx=0 tx=0).stop 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 -- 172.21.15.5:0/2046328438 shutdown_connections 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561150695350 0x561150697740 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56115062ca60 0x56115063b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56115062b260 0x56115063a2a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f37d17fa700 0 client.15672 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 --2- 172.21.15.5:0/2046328438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56115062bbc0 0x56115063a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 -- 172.21.15.5:0/2046328438 >> 172.21.15.5:0/2046328438 conn(0x56115059f260 msgr2=0x561150632ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 -- 172.21.15.5:0/2046328438 shutdown_connections 2023-10-07T00:13:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.835+0000 7f38038f3b80 1 -- 172.21.15.5:0/2046328438 wait complete. 2023-10-07T00:13:34.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f38038f3b80 20 client.15672 trim_cache size 0 max 16384 2023-10-07T00:13:34.842 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 -- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f37d40a1480 msgr2=0x7f37d40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f37d40a1480 0x7f37d40a3940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f37d800b2e0 tx=0x7f37d8005fd0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 -- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8101a40 msgr2=0x7f37e8198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8101a40 0x7f37e8198de0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f37e400e9a0 tx=0x7f37e400ed60 comp rx=0 tx=0).stop 2023-10-07T00:13:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 -- 172.21.15.5:0/3316251384 shutdown_connections 2023-10-07T00:13:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f37d40a1480 0x7f37d40a3940 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37e8106ca0 0x7f37e81a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e8101a40 0x7f37e8198de0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 --2- 172.21.15.5:0/3316251384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37e8104370 0x7f37e8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 -- 172.21.15.5:0/3316251384 >> 172.21.15.5:0/3316251384 conn(0x7f37e80fb450 msgr2=0x7f37e81026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.836+0000 7f37effff700 1 -- 172.21.15.5:0/3316251384 shutdown_connections 2023-10-07T00:13:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:34.837+0000 7f37effff700 1 -- 172.21.15.5:0/3316251384 wait complete. 2023-10-07T00:13:34.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:34 smithi005 ceph-mon[129406]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:34.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-07T00:13:34.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:34 smithi112 ceph-mon[133548]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.077+0000 7fd38ffff700 1 -- 172.21.15.5:0/3521522112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 msgr2=0x7fd388108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.077+0000 7fd38ffff700 1 --2- 172.21.15.5:0/3521522112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 0x7fd388108330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd38000b0a0 tx=0x7fd38000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.078+0000 7fd38ffff700 1 -- 172.21.15.5:0/3521522112 shutdown_connections 2023-10-07T00:13:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.078+0000 7fd38ffff700 1 --2- 172.21.15.5:0/3521522112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 0x7fd388108330 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.078+0000 7fd38ffff700 1 --2- 172.21.15.5:0/3521522112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3880ffe70 0x7fd388100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.078+0000 7fd38ffff700 1 --2- 172.21.15.5:0/3521522112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388101050 0x7fd3881014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.078+0000 7fd38ffff700 1 -- 172.21.15.5:0/3521522112 >> 172.21.15.5:0/3521522112 conn(0x7fd3880fb450 msgr2=0x7fd3880fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.078+0000 7fd38ffff700 1 -- 172.21.15.5:0/3521522112 shutdown_connections 2023-10-07T00:13:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.078+0000 7fd38ffff700 1 -- 172.21.15.5:0/3521522112 wait complete. 2023-10-07T00:13:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.079+0000 7fd38ffff700 1 Processor -- start 2023-10-07T00:13:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.080+0000 7fd38ffff700 1 -- start start 2023-10-07T00:13:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.080+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880ffe70 0x7fd388196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.080+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd388101050 0x7fd3881971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.080+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 0x7fd38819e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.080+0000 7fd38ffff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38819e7f0 con 0x7fd388101a10 2023-10-07T00:13:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.080+0000 7fd38ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38819e960 con 0x7fd388101050 2023-10-07T00:13:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.080+0000 7fd38ffff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38819eb20 con 0x7fd3880ffe70 2023-10-07T00:13:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.080+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880ffe70 0x7fd388196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880ffe70 0x7fd388196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48892/0 (socket says 172.21.15.5:48892) 2023-10-07T00:13:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38dd9b700 1 -- 172.21.15.5:0/2072340479 learned_addr learned my addr 172.21.15.5:0/2072340479 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38d59a700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd388101050 0x7fd3881971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38e59c700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 0x7fd38819e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38d59a700 1 -- 172.21.15.5:0/2072340479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880ffe70 msgr2=0x7fd388196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38d59a700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880ffe70 0x7fd388196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38d59a700 1 -- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 msgr2=0x7fd38819e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38d59a700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 0x7fd38819e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38d59a700 1 -- 172.21.15.5:0/2072340479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009d00 con 0x7fd388101050 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38e59c700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 0x7fd38819e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.081+0000 7fd38d59a700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd388101050 0x7fd3881971c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd37800e9c0 tx=0x7fd37800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.082+0000 7fd37effd700 1 -- 172.21.15.5:0/2072340479 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378004220 con 0x7fd388101050 2023-10-07T00:13:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.082+0000 7fd38ffff700 1 -- 172.21.15.5:0/2072340479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38819ee00 con 0x7fd388101050 2023-10-07T00:13:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.082+0000 7fd37effd700 1 -- 172.21.15.5:0/2072340479 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd378004380 con 0x7fd388101050 2023-10-07T00:13:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.082+0000 7fd37effd700 1 -- 172.21.15.5:0/2072340479 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378003aa0 con 0x7fd388101050 2023-10-07T00:13:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.082+0000 7fd38ffff700 1 -- 172.21.15.5:0/2072340479 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38819f290 con 0x7fd388101050 2023-10-07T00:13:35.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.086+0000 7fd37effd700 1 -- 172.21.15.5:0/2072340479 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd378003c00 con 0x7fd388101050 2023-10-07T00:13:35.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd3a3a0fb80 1 Processor -- start 2023-10-07T00:13:35.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd3a3a0fb80 1 -- start start 2023-10-07T00:13:35.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b1670 0x56000d7b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b2e70 0x56000d7b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d715460 con 0x56000d7b1fd0 2023-10-07T00:13:35.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d706c20 con 0x56000d7b1670 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d704540 con 0x56000d7b2e70 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.087+0000 7fd37effd700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3740a1480 0x7fd3740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36458/0 (socket says 172.21.15.5:36458) 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38dd9b700 1 -- 172.21.15.5:0/1224555667 learned_addr learned my addr 172.21.15.5:0/1224555667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd37effd700 1 -- 172.21.15.5:0/2072340479 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd378014070 con 0x7fd388101050 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38e59c700 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b1670 0x56000d7b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38e59c700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3740a1480 0x7fd3740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38d59a700 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b2e70 0x56000d7b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38dd9b700 1 -- 172.21.15.5:0/1224555667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b2e70 msgr2=0x56000d7b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b2e70 0x56000d7b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38dd9b700 1 -- 172.21.15.5:0/1224555667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b1670 msgr2=0x56000d7b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b1670 0x56000d7b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.088+0000 7fd38dd9b700 1 -- 172.21.15.5:0/1224555667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56000d52ade0 con 0x56000d7b1fd0 2023-10-07T00:13:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.089+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7b2890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd384009d90 tx=0x7fd384011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8128b8092da6c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.089+0000 7fd38e59c700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3740a1480 0x7fd3740a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd380009fd0 tx=0x7fd3800060d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.089+0000 7fd373fff700 1 -- 172.21.15.5:0/1224555667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384004230 con 0x56000d7b1fd0 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.089+0000 7fd373fff700 1 -- 172.21.15.5:0/1224555667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd384004390 con 0x56000d7b1fd0 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.089+0000 7fd373fff700 1 -- 172.21.15.5:0/1224555667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384019680 con 0x56000d7b1fd0 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1224555667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 msgr2=0x56000d7b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7b2890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd384009d90 tx=0x7fd384011720 comp rx=0 tx=0).stop 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1224555667 shutdown_connections 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b2e70 0x56000d7b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b1670 0x56000d7b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/1224555667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7b2890 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1224555667 >> 172.21.15.5:0/1224555667 conn(0x56000d721260 msgr2=0x56000d7a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1224555667 shutdown_connections 2023-10-07T00:13:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.090+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1224555667 wait complete. 2023-10-07T00:13:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.091+0000 7fd3a3a0fb80 1 -- start start 2023-10-07T00:13:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.091+0000 7fd3a3a0fb80 1 Processor -- start 2023-10-07T00:13:35.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7c2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d6ffe30 con 0x56000d7b1fd0 2023-10-07T00:13:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d69c710 con 0x56000d7b2e70 2023-10-07T00:13:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d69c3b0 con 0x56000d7b1670 2023-10-07T00:13:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd3a3a0fb80 10 client.0 _ll_register_callbacks cb 0x56000d4f9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd38d59a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd38d59a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36468/0 (socket says 172.21.15.5:36468) 2023-10-07T00:13:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7bb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48898/0 (socket says 172.21.15.5:48898) 2023-10-07T00:13:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd38e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.092+0000 7fd38dd9b700 1 -- 172.21.15.5:0/43060403 learned_addr learned my addr 172.21.15.5:0/43060403 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd38dd9b700 1 -- 172.21.15.5:0/43060403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 msgr2=0x56000d7c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd38dd9b700 1 -- 172.21.15.5:0/43060403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 msgr2=0x56000d7bb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd38dd9b700 1 -- 172.21.15.5:0/43060403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3840099f0 con 0x56000d7b1670 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7bb3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd384005950 tx=0x7fd384005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=427ce8b12331b18 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd3717fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd3717fa700 1 -- 172.21.15.5:0/43060403 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384005240 con 0x56000d7b1670 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd3717fa700 1 -- 172.21.15.5:0/43060403 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd3840053a0 con 0x56000d7b1670 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.093+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/43060403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56000d79ff10 con 0x56000d7b1670 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3717fa700 1 -- 172.21.15.5:0/43060403 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3840039d0 con 0x56000d7b1670 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3a3a0fb80 10 client.25453 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/43060403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56000d513c60 con 0x56000d7b1670 2023-10-07T00:13:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3717fa700 1 -- 172.21.15.5:0/43060403 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56000d79ff10 con 0x56000d7b1670 2023-10-07T00:13:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3717fa700 1 -- 172.21.15.5:0/43060403 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd384021040 con 0x56000d7b1670 2023-10-07T00:13:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3a3a0fb80 10 client.25453 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3a3a0fb80 10 client.25453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3a3a0fb80 20 client.25453 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.094+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56000d7c7080 0x56000d7c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.095+0000 7fd3a3a0fb80 4 client.25453 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.095+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/43060403 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56000d6f8e10 con 0x56000d7c7080 2023-10-07T00:13:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.095+0000 7fd38d59a700 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56000d7c7080 0x56000d7c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.096+0000 7fd3717fa700 10 client.25453 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.096+0000 7fd38d59a700 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56000d7c7080 0x56000d7c94a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bd6865ff2c7ae9c server_cookie=6c09b74233977624 in_seq=0 out_seq=0 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3717fa700 1 -- 172.21.15.5:0/43060403 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56000d6f8e10 con 0x56000d7c7080 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3717fa700 10 client.25453 handle_command_reply: tid=0 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 client.25453 shutdown 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/43060403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 msgr2=0x56000d7bb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7bb3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd384005950 tx=0x7fd384005ce0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/43060403 shutdown_connections 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56000d7c7080 0x56000d7c94a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7bb3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/43060403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/43060403 >> 172.21.15.5:0/43060403 conn(0x56000d721260 msgr2=0x56000d7a7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3717fa700 0 client.25453 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/43060403 shutdown_connections 2023-10-07T00:13:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/43060403 wait complete. 2023-10-07T00:13:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.097+0000 7fd3a3a0fb80 20 client.25453 trim_cache size 0 max 16384 2023-10-07T00:13:35.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.111+0000 7fd3a3a0fb80 1 Processor -- start 2023-10-07T00:13:35.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.111+0000 7fd3a3a0fb80 1 -- start start 2023-10-07T00:13:35.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.111+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1670 0x56000d7c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1fd0 0x56000d7c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7bb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d580920 con 0x56000d7b1670 2023-10-07T00:13:35.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d7b9b70 con 0x56000d7b2e70 2023-10-07T00:13:35.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d7bc5c0 con 0x56000d7b1fd0 2023-10-07T00:13:35.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1670 0x56000d7c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1670 0x56000d7c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36474/0 (socket says 172.21.15.5:36474) 2023-10-07T00:13:35.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38d59a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1fd0 0x56000d7c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38dd9b700 1 -- 172.21.15.5:0/1990841156 learned_addr learned my addr 172.21.15.5:0/1990841156 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38e59c700 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7bb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38dd9b700 1 -- 172.21.15.5:0/1990841156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1fd0 msgr2=0x56000d7c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1fd0 0x56000d7c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38dd9b700 1 -- 172.21.15.5:0/1990841156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 msgr2=0x56000d7bb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7bb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38dd9b700 1 -- 172.21.15.5:0/1990841156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56000d551250 con 0x56000d7b1670 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.112+0000 7fd38d59a700 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1fd0 0x56000d7c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.113+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1670 0x56000d7c3230 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd384003bc0 tx=0x7fd384011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2a161acb7e0cad server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.113+0000 7fd37cff9700 1 -- 172.21.15.5:0/1990841156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384023cf0 con 0x56000d7b1670 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.113+0000 7fd37cff9700 1 -- 172.21.15.5:0/1990841156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd384005d50 con 0x56000d7b1670 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.113+0000 7fd37cff9700 1 -- 172.21.15.5:0/1990841156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384004710 con 0x56000d7b1670 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1990841156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1670 msgr2=0x56000d7c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1670 0x56000d7c3230 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd384003bc0 tx=0x7fd384011720 comp rx=0 tx=0).stop 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1990841156 shutdown_connections 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7bb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1670 0x56000d7c3230 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/1990841156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1fd0 0x56000d7c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1990841156 >> 172.21.15.5:0/1990841156 conn(0x56000d721260 msgr2=0x56000d7ba0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1990841156 shutdown_connections 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/1990841156 wait complete. 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.114+0000 7fd3a3a0fb80 1 -- start start 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd3a3a0fb80 1 Processor -- start 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7beb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd3a3a0fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d7c25d0 con 0x56000d7b1fd0 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d7c2740 con 0x56000d7b2e70 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd3a3a0fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d7c2900 con 0x56000d7b1670 2023-10-07T00:13:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd3a3a0fb80 10 client.0 _ll_register_callbacks cb 0x7fd384005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:35.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.115+0000 7fd38d59a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38d59a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36480/0 (socket says 172.21.15.5:36480) 2023-10-07T00:13:35.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38d59a700 1 -- 172.21.15.5:0/3461670616 learned_addr learned my addr 172.21.15.5:0/3461670616 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:35.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7beb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38e59c700 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38d59a700 1 -- 172.21.15.5:0/3461670616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 msgr2=0x56000d7beb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38d59a700 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7beb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38d59a700 1 -- 172.21.15.5:0/3461670616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 msgr2=0x56000d7c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38d59a700 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38d59a700 1 -- 172.21.15.5:0/3461670616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38819f290 con 0x56000d7b1fd0 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd38d59a700 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bf070 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd378096cf0 tx=0x7fd3780092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777c6f5836f43be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd3717fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd3717fa700 1 -- 172.21.15.5:0/3461670616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37809e3d0 con 0x56000d7b1fd0 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/3461670616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd384004390 con 0x56000d7b1fd0 2023-10-07T00:13:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.116+0000 7fd3717fa700 1 -- 172.21.15.5:0/3461670616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd3780a2610 con 0x56000d7b1fd0 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3717fa700 1 -- 172.21.15.5:0/3461670616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd378098620 con 0x56000d7b1fd0 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3a3a0fb80 10 client.15690 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/3461670616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56000d513c60 con 0x56000d7b1fd0 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3717fa700 1 -- 172.21.15.5:0/3461670616 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd384004390 con 0x56000d7b1fd0 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3717fa700 1 -- 172.21.15.5:0/3461670616 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd3780b8020 con 0x56000d7b1fd0 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3a3a0fb80 10 client.15690 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3a3a0fb80 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3a3a0fb80 20 client.15690 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56000d81c340 0x56000d81e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3a3a0fb80 4 client.15690 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.117+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/3461670616 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56000d6f8b30 con 0x56000d81c340 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.118+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56000d81c340 0x56000d81e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd38dd9b700 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56000d81c340 0x56000d81e760 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5ad553596d2a63 server_cookie=def83045f4753b6f in_seq=0 out_seq=0 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3717fa700 10 client.15690 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3717fa700 1 -- 172.21.15.5:0/3461670616 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56000d6f8b30 con 0x56000d81c340 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3717fa700 10 client.15690 handle_command_reply: tid=0 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 client.15690 shutdown 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/3461670616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 msgr2=0x56000d7bf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bf070 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd378096cf0 tx=0x7fd3780092d0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/3461670616 shutdown_connections 2023-10-07T00:13:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56000d81c340 0x56000d81e760 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56000d7b2e70 0x56000d7c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56000d7b1670 0x56000d7beb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 --2- 172.21.15.5:0/3461670616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56000d7b1fd0 0x56000d7bf070 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3717fa700 0 client.15690 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/3461670616 >> 172.21.15.5:0/3461670616 conn(0x56000d721260 msgr2=0x56000d7b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/3461670616 shutdown_connections 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 1 -- 172.21.15.5:0/3461670616 wait complete. 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.119+0000 7fd3a3a0fb80 20 client.15690 trim_cache size 0 max 16384 2023-10-07T00:13:35.126 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 -- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3740a1480 msgr2=0x7fd3740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3740a1480 0x7fd3740a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd380009fd0 tx=0x7fd3800060d0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 -- 172.21.15.5:0/2072340479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd388101050 msgr2=0x7fd3881971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd388101050 0x7fd3881971c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd37800e9c0 tx=0x7fd37800ecd0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 -- 172.21.15.5:0/2072340479 shutdown_connections 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3740a1480 0x7fd3740a3940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd388101a10 0x7fd38819e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880ffe70 0x7fd388196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 --2- 172.21.15.5:0/2072340479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd388101050 0x7fd3881971c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 -- 172.21.15.5:0/2072340479 >> 172.21.15.5:0/2072340479 conn(0x7fd3880fb450 msgr2=0x7fd3880fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 -- 172.21.15.5:0/2072340479 shutdown_connections 2023-10-07T00:13:35.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:35.120+0000 7fd38ffff700 1 -- 172.21.15.5:0/2072340479 wait complete. 2023-10-07T00:13:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:34 smithi088 ceph-mon[103111]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:36.141 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-07T00:13:36.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 -- 172.21.15.5:0/3974901156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d64100190 msgr2=0x7f0d64100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 --2- 172.21.15.5:0/3974901156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d64100190 0x7f0d64100610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d580098f0 tx=0x7f0d58009c00 comp rx=0 tx=0).stop 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 -- 172.21.15.5:0/3974901156 shutdown_connections 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 --2- 172.21.15.5:0/3974901156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d64100b50 0x7f0d64100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 --2- 172.21.15.5:0/3974901156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640ff830 0x7f0d640ffc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 --2- 172.21.15.5:0/3974901156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d64100190 0x7f0d64100610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 -- 172.21.15.5:0/3974901156 >> 172.21.15.5:0/3974901156 conn(0x7f0d640fb450 msgr2=0x7f0d640fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 -- 172.21.15.5:0/3974901156 shutdown_connections 2023-10-07T00:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.359+0000 7f0d693ff700 1 -- 172.21.15.5:0/3974901156 wait complete. 2023-10-07T00:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.360+0000 7f0d693ff700 1 Processor -- start 2023-10-07T00:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d693ff700 1 -- start start 2023-10-07T00:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d693ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640ff830 0x7f0d64198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d693ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d64100190 0x7f0d64199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d693ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d64100b50 0x7f0d641a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d693ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d641a0950 con 0x7f0d64100190 2023-10-07T00:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d693ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d641a0a90 con 0x7f0d64100b50 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d693ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d641a0c20 con 0x7f0d640ff830 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d627fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d64100190 0x7f0d64199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640ff830 0x7f0d64198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640ff830 0x7f0d64198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:48944/0 (socket says 172.21.15.5:48944) 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.361+0000 7f0d62ffd700 1 -- 172.21.15.5:0/823673325 learned_addr learned my addr 172.21.15.5:0/823673325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d637fe700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d64100b50 0x7f0d641a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d627fc700 1 -- 172.21.15.5:0/823673325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640ff830 msgr2=0x7f0d64198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d627fc700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640ff830 0x7f0d64198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d627fc700 1 -- 172.21.15.5:0/823673325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d64100b50 msgr2=0x7f0d641a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d627fc700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d64100b50 0x7f0d641a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d627fc700 1 -- 172.21.15.5:0/823673325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c009d00 con 0x7f0d64100190 2023-10-07T00:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d627fc700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d64100190 0x7f0d64199310 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0d58000c00 tx=0x7f0d5800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d4bfff700 1 -- 172.21.15.5:0/823673325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5801c070 con 0x7f0d64100190 2023-10-07T00:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d4bfff700 1 -- 172.21.15.5:0/823673325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d5800f7b0 con 0x7f0d64100190 2023-10-07T00:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d693ff700 1 -- 172.21.15.5:0/823673325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58009520 con 0x7f0d64100190 2023-10-07T00:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.362+0000 7f0d4bfff700 1 -- 172.21.15.5:0/823673325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58003970 con 0x7f0d64100190 2023-10-07T00:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.363+0000 7f0d693ff700 1 -- 172.21.15.5:0/823673325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d641a1190 con 0x7f0d64100190 2023-10-07T00:13:36.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.366+0000 7f0d4bfff700 1 -- 172.21.15.5:0/823673325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0d58020030 con 0x7f0d64100190 2023-10-07T00:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.367+0000 7f0d7ccd9b80 1 Processor -- start 2023-10-07T00:13:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.367+0000 7f0d7ccd9b80 1 -- start start 2023-10-07T00:13:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d4bfff700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0d4c0a1500 0x7f0d4c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bf2e0 0x55bfd97bf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d4bfff700 1 -- 172.21.15.5:0/823673325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0d580cdc90 con 0x7f0d64100190 2023-10-07T00:13:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd97274e0 con 0x55bfd97c0ae0 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd9718ca0 con 0x55bfd97bf2e0 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd97165c0 con 0x55bfd97bfc40 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d637fe700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0d4c0a1500 0x7f0d4c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bf2e0 0x55bfd97bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97c0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36506/0 (socket says 172.21.15.5:36506) 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d637fe700 1 -- 172.21.15.5:0/594140188 learned_addr learned my addr 172.21.15.5:0/594140188 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.368+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bf2e0 0x55bfd97bf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:57936/0 (socket says 172.21.15.5:57936) 2023-10-07T00:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d627fc700 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d637fe700 1 -- 172.21.15.5:0/594140188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 msgr2=0x55bfd97c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d637fe700 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d637fe700 1 -- 172.21.15.5:0/594140188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bf2e0 msgr2=0x55bfd97bf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d637fe700 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bf2e0 0x55bfd97bf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d637fe700 1 -- 172.21.15.5:0/594140188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfd953ce60 con 0x55bfd97c0ae0 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d627fc700 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d637fe700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0d4c0a1500 0x7f0d4c0a39c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c010f70 tx=0x7f0d5c0105d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.369+0000 7f0d637fe700 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97c0f60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c019ec0 tx=0x7f0d5c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c5adda0b1b855e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.370+0000 7f0d497fa700 1 -- 172.21.15.5:0/594140188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00e040 con 0x55bfd97c0ae0 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.370+0000 7f0d497fa700 1 -- 172.21.15.5:0/594140188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d5c004bb0 con 0x55bfd97c0ae0 2023-10-07T00:13:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.370+0000 7f0d497fa700 1 -- 172.21.15.5:0/594140188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c007820 con 0x55bfd97c0ae0 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.370+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/594140188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 msgr2=0x55bfd97c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.370+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97c0f60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c019ec0 tx=0x7f0d5c01c000 comp rx=0 tx=0).stop 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.371+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/594140188 shutdown_connections 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.371+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97c0f60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.371+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bf2e0 0x55bfd97bf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.371+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/594140188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.371+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/594140188 >> 172.21.15.5:0/594140188 conn(0x55bfd97332e0 msgr2=0x55bfd97ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.371+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/594140188 shutdown_connections 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.371+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/594140188 wait complete. 2023-10-07T00:13:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.371+0000 7f0d7ccd9b80 1 -- start start 2023-10-07T00:13:36.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d7ccd9b80 1 Processor -- start 2023-10-07T00:13:36.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd9711eb0 con 0x55bfd97bf2e0 2023-10-07T00:13:36.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd96ae790 con 0x55bfd97c0ae0 2023-10-07T00:13:36.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd96ae430 con 0x55bfd97bfc40 2023-10-07T00:13:36.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d7ccd9b80 10 client.0 _ll_register_callbacks cb 0x55bfd950b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:36.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36522/0 (socket says 172.21.15.5:36522) 2023-10-07T00:13:36.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.372+0000 7f0d62ffd700 1 -- 172.21.15.5:0/3064786212 learned_addr learned my addr 172.21.15.5:0/3064786212 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d627fc700 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d637fe700 1 -- 172.21.15.5:0/3064786212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 msgr2=0x55bfd97c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d637fe700 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d637fe700 1 -- 172.21.15.5:0/3064786212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 msgr2=0x55bfd97c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d637fe700 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d637fe700 1 -- 172.21.15.5:0/3064786212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c019c80 con 0x55bfd97c0ae0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d62ffd700 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d637fe700 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d05a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c026040 tx=0x7f0d5c007840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a84397233a04a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.373+0000 7f0d46ff5700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.374+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3064786212 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00e040 con 0x55bfd97c0ae0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.374+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3064786212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfd97b1f90 con 0x55bfd97c0ae0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.374+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3064786212 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0d5c007cc0 con 0x55bfd97c0ae0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.374+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3064786212 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d5c007e80 con 0x55bfd97c0ae0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.374+0000 7f0d7ccd9b80 10 client.25484 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.374+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3064786212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bfd9525ce0 con 0x55bfd97c0ae0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.374+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3064786212 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bfd97b1f90 con 0x55bfd97c0ae0 2023-10-07T00:13:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.375+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3064786212 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0d5c022070 con 0x55bfd97c0ae0 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.375+0000 7f0d7ccd9b80 10 client.25484 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.375+0000 7f0d7ccd9b80 10 client.25484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.375+0000 7f0d7ccd9b80 20 client.25484 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.375+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bfd97d4c90 0x55bfd97d70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.375+0000 7f0d7ccd9b80 4 client.25484 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.375+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3064786212 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfd970ae90 con 0x55bfd97d4c90 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.375+0000 7f0d62ffd700 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bfd97d4c90 0x55bfd97d70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.376+0000 7f0d62ffd700 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bfd97d4c90 0x55bfd97d70b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3dbbb70ae84e23 server_cookie=4eea6bb644e2ddcd in_seq=0 out_seq=0 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.376+0000 7f0d46ff5700 10 client.25484 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3064786212 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bfd970ae90 con 0x55bfd97d4c90 2023-10-07T00:13:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d46ff5700 10 client.25484 handle_command_reply: tid=0 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 client.25484 shutdown 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3064786212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 msgr2=0x55bfd97d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d05a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c026040 tx=0x7f0d5c007840 comp rx=0 tx=0).stop 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3064786212 shutdown_connections 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bfd97d4c90 0x55bfd97d70b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d05a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3064786212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d46ff5700 0 client.25484 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3064786212 >> 172.21.15.5:0/3064786212 conn(0x55bfd97332e0 msgr2=0x55bfd97b9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3064786212 shutdown_connections 2023-10-07T00:13:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3064786212 wait complete. 2023-10-07T00:13:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.377+0000 7f0d7ccd9b80 20 client.25484 trim_cache size 0 max 16384 2023-10-07T00:13:36.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.400+0000 7f0d7ccd9b80 1 Processor -- start 2023-10-07T00:13:36.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.400+0000 7f0d7ccd9b80 1 -- start start 2023-10-07T00:13:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.400+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.400+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bfc40 0x55bfd97c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.400+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.400+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd95929a0 con 0x55bfd97c0ae0 2023-10-07T00:13:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.400+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd97c8500 con 0x55bfd97bfc40 2023-10-07T00:13:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.400+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd97bef10 con 0x55bfd97bf2e0 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d627fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bfc40 0x55bfd97c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d627fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bfc40 0x55bfd97c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:57962/0 (socket says 172.21.15.5:57962) 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d627fc700 1 -- 172.21.15.5:0/1954939069 learned_addr learned my addr 172.21.15.5:0/1954939069 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d637fe700 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d627fc700 1 -- 172.21.15.5:0/1954939069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bf2e0 msgr2=0x55bfd97c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d627fc700 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d627fc700 1 -- 172.21.15.5:0/1954939069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 msgr2=0x55bfd97d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d627fc700 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d627fc700 1 -- 172.21.15.5:0/1954939069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfd97b8f10 con 0x55bfd97bfc40 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.401+0000 7f0d62ffd700 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.402+0000 7f0d627fc700 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bfc40 0x55bfd97c7480 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d580098c0 tx=0x7f0d58009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08b8d25f19507dc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.402+0000 7f0d49ffb700 1 -- 172.21.15.5:0/1954939069 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5809b6c0 con 0x55bfd97bfc40 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.402+0000 7f0d49ffb700 1 -- 172.21.15.5:0/1954939069 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d5809afc0 con 0x55bfd97bfc40 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.402+0000 7f0d49ffb700 1 -- 172.21.15.5:0/1954939069 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580976d0 con 0x55bfd97bfc40 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.402+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/1954939069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bfc40 msgr2=0x55bfd97c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.402+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bfc40 0x55bfd97c7480 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d580098c0 tx=0x7f0d58009c00 comp rx=0 tx=0).stop 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/1954939069 shutdown_connections 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97c0ae0 0x55bfd97d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bf2e0 0x55bfd97c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/1954939069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97bfc40 0x55bfd97c7480 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/1954939069 >> 172.21.15.5:0/1954939069 conn(0x55bfd97332e0 msgr2=0x55bfd97c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/1954939069 shutdown_connections 2023-10-07T00:13:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/1954939069 wait complete. 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 -- start start 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.403+0000 7f0d7ccd9b80 1 Processor -- start 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d7ccd9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd97cf730 con 0x55bfd97bf2e0 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd97cf8a0 con 0x55bfd97c0ae0 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d7ccd9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd9828af0 con 0x55bfd97bfc40 2023-10-07T00:13:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d7ccd9b80 10 client.0 _ll_register_callbacks cb 0x7f0d540095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36540/0 (socket says 172.21.15.5:36540) 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.404+0000 7f0d62ffd700 1 -- 172.21.15.5:0/3419207692 learned_addr learned my addr 172.21.15.5:0/3419207692 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d637fe700 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d627fc700 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d62ffd700 1 -- 172.21.15.5:0/3419207692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 msgr2=0x55bfd97ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d62ffd700 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d62ffd700 1 -- 172.21.15.5:0/3419207692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 msgr2=0x55bfd97cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d62ffd700 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d62ffd700 1 -- 172.21.15.5:0/3419207692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54012570 con 0x55bfd97bf2e0 2023-10-07T00:13:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d62ffd700 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97d0510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0d54005d90 tx=0x7f0d54004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c565742ffc7418 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.405+0000 7f0d46ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.406+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3419207692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54017030 con 0x55bfd97bf2e0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.406+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3419207692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d5c004bb0 con 0x55bfd97bf2e0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.406+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3419207692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0d54012e40 con 0x55bfd97bf2e0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.406+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3419207692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d54021a00 con 0x55bfd97bf2e0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.406+0000 7f0d7ccd9b80 10 client.15708 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.406+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3419207692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f0d641a1190 con 0x55bfd97bf2e0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.406+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3419207692 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d5c004bb0 con 0x55bfd97bf2e0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.406+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3419207692 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0d54032050 con 0x55bfd97bf2e0 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.407+0000 7f0d7ccd9b80 10 client.15708 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.407+0000 7f0d7ccd9b80 10 client.15708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.407+0000 7f0d7ccd9b80 20 client.15708 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.407+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bfd982a4b0 0x55bfd982c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.407+0000 7f0d7ccd9b80 4 client.15708 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-07T00:13:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.407+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3419207692 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bfd970abb0 con 0x55bfd982a4b0 2023-10-07T00:13:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.407+0000 7f0d627fc700 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bfd982a4b0 0x55bfd982c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.408+0000 7f0d627fc700 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bfd982a4b0 0x55bfd982c8d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8fe3a11d1376e46 server_cookie=1199d3e54de6048c in_seq=0 out_seq=0 2023-10-07T00:13:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.408+0000 7f0d46ff5700 10 client.15708 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d46ff5700 1 -- 172.21.15.5:0/3419207692 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bfd970abb0 con 0x55bfd982a4b0 2023-10-07T00:13:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d46ff5700 10 client.15708 handle_command_reply: tid=0 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 client.15708 shutdown 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3419207692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 msgr2=0x55bfd97d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97d0510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0d54005d90 tx=0x7f0d54004320 comp rx=0 tx=0).stop 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3419207692 shutdown_connections 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bfd982a4b0 0x55bfd982c8d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bfd97c0ae0 0x55bfd97cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfd97bf2e0 0x55bfd97d0510 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 --2- 172.21.15.5:0/3419207692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfd97bfc40 0x55bfd97ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3419207692 >> 172.21.15.5:0/3419207692 conn(0x55bfd97332e0 msgr2=0x55bfd97c3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d46ff5700 0 client.15708 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3419207692 shutdown_connections 2023-10-07T00:13:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.409+0000 7f0d7ccd9b80 1 -- 172.21.15.5:0/3419207692 wait complete. 2023-10-07T00:13:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.410+0000 7f0d7ccd9b80 20 client.15708 trim_cache size 0 max 16384 2023-10-07T00:13:36.415 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:13:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2023-10-07T00:13:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "c322da59-b7da-4e8a-93d8-8d3213ee88b3", 2023-10-07T00:13:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2023-10-07T00:13:36.416 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:13:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.410+0000 7f0d693ff700 1 -- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0d4c0a1500 msgr2=0x7f0d4c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.410+0000 7f0d693ff700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0d4c0a1500 0x7f0d4c0a39c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c010f70 tx=0x7f0d5c0105d0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.410+0000 7f0d693ff700 1 -- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d64100190 msgr2=0x7f0d64199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.410+0000 7f0d693ff700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d64100190 0x7f0d64199310 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0d58000c00 tx=0x7f0d5800b790 comp rx=0 tx=0).stop 2023-10-07T00:13:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.411+0000 7f0d693ff700 1 -- 172.21.15.5:0/823673325 shutdown_connections 2023-10-07T00:13:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.411+0000 7f0d693ff700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0d4c0a1500 0x7f0d4c0a39c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.411+0000 7f0d693ff700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d64100b50 0x7f0d641a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.411+0000 7f0d693ff700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d640ff830 0x7f0d64198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.411+0000 7f0d693ff700 1 --2- 172.21.15.5:0/823673325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d64100190 0x7f0d64199310 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.411+0000 7f0d693ff700 1 -- 172.21.15.5:0/823673325 >> 172.21.15.5:0/823673325 conn(0x7f0d640fb450 msgr2=0x7f0d640fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.411+0000 7f0d693ff700 1 -- 172.21.15.5:0/823673325 shutdown_connections 2023-10-07T00:13:36.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.411+0000 7f0d693ff700 1 -- 172.21.15.5:0/823673325 wait complete. 2023-10-07T00:13:36.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 -- 172.21.15.5:0/901924831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 msgr2=0x7fa75c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 --2- 172.21.15.5:0/901924831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 0x7fa75c1013e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa7580099c0 tx=0x7fa758009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 -- 172.21.15.5:0/901924831 shutdown_connections 2023-10-07T00:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 --2- 172.21.15.5:0/901924831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa75c102b50 0x7fa75c109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 --2- 172.21.15.5:0/901924831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 0x7fa75c1013e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 --2- 172.21.15.5:0/901924831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c1021b0 0x7fa75c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 -- 172.21.15.5:0/901924831 >> 172.21.15.5:0/901924831 conn(0x7fa75c0fc530 msgr2=0x7fa75c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 -- 172.21.15.5:0/901924831 shutdown_connections 2023-10-07T00:13:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.653+0000 7fa7637ff700 1 -- 172.21.15.5:0/901924831 wait complete. 2023-10-07T00:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.654+0000 7fa7637ff700 1 Processor -- start 2023-10-07T00:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.654+0000 7fa7637ff700 1 -- start start 2023-10-07T00:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa7637ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 0x7fa75c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa7637ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa75c1021b0 0x7fa75c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa7637ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c102b50 0x7fa75c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa7637ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c073f80 con 0x7fa75c100fc0 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa7637ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0740f0 con 0x7fa75c102b50 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa7637ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c1a0bc0 con 0x7fa75c1021b0 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa76159b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 0x7fa75c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa76159b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 0x7fa75c074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36556/0 (socket says 172.21.15.5:36556) 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa76159b700 1 -- 172.21.15.5:0/2125630776 learned_addr learned my addr 172.21.15.5:0/2125630776 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa760d9a700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa75c1021b0 0x7fa75c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa761d9c700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c102b50 0x7fa75c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa76159b700 1 -- 172.21.15.5:0/2125630776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa75c1021b0 msgr2=0x7fa75c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa76159b700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa75c1021b0 0x7fa75c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa76159b700 1 -- 172.21.15.5:0/2125630776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c102b50 msgr2=0x7fa75c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa76159b700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c102b50 0x7fa75c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.655+0000 7fa76159b700 1 -- 172.21.15.5:0/2125630776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7580095f0 con 0x7fa75c100fc0 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.656+0000 7fa76159b700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 0x7fa75c074c60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa758000c00 tx=0x7fa75800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.656+0000 7fa7527fc700 1 -- 172.21.15.5:0/2125630776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75801d070 con 0x7fa75c100fc0 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.656+0000 7fa7637ff700 1 -- 172.21.15.5:0/2125630776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c1a0e40 con 0x7fa75c100fc0 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.656+0000 7fa7527fc700 1 -- 172.21.15.5:0/2125630776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa75800fe70 con 0x7fa75c100fc0 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.656+0000 7fa7527fc700 1 -- 172.21.15.5:0/2125630776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758004bb0 con 0x7fa75c100fc0 2023-10-07T00:13:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.656+0000 7fa7637ff700 1 -- 172.21.15.5:0/2125630776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c1a1200 con 0x7fa75c100fc0 2023-10-07T00:13:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.661+0000 7fa7527fc700 1 -- 172.21.15.5:0/2125630776 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa758004d10 con 0x7fa75c100fc0 2023-10-07T00:13:36.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.662+0000 7fa7771acb80 1 Processor -- start 2023-10-07T00:13:36.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.662+0000 7fa7771acb80 1 -- start start 2023-10-07T00:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 0x55a87660ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa7527fc700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7480a1480 0x7fa7480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87660bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660c270 0x55a87660c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa7771acb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a87656a460 con 0x55a87660b3d0 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa7771acb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a87655bc20 con 0x55a87660c270 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa7771acb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a876559540 con 0x55a87660aa70 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa7527fc700 1 -- 172.21.15.5:0/2125630776 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa7580cdb70 con 0x7fa75c100fc0 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa760d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87660bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa76159b700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7480a1480 0x7fa7480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa760d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87660bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36564/0 (socket says 172.21.15.5:36564) 2023-10-07T00:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa760d9a700 1 -- 172.21.15.5:0/617941316 learned_addr learned my addr 172.21.15.5:0/617941316 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.663+0000 7fa761d9c700 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660c270 0x55a87660c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa761d9c700 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 0x55a87660ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa760d9a700 1 -- 172.21.15.5:0/617941316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 msgr2=0x55a87660ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa760d9a700 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 0x55a87660ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa760d9a700 1 -- 172.21.15.5:0/617941316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660c270 msgr2=0x55a87660c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa760d9a700 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660c270 0x55a87660c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa760d9a700 1 -- 172.21.15.5:0/617941316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a87637fde0 con 0x55a87660b3d0 2023-10-07T00:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa761d9c700 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660c270 0x55a87660c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa76159b700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7480a1480 0x7fa7480a3940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa758005f30 tx=0x7fa758005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.664+0000 7fa760d9a700 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87660bc90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009d80 tx=0x7fa74c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c36e4e33efff973 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.665+0000 7fa7477fe700 1 -- 172.21.15.5:0/617941316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c004230 con 0x55a87660b3d0 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.665+0000 7fa7477fe700 1 -- 172.21.15.5:0/617941316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa74c004390 con 0x55a87660b3d0 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.665+0000 7fa7477fe700 1 -- 172.21.15.5:0/617941316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c019750 con 0x55a87660b3d0 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 -- 172.21.15.5:0/617941316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 msgr2=0x55a87660bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87660bc90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009d80 tx=0x7fa74c011720 comp rx=0 tx=0).stop 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 -- 172.21.15.5:0/617941316 shutdown_connections 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660c270 0x55a87660c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 0x55a87660ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 --2- 172.21.15.5:0/617941316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87660bc90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 -- 172.21.15.5:0/617941316 >> 172.21.15.5:0/617941316 conn(0x55a876576260 msgr2=0x55a8765fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 -- 172.21.15.5:0/617941316 shutdown_connections 2023-10-07T00:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 -- 172.21.15.5:0/617941316 wait complete. 2023-10-07T00:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.666+0000 7fa7771acb80 1 -- start start 2023-10-07T00:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.667+0000 7fa7771acb80 1 Processor -- start 2023-10-07T00:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.667+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 0x55a876614800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.667+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.667+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660c270 0x55a87661bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.667+0000 7fa7771acb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a876554e30 con 0x55a87660c270 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.667+0000 7fa7771acb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8764f1710 con 0x55a87660b3d0 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.667+0000 7fa7771acb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8764f13b0 con 0x55a87660aa70 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.667+0000 7fa7771acb80 10 client.0 _ll_register_callbacks cb 0x55a87634e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:57994/0 (socket says 172.21.15.5:57994) 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa761d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660c270 0x55a87661bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 -- 172.21.15.5:0/898072334 learned_addr learned my addr 172.21.15.5:0/898072334 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa761d9c700 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 0x55a876614800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 -- 172.21.15.5:0/898072334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 msgr2=0x55a876614800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 0x55a876614800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 -- 172.21.15.5:0/898072334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660c270 msgr2=0x55a87661bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660c270 0x55a87661bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 -- 172.21.15.5:0/898072334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75400f040 con 0x55a87660b3d0 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa760d9a700 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000c00 tx=0x7fa74c003930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fcda1402af6697c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.668+0000 7fa744ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.669+0000 7fa744ff9700 1 -- 172.21.15.5:0/898072334 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c005450 con 0x55a87660b3d0 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.669+0000 7fa7771acb80 1 -- 172.21.15.5:0/898072334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8765f4f10 con 0x55a87660b3d0 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.669+0000 7fa744ff9700 1 -- 172.21.15.5:0/898072334 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa74c004500 con 0x55a87660b3d0 2023-10-07T00:13:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.669+0000 7fa744ff9700 1 -- 172.21.15.5:0/898072334 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa74c003b60 con 0x55a87660b3d0 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.669+0000 7fa7771acb80 10 client.25502 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.669+0000 7fa7771acb80 1 -- 172.21.15.5:0/898072334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fa74c0099e0 con 0x55a87660b3d0 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.669+0000 7fa744ff9700 1 -- 172.21.15.5:0/898072334 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a8765f4f10 con 0x55a87660b3d0 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.670+0000 7fa744ff9700 1 -- 172.21.15.5:0/898072334 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa74c028020 con 0x55a87660b3d0 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.670+0000 7fa7771acb80 10 client.25502 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.670+0000 7fa7771acb80 10 client.25502 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.670+0000 7fa7771acb80 20 client.25502 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.670+0000 7fa7771acb80 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a8766205a0 0x55a8766229c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.670+0000 7fa7771acb80 4 client.25502 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.670+0000 7fa7771acb80 1 -- 172.21.15.5:0/898072334 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a87654de10 con 0x55a8766205a0 2023-10-07T00:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.670+0000 7fa761d9c700 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a8766205a0 0x55a8766229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.671+0000 7fa761d9c700 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a8766205a0 0x55a8766229c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f9d8a2ca140d3a server_cookie=cc79c68d6bd12fa2 in_seq=0 out_seq=0 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.671+0000 7fa744ff9700 10 client.25502 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.671+0000 7fa744ff9700 1 -- 172.21.15.5:0/898072334 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a87654de10 con 0x55a8766205a0 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.671+0000 7fa744ff9700 10 client.25502 handle_command_reply: tid=0 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 client.25502 shutdown 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 -- 172.21.15.5:0/898072334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 msgr2=0x55a876614d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000c00 tx=0x7fa74c003930 comp rx=0 tx=0).stop 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 -- 172.21.15.5:0/898072334 shutdown_connections 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a8766205a0 0x55a8766229c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660c270 0x55a87661bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660aa70 0x55a876614800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 --2- 172.21.15.5:0/898072334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa744ff9700 0 client.25502 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 -- 172.21.15.5:0/898072334 >> 172.21.15.5:0/898072334 conn(0x55a876576260 msgr2=0x55a8765fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 -- 172.21.15.5:0/898072334 shutdown_connections 2023-10-07T00:13:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 1 -- 172.21.15.5:0/898072334 wait complete. 2023-10-07T00:13:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.672+0000 7fa7771acb80 20 client.25502 trim_cache size 0 max 16384 2023-10-07T00:13:36.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.690+0000 7fa7771acb80 1 Processor -- start 2023-10-07T00:13:36.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.690+0000 7fa7771acb80 1 -- start start 2023-10-07T00:13:36.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660aa70 0x55a876614800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 0x55a87661bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa7771acb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8763d5920 con 0x55a87660aa70 2023-10-07T00:13:36.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa7771acb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a876613cb0 con 0x55a87660b3d0 2023-10-07T00:13:36.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa7771acb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a87660bed0 con 0x55a87660c270 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa761d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660aa70 0x55a876614800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa761d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660aa70 0x55a876614800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36580/0 (socket says 172.21.15.5:36580) 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa761d9c700 1 -- 172.21.15.5:0/3287604561 learned_addr learned my addr 172.21.15.5:0/3287604561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa760d9a700 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.691+0000 7fa761d9c700 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 0x55a87661bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa761d9c700 1 -- 172.21.15.5:0/3287604561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 msgr2=0x55a87661bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa761d9c700 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 0x55a87661bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa761d9c700 1 -- 172.21.15.5:0/3287604561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 msgr2=0x55a876614d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa761d9c700 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa761d9c700 1 -- 172.21.15.5:0/3287604561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a876368c60 con 0x55a87660aa70 2023-10-07T00:13:36.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa761d9c700 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660aa70 0x55a876614800 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55a876623260 tx=0x7fa7540132f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce94f8ec72745e41 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa747fff700 1 -- 172.21.15.5:0/3287604561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754022820 con 0x55a87660aa70 2023-10-07T00:13:36.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa747fff700 1 -- 172.21.15.5:0/3287604561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa75400d040 con 0x55a87660aa70 2023-10-07T00:13:36.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.692+0000 7fa747fff700 1 -- 172.21.15.5:0/3287604561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754019d80 con 0x55a87660aa70 2023-10-07T00:13:36.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 -- 172.21.15.5:0/3287604561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660aa70 msgr2=0x55a876614800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660aa70 0x55a876614800 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55a876623260 tx=0x7fa7540132f0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 -- 172.21.15.5:0/3287604561 shutdown_connections 2023-10-07T00:13:36.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 0x55a87661bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660aa70 0x55a876614800 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 --2- 172.21.15.5:0/3287604561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660b3d0 0x55a876614d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 -- 172.21.15.5:0/3287604561 >> 172.21.15.5:0/3287604561 conn(0x55a876576260 msgr2=0x55a87660f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 -- 172.21.15.5:0/3287604561 shutdown_connections 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.693+0000 7fa7771acb80 1 -- 172.21.15.5:0/3287604561 wait complete. 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 1 -- start start 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 1 Processor -- start 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660aa70 0x55a87661b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87661bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 0x55a8766180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8766186d0 con 0x55a87660b3d0 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a876618840 con 0x55a87660aa70 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a876618a00 con 0x55a87660c270 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.694+0000 7fa7771acb80 10 client.0 _ll_register_callbacks cb 0x7fa754007f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa760d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87661bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa760d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87661bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36586/0 (socket says 172.21.15.5:36586) 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa760d9a700 1 -- 172.21.15.5:0/2786252246 learned_addr learned my addr 172.21.15.5:0/2786252246 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa761d9c700 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660aa70 0x55a87661b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa761d9c700 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 0x55a8766180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa760d9a700 1 -- 172.21.15.5:0/2786252246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 msgr2=0x55a8766180f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa760d9a700 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 0x55a8766180f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa760d9a700 1 -- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660aa70 msgr2=0x55a87661b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa760d9a700 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660aa70 0x55a87661b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa760d9a700 1 -- 172.21.15.5:0/2786252246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa754022040 con 0x55a87660b3d0 2023-10-07T00:13:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.695+0000 7fa761d9c700 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660aa70 0x55a87661b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa760d9a700 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87661bb90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa74c011760 tx=0x7fa74c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599ccf34a55d66d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa744ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa744ff9700 1 -- 172.21.15.5:0/2786252246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c003d70 con 0x55a87660b3d0 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa7771acb80 1 -- 172.21.15.5:0/2786252246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa74c004390 con 0x55a87660b3d0 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa744ff9700 1 -- 172.21.15.5:0/2786252246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa74c000e40 con 0x55a87660b3d0 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa744ff9700 1 -- 172.21.15.5:0/2786252246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa74c00faa0 con 0x55a87660b3d0 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa7771acb80 10 client.15726 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa7771acb80 1 -- 172.21.15.5:0/2786252246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a8763a6250 con 0x55a87660b3d0 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.696+0000 7fa744ff9700 1 -- 172.21.15.5:0/2786252246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa74c004390 con 0x55a87660b3d0 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.697+0000 7fa744ff9700 1 -- 172.21.15.5:0/2786252246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa74c028070 con 0x55a87660b3d0 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.697+0000 7fa7771acb80 10 client.15726 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.697+0000 7fa7771acb80 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.697+0000 7fa7771acb80 20 client.15726 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:36.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.697+0000 7fa7771acb80 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a876675430 0x55a876677820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.697+0000 7fa7771acb80 4 client.15726 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:13:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.697+0000 7fa7771acb80 1 -- 172.21.15.5:0/2786252246 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a87654db30 con 0x55a876675430 2023-10-07T00:13:36.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.697+0000 7fa761d9c700 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a876675430 0x55a876677820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa761d9c700 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a876675430 0x55a876677820 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1443f15da026f3f7 server_cookie=61ddff52e3d4b1fa in_seq=0 out_seq=0 2023-10-07T00:13:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa744ff9700 10 client.15726 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa744ff9700 1 -- 172.21.15.5:0/2786252246 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a87654db30 con 0x55a876675430 2023-10-07T00:13:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa744ff9700 10 client.15726 handle_command_reply: tid=0 2023-10-07T00:13:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 client.15726 shutdown 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 -- 172.21.15.5:0/2786252246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 msgr2=0x55a87661bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87661bb90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa74c011760 tx=0x7fa74c009300 comp rx=0 tx=0).stop 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 -- 172.21.15.5:0/2786252246 shutdown_connections 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a876675430 0x55a876677820 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a87660c270 0x55a8766180f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a87660aa70 0x55a87661b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa744ff9700 0 client.15726 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 --2- 172.21.15.5:0/2786252246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a87660b3d0 0x55a87661bb90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 -- 172.21.15.5:0/2786252246 >> 172.21.15.5:0/2786252246 conn(0x55a876576260 msgr2=0x55a8766147a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.698+0000 7fa7771acb80 1 -- 172.21.15.5:0/2786252246 shutdown_connections 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7771acb80 1 -- 172.21.15.5:0/2786252246 wait complete. 2023-10-07T00:13:36.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7771acb80 20 client.15726 trim_cache size 0 max 16384 2023-10-07T00:13:36.706 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:13:36.706 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2023-10-07T00:13:36.706 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2023-10-07T00:13:36.706 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 -- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7480a1480 msgr2=0x7fa7480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7480a1480 0x7fa7480a3940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa758005f30 tx=0x7fa758005e80 comp rx=0 tx=0).stop 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 -- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 msgr2=0x7fa75c074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 0x7fa75c074c60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa758000c00 tx=0x7fa75800fa00 comp rx=0 tx=0).stop 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 -- 172.21.15.5:0/2125630776 shutdown_connections 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fa7480a1480 0x7fa7480a3940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c102b50 0x7fa75c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa75c100fc0 0x7fa75c074c60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 --2- 172.21.15.5:0/2125630776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa75c1021b0 0x7fa75c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.699+0000 7fa7637ff700 1 -- 172.21.15.5:0/2125630776 >> 172.21.15.5:0/2125630776 conn(0x7fa75c0fc530 msgr2=0x7fa75c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.700+0000 7fa7637ff700 1 -- 172.21.15.5:0/2125630776 shutdown_connections 2023-10-07T00:13:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.700+0000 7fa7637ff700 1 -- 172.21.15.5:0/2125630776 wait complete. 2023-10-07T00:13:36.720 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-07T00:13:36.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:13:36.788 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:36 smithi005 ceph-mon[129406]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:13:36.789 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:36 smithi005 ceph-mon[129406]: scrub queued for path: / 2023-10-07T00:13:36.789 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:36 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:36.789 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:36 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:13:36.789 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:36 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:36.789 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:36 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:13:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.938+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2181028341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 msgr2=0x7fc8f0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.938+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2181028341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 0x7fc8f0102610 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00099c0 tx=0x7fc8e0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.938+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2181028341 shutdown_connections 2023-10-07T00:13:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.938+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2181028341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0102b50 0x7fc8f0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.938+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2181028341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f0100fc0 0x7fc8f01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.938+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2181028341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 0x7fc8f0102610 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.938+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2181028341 >> 172.21.15.5:0/2181028341 conn(0x7fc8f00fc530 msgr2=0x7fc8f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.939+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2181028341 shutdown_connections 2023-10-07T00:13:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.939+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2181028341 wait complete. 2023-10-07T00:13:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f7fff700 1 Processor -- start 2023-10-07T00:13:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f7fff700 1 -- start start 2023-10-07T00:13:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0100fc0 0x7fc8f0198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 0x7fc8f0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f0102b50 0x7fc8f01a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f7fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f01a0950 con 0x7fc8f01021b0 2023-10-07T00:13:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f7fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f01a0a90 con 0x7fc8f0100fc0 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f7fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f01a0c20 con 0x7fc8f0102b50 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.940+0000 7fc8f559a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 0x7fc8f0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f559a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 0x7fc8f0199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36616/0 (socket says 172.21.15.5:36616) 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f559a700 1 -- 172.21.15.5:0/2208829840 learned_addr learned my addr 172.21.15.5:0/2208829840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f5d9b700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0100fc0 0x7fc8f0198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f659c700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f0102b50 0x7fc8f01a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f559a700 1 -- 172.21.15.5:0/2208829840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f0102b50 msgr2=0x7fc8f01a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f559a700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f0102b50 0x7fc8f01a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f559a700 1 -- 172.21.15.5:0/2208829840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0100fc0 msgr2=0x7fc8f0198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f559a700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0100fc0 0x7fc8f0198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f559a700 1 -- 172.21.15.5:0/2208829840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00095f0 con 0x7fc8f01021b0 2023-10-07T00:13:36.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.941+0000 7fc8f559a700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 0x7fc8f0199310 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0000c00 tx=0x7fc8e000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.942+0000 7fc8e6ffd700 1 -- 172.21.15.5:0/2208829840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e001d070 con 0x7fc8f01021b0 2023-10-07T00:13:36.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.942+0000 7fc8e6ffd700 1 -- 172.21.15.5:0/2208829840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8e000fdc0 con 0x7fc8f01021b0 2023-10-07T00:13:36.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.942+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f01a0ea0 con 0x7fc8f01021b0 2023-10-07T00:13:36.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.942+0000 7fc8e6ffd700 1 -- 172.21.15.5:0/2208829840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0004ae0 con 0x7fc8f01021b0 2023-10-07T00:13:36.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.942+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f01a12c0 con 0x7fc8f01021b0 2023-10-07T00:13:36.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.943+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f010c6e0 con 0x7fc8f01021b0 2023-10-07T00:13:36.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.946+0000 7fc8e6ffd700 1 -- 172.21.15.5:0/2208829840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc8e0004c40 con 0x7fc8f01021b0 2023-10-07T00:13:36.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.947+0000 7fc8e6ffd700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc8dc0a1500 0x7fc8dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:36.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.947+0000 7fc8e6ffd700 1 -- 172.21.15.5:0/2208829840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc8e00cdb00 con 0x7fc8f01021b0 2023-10-07T00:13:36.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.947+0000 7fc8f5d9b700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc8dc0a1500 0x7fc8dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:36.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.948+0000 7fc8f5d9b700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc8dc0a1500 0x7fc8dc0a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009550 tx=0x7fc8ec0091b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:36.951+0000 7fc8e6ffd700 1 -- 172.21.15.5:0/2208829840 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc8e00cfe60 con 0x7fc8f01021b0 2023-10-07T00:13:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:36 smithi088 ceph-mon[103111]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:13:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:36 smithi088 ceph-mon[103111]: scrub queued for path: / 2023-10-07T00:13:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:36 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:36 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:13:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:36 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:36 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:13:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.243+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8f01a1570 con 0x7fc8f01021b0 2023-10-07T00:13:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.244+0000 7fc8e6ffd700 1 -- 172.21.15.5:0/2208829840 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7fc8e0097170 con 0x7fc8f01021b0 2023-10-07T00:13:37.245 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:13:37.245 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:13:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:36 smithi112 ceph-mon[133548]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:13:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:36 smithi112 ceph-mon[133548]: scrub queued for path: / 2023-10-07T00:13:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:36 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:36 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:13:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:36 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:36 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:13:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.246+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc8dc0a1500 msgr2=0x7fc8dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.246+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc8dc0a1500 0x7fc8dc0a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009550 tx=0x7fc8ec0091b0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 msgr2=0x7fc8f0199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 0x7fc8f0199310 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0000c00 tx=0x7fc8e000fa00 comp rx=0 tx=0).stop 2023-10-07T00:13:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 shutdown_connections 2023-10-07T00:13:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc8dc0a1500 0x7fc8dc0a39c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f0102b50 0x7fc8f01a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0100fc0 0x7fc8f0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 --2- 172.21.15.5:0/2208829840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f01021b0 0x7fc8f0199310 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 >> 172.21.15.5:0/2208829840 conn(0x7fc8f00fc530 msgr2=0x7fc8f00fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 shutdown_connections 2023-10-07T00:13:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.247+0000 7fc8f7fff700 1 -- 172.21.15.5:0/2208829840 wait complete. 2023-10-07T00:13:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:13:37.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-07T00:13:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 -- 172.21.15.5:0/1335662227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c100fc0 msgr2=0x7ff61c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 --2- 172.21.15.5:0/1335662227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c100fc0 0x7ff61c1013e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff6180099c0 tx=0x7ff618009cd0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 -- 172.21.15.5:0/1335662227 shutdown_connections 2023-10-07T00:13:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 --2- 172.21.15.5:0/1335662227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff61c102b50 0x7ff61c109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 --2- 172.21.15.5:0/1335662227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c100fc0 0x7ff61c1013e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 --2- 172.21.15.5:0/1335662227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff61c1021b0 0x7ff61c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 -- 172.21.15.5:0/1335662227 >> 172.21.15.5:0/1335662227 conn(0x7ff61c0fc530 msgr2=0x7ff61c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 -- 172.21.15.5:0/1335662227 shutdown_connections 2023-10-07T00:13:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.498+0000 7ff6239ff700 1 -- 172.21.15.5:0/1335662227 wait complete. 2023-10-07T00:13:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.500+0000 7ff6239ff700 1 Processor -- start 2023-10-07T00:13:37.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.500+0000 7ff6239ff700 1 -- start start 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.500+0000 7ff6239ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff61c100fc0 0x7ff61c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.500+0000 7ff6239ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff61c1021b0 0x7ff61c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.500+0000 7ff6239ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c102b50 0x7ff61c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.500+0000 7ff6239ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c073f80 con 0x7ff61c102b50 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.500+0000 7ff6239ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0740f0 con 0x7ff61c100fc0 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.500+0000 7ff6239ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c1a0c20 con 0x7ff61c1021b0 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff621f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c102b50 0x7ff61c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff62179b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff61c100fc0 0x7ff61c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff621f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c102b50 0x7ff61c0737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36632/0 (socket says 172.21.15.5:36632) 2023-10-07T00:13:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff621f9c700 1 -- 172.21.15.5:0/3150150829 learned_addr learned my addr 172.21.15.5:0/3150150829 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff620f9a700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff61c1021b0 0x7ff61c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff621f9c700 1 -- 172.21.15.5:0/3150150829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff61c1021b0 msgr2=0x7ff61c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff621f9c700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff61c1021b0 0x7ff61c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff621f9c700 1 -- 172.21.15.5:0/3150150829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff61c100fc0 msgr2=0x7ff61c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff621f9c700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff61c100fc0 0x7ff61c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.501+0000 7ff621f9c700 1 -- 172.21.15.5:0/3150150829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6180095f0 con 0x7ff61c102b50 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.502+0000 7ff621f9c700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c102b50 0x7ff61c0737e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff614007ee0 tx=0x7ff61400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.502+0000 7ff6127fc700 1 -- 172.21.15.5:0/3150150829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614017070 con 0x7ff61c102b50 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.502+0000 7ff6127fc700 1 -- 172.21.15.5:0/3150150829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff61400f040 con 0x7ff61c102b50 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.502+0000 7ff6239ff700 1 -- 172.21.15.5:0/3150150829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c1a0f00 con 0x7ff61c102b50 2023-10-07T00:13:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.502+0000 7ff6127fc700 1 -- 172.21.15.5:0/3150150829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614005570 con 0x7ff61c102b50 2023-10-07T00:13:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.502+0000 7ff6239ff700 1 -- 172.21.15.5:0/3150150829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c1a1330 con 0x7ff61c102b50 2023-10-07T00:13:37.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.506+0000 7ff6127fc700 1 -- 172.21.15.5:0/3150150829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff61400db20 con 0x7ff61c102b50 2023-10-07T00:13:37.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.508+0000 7ff63721fb80 1 Processor -- start 2023-10-07T00:13:37.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.508+0000 7ff63721fb80 1 -- start start 2023-10-07T00:13:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.508+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f928a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.508+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f928b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.508+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f928bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.508+0000 7ff63721fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f91f2460 con 0x55f3f928a260 2023-10-07T00:13:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.508+0000 7ff63721fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f91e3c20 con 0x55f3f928abc0 2023-10-07T00:13:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.508+0000 7ff63721fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f91e1540 con 0x55f3f928ba60 2023-10-07T00:13:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f928a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f928a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36638/0 (socket says 172.21.15.5:36638) 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 -- 172.21.15.5:0/2019854821 learned_addr learned my addr 172.21.15.5:0/2019854821 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff62179b700 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f928b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff6127fc700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff6080a1480 0x7ff6080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f928bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 -- 172.21.15.5:0/2019854821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 msgr2=0x55f3f928bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f928bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 -- 172.21.15.5:0/2019854821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 msgr2=0x55f3f928b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f928b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.509+0000 7ff620f9a700 1 -- 172.21.15.5:0/2019854821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3f9007de0 con 0x55f3f928a260 2023-10-07T00:13:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.510+0000 7ff6127fc700 1 -- 172.21.15.5:0/3150150829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff6140cc4e0 con 0x7ff61c102b50 2023-10-07T00:13:37.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.510+0000 7ff620f9a700 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f928a680 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff60c013630 tx=0x7ff60c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c19f6bd28e6e5e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.510+0000 7ff621f9c700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff6080a1480 0x7ff6080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.510+0000 7ff6077fe700 1 -- 172.21.15.5:0/2019854821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c010660 con 0x55f3f928a260 2023-10-07T00:13:37.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.510+0000 7ff6077fe700 1 -- 172.21.15.5:0/2019854821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff60c013e90 con 0x55f3f928a260 2023-10-07T00:13:37.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.510+0000 7ff6077fe700 1 -- 172.21.15.5:0/2019854821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c00eaa0 con 0x55f3f928a260 2023-10-07T00:13:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.511+0000 7ff621f9c700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff6080a1480 0x7ff6080a3940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff6140a15e0 tx=0x7ff61400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.511+0000 7ff63721fb80 1 -- 172.21.15.5:0/2019854821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 msgr2=0x55f3f928a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.511+0000 7ff63721fb80 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f928a680 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff60c013630 tx=0x7ff60c009900 comp rx=0 tx=0).stop 2023-10-07T00:13:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.511+0000 7ff63721fb80 1 -- 172.21.15.5:0/2019854821 shutdown_connections 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.511+0000 7ff63721fb80 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f928bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.511+0000 7ff63721fb80 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f928a680 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.511+0000 7ff63721fb80 1 --2- 172.21.15.5:0/2019854821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f928b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.511+0000 7ff63721fb80 1 -- 172.21.15.5:0/2019854821 >> 172.21.15.5:0/2019854821 conn(0x55f3f91fe260 msgr2=0x55f3f9285140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.512+0000 7ff63721fb80 1 -- 172.21.15.5:0/2019854821 shutdown_connections 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.512+0000 7ff63721fb80 1 -- 172.21.15.5:0/2019854821 wait complete. 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.512+0000 7ff63721fb80 1 -- start start 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.513+0000 7ff63721fb80 1 Processor -- start 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.513+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928a260 0x55f3f9294030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.513+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f9294570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.513+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928ba60 0x55f3f929b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.513+0000 7ff63721fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f91dce30 con 0x55f3f928abc0 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.513+0000 7ff63721fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f9179710 con 0x55f3f928ba60 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.513+0000 7ff63721fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f91793b0 con 0x55f3f928a260 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.513+0000 7ff63721fb80 10 client.0 _ll_register_callbacks cb 0x55f3f8fd6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.514+0000 7ff620f9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928a260 0x55f3f9294030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.514+0000 7ff620f9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928a260 0x55f3f9294030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49132/0 (socket says 172.21.15.5:49132) 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.514+0000 7ff620f9a700 1 -- 172.21.15.5:0/639274792 learned_addr learned my addr 172.21.15.5:0/639274792 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.514+0000 7ff620f9a700 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928ba60 0x55f3f929b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.514+0000 7ff62179b700 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f9294570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff620f9a700 1 -- 172.21.15.5:0/639274792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928ba60 msgr2=0x55f3f929b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff620f9a700 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928ba60 0x55f3f929b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff620f9a700 1 -- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 msgr2=0x55f3f9294570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff620f9a700 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f9294570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff620f9a700 1 -- 172.21.15.5:0/639274792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c009e00 con 0x55f3f928a260 2023-10-07T00:13:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff62179b700 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f9294570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff620f9a700 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928a260 0x55f3f9294030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00ea20 tx=0x7ff60c017040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d3b0d134ac438c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff604ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:37.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.515+0000 7ff604ff9700 1 -- 172.21.15.5:0/639274792 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c00ea80 con 0x55f3f928a260 2023-10-07T00:13:37.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.516+0000 7ff63721fb80 1 -- 172.21.15.5:0/639274792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3f927cf10 con 0x55f3f928a260 2023-10-07T00:13:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.516+0000 7ff604ff9700 1 -- 172.21.15.5:0/639274792 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff60c005260 con 0x55f3f928a260 2023-10-07T00:13:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.516+0000 7ff604ff9700 1 -- 172.21.15.5:0/639274792 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff60c005420 con 0x55f3f928a260 2023-10-07T00:13:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.516+0000 7ff63721fb80 10 client.25510 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.516+0000 7ff63721fb80 1 -- 172.21.15.5:0/639274792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f3f8ff0c60 con 0x55f3f928a260 2023-10-07T00:13:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.516+0000 7ff604ff9700 1 -- 172.21.15.5:0/639274792 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3f927cf10 con 0x55f3f928a260 2023-10-07T00:13:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.517+0000 7ff604ff9700 1 -- 172.21.15.5:0/639274792 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff60c010460 con 0x55f3f928a260 2023-10-07T00:13:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.517+0000 7ff63721fb80 10 client.25510 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.517+0000 7ff63721fb80 10 client.25510 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.517+0000 7ff63721fb80 20 client.25510 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.517+0000 7ff63721fb80 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55f3f929fd80 0x55f3f92a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.517+0000 7ff63721fb80 4 client.25510 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.517+0000 7ff63721fb80 1 -- 172.21.15.5:0/639274792 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3f91d5e10 con 0x55f3f929fd80 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.517+0000 7ff62179b700 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55f3f929fd80 0x55f3f92a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.518+0000 7ff604ff9700 10 client.25510 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.518+0000 7ff62179b700 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55f3f929fd80 0x55f3f92a21a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5ddf83be0307b5cf server_cookie=bb4c8b1e4f5671d in_seq=0 out_seq=0 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.518+0000 7ff604ff9700 1 -- 172.21.15.5:0/639274792 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f3f91d5e10 con 0x55f3f929fd80 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.518+0000 7ff604ff9700 10 client.25510 handle_command_reply: tid=0 2023-10-07T00:13:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.518+0000 7ff63721fb80 1 client.25510 shutdown 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 -- 172.21.15.5:0/639274792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928a260 msgr2=0x55f3f9294030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928a260 0x55f3f9294030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00ea20 tx=0x7ff60c017040 comp rx=0 tx=0).stop 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 -- 172.21.15.5:0/639274792 shutdown_connections 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55f3f929fd80 0x55f3f92a21a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928ba60 0x55f3f929b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff604ff9700 0 client.25510 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928a260 0x55f3f9294030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 --2- 172.21.15.5:0/639274792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f9294570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 -- 172.21.15.5:0/639274792 >> 172.21.15.5:0/639274792 conn(0x55f3f91fe260 msgr2=0x55f3f9284f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 -- 172.21.15.5:0/639274792 shutdown_connections 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 1 -- 172.21.15.5:0/639274792 wait complete. 2023-10-07T00:13:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.519+0000 7ff63721fb80 20 client.25510 trim_cache size 0 max 16384 2023-10-07T00:13:37.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.546+0000 7ff63721fb80 1 Processor -- start 2023-10-07T00:13:37.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.546+0000 7ff63721fb80 1 -- start start 2023-10-07T00:13:37.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928a260 0x55f3f9284f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f929b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f9291e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff63721fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f905d920 con 0x55f3f928abc0 2023-10-07T00:13:37.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff63721fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f928afa0 con 0x55f3f928a260 2023-10-07T00:13:37.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff63721fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f9293bd0 con 0x55f3f928ba60 2023-10-07T00:13:37.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff62179b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f929b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff62179b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f929b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36642/0 (socket says 172.21.15.5:36642) 2023-10-07T00:13:37.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff62179b700 1 -- 172.21.15.5:0/3898852393 learned_addr learned my addr 172.21.15.5:0/3898852393 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff620f9a700 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928a260 0x55f3f9284f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff620f9a700 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f9291e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.547+0000 7ff62179b700 1 -- 172.21.15.5:0/3898852393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 msgr2=0x55f3f9291e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.548+0000 7ff62179b700 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f9291e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.548+0000 7ff62179b700 1 -- 172.21.15.5:0/3898852393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928a260 msgr2=0x55f3f9284f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.548+0000 7ff62179b700 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928a260 0x55f3f9284f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.548+0000 7ff62179b700 1 -- 172.21.15.5:0/3898852393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3f902e250 con 0x55f3f928abc0 2023-10-07T00:13:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.548+0000 7ff62179b700 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f929b570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff618005f50 tx=0x7ff618005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97de59baae330861 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.548+0000 7ff607fff700 1 -- 172.21.15.5:0/3898852393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618028e10 con 0x55f3f928abc0 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.548+0000 7ff607fff700 1 -- 172.21.15.5:0/3898852393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff61802c070 con 0x55f3f928abc0 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.548+0000 7ff607fff700 1 -- 172.21.15.5:0/3898852393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618003760 con 0x55f3f928abc0 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 -- 172.21.15.5:0/3898852393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 msgr2=0x55f3f929b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f929b570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff618005f50 tx=0x7ff618005040 comp rx=0 tx=0).stop 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 -- 172.21.15.5:0/3898852393 shutdown_connections 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f9291e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928a260 0x55f3f9284f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 --2- 172.21.15.5:0/3898852393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928abc0 0x55f3f929b570 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 -- 172.21.15.5:0/3898852393 >> 172.21.15.5:0/3898852393 conn(0x55f3f91fe260 msgr2=0x55f3f9283bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 -- 172.21.15.5:0/3898852393 shutdown_connections 2023-10-07T00:13:37.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.549+0000 7ff63721fb80 1 -- 172.21.15.5:0/3898852393 wait complete. 2023-10-07T00:13:37.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.550+0000 7ff63721fb80 1 -- start start 2023-10-07T00:13:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.550+0000 7ff63721fb80 1 Processor -- start 2023-10-07T00:13:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.550+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f92973a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.550+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f92978e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.550+0000 7ff63721fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f929a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.550+0000 7ff63721fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f929ae40 con 0x55f3f928a260 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.550+0000 7ff63721fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f929afb0 con 0x55f3f928abc0 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.550+0000 7ff63721fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f929b170 con 0x55f3f928ba60 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff63721fb80 10 client.0 _ll_register_callbacks cb 0x7ff60c00ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f92973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f92973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36658/0 (socket says 172.21.15.5:36658) 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 -- 172.21.15.5:0/675177574 learned_addr learned my addr 172.21.15.5:0/675177574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff62179b700 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f92978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 -- 172.21.15.5:0/675177574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 msgr2=0x55f3f929a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f929a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 -- 172.21.15.5:0/675177574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 msgr2=0x55f3f92978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f92978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 -- 172.21.15.5:0/675177574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c109d50 con 0x55f3f928a260 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff62179b700 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f92978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff620f9a700 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f92973a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff60c005950 tx=0x7ff60c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d2d9907449965f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.551+0000 7ff604ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.552+0000 7ff604ff9700 1 -- 172.21.15.5:0/675177574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c023040 con 0x55f3f928a260 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.552+0000 7ff63721fb80 1 -- 172.21.15.5:0/675177574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff60c013e90 con 0x55f3f928a260 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.552+0000 7ff604ff9700 1 -- 172.21.15.5:0/675177574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff60c000e40 con 0x55f3f928a260 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.552+0000 7ff604ff9700 1 -- 172.21.15.5:0/675177574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff60c010670 con 0x55f3f928a260 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.552+0000 7ff63721fb80 10 client.15750 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.552+0000 7ff63721fb80 1 -- 172.21.15.5:0/675177574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f3f90062b0 con 0x55f3f928a260 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.552+0000 7ff604ff9700 1 -- 172.21.15.5:0/675177574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff60c048020 con 0x55f3f928a260 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.553+0000 7ff604ff9700 1 -- 172.21.15.5:0/675177574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff60c0048a0 con 0x55f3f928a260 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.553+0000 7ff63721fb80 10 client.15750 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.553+0000 7ff63721fb80 10 client.15750 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.553+0000 7ff63721fb80 20 client.15750 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.553+0000 7ff63721fb80 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55f3f92f48a0 0x55f3f92f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.553+0000 7ff63721fb80 4 client.15750 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.553+0000 7ff63721fb80 1 -- 172.21.15.5:0/675177574 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f3f91d5b30 con 0x55f3f92f48a0 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.553+0000 7ff62179b700 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55f3f92f48a0 0x55f3f92f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff62179b700 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55f3f92f48a0 0x55f3f92f6cc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a9b440bdcb3e6a8a server_cookie=d387f0133528c99b in_seq=0 out_seq=0 2023-10-07T00:13:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff604ff9700 10 client.15750 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:13:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff604ff9700 1 -- 172.21.15.5:0/675177574 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f3f91d5b30 con 0x55f3f92f48a0 2023-10-07T00:13:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff604ff9700 10 client.15750 handle_command_reply: tid=0 2023-10-07T00:13:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 client.15750 shutdown 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 -- 172.21.15.5:0/675177574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 msgr2=0x55f3f92973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f92973a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff60c005950 tx=0x7ff60c011db0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 -- 172.21.15.5:0/675177574 shutdown_connections 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f3f928ba60 0x55f3f929a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3f928a260 0x55f3f92973a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55f3f92f48a0 0x55f3f92f6cc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 --2- 172.21.15.5:0/675177574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f3f928abc0 0x55f3f92978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff63721fb80 1 -- 172.21.15.5:0/675177574 >> 172.21.15.5:0/675177574 conn(0x55f3f91fe260 msgr2=0x55f3f928e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.554+0000 7ff604ff9700 0 client.15750 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.555+0000 7ff63721fb80 1 -- 172.21.15.5:0/675177574 shutdown_connections 2023-10-07T00:13:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.555+0000 7ff63721fb80 1 -- 172.21.15.5:0/675177574 wait complete. 2023-10-07T00:13:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.555+0000 7ff63721fb80 20 client.15750 trim_cache size 0 max 16384 2023-10-07T00:13:37.566 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 -- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff6080a1480 msgr2=0x7ff6080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff6080a1480 0x7ff6080a3940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff6140a15e0 tx=0x7ff61400b040 comp rx=0 tx=0).stop 2023-10-07T00:13:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 -- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c102b50 msgr2=0x7ff61c0737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c102b50 0x7ff61c0737e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff614007ee0 tx=0x7ff61400d3b0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 -- 172.21.15.5:0/3150150829 shutdown_connections 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff6080a1480 0x7ff6080a3940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff61c102b50 0x7ff61c0737e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff61c100fc0 0x7ff61c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 --2- 172.21.15.5:0/3150150829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff61c1021b0 0x7ff61c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 -- 172.21.15.5:0/3150150829 >> 172.21.15.5:0/3150150829 conn(0x7ff61c0fc530 msgr2=0x7ff61c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 -- 172.21.15.5:0/3150150829 shutdown_connections 2023-10-07T00:13:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.556+0000 7ff6239ff700 1 -- 172.21.15.5:0/3150150829 wait complete. 2023-10-07T00:13:37.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-07T00:13:37.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 -- 172.21.15.5:0/3768443272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc102b50 msgr2=0x7f4bbc109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/3768443272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc102b50 0x7f4bbc109400 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400b0d0 tx=0x7f4bb400b3e0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 -- 172.21.15.5:0/3768443272 shutdown_connections 2023-10-07T00:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/3768443272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc102b50 0x7f4bbc109400 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/3768443272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bbc100fc0 0x7f4bbc1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/3768443272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bbc1021b0 0x7f4bbc102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 -- 172.21.15.5:0/3768443272 >> 172.21.15.5:0/3768443272 conn(0x7f4bbc0fc530 msgr2=0x7f4bbc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 -- 172.21.15.5:0/3768443272 shutdown_connections 2023-10-07T00:13:37.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.796+0000 7f4bc09ff700 1 -- 172.21.15.5:0/3768443272 wait complete. 2023-10-07T00:13:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.797+0000 7f4bc09ff700 1 Processor -- start 2023-10-07T00:13:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.797+0000 7f4bc09ff700 1 -- start start 2023-10-07T00:13:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.797+0000 7f4bc09ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc100fc0 0x7f4bbc198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bc09ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bbc1021b0 0x7f4bbc1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bc09ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bbc102b50 0x7f4bbc1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bc09ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1a0a00 con 0x7f4bbc100fc0 2023-10-07T00:13:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bc09ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1a0b40 con 0x7f4bbc1021b0 2023-10-07T00:13:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bc09ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1a0cd0 con 0x7f4bbc102b50 2023-10-07T00:13:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc100fc0 0x7f4bbc198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc100fc0 0x7f4bbc198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36680/0 (socket says 172.21.15.5:36680) 2023-10-07T00:13:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bba59c700 1 -- 172.21.15.5:0/2796842587 learned_addr learned my addr 172.21.15.5:0/2796842587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bbc1021b0 0x7f4bbc1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bbad9d700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bbc102b50 0x7f4bbc1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bba59c700 1 -- 172.21.15.5:0/2796842587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bbc102b50 msgr2=0x7f4bbc1a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bba59c700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bbc102b50 0x7f4bbc1a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bba59c700 1 -- 172.21.15.5:0/2796842587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bbc1021b0 msgr2=0x7f4bbc1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bba59c700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bbc1021b0 0x7f4bbc1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bba59c700 1 -- 172.21.15.5:0/2796842587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac009520 con 0x7f4bbc100fc0 2023-10-07T00:13:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.798+0000 7f4bbad9d700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bbc102b50 0x7f4bbc1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.799+0000 7f4bba59c700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc100fc0 0x7f4bbc198e80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00ea50 tx=0x7f4bac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.799+0000 7f4bab7fe700 1 -- 172.21.15.5:0/2796842587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00cbd0 con 0x7f4bbc100fc0 2023-10-07T00:13:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.799+0000 7f4bab7fe700 1 -- 172.21.15.5:0/2796842587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bac00cd30 con 0x7f4bbc100fc0 2023-10-07T00:13:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.799+0000 7f4bc09ff700 1 -- 172.21.15.5:0/2796842587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb4009d00 con 0x7f4bbc100fc0 2023-10-07T00:13:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.799+0000 7f4bab7fe700 1 -- 172.21.15.5:0/2796842587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac018680 con 0x7f4bbc100fc0 2023-10-07T00:13:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.799+0000 7f4bc09ff700 1 -- 172.21.15.5:0/2796842587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc1a1250 con 0x7f4bbc100fc0 2023-10-07T00:13:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.802+0000 7f4bab7fe700 1 -- 172.21.15.5:0/2796842587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4bac010430 con 0x7f4bbc100fc0 2023-10-07T00:13:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.804+0000 7f4bab7fe700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4ba40a1500 0x7f4ba40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.804+0000 7f4bab7fe700 1 -- 172.21.15.5:0/2796842587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4bac014070 con 0x7f4bbc100fc0 2023-10-07T00:13:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.804+0000 7f4bd4292b80 1 Processor -- start 2023-10-07T00:13:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.804+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4ba40a1500 0x7f4ba40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bd4292b80 1 -- start start 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63260 0x565039d63680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63bc0 0x565039d64480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d64a60 0x565039d64ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039ccb460 con 0x565039d64a60 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039cbcc20 con 0x565039d63260 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039cba540 con 0x565039d63bc0 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4ba40a1500 0x7f4ba40a39c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0007be0 tx=0x7f4bb00073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bbad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d64a60 0x565039d64ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63260 0x565039d63680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bbad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d64a60 0x565039d64ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36686/0 (socket says 172.21.15.5:36686) 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.805+0000 7f4bbad9d700 1 -- 172.21.15.5:0/1504396325 learned_addr learned my addr 172.21.15.5:0/1504396325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63bc0 0x565039d64480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4bbad9d700 1 -- 172.21.15.5:0/1504396325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63bc0 msgr2=0x565039d64480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4bbad9d700 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63bc0 0x565039d64480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4bbad9d700 1 -- 172.21.15.5:0/1504396325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63260 msgr2=0x565039d63680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4bbad9d700 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63260 0x565039d63680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4bbad9d700 1 -- 172.21.15.5:0/1504396325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565039ae0de0 con 0x565039d64a60 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4bba59c700 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63260 0x565039d63680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4bbad9d700 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d64a60 0x565039d64ee0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4015000 tx=0x7f4bb40092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bfb19ae34cb139 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4ba8ff9700 1 -- 172.21.15.5:0/1504396325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400e050 con 0x565039d64a60 2023-10-07T00:13:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.806+0000 7f4ba8ff9700 1 -- 172.21.15.5:0/1504396325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bb4007d90 con 0x565039d64a60 2023-10-07T00:13:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.807+0000 7f4ba8ff9700 1 -- 172.21.15.5:0/1504396325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4004e80 con 0x565039d64a60 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.807+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1504396325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d64a60 msgr2=0x565039d64ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.807+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d64a60 0x565039d64ee0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4015000 tx=0x7f4bb40092e0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.807+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1504396325 shutdown_connections 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.807+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d64a60 0x565039d64ee0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.807+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63260 0x565039d63680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.807+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1504396325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63bc0 0x565039d64480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.807+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1504396325 >> 172.21.15.5:0/1504396325 conn(0x565039cd7260 msgr2=0x565039d5e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.808+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1504396325 shutdown_connections 2023-10-07T00:13:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.808+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1504396325 wait complete. 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.808+0000 7f4bd4292b80 1 -- start start 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.808+0000 7f4bd4292b80 1 Processor -- start 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d6cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d6d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 0x565039d74540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039cb5e30 con 0x565039d63bc0 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039c52710 con 0x565039d64a60 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039c523b0 con 0x565039d63260 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bd4292b80 10 client.0 _ll_register_callbacks cb 0x565039aaf800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bb9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d6d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bb9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d6d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36696/0 (socket says 172.21.15.5:36696) 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bb9d9b700 1 -- 172.21.15.5:0/1130798518 learned_addr learned my addr 172.21.15.5:0/1130798518 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.809+0000 7f4bbad9d700 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 0x565039d74540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4bba59c700 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d6cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4bb9d9b700 1 -- 172.21.15.5:0/1130798518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 msgr2=0x565039d6cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d6cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4bb9d9b700 1 -- 172.21.15.5:0/1130798518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 msgr2=0x565039d74540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 0x565039d74540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4bb9d9b700 1 -- 172.21.15.5:0/1130798518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc1a1250 con 0x565039d63bc0 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d6d500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00042e0 tx=0x7f4bb00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8155e8f0590a7595 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4ba1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/1130798518 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0003d10 con 0x565039d63bc0 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/1130798518 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4bb0017040 con 0x565039d63bc0 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.810+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1130798518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565039d55f10 con 0x565039d63bc0 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/1130798518 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bb0003e70 con 0x565039d63bc0 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4bd4292b80 10 client.15762 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1130798518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f4bbc109d50 con 0x565039d63bc0 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/1130798518 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565039d55f10 con 0x565039d63bc0 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/1130798518 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4bb0029420 con 0x565039d63bc0 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4bd4292b80 10 client.15762 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4bd4292b80 10 client.15762 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:13:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4bd4292b80 20 client.15762 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x565039d78ef0 0x565039d7b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4bd4292b80 4 client.15762 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.811+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1130798518 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565039caee10 con 0x565039d78ef0 2023-10-07T00:13:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.812+0000 7f4bba59c700 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x565039d78ef0 0x565039d7b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.812+0000 7f4bba59c700 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x565039d78ef0 0x565039d7b310 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ceef66fcd2eaa0e3 server_cookie=12fb62bf20329d55 in_seq=0 out_seq=0 2023-10-07T00:13:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.812+0000 7f4ba1ffb700 10 client.15762 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:13:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.813+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/1130798518 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565039caee10 con 0x565039d78ef0 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.813+0000 7f4ba1ffb700 10 client.15762 handle_command_reply: tid=0 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.813+0000 7f4bd4292b80 1 client.15762 shutdown 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1130798518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 msgr2=0x565039d6d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d6d500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00042e0 tx=0x7f4bb00047c0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1130798518 shutdown_connections 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x565039d78ef0 0x565039d7b310 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 0x565039d74540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d6cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/1130798518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d6d500 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1130798518 >> 172.21.15.5:0/1130798518 conn(0x565039cd7260 msgr2=0x565039d5df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4ba1ffb700 0 client.15762 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:13:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1130798518 shutdown_connections 2023-10-07T00:13:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 1 -- 172.21.15.5:0/1130798518 wait complete. 2023-10-07T00:13:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.814+0000 7f4bd4292b80 20 client.15762 trim_cache size 0 max 16384 2023-10-07T00:13:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.833+0000 7f4bd4292b80 1 Processor -- start 2023-10-07T00:13:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.833+0000 7f4bd4292b80 1 -- start start 2023-10-07T00:13:37.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.833+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63260 0x565039d67930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.833+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63bc0 0x565039d74500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d64a60 0x565039d67e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039b36920 con 0x565039d63260 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039d63fd0 con 0x565039d63bc0 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039d5aa20 con 0x565039d64a60 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63260 0x565039d67930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63260 0x565039d67930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36698/0 (socket says 172.21.15.5:36698) 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bba59c700 1 -- 172.21.15.5:0/4193137005 learned_addr learned my addr 172.21.15.5:0/4193137005 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bbad9d700 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d64a60 0x565039d67e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63bc0 0x565039d74500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bba59c700 1 -- 172.21.15.5:0/4193137005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d64a60 msgr2=0x565039d67e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.834+0000 7f4bba59c700 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d64a60 0x565039d67e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.835+0000 7f4bba59c700 1 -- 172.21.15.5:0/4193137005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63bc0 msgr2=0x565039d74500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.835+0000 7f4bba59c700 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63bc0 0x565039d74500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.835+0000 7f4bba59c700 1 -- 172.21.15.5:0/4193137005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565039ac9c60 con 0x565039d63260 2023-10-07T00:13:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.835+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63bc0 0x565039d74500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.835+0000 7f4bba59c700 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63260 0x565039d67930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0cabc0 tx=0x7f4bac01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981ba1001b61f191 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.835+0000 7f4ba97fa700 1 -- 172.21.15.5:0/4193137005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b2ea0 con 0x565039d63260 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.835+0000 7f4ba97fa700 1 -- 172.21.15.5:0/4193137005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bac09e530 con 0x565039d63260 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.835+0000 7f4ba97fa700 1 -- 172.21.15.5:0/4193137005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac09e120 con 0x565039d63260 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 -- 172.21.15.5:0/4193137005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63260 msgr2=0x565039d67930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63260 0x565039d67930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0cabc0 tx=0x7f4bac01a040 comp rx=0 tx=0).stop 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 -- 172.21.15.5:0/4193137005 shutdown_connections 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d64a60 0x565039d67e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63260 0x565039d67930 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/4193137005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d63bc0 0x565039d74500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 -- 172.21.15.5:0/4193137005 >> 172.21.15.5:0/4193137005 conn(0x565039cd7260 msgr2=0x565039d6cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 -- 172.21.15.5:0/4193137005 shutdown_connections 2023-10-07T00:13:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.836+0000 7f4bd4292b80 1 -- 172.21.15.5:0/4193137005 wait complete. 2023-10-07T00:13:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.837+0000 7f4bd4292b80 1 -- start start 2023-10-07T00:13:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.837+0000 7f4bd4292b80 1 Processor -- start 2023-10-07T00:13:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d70d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bd4292b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 0x565039d712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039d71800 con 0x565039d63bc0 2023-10-07T00:13:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039d71970 con 0x565039d64a60 2023-10-07T00:13:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bd4292b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x565039dd54e0 con 0x565039d63260 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bd4292b80 10 client.0 _ll_register_callbacks cb 0x7f4bb0010dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bb9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d70d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d742e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49220/0 (socket says 172.21.15.5:49220) 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bba59c700 1 -- 172.21.15.5:0/543482243 learned_addr learned my addr 172.21.15.5:0/543482243 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bbad9d700 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 0x565039d712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bba59c700 1 -- 172.21.15.5:0/543482243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 msgr2=0x565039d712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bba59c700 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 0x565039d712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bba59c700 1 -- 172.21.15.5:0/543482243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 msgr2=0x565039d70d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.838+0000 7f4bba59c700 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d70d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.839+0000 7f4bba59c700 1 -- 172.21.15.5:0/543482243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb4009d00 con 0x565039d63260 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.839+0000 7f4bba59c700 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d742e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4bac005bf0 tx=0x7f4bac0967d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6615f63a3f5a8bb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.839+0000 7f4ba1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.839+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/543482243 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b2ea0 con 0x565039d63260 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.839+0000 7f4bd4292b80 1 -- 172.21.15.5:0/543482243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bb4007d90 con 0x565039d63260 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.839+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/543482243 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4bac09e310 con 0x565039d63260 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.839+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/543482243 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bac0a2770 con 0x565039d63260 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.840+0000 7f4bd4292b80 10 client.25531 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.840+0000 7f4bd4292b80 1 -- 172.21.15.5:0/543482243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x565039b07250 con 0x565039d63260 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/543482243 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bb4007d90 con 0x565039d63260 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/543482243 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4bac0a22e0 con 0x565039d63260 2023-10-07T00:13:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4bd4292b80 10 client.25531 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4bd4292b80 10 client.25531 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:13:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4bd4292b80 20 client.25531 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x565039dd6a50 0x565039dd8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4bd4292b80 4 client.25531 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:37.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4bd4292b80 1 -- 172.21.15.5:0/543482243 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x565039caeb30 con 0x565039dd6a50 2023-10-07T00:13:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.841+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x565039dd6a50 0x565039dd8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.842+0000 7f4ba1ffb700 10 client.25531 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:13:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.842+0000 7f4bb9d9b700 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x565039dd6a50 0x565039dd8e70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5f0c5765ca4bdd94 server_cookie=b2aba566fb44493c in_seq=0 out_seq=0 2023-10-07T00:13:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4ba1ffb700 1 -- 172.21.15.5:0/543482243 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x565039caeb30 con 0x565039dd6a50 2023-10-07T00:13:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4ba1ffb700 10 client.25531 handle_command_reply: tid=0 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 client.25531 shutdown 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 -- 172.21.15.5:0/543482243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 msgr2=0x565039d742e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d742e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4bac005bf0 tx=0x7f4bac0967d0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 -- 172.21.15.5:0/543482243 shutdown_connections 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x565039dd6a50 0x565039dd8e70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565039d64a60 0x565039d712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x565039d63260 0x565039d742e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 --2- 172.21.15.5:0/543482243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565039d63bc0 0x565039d70d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 -- 172.21.15.5:0/543482243 >> 172.21.15.5:0/543482243 conn(0x565039cd7260 msgr2=0x565039d6cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4ba1ffb700 0 client.25531 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:13:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.843+0000 7f4bd4292b80 1 -- 172.21.15.5:0/543482243 shutdown_connections 2023-10-07T00:13:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.844+0000 7f4bd4292b80 1 -- 172.21.15.5:0/543482243 wait complete. 2023-10-07T00:13:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.844+0000 7f4bd4292b80 20 client.25531 trim_cache size 0 max 16384 2023-10-07T00:13:37.848 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 -- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4ba40a1500 msgr2=0x7f4ba40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4ba40a1500 0x7f4ba40a39c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0007be0 tx=0x7f4bb00073d0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 -- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc100fc0 msgr2=0x7f4bbc198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc100fc0 0x7f4bbc198e80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00ea50 tx=0x7f4bac00ed60 comp rx=0 tx=0).stop 2023-10-07T00:13:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 -- 172.21.15.5:0/2796842587 shutdown_connections 2023-10-07T00:13:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4ba40a1500 0x7f4ba40a39c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bbc102b50 0x7f4bbc1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bbc100fc0 0x7f4bbc198e80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 --2- 172.21.15.5:0/2796842587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bbc1021b0 0x7f4bbc1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 -- 172.21.15.5:0/2796842587 >> 172.21.15.5:0/2796842587 conn(0x7f4bbc0fc530 msgr2=0x7f4bbc107aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 -- 172.21.15.5:0/2796842587 shutdown_connections 2023-10-07T00:13:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:37.845+0000 7f4bc09ff700 1 -- 172.21.15.5:0/2796842587 wait complete. 2023-10-07T00:13:37.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:37 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2208829840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:37.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-07T00:13:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.091+0000 7f3a403ff700 1 -- 172.21.15.5:0/11253324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 msgr2=0x7f3a38106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.091+0000 7f3a403ff700 1 --2- 172.21.15.5:0/11253324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 0x7f3a38106760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a280098f0 tx=0x7f3a28009c00 comp rx=0 tx=0).stop 2023-10-07T00:13:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.091+0000 7f3a403ff700 1 -- 172.21.15.5:0/11253324 shutdown_connections 2023-10-07T00:13:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.092+0000 7f3a403ff700 1 --2- 172.21.15.5:0/11253324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38106ca0 0x7f3a38109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.092+0000 7f3a403ff700 1 --2- 172.21.15.5:0/11253324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a38101a40 0x7f3a38103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.092+0000 7f3a403ff700 1 --2- 172.21.15.5:0/11253324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 0x7f3a38106760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.092+0000 7f3a403ff700 1 -- 172.21.15.5:0/11253324 >> 172.21.15.5:0/11253324 conn(0x7f3a380fb450 msgr2=0x7f3a380fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.092+0000 7f3a403ff700 1 -- 172.21.15.5:0/11253324 shutdown_connections 2023-10-07T00:13:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.092+0000 7f3a403ff700 1 -- 172.21.15.5:0/11253324 wait complete. 2023-10-07T00:13:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.093+0000 7f3a403ff700 1 Processor -- start 2023-10-07T00:13:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.093+0000 7f3a403ff700 1 -- start start 2023-10-07T00:13:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.093+0000 7f3a403ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a38101a40 0x7f3a38198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.093+0000 7f3a403ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 0x7f3a38199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.093+0000 7f3a403ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38106ca0 0x7f3a381a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.093+0000 7f3a403ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a381a0950 con 0x7f3a38101a40 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.093+0000 7f3a403ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a381a0a90 con 0x7f3a38106ca0 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.093+0000 7f3a403ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a381a0c20 con 0x7f3a38104370 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a38101a40 0x7f3a38198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a38101a40 0x7f3a38198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36726/0 (socket says 172.21.15.5:36726) 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 -- 172.21.15.5:0/3760629944 learned_addr learned my addr 172.21.15.5:0/3760629944 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 0x7f3a38199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e99c700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38106ca0 0x7f3a381a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 -- 172.21.15.5:0/3760629944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 msgr2=0x7f3a38199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 0x7f3a38199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 -- 172.21.15.5:0/3760629944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38106ca0 msgr2=0x7f3a381a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38106ca0 0x7f3a381a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 -- 172.21.15.5:0/3760629944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340095f0 con 0x7f3a38101a40 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 0x7f3a38199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.094+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a38101a40 0x7f3a38198dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400ec10 tx=0x7f3a3400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.095+0000 7f3a2f7fe700 1 -- 172.21.15.5:0/3760629944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400cd40 con 0x7f3a38101a40 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.095+0000 7f3a2f7fe700 1 -- 172.21.15.5:0/3760629944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a340044b0 con 0x7f3a38101a40 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.095+0000 7f3a2f7fe700 1 -- 172.21.15.5:0/3760629944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34010430 con 0x7f3a38101a40 2023-10-07T00:13:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.095+0000 7f3a403ff700 1 -- 172.21.15.5:0/3760629944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a28009520 con 0x7f3a38101a40 2023-10-07T00:13:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.095+0000 7f3a403ff700 1 -- 172.21.15.5:0/3760629944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a381a11d0 con 0x7f3a38101a40 2023-10-07T00:13:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.098+0000 7f3a2f7fe700 1 -- 172.21.15.5:0/3760629944 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3a34004000 con 0x7f3a38101a40 2023-10-07T00:13:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.100+0000 7f3a2f7fe700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3a240a1500 0x7f3a240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.100+0000 7f3a2f7fe700 1 -- 172.21.15.5:0/3760629944 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3a34014070 con 0x7f3a38101a40 2023-10-07T00:13:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.101+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3a240a1500 0x7f3a240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.101+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3a240a1500 0x7f3a240a39c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800f9d0 tx=0x7f3a28019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.102+0000 7f3a53dfab80 1 Processor -- start 2023-10-07T00:13:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.102+0000 7f3a53dfab80 1 -- start start 2023-10-07T00:13:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.102+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.102+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.102+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.102+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd72d460 con 0x55a8bd7c6a60 2023-10-07T00:13:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.102+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd71ec20 con 0x55a8bd7c5260 2023-10-07T00:13:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.102+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd71c540 con 0x55a8bd7c5bc0 2023-10-07T00:13:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36742/0 (socket says 172.21.15.5:36742) 2023-10-07T00:13:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e99c700 1 -- 172.21.15.5:0/2615243861 learned_addr learned my addr 172.21.15.5:0/2615243861 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e19b700 1 -- 172.21.15.5:0/2615243861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5bc0 msgr2=0x55a8bd7c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e19b700 1 -- 172.21.15.5:0/2615243861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 msgr2=0x55a8bd7c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e19b700 1 -- 172.21.15.5:0/2615243861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8bd542de0 con 0x55a8bd7c5260 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.103+0000 7f3a3e99c700 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.104+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c5680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a3409a1a0 tx=0x7f3a34004620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26fe413060db132b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.104+0000 7f3a2cbfe700 1 -- 172.21.15.5:0/2615243861 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34003710 con 0x55a8bd7c5260 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.104+0000 7f3a2cbfe700 1 -- 172.21.15.5:0/2615243861 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a340cc070 con 0x55a8bd7c5260 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.104+0000 7f3a2cbfe700 1 -- 172.21.15.5:0/2615243861 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340a2830 con 0x55a8bd7c5260 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 -- 172.21.15.5:0/2615243861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5260 msgr2=0x55a8bd7c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c5680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a3409a1a0 tx=0x7f3a34004620 comp rx=0 tx=0).stop 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 -- 172.21.15.5:0/2615243861 shutdown_connections 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c5680 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/2615243861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 -- 172.21.15.5:0/2615243861 >> 172.21.15.5:0/2615243861 conn(0x55a8bd739260 msgr2=0x55a8bd7c0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 -- 172.21.15.5:0/2615243861 shutdown_connections 2023-10-07T00:13:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.105+0000 7f3a53dfab80 1 -- 172.21.15.5:0/2615243861 wait complete. 2023-10-07T00:13:38.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.106+0000 7f3a53dfab80 1 -- start start 2023-10-07T00:13:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.106+0000 7f3a53dfab80 1 Processor -- start 2023-10-07T00:13:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd717e30 con 0x55a8bd7c6a60 2023-10-07T00:13:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd6b4710 con 0x55a8bd7c5bc0 2023-10-07T00:13:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd6b43b0 con 0x55a8bd7c5260 2023-10-07T00:13:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a53dfab80 10 client.0 _ll_register_callbacks cb 0x55a8bd511800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a3e99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a3e99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36758/0 (socket says 172.21.15.5:36758) 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.107+0000 7f3a3e99c700 1 -- 172.21.15.5:0/4027407712 learned_addr learned my addr 172.21.15.5:0/4027407712 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a3e99c700 1 -- 172.21.15.5:0/4027407712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 msgr2=0x55a8bd7cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a3e99c700 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a3e99c700 1 -- 172.21.15.5:0/4027407712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 msgr2=0x55a8bd7cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a3e99c700 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a3e99c700 1 -- 172.21.15.5:0/4027407712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a300090f0 con 0x55a8bd7c6a60 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a3e99c700 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d6600 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3a30007f00 tx=0x7f3a30007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351edd54a62ef1b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.108+0000 7f3a21ffb700 1 -- 172.21.15.5:0/4027407712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000e070 con 0x55a8bd7c6a60 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 1 -- 172.21.15.5:0/4027407712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8bd7b7f10 con 0x55a8bd7c6a60 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a21ffb700 1 -- 172.21.15.5:0/4027407712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3a30003a00 con 0x55a8bd7c6a60 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a21ffb700 1 -- 172.21.15.5:0/4027407712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a30003bc0 con 0x55a8bd7c6a60 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 10 client.15780 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 1 -- 172.21.15.5:0/4027407712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f3a381a11d0 con 0x55a8bd7c6a60 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a21ffb700 1 -- 172.21.15.5:0/4027407712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a8bd7b7f10 con 0x55a8bd7c6a60 2023-10-07T00:13:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a21ffb700 1 -- 172.21.15.5:0/4027407712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a30016950 con 0x55a8bd7c6a60 2023-10-07T00:13:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 10 client.15780 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 10 client.15780 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:13:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 20 client.15780 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55a8bd7daeb0 0x55a8bd7dd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 4 client.15780 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.109+0000 7f3a53dfab80 1 -- 172.21.15.5:0/4027407712 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8bd710e10 con 0x55a8bd7daeb0 2023-10-07T00:13:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.110+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55a8bd7daeb0 0x55a8bd7dd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.110+0000 7f3a21ffb700 10 client.15780 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.110+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55a8bd7daeb0 0x55a8bd7dd2d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a5d65d16a19c234d server_cookie=3df1a3e10eb68686 in_seq=0 out_seq=0 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.111+0000 7f3a21ffb700 1 -- 172.21.15.5:0/4027407712 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a8bd710e10 con 0x55a8bd7daeb0 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.111+0000 7f3a21ffb700 10 client.15780 handle_command_reply: tid=0 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.111+0000 7f3a53dfab80 1 client.15780 shutdown 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 -- 172.21.15.5:0/4027407712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 msgr2=0x55a8bd7d6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d6600 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3a30007f00 tx=0x7f3a30007f30 comp rx=0 tx=0).stop 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 -- 172.21.15.5:0/4027407712 shutdown_connections 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55a8bd7daeb0 0x55a8bd7dd2d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d6600 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/4027407712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a21ffb700 0 client.15780 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:13:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 -- 172.21.15.5:0/4027407712 >> 172.21.15.5:0/4027407712 conn(0x55a8bd739260 msgr2=0x55a8bd7bff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 -- 172.21.15.5:0/4027407712 shutdown_connections 2023-10-07T00:13:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 1 -- 172.21.15.5:0/4027407712 wait complete. 2023-10-07T00:13:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.112+0000 7f3a53dfab80 20 client.15780 trim_cache size 0 max 16384 2023-10-07T00:13:38.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.126+0000 7f3a53dfab80 1 Processor -- start 2023-10-07T00:13:38.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.126+0000 7f3a53dfab80 1 -- start start 2023-10-07T00:13:38.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.126+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.126+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.126+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.126+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd598920 con 0x55a8bd7c5bc0 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.126+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd7c6300 con 0x55a8bd7c6a60 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.126+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd7cffd0 con 0x55a8bd7c5260 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3d99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3d99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36772/0 (socket says 172.21.15.5:36772) 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3d99a700 1 -- 172.21.15.5:0/3355152159 learned_addr learned my addr 172.21.15.5:0/3355152159 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3e99c700 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3e19b700 1 -- 172.21.15.5:0/3355152159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c6a60 msgr2=0x55a8bd7cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3e19b700 1 -- 172.21.15.5:0/3355152159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5bc0 msgr2=0x55a8bd7d6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.127+0000 7f3a3e19b700 1 -- 172.21.15.5:0/3355152159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8bd52bc60 con 0x55a8bd7c5260 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.128+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c6e40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3a3409a660 tx=0x7f3a34000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3b0138bcae9b419 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.128+0000 7f3a2d3ff700 1 -- 172.21.15.5:0/3355152159 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34016330 con 0x55a8bd7c5260 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.128+0000 7f3a2d3ff700 1 -- 172.21.15.5:0/3355152159 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a3409aba0 con 0x55a8bd7c5260 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.128+0000 7f3a2d3ff700 1 -- 172.21.15.5:0/3355152159 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34098840 con 0x55a8bd7c5260 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 -- 172.21.15.5:0/3355152159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 msgr2=0x55a8bd7c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c6e40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3a3409a660 tx=0x7f3a34000bc0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 -- 172.21.15.5:0/3355152159 shutdown_connections 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c5260 0x55a8bd7c6e40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/3355152159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 -- 172.21.15.5:0/3355152159 >> 172.21.15.5:0/3355152159 conn(0x55a8bd739260 msgr2=0x55a8bd7e1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 -- 172.21.15.5:0/3355152159 shutdown_connections 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.129+0000 7f3a53dfab80 1 -- 172.21.15.5:0/3355152159 wait complete. 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 1 -- start start 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 1 Processor -- start 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5260 0x55a8bd7d4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd7d5a90 con 0x55a8bd7c5260 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd7d5c00 con 0x55a8bd7c5bc0 2023-10-07T00:13:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bd7d5dc0 con 0x55a8bd7c6a60 2023-10-07T00:13:38.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.130+0000 7f3a53dfab80 10 client.0 _ll_register_callbacks cb 0x7f3a300078a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:38.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5260 0x55a8bd7d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5260 0x55a8bd7d4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36774/0 (socket says 172.21.15.5:36774) 2023-10-07T00:13:38.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 -- 172.21.15.5:0/101559852 learned_addr learned my addr 172.21.15.5:0/101559852 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e99c700 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 -- 172.21.15.5:0/101559852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c6a60 msgr2=0x55a8bd7d5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 -- 172.21.15.5:0/101559852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 msgr2=0x55a8bd7d4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 -- 172.21.15.5:0/101559852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8bd542de0 con 0x55a8bd7c5260 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e99c700 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a3e19b700 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5260 0x55a8bd7d4000 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3a34085100 tx=0x7f3a34016330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcd998a27020ce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.131+0000 7f3a21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a21ffb700 1 -- 172.21.15.5:0/101559852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34004330 con 0x55a8bd7c5260 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a21ffb700 1 -- 172.21.15.5:0/101559852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3a3409e170 con 0x55a8bd7c5260 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a53dfab80 1 -- 172.21.15.5:0/101559852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a340cc070 con 0x55a8bd7c5260 2023-10-07T00:13:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a21ffb700 1 -- 172.21.15.5:0/101559852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a3409e330 con 0x55a8bd7c5260 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a53dfab80 10 client.15786 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a53dfab80 1 -- 172.21.15.5:0/101559852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a8bd569250 con 0x55a8bd7c5260 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a21ffb700 1 -- 172.21.15.5:0/101559852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a340cc070 con 0x55a8bd7c5260 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a21ffb700 1 -- 172.21.15.5:0/101559852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a340a23a0 con 0x55a8bd7c5260 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a53dfab80 10 client.15786 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a53dfab80 10 client.15786 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a53dfab80 20 client.15786 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.132+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55a8bd82f560 0x55a8bd831980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.133+0000 7f3a53dfab80 4 client.15786 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.133+0000 7f3a53dfab80 1 -- 172.21.15.5:0/101559852 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a8bd710b30 con 0x55a8bd82f560 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.133+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55a8bd82f560 0x55a8bd831980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a21ffb700 10 client.15786 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a3d99a700 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55a8bd82f560 0x55a8bd831980 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82ebf3b895ee2eab server_cookie=1a3710e3c18fea73 in_seq=0 out_seq=0 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a21ffb700 1 -- 172.21.15.5:0/101559852 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a8bd710b30 con 0x55a8bd82f560 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a21ffb700 10 client.15786 handle_command_reply: tid=0 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 client.15786 shutdown 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 -- 172.21.15.5:0/101559852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5260 msgr2=0x55a8bd7d4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5260 0x55a8bd7d4000 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3a34085100 tx=0x7f3a34016330 comp rx=0 tx=0).stop 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 -- 172.21.15.5:0/101559852 shutdown_connections 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55a8bd82f560 0x55a8bd831980 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8bd7c6a60 0x55a8bd7d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8bd7c5260 0x55a8bd7d4000 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 --2- 172.21.15.5:0/101559852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a8bd7c5bc0 0x55a8bd7d4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a21ffb700 0 client.15786 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:13:38.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 -- 172.21.15.5:0/101559852 >> 172.21.15.5:0/101559852 conn(0x55a8bd739260 msgr2=0x55a8bd7cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 -- 172.21.15.5:0/101559852 shutdown_connections 2023-10-07T00:13:38.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.134+0000 7f3a53dfab80 1 -- 172.21.15.5:0/101559852 wait complete. 2023-10-07T00:13:38.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a53dfab80 20 client.15786 trim_cache size 0 max 16384 2023-10-07T00:13:38.140 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 -- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3a240a1500 msgr2=0x7f3a240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3a240a1500 0x7f3a240a39c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800f9d0 tx=0x7f3a28019040 comp rx=0 tx=0).stop 2023-10-07T00:13:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 -- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a38101a40 msgr2=0x7f3a38198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a38101a40 0x7f3a38198dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400ec10 tx=0x7f3a3400ef20 comp rx=0 tx=0).stop 2023-10-07T00:13:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 -- 172.21.15.5:0/3760629944 shutdown_connections 2023-10-07T00:13:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3a240a1500 0x7f3a240a39c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38106ca0 0x7f3a381a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a38101a40 0x7f3a38198dd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 --2- 172.21.15.5:0/3760629944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a38104370 0x7f3a38199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.135+0000 7f3a403ff700 1 -- 172.21.15.5:0/3760629944 >> 172.21.15.5:0/3760629944 conn(0x7f3a380fb450 msgr2=0x7f3a381026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.136+0000 7f3a403ff700 1 -- 172.21.15.5:0/3760629944 shutdown_connections 2023-10-07T00:13:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.136+0000 7f3a403ff700 1 -- 172.21.15.5:0/3760629944 wait complete. 2023-10-07T00:13:38.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-07T00:13:38.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:37 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2208829840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:38.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:37 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2208829840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:13:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 -- 172.21.15.5:0/2747273473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d80ff830 msgr2=0x7f60d80ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 --2- 172.21.15.5:0/2747273473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d80ff830 0x7f60d80ffc50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009990 tx=0x7f60d4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 -- 172.21.15.5:0/2747273473 shutdown_connections 2023-10-07T00:13:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 --2- 172.21.15.5:0/2747273473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60d8100b50 0x7f60d8100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 --2- 172.21.15.5:0/2747273473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d80ff830 0x7f60d80ffc50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 --2- 172.21.15.5:0/2747273473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d8100190 0x7f60d8100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 -- 172.21.15.5:0/2747273473 >> 172.21.15.5:0/2747273473 conn(0x7f60d80fb450 msgr2=0x7f60d80fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 -- 172.21.15.5:0/2747273473 shutdown_connections 2023-10-07T00:13:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.366+0000 7f60e01ff700 1 -- 172.21.15.5:0/2747273473 wait complete. 2023-10-07T00:13:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.367+0000 7f60e01ff700 1 Processor -- start 2023-10-07T00:13:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.367+0000 7f60e01ff700 1 -- start start 2023-10-07T00:13:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60e01ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d80ff830 0x7f60d8198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60e01ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d8100190 0x7f60d81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60e01ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60d8100b50 0x7f60d81a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60e01ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81a08f0 con 0x7f60d80ff830 2023-10-07T00:13:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60e01ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81a0a30 con 0x7f60d8100b50 2023-10-07T00:13:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60e01ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81a0bc0 con 0x7f60d8100190 2023-10-07T00:13:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60ddf9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d80ff830 0x7f60d8198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60ddf9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d80ff830 0x7f60d8198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36796/0 (socket says 172.21.15.5:36796) 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60ddf9b700 1 -- 172.21.15.5:0/1506699514 learned_addr learned my addr 172.21.15.5:0/1506699514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60de79c700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60d8100b50 0x7f60d81a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.368+0000 7f60dd79a700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d8100190 0x7f60d81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.369+0000 7f60ddf9b700 1 -- 172.21.15.5:0/1506699514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d8100190 msgr2=0x7f60d81992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.369+0000 7f60ddf9b700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d8100190 0x7f60d81992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.369+0000 7f60ddf9b700 1 -- 172.21.15.5:0/1506699514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60d8100b50 msgr2=0x7f60d81a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.369+0000 7f60ddf9b700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60d8100b50 0x7f60d81a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.369+0000 7f60ddf9b700 1 -- 172.21.15.5:0/1506699514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40095f0 con 0x7f60d80ff830 2023-10-07T00:13:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.369+0000 7f60de79c700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60d8100b50 0x7f60d81a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.369+0000 7f60ddf9b700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d80ff830 0x7f60d8198d70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f60d40059d0 tx=0x7f60d40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.369+0000 7f60ceffd700 1 -- 172.21.15.5:0/1506699514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d401d070 con 0x7f60d80ff830 2023-10-07T00:13:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.370+0000 7f60ceffd700 1 -- 172.21.15.5:0/1506699514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d400bdb0 con 0x7f60d80ff830 2023-10-07T00:13:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.370+0000 7f60e01ff700 1 -- 172.21.15.5:0/1506699514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d81a0e40 con 0x7f60d80ff830 2023-10-07T00:13:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.370+0000 7f60ceffd700 1 -- 172.21.15.5:0/1506699514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400fd90 con 0x7f60d80ff830 2023-10-07T00:13:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.370+0000 7f60e01ff700 1 -- 172.21.15.5:0/1506699514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d81a1260 con 0x7f60d80ff830 2023-10-07T00:13:38.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.375+0000 7f60ceffd700 1 -- 172.21.15.5:0/1506699514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f60d400f560 con 0x7f60d80ff830 2023-10-07T00:13:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.376+0000 7f60f3aebb80 1 Processor -- start 2023-10-07T00:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.377+0000 7f60f3aebb80 1 -- start start 2023-10-07T00:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.377+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022370e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.377+0000 7f60ceffd700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60c40a1500 0x7f60c40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.377+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022371c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d0223726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0222d0460 con 0x55d022372270 2023-10-07T00:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0222c1c20 con 0x55d022370a70 2023-10-07T00:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0222bf540 con 0x55d0223713d0 2023-10-07T00:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60ceffd700 1 -- 172.21.15.5:0/1506699514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f60d40ce070 con 0x7f60d80ff830 2023-10-07T00:13:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60de79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022370e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60de79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022370e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:58250/0 (socket says 172.21.15.5:58250) 2023-10-07T00:13:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60de79c700 1 -- 172.21.15.5:0/3968268851 learned_addr learned my addr 172.21.15.5:0/3968268851 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60dd79a700 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022371c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.378+0000 7f60ddf9b700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60c40a1500 0x7f60c40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60de79c700 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d0223726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60dd79a700 1 -- 172.21.15.5:0/3968268851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 msgr2=0x55d022370e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60dd79a700 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022370e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60dd79a700 1 -- 172.21.15.5:0/3968268851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 msgr2=0x55d0223726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60dd79a700 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d0223726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60dd79a700 1 -- 172.21.15.5:0/3968268851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0220e5de0 con 0x55d0223713d0 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60dd79a700 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022371c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009cb0 tx=0x7f60c8011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50c144b03e0585f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60ddf9b700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60c40a1500 0x7f60c40a39c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006010 tx=0x7f60d4026f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.379+0000 7f60c3fff700 1 -- 172.21.15.5:0/3968268851 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8011d20 con 0x55d0223713d0 2023-10-07T00:13:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.380+0000 7f60c3fff700 1 -- 172.21.15.5:0/3968268851 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60c8011e80 con 0x55d0223713d0 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.380+0000 7f60c3fff700 1 -- 172.21.15.5:0/3968268851 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8005280 con 0x55d0223713d0 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3968268851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 msgr2=0x55d022371c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022371c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009cb0 tx=0x7f60c8011440 comp rx=0 tx=0).stop 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3968268851 shutdown_connections 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d0223726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022370e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3968268851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022371c90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3968268851 >> 172.21.15.5:0/3968268851 conn(0x55d0222dc260 msgr2=0x55d022363140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3968268851 shutdown_connections 2023-10-07T00:13:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.381+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3968268851 wait complete. 2023-10-07T00:13:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.382+0000 7f60f3aebb80 1 -- start start 2023-10-07T00:13:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.382+0000 7f60f3aebb80 1 Processor -- start 2023-10-07T00:13:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d0223713d0 0x55d02237acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d022372270 0x55d022381d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0222bae30 con 0x55d022370a70 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d022257710 con 0x55d0223713d0 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0222573b0 con 0x55d022372270 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60f3aebb80 10 client.0 _ll_register_callbacks cb 0x55d0220b4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60de79c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d022372270 0x55d022381d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60de79c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d022372270 0x55d022381d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49286/0 (socket says 172.21.15.5:49286) 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60de79c700 1 -- 172.21.15.5:0/3112892087 learned_addr learned my addr 172.21.15.5:0/3112892087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.383+0000 7f60de79c700 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.384+0000 7f60dd79a700 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d0223713d0 0x55d02237acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.384+0000 7f60de79c700 1 -- 172.21.15.5:0/3112892087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d0223713d0 msgr2=0x55d02237acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.384+0000 7f60de79c700 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d0223713d0 0x55d02237acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.384+0000 7f60de79c700 1 -- 172.21.15.5:0/3112892087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 msgr2=0x55d02237a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.384+0000 7f60de79c700 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.384+0000 7f60de79c700 1 -- 172.21.15.5:0/3112892087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c80098e0 con 0x55d022372270 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.384+0000 7f60de79c700 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d022372270 0x55d022381d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f60d000eb30 tx=0x7f60d0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc21659178a39eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.384+0000 7f60c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.385+0000 7f60c17fa700 1 -- 172.21.15.5:0/3112892087 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0003c10 con 0x55d022372270 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.385+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3112892087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0222b3e10 con 0x55d022372270 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.385+0000 7f60c17fa700 1 -- 172.21.15.5:0/3112892087 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f60d0003d70 con 0x55d022372270 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.385+0000 7f60c17fa700 1 -- 172.21.15.5:0/3112892087 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d0004bb0 con 0x55d022372270 2023-10-07T00:13:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.385+0000 7f60f3aebb80 10 client.25561 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:38.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.385+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3112892087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d0220cec60 con 0x55d022372270 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.386+0000 7f60c17fa700 1 -- 172.21.15.5:0/3112892087 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d0222b3e10 con 0x55d022372270 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.386+0000 7f60c17fa700 1 -- 172.21.15.5:0/3112892087 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f60d0004050 con 0x55d022372270 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.386+0000 7f60f3aebb80 10 client.25561 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.386+0000 7f60f3aebb80 10 client.25561 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.386+0000 7f60f3aebb80 20 client.25561 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.386+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d022386630 0x55d022388a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.386+0000 7f60f3aebb80 4 client.25561 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.386+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3112892087 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0222b3b30 con 0x55d022386630 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.387+0000 7f60dd79a700 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d022386630 0x55d022388a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.387+0000 7f60dd79a700 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d022386630 0x55d022388a50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f5b468cc57efac3 server_cookie=11436ede7f3a3b2d in_seq=0 out_seq=0 2023-10-07T00:13:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.387+0000 7f60c17fa700 10 client.25561 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:13:38.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.388+0000 7f60c17fa700 1 -- 172.21.15.5:0/3112892087 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d0222b3b30 con 0x55d022386630 2023-10-07T00:13:38.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.388+0000 7f60c17fa700 10 client.25561 handle_command_reply: tid=0 2023-10-07T00:13:38.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.388+0000 7f60f3aebb80 1 client.25561 shutdown 2023-10-07T00:13:38.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3112892087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d022372270 msgr2=0x55d022381d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d022372270 0x55d022381d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f60d000eb30 tx=0x7f60d0004ad0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3112892087 shutdown_connections 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d022386630 0x55d022388a50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d022372270 0x55d022381d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/3112892087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d0223713d0 0x55d02237acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3112892087 >> 172.21.15.5:0/3112892087 conn(0x55d0222dc260 msgr2=0x55d022362f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60c17fa700 0 client.25561 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.389+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3112892087 shutdown_connections 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.390+0000 7f60f3aebb80 1 -- 172.21.15.5:0/3112892087 wait complete. 2023-10-07T00:13:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.390+0000 7f60f3aebb80 20 client.25561 trim_cache size 0 max 16384 2023-10-07T00:13:38.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.404+0000 7f60f3aebb80 1 Processor -- start 2023-10-07T00:13:38.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.404+0000 7f60f3aebb80 1 -- start start 2023-10-07T00:13:38.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.404+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022362f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.404+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022381cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.404+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d022378610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.404+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d02213b920 con 0x55d022372270 2023-10-07T00:13:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.404+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d022379c60 con 0x55d022370a70 2023-10-07T00:13:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.404+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d022386150 con 0x55d0223713d0 2023-10-07T00:13:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60de79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d022378610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60de79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d022378610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36818/0 (socket says 172.21.15.5:36818) 2023-10-07T00:13:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60de79c700 1 -- 172.21.15.5:0/2339014373 learned_addr learned my addr 172.21.15.5:0/2339014373 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60de79c700 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022362f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60dd79a700 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022381cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60dd79a700 1 -- 172.21.15.5:0/2339014373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 msgr2=0x55d022362f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60dd79a700 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022362f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60dd79a700 1 -- 172.21.15.5:0/2339014373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 msgr2=0x55d022378610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60dd79a700 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d022378610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60dd79a700 1 -- 172.21.15.5:0/2339014373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d02210c250 con 0x55d0223713d0 2023-10-07T00:13:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.405+0000 7f60de79c700 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d022378610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.406+0000 7f60dd79a700 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022381cf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55d022389360 tx=0x7f60c80046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91adadf6fc3c0f5f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.406+0000 7f60ccff9700 1 -- 172.21.15.5:0/2339014373 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8011ba0 con 0x55d0223713d0 2023-10-07T00:13:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.406+0000 7f60ccff9700 1 -- 172.21.15.5:0/2339014373 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60c8011d00 con 0x55d0223713d0 2023-10-07T00:13:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.406+0000 7f60ccff9700 1 -- 172.21.15.5:0/2339014373 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8024420 con 0x55d0223713d0 2023-10-07T00:13:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 -- 172.21.15.5:0/2339014373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 msgr2=0x55d022381cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022381cf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55d022389360 tx=0x7f60c80046b0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 -- 172.21.15.5:0/2339014373 shutdown_connections 2023-10-07T00:13:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022372270 0x55d022378610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022370a70 0x55d022362f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/2339014373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d022381cf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 -- 172.21.15.5:0/2339014373 >> 172.21.15.5:0/2339014373 conn(0x55d0222dc260 msgr2=0x55d022388640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 -- 172.21.15.5:0/2339014373 shutdown_connections 2023-10-07T00:13:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 -- 172.21.15.5:0/2339014373 wait complete. 2023-10-07T00:13:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.407+0000 7f60f3aebb80 1 -- start start 2023-10-07T00:13:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.408+0000 7f60f3aebb80 1 Processor -- start 2023-10-07T00:13:38.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.408+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.408+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d02237e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.408+0000 7f60f3aebb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022372270 0x55d022381020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.408+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d022381560 con 0x55d022370a70 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.408+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0223816d0 con 0x55d022372270 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.408+0000 7f60f3aebb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d022381890 con 0x55d0223713d0 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60f3aebb80 10 client.0 _ll_register_callbacks cb 0x7f60d0008f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60de79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60de79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36830/0 (socket says 172.21.15.5:36830) 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60de79c700 1 -- 172.21.15.5:0/1803442751 learned_addr learned my addr 172.21.15.5:0/1803442751 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60dd79a700 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d02237e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60de79c700 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022372270 0x55d022381020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60de79c700 1 -- 172.21.15.5:0/1803442751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 msgr2=0x55d02237e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60de79c700 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d02237e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60de79c700 1 -- 172.21.15.5:0/1803442751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022372270 msgr2=0x55d022381020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.409+0000 7f60de79c700 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022372270 0x55d022381020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.410+0000 7f60de79c700 1 -- 172.21.15.5:0/1803442751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0220cec60 con 0x55d022370a70 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.410+0000 7f60dd79a700 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d02237e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.410+0000 7f60de79c700 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237dac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f60d000eb30 tx=0x7f60d00086c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef59cfda257ca05 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.410+0000 7f60c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.410+0000 7f60c17fa700 1 -- 172.21.15.5:0/1803442751 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0004820 con 0x55d022370a70 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.410+0000 7f60f3aebb80 1 -- 172.21.15.5:0/1803442751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d02235af10 con 0x55d022370a70 2023-10-07T00:13:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.410+0000 7f60c17fa700 1 -- 172.21.15.5:0/1803442751 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f60d0003c10 con 0x55d022370a70 2023-10-07T00:13:38.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60c17fa700 1 -- 172.21.15.5:0/1803442751 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d0003dd0 con 0x55d022370a70 2023-10-07T00:13:38.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60f3aebb80 10 client.15804 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60f3aebb80 1 -- 172.21.15.5:0/1803442751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f60c801d040 con 0x55d022370a70 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60c17fa700 1 -- 172.21.15.5:0/1803442751 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d0042020 con 0x55d022370a70 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60c17fa700 1 -- 172.21.15.5:0/1803442751 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f60d0018d10 con 0x55d022370a70 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60f3aebb80 10 client.15804 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60f3aebb80 10 client.15804 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60f3aebb80 20 client.15804 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d0223db360 0x55d0223dd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60f3aebb80 4 client.15804 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.411+0000 7f60f3aebb80 1 -- 172.21.15.5:0/1803442751 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d022106f70 con 0x55d0223db360 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.412+0000 7f60dd79a700 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d0223db360 0x55d0223dd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.413+0000 7f60dd79a700 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d0223db360 0x55d0223dd780 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e94194d2fc20bf64 server_cookie=df1b27dfe3449c17 in_seq=0 out_seq=0 2023-10-07T00:13:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.413+0000 7f60c17fa700 10 client.15804 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:13:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.413+0000 7f60c17fa700 1 -- 172.21.15.5:0/1803442751 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d022106f70 con 0x55d0223db360 2023-10-07T00:13:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.413+0000 7f60c17fa700 10 client.15804 handle_command_reply: tid=0 2023-10-07T00:13:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.413+0000 7f60f3aebb80 1 client.15804 shutdown 2023-10-07T00:13:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.413+0000 7f60f3aebb80 1 -- 172.21.15.5:0/1803442751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 msgr2=0x55d02237dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.413+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237dac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f60d000eb30 tx=0x7f60d00086c0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 1 -- 172.21.15.5:0/1803442751 shutdown_connections 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x55d0223db360 0x55d0223dd780 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d022372270 0x55d022381020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d022370a70 0x55d02237dac0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 1 --2- 172.21.15.5:0/1803442751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0223713d0 0x55d02237e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 1 -- 172.21.15.5:0/1803442751 >> 172.21.15.5:0/1803442751 conn(0x55d0222dc260 msgr2=0x55d022375140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60c17fa700 0 client.15804 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 1 -- 172.21.15.5:0/1803442751 shutdown_connections 2023-10-07T00:13:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 1 -- 172.21.15.5:0/1803442751 wait complete. 2023-10-07T00:13:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.414+0000 7f60f3aebb80 20 client.15804 trim_cache size 0 max 16384 2023-10-07T00:13:38.418 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 -- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60c40a1500 msgr2=0x7f60c40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60c40a1500 0x7f60c40a39c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006010 tx=0x7f60d4026f70 comp rx=0 tx=0).stop 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 -- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d80ff830 msgr2=0x7f60d8198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d80ff830 0x7f60d8198d70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f60d40059d0 tx=0x7f60d40047b0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 -- 172.21.15.5:0/1506699514 shutdown_connections 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60c40a1500 0x7f60c40a39c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60d8100b50 0x7f60d81a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d80ff830 0x7f60d8198d70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 --2- 172.21.15.5:0/1506699514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d8100190 0x7f60d81992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.415+0000 7f60e01ff700 1 -- 172.21.15.5:0/1506699514 >> 172.21.15.5:0/1506699514 conn(0x7f60d80fb450 msgr2=0x7f60d80fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.416+0000 7f60e01ff700 1 -- 172.21.15.5:0/1506699514 shutdown_connections 2023-10-07T00:13:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.416+0000 7f60e01ff700 1 -- 172.21.15.5:0/1506699514 wait complete. 2023-10-07T00:13:38.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-07T00:13:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 -- 172.21.15.5:0/3553036544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0230101810 msgr2=0x7f0230103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 --2- 172.21.15.5:0/3553036544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0230101810 0x7f0230103c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02200098f0 tx=0x7f0220009c00 comp rx=0 tx=0).stop 2023-10-07T00:13:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 -- 172.21.15.5:0/3553036544 shutdown_connections 2023-10-07T00:13:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 --2- 172.21.15.5:0/3553036544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0230106a70 0x7f0230108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 --2- 172.21.15.5:0/3553036544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0230101810 0x7f0230103c00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 --2- 172.21.15.5:0/3553036544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0230104140 0x7f0230106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 -- 172.21.15.5:0/3553036544 >> 172.21.15.5:0/3553036544 conn(0x7f02300fb120 msgr2=0x7f02300fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 -- 172.21.15.5:0/3553036544 shutdown_connections 2023-10-07T00:13:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.656+0000 7f02349fe700 1 -- 172.21.15.5:0/3553036544 wait complete. 2023-10-07T00:13:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.657+0000 7f02349fe700 1 Processor -- start 2023-10-07T00:13:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f02349fe700 1 -- start start 2023-10-07T00:13:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f02349fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0230101810 0x7f0230101180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f02349fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0230104140 0x7f02300ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f02349fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0230106a70 0x7f02300ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f02349fe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301004a0 con 0x7f0230104140 2023-10-07T00:13:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f02349fe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230100610 con 0x7f0230106a70 2023-10-07T00:13:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f02349fe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301a0990 con 0x7f0230101810 2023-10-07T00:13:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f022e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0230104140 0x7f02300ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f022e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0230104140 0x7f02300ff7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36848/0 (socket says 172.21.15.5:36848) 2023-10-07T00:13:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.658+0000 7f022e59c700 1 -- 172.21.15.5:0/3291197979 learned_addr learned my addr 172.21.15.5:0/3291197979 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.659+0000 7f022ed9d700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0230101810 0x7f0230101180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.659+0000 7f022f59e700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0230106a70 0x7f02300ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.659+0000 7f022e59c700 1 -- 172.21.15.5:0/3291197979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0230101810 msgr2=0x7f0230101180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.659+0000 7f022e59c700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0230101810 0x7f0230101180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.659+0000 7f022e59c700 1 -- 172.21.15.5:0/3291197979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0230106a70 msgr2=0x7f02300ffd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.659+0000 7f022e59c700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0230106a70 0x7f02300ffd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.659+0000 7f022e59c700 1 -- 172.21.15.5:0/3291197979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02240095f0 con 0x7f0230104140 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.659+0000 7f022e59c700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0230104140 0x7f02300ff7c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f022400ec10 tx=0x7f022400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.660+0000 7f0217fff700 1 -- 172.21.15.5:0/3291197979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400cd40 con 0x7f0230104140 2023-10-07T00:13:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.660+0000 7f0217fff700 1 -- 172.21.15.5:0/3291197979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02240044b0 con 0x7f0230104140 2023-10-07T00:13:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.660+0000 7f0217fff700 1 -- 172.21.15.5:0/3291197979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224010430 con 0x7f0230104140 2023-10-07T00:13:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.660+0000 7f02349fe700 1 -- 172.21.15.5:0/3291197979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0220009520 con 0x7f0230104140 2023-10-07T00:13:38.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.660+0000 7f02349fe700 1 -- 172.21.15.5:0/3291197979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02301a0f70 con 0x7f0230104140 2023-10-07T00:13:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.665+0000 7f0217fff700 1 -- 172.21.15.5:0/3291197979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0224003fd0 con 0x7f0230104140 2023-10-07T00:13:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.666+0000 7f0248a93b80 1 Processor -- start 2023-10-07T00:13:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.667+0000 7f0248a93b80 1 -- start start 2023-10-07T00:13:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.667+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.667+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 0x55ae6d4abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.667+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 0x55ae6d4ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.667+0000 7f0248a93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d40a460 con 0x55ae6d4ab580 2023-10-07T00:13:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.667+0000 7f0248a93b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d3fbc20 con 0x55ae6d4ac470 2023-10-07T00:13:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.667+0000 7f0248a93b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d3f9540 con 0x55ae6d4aac20 2023-10-07T00:13:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f0217fff700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02180a1500 0x7f02180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f0217fff700 1 -- 172.21.15.5:0/3291197979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0224014070 con 0x7f0230104140 2023-10-07T00:13:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49330/0 (socket says 172.21.15.5:49330) 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 -- 172.21.15.5:0/933506052 learned_addr learned my addr 172.21.15.5:0/933506052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02180a1500 0x7f02180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022ed9d700 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 0x55ae6d4abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022e59c700 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 0x55ae6d4ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 -- 172.21.15.5:0/933506052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 msgr2=0x55ae6d4ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 0x55ae6d4ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 -- 172.21.15.5:0/933506052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 msgr2=0x55ae6d4abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 0x55ae6d4abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.668+0000 7f022f59e700 1 -- 172.21.15.5:0/933506052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae6d21fde0 con 0x55ae6d4aac20 2023-10-07T00:13:38.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.669+0000 7f022f59e700 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f02280194d0 tx=0x7f02280197e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3533fba9facf7703 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.669+0000 7f022f59e700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02180a1500 0x7f02180a39c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0228019be0 tx=0x7f022801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.669+0000 7f02157fa700 1 -- 172.21.15.5:0/933506052 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228025070 con 0x55ae6d4aac20 2023-10-07T00:13:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.669+0000 7f02157fa700 1 -- 172.21.15.5:0/933506052 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0228012380 con 0x55ae6d4aac20 2023-10-07T00:13:38.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.669+0000 7f02157fa700 1 -- 172.21.15.5:0/933506052 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022800e040 con 0x55ae6d4aac20 2023-10-07T00:13:38.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.670+0000 7f0248a93b80 1 -- 172.21.15.5:0/933506052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 msgr2=0x55ae6d4ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.670+0000 7f0248a93b80 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f02280194d0 tx=0x7f02280197e0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.670+0000 7f0248a93b80 1 -- 172.21.15.5:0/933506052 shutdown_connections 2023-10-07T00:13:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.670+0000 7f0248a93b80 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 0x55ae6d4ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.670+0000 7f0248a93b80 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.670+0000 7f0248a93b80 1 --2- 172.21.15.5:0/933506052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 0x55ae6d4abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.670+0000 7f0248a93b80 1 -- 172.21.15.5:0/933506052 >> 172.21.15.5:0/933506052 conn(0x55ae6d416260 msgr2=0x55ae6d49d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.671+0000 7f0248a93b80 1 -- 172.21.15.5:0/933506052 shutdown_connections 2023-10-07T00:13:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.671+0000 7f0248a93b80 1 -- 172.21.15.5:0/933506052 wait complete. 2023-10-07T00:13:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.671+0000 7f0248a93b80 1 -- start start 2023-10-07T00:13:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.672+0000 7f0248a93b80 1 Processor -- start 2023-10-07T00:13:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.672+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.672+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 0x55ae6d4b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.672+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ac470 0x55ae6d4bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.672+0000 7f0248a93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d3f4e30 con 0x55ae6d4ac470 2023-10-07T00:13:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.672+0000 7f0248a93b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d391710 con 0x55ae6d4ab580 2023-10-07T00:13:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.672+0000 7f0248a93b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d3913b0 con 0x55ae6d4aac20 2023-10-07T00:13:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f0248a93b80 10 client.0 _ll_register_callbacks cb 0x55ae6d1ee800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49344/0 (socket says 172.21.15.5:49344) 2023-10-07T00:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022ed9d700 1 -- 172.21.15.5:0/1414851381 learned_addr learned my addr 172.21.15.5:0/1414851381 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022f59e700 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ac470 0x55ae6d4bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022e59c700 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 0x55ae6d4b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022ed9d700 1 -- 172.21.15.5:0/1414851381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 msgr2=0x55ae6d4b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022ed9d700 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 0x55ae6d4b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022ed9d700 1 -- 172.21.15.5:0/1414851381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ac470 msgr2=0x55ae6d4bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022ed9d700 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ac470 0x55ae6d4bbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022ed9d700 1 -- 172.21.15.5:0/1414851381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0228012c90 con 0x55ae6d4aac20 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.673+0000 7f022f59e700 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ac470 0x55ae6d4bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.674+0000 7f022ed9d700 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b4a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f02200098f0 tx=0x7f022000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365a8a718b04d45c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.674+0000 7f0212ff5700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.674+0000 7f0212ff5700 1 -- 172.21.15.5:0/1414851381 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220026070 con 0x55ae6d4aac20 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.674+0000 7f0248a93b80 1 -- 172.21.15.5:0/1414851381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae6d495160 con 0x55ae6d4aac20 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0212ff5700 1 -- 172.21.15.5:0/1414851381 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f022000b770 con 0x55ae6d4aac20 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0212ff5700 1 -- 172.21.15.5:0/1414851381 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f022001c070 con 0x55ae6d4aac20 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0248a93b80 10 client.25579 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0248a93b80 1 -- 172.21.15.5:0/1414851381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ae6d208c60 con 0x55ae6d4aac20 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0212ff5700 1 -- 172.21.15.5:0/1414851381 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0220030080 con 0x55ae6d4aac20 2023-10-07T00:13:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0212ff5700 1 -- 172.21.15.5:0/1414851381 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0220029020 con 0x55ae6d4aac20 2023-10-07T00:13:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0248a93b80 10 client.25579 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0248a93b80 10 client.25579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0248a93b80 20 client.25579 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.675+0000 7f0248a93b80 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ae6d4c0890 0x55ae6d4c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.676+0000 7f0248a93b80 4 client.25579 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.676+0000 7f0248a93b80 1 -- 172.21.15.5:0/1414851381 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae6d3ede10 con 0x55ae6d4c0890 2023-10-07T00:13:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.676+0000 7f022e59c700 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ae6d4c0890 0x55ae6d4c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.677+0000 7f022e59c700 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ae6d4c0890 0x55ae6d4c2cb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41fca03fd9081b23 server_cookie=cbaa5f138de9d789 in_seq=0 out_seq=0 2023-10-07T00:13:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.677+0000 7f0212ff5700 10 client.25579 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.677+0000 7f0212ff5700 1 -- 172.21.15.5:0/1414851381 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ae6d3ede10 con 0x55ae6d4c0890 2023-10-07T00:13:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.677+0000 7f0212ff5700 10 client.25579 handle_command_reply: tid=0 2023-10-07T00:13:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 client.25579 shutdown 2023-10-07T00:13:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 -- 172.21.15.5:0/1414851381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 msgr2=0x55ae6d4b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b4a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f02200098f0 tx=0x7f022000f690 comp rx=0 tx=0).stop 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 -- 172.21.15.5:0/1414851381 shutdown_connections 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ae6d4c0890 0x55ae6d4c2cb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ac470 0x55ae6d4bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b4a10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 --2- 172.21.15.5:0/1414851381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 0x55ae6d4b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 -- 172.21.15.5:0/1414851381 >> 172.21.15.5:0/1414851381 conn(0x55ae6d416260 msgr2=0x55ae6d49d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0212ff5700 0 client.25579 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 -- 172.21.15.5:0/1414851381 shutdown_connections 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.678+0000 7f0248a93b80 1 -- 172.21.15.5:0/1414851381 wait complete. 2023-10-07T00:13:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.679+0000 7f0248a93b80 20 client.25579 trim_cache size 0 max 16384 2023-10-07T00:13:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.702+0000 7f0248a93b80 1 Processor -- start 2023-10-07T00:13:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f0248a93b80 1 -- start start 2023-10-07T00:13:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 0x55ae6d4bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4ac470 0x55ae6d4b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f0248a93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d275920 con 0x55ae6d4aac20 2023-10-07T00:13:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f0248a93b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d49e040 con 0x55ae6d4ab580 2023-10-07T00:13:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f0248a93b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d4b3ef0 con 0x55ae6d4ac470 2023-10-07T00:13:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f022ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f022ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36862/0 (socket says 172.21.15.5:36862) 2023-10-07T00:13:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.703+0000 7f022ed9d700 1 -- 172.21.15.5:0/2715520741 learned_addr learned my addr 172.21.15.5:0/2715520741 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f022f59e700 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4ac470 0x55ae6d4b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f022e59c700 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 0x55ae6d4bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f022ed9d700 1 -- 172.21.15.5:0/2715520741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4ac470 msgr2=0x55ae6d4b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f022ed9d700 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4ac470 0x55ae6d4b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f022ed9d700 1 -- 172.21.15.5:0/2715520741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 msgr2=0x55ae6d4bbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f022ed9d700 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 0x55ae6d4bbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f022ed9d700 1 -- 172.21.15.5:0/2715520741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae6d246250 con 0x55ae6d4aac20 2023-10-07T00:13:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f022ed9d700 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab000 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0220009c40 tx=0x7f022000b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13761ddf1195515 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f0215ffb700 1 -- 172.21.15.5:0/2715520741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220026040 con 0x55ae6d4aac20 2023-10-07T00:13:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f0215ffb700 1 -- 172.21.15.5:0/2715520741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ae6d495160 con 0x55ae6d4aac20 2023-10-07T00:13:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.704+0000 7f0215ffb700 1 -- 172.21.15.5:0/2715520741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022001c040 con 0x55ae6d4aac20 2023-10-07T00:13:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.705+0000 7f0248a93b80 1 -- 172.21.15.5:0/2715520741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4aac20 msgr2=0x55ae6d4ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.705+0000 7f0248a93b80 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab000 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0220009c40 tx=0x7f022000b2c0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.706+0000 7f0248a93b80 1 -- 172.21.15.5:0/2715520741 shutdown_connections 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.706+0000 7f0248a93b80 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4ac470 0x55ae6d4b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.706+0000 7f0248a93b80 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4aac20 0x55ae6d4ab000 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.706+0000 7f0248a93b80 1 --2- 172.21.15.5:0/2715520741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ab580 0x55ae6d4bbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.706+0000 7f0248a93b80 1 -- 172.21.15.5:0/2715520741 >> 172.21.15.5:0/2715520741 conn(0x55ae6d416260 msgr2=0x55ae6d4b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.706+0000 7f0248a93b80 1 -- 172.21.15.5:0/2715520741 shutdown_connections 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.706+0000 7f0248a93b80 1 -- 172.21.15.5:0/2715520741 wait complete. 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.706+0000 7f0248a93b80 1 -- start start 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.707+0000 7f0248a93b80 1 Processor -- start 2023-10-07T00:13:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.707+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.707+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 0x55ae6d4b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.707+0000 7f0248a93b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 0x55ae6d4bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.707+0000 7f0248a93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d4bb1f0 con 0x55ae6d4ab580 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.707+0000 7f0248a93b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d4bb360 con 0x55ae6d4ac470 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.707+0000 7f0248a93b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae6d4bb520 con 0x55ae6d4aac20 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.707+0000 7f0248a93b80 10 client.0 _ll_register_callbacks cb 0x55ae6d1ee800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49366/0 (socket says 172.21.15.5:49366) 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022ed9d700 1 -- 172.21.15.5:0/4025559374 learned_addr learned my addr 172.21.15.5:0/4025559374 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022e59c700 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 0x55ae6d4b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022ed9d700 1 -- 172.21.15.5:0/4025559374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 msgr2=0x55ae6d4bacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022ed9d700 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 0x55ae6d4bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022ed9d700 1 -- 172.21.15.5:0/4025559374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 msgr2=0x55ae6d4b9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022ed9d700 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 0x55ae6d4b9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.708+0000 7f022ed9d700 1 -- 172.21.15.5:0/4025559374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae6d208c60 con 0x55ae6d4aac20 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.709+0000 7f022ed9d700 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b9760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f022000bbc0 tx=0x7f0220003930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5343eb51d348cf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.709+0000 7f0212ff5700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.709+0000 7f0212ff5700 1 -- 172.21.15.5:0/4025559374 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220026070 con 0x55ae6d4aac20 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.709+0000 7f0212ff5700 1 -- 172.21.15.5:0/4025559374 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0220000e40 con 0x55ae6d4aac20 2023-10-07T00:13:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.709+0000 7f0248a93b80 1 -- 172.21.15.5:0/4025559374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0228012380 con 0x55ae6d4aac20 2023-10-07T00:13:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.710+0000 7f0212ff5700 1 -- 172.21.15.5:0/4025559374 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f022001c070 con 0x55ae6d4aac20 2023-10-07T00:13:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.710+0000 7f0248a93b80 10 client.25585 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.710+0000 7f0248a93b80 1 -- 172.21.15.5:0/4025559374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ae6d21e2b0 con 0x55ae6d4aac20 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.710+0000 7f0212ff5700 1 -- 172.21.15.5:0/4025559374 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0228012380 con 0x55ae6d4aac20 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.711+0000 7f0212ff5700 1 -- 172.21.15.5:0/4025559374 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0220035070 con 0x55ae6d4aac20 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.711+0000 7f0248a93b80 10 client.25585 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.711+0000 7f0248a93b80 10 client.25585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.711+0000 7f0248a93b80 20 client.25585 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.711+0000 7f0248a93b80 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ae6d514b70 0x55ae6d516f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.711+0000 7f0248a93b80 4 client.25585 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.711+0000 7f0248a93b80 1 -- 172.21.15.5:0/4025559374 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ae6d3edb30 con 0x55ae6d514b70 2023-10-07T00:13:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.712+0000 7f022e59c700 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ae6d514b70 0x55ae6d516f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.712+0000 7f022e59c700 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ae6d514b70 0x55ae6d516f90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d0c5d857986b2b server_cookie=58b0eba8abbcfb6d in_seq=0 out_seq=0 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0212ff5700 10 client.25585 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0212ff5700 1 -- 172.21.15.5:0/4025559374 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ae6d3edb30 con 0x55ae6d514b70 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0212ff5700 10 client.25585 handle_command_reply: tid=0 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 client.25585 shutdown 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 -- 172.21.15.5:0/4025559374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 msgr2=0x55ae6d4b9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b9760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f022000bbc0 tx=0x7f0220003930 comp rx=0 tx=0).stop 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 -- 172.21.15.5:0/4025559374 shutdown_connections 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55ae6d514b70 0x55ae6d516f90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ae6d4ac470 0x55ae6d4bacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ae6d4aac20 0x55ae6d4b9760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 --2- 172.21.15.5:0/4025559374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae6d4ab580 0x55ae6d4b9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 -- 172.21.15.5:0/4025559374 >> 172.21.15.5:0/4025559374 conn(0x55ae6d416260 msgr2=0x55ae6d4b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0212ff5700 0 client.25585 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 -- 172.21.15.5:0/4025559374 shutdown_connections 2023-10-07T00:13:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.713+0000 7f0248a93b80 1 -- 172.21.15.5:0/4025559374 wait complete. 2023-10-07T00:13:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f0248a93b80 20 client.25585 trim_cache size 0 max 16384 2023-10-07T00:13:38.719 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:13:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 -- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02180a1500 msgr2=0x7f02180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02180a1500 0x7f02180a39c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0228019be0 tx=0x7f022801d000 comp rx=0 tx=0).stop 2023-10-07T00:13:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 -- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0230104140 msgr2=0x7f02300ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0230104140 0x7f02300ff7c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f022400ec10 tx=0x7f022400ef20 comp rx=0 tx=0).stop 2023-10-07T00:13:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 -- 172.21.15.5:0/3291197979 shutdown_connections 2023-10-07T00:13:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f02180a1500 0x7f02180a39c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0230106a70 0x7f02300ffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0230101810 0x7f0230101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 --2- 172.21.15.5:0/3291197979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0230104140 0x7f02300ff7c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.714+0000 7f02349fe700 1 -- 172.21.15.5:0/3291197979 >> 172.21.15.5:0/3291197979 conn(0x7f02300fb120 msgr2=0x7f0230102480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.715+0000 7f02349fe700 1 -- 172.21.15.5:0/3291197979 shutdown_connections 2023-10-07T00:13:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:38.715+0000 7f02349fe700 1 -- 172.21.15.5:0/3291197979 wait complete. 2023-10-07T00:13:39.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:38 smithi005 ceph-mon[129406]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:38 smithi088 ceph-mon[103111]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:38 smithi112 ceph-mon[133548]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:39.735 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-07T00:13:39.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-07T00:13:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3942164571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 msgr2=0x7f4e20100340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3942164571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 0x7f4e20100340 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009990 tx=0x7f4e14009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3942164571 shutdown_connections 2023-10-07T00:13:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3942164571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e20100880 0x7f4e20100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3942164571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e200ff560 0x7f4e200ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3942164571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 0x7f4e20100340 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3942164571 >> 172.21.15.5:0/3942164571 conn(0x7f4e200fb120 msgr2=0x7f4e200fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3942164571 shutdown_connections 2023-10-07T00:13:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:39.998+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3942164571 wait complete. 2023-10-07T00:13:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.000+0000 7f4e1ffff700 1 Processor -- start 2023-10-07T00:13:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.000+0000 7f4e1ffff700 1 -- start start 2023-10-07T00:13:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.000+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e200ff560 0x7f4e20198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.000+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 0x7f4e20199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e20100880 0x7f4e201a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1ffff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e201a0680 con 0x7f4e200ffec0 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e201a07c0 con 0x7f4e200ff560 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1ffff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e201a0950 con 0x7f4e20100880 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 0x7f4e20199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 0x7f4e20199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36880/0 (socket says 172.21.15.5:36880) 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1e7fc700 1 -- 172.21.15.5:0/3183043457 learned_addr learned my addr 172.21.15.5:0/3183043457 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1f7fe700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e20100880 0x7f4e201a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1effd700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e200ff560 0x7f4e20198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1e7fc700 1 -- 172.21.15.5:0/3183043457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e20100880 msgr2=0x7f4e201a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e20100880 0x7f4e201a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1e7fc700 1 -- 172.21.15.5:0/3183043457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e200ff560 msgr2=0x7f4e20198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e200ff560 0x7f4e20198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.001+0000 7f4e1e7fc700 1 -- 172.21.15.5:0/3183043457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140095f0 con 0x7f4e200ffec0 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.002+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 0x7f4e20199040 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4e14005910 tx=0x7f4e14005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.002+0000 7f4e07fff700 1 -- 172.21.15.5:0/3183043457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1401d070 con 0x7f4e200ffec0 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.002+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3183043457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e201a0bd0 con 0x7f4e200ffec0 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.002+0000 7f4e07fff700 1 -- 172.21.15.5:0/3183043457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e1400be70 con 0x7f4e200ffec0 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.002+0000 7f4e07fff700 1 -- 172.21.15.5:0/3183043457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14022e60 con 0x7f4e200ffec0 2023-10-07T00:13:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.002+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3183043457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e201a0ff0 con 0x7f4e200ffec0 2023-10-07T00:13:40.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.006+0000 7f4e07fff700 1 -- 172.21.15.5:0/3183043457 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4e14022600 con 0x7f4e200ffec0 2023-10-07T00:13:40.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.008+0000 7f4e38c66b80 1 Processor -- start 2023-10-07T00:13:40.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.008+0000 7f4e07fff700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4e080a1480 0x7f4e080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.008+0000 7f4e07fff700 1 -- 172.21.15.5:0/3183043457 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4e140ce140 con 0x7f4e200ffec0 2023-10-07T00:13:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.008+0000 7f4e38c66b80 1 -- start start 2023-10-07T00:13:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.008+0000 7f4e1f7fe700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4e080a1480 0x7f4e080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2594ca0 0x55d4f25950c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f2595f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f25964f0 0x55d4f2596970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f24f44e0 con 0x55d4f25964f0 2023-10-07T00:13:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f24e5ca0 con 0x55d4f2595600 2023-10-07T00:13:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f24e35c0 con 0x55d4f2594ca0 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e1effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2594ca0 0x55d4f25950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e1f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f25964f0 0x55d4f2596970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e1effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2594ca0 0x55d4f25950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49382/0 (socket says 172.21.15.5:49382) 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.009+0000 7f4e1effd700 1 -- 172.21.15.5:0/2858583362 learned_addr learned my addr 172.21.15.5:0/2858583362 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/2858583362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f2595f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e1f7fe700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4e080a1480 0x7f4e080a3940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800f590 tx=0x7f4e18009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e1effd700 1 -- 172.21.15.5:0/2858583362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 msgr2=0x55d4f2595f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e1effd700 1 --2- 172.21.15.5:0/2858583362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f2595f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e1effd700 1 -- 172.21.15.5:0/2858583362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f25964f0 msgr2=0x55d4f2596970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e1effd700 1 --2- 172.21.15.5:0/2858583362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f25964f0 0x55d4f2596970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e1effd700 1 -- 172.21.15.5:0/2858583362 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4f2309e60 con 0x55d4f2594ca0 2023-10-07T00:13:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e1effd700 1 --2- 172.21.15.5:0/2858583362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2594ca0 0x55d4f25950c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009d80 tx=0x7f4e10011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7dba31d09fb9ff server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.010+0000 7f4e057fa700 1 -- 172.21.15.5:0/2858583362 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10004230 con 0x55d4f2594ca0 2023-10-07T00:13:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e057fa700 1 -- 172.21.15.5:0/2858583362 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e10004390 con 0x55d4f2594ca0 2023-10-07T00:13:40.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e057fa700 1 -- 172.21.15.5:0/2858583362 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10019800 con 0x55d4f2594ca0 2023-10-07T00:13:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e38c66b80 1 -- 172.21.15.5:0/2858583362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2594ca0 msgr2=0x55d4f25950c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/2858583362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2594ca0 0x55d4f25950c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009d80 tx=0x7f4e10011720 comp rx=0 tx=0).stop 2023-10-07T00:13:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e38c66b80 1 -- 172.21.15.5:0/2858583362 shutdown_connections 2023-10-07T00:13:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/2858583362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f25964f0 0x55d4f2596970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/2858583362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2594ca0 0x55d4f25950c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/2858583362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f2595f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.011+0000 7f4e38c66b80 1 -- 172.21.15.5:0/2858583362 >> 172.21.15.5:0/2858583362 conn(0x55d4f25002e0 msgr2=0x55d4f2587360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.012+0000 7f4e38c66b80 1 -- 172.21.15.5:0/2858583362 shutdown_connections 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.012+0000 7f4e38c66b80 1 -- 172.21.15.5:0/2858583362 wait complete. 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.012+0000 7f4e38c66b80 1 -- start start 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.013+0000 7f4e38c66b80 1 Processor -- start 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.013+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f259eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.013+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2595600 0x55d4f259f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.013+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f25964f0 0x55d4f25a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.013+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f24deeb0 con 0x55d4f2594ca0 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.013+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f247b790 con 0x55d4f25964f0 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.013+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f247b430 con 0x55d4f2595600 2023-10-07T00:13:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.013+0000 7f4e38c66b80 10 client.0 _ll_register_callbacks cb 0x55d4f22d8880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f259eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f259eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36904/0 (socket says 172.21.15.5:36904) 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1effd700 1 -- 172.21.15.5:0/4243715554 learned_addr learned my addr 172.21.15.5:0/4243715554 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2595600 0x55d4f259f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1f7fe700 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f25964f0 0x55d4f25a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1effd700 1 -- 172.21.15.5:0/4243715554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2595600 msgr2=0x55d4f259f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1effd700 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2595600 0x55d4f259f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1effd700 1 -- 172.21.15.5:0/4243715554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f25964f0 msgr2=0x55d4f25a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1effd700 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f25964f0 0x55d4f25a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.014+0000 7f4e1effd700 1 -- 172.21.15.5:0/4243715554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100099e0 con 0x55d4f2594ca0 2023-10-07T00:13:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.015+0000 7f4e1effd700 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f259eb20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4e10000c00 tx=0x7f4e10003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515bcd8b7eb926e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.015+0000 7f4e02ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.015+0000 7f4e02ff5700 1 -- 172.21.15.5:0/4243715554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10005450 con 0x55d4f2594ca0 2023-10-07T00:13:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.015+0000 7f4e38c66b80 1 -- 172.21.15.5:0/4243715554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4f257f1e0 con 0x55d4f2594ca0 2023-10-07T00:13:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.015+0000 7f4e02ff5700 1 -- 172.21.15.5:0/4243715554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4e10005ce0 con 0x55d4f2594ca0 2023-10-07T00:13:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.015+0000 7f4e02ff5700 1 -- 172.21.15.5:0/4243715554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e10004500 con 0x55d4f2594ca0 2023-10-07T00:13:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.015+0000 7f4e38c66b80 10 client.15834 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:40.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.015+0000 7f4e38c66b80 1 -- 172.21.15.5:0/4243715554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d4f22f2ce0 con 0x55d4f2594ca0 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.016+0000 7f4e02ff5700 1 -- 172.21.15.5:0/4243715554 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d4f257f1e0 con 0x55d4f2594ca0 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.016+0000 7f4e02ff5700 1 -- 172.21.15.5:0/4243715554 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4e10021040 con 0x55d4f2594ca0 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.016+0000 7f4e38c66b80 10 client.15834 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.016+0000 7f4e38c66b80 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.016+0000 7f4e38c66b80 20 client.15834 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.016+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55d4f25aa810 0x55d4f25acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.016+0000 7f4e38c66b80 4 client.15834 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.016+0000 7f4e38c66b80 1 -- 172.21.15.5:0/4243715554 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4f24d7e90 con 0x55d4f25aa810 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.017+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55d4f25aa810 0x55d4f25acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.017+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55d4f25aa810 0x55d4f25acc30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69ab882ad244d06b server_cookie=668f9d65a3102149 in_seq=0 out_seq=0 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.017+0000 7f4e02ff5700 10 client.15834 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.018+0000 7f4e02ff5700 1 -- 172.21.15.5:0/4243715554 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d4f24d7e90 con 0x55d4f25aa810 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.018+0000 7f4e02ff5700 10 client.15834 handle_command_reply: tid=0 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.018+0000 7f4e38c66b80 1 client.15834 shutdown 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.018+0000 7f4e38c66b80 1 -- 172.21.15.5:0/4243715554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 msgr2=0x55d4f259eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.018+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f259eb20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4e10000c00 tx=0x7f4e10003890 comp rx=0 tx=0).stop 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 1 -- 172.21.15.5:0/4243715554 shutdown_connections 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55d4f25aa810 0x55d4f25acc30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f25964f0 0x55d4f25a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f259eb20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/4243715554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f2595600 0x55d4f259f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 1 -- 172.21.15.5:0/4243715554 >> 172.21.15.5:0/4243715554 conn(0x55d4f25002e0 msgr2=0x55d4f25871b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e02ff5700 0 client.15834 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 1 -- 172.21.15.5:0/4243715554 shutdown_connections 2023-10-07T00:13:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 1 -- 172.21.15.5:0/4243715554 wait complete. 2023-10-07T00:13:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.019+0000 7f4e38c66b80 20 client.15834 trim_cache size 0 max 16384 2023-10-07T00:13:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.045+0000 7f4e38c66b80 1 Processor -- start 2023-10-07T00:13:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.045+0000 7f4e38c66b80 1 -- start start 2023-10-07T00:13:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2594ca0 0x55d4f259e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2595600 0x55d4f25a6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 0x55d4f259ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f235f9a0 con 0x55d4f2595600 2023-10-07T00:13:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f2595d00 con 0x55d4f2594ca0 2023-10-07T00:13:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f259c750 con 0x55d4f25964f0 2023-10-07T00:13:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e1e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2595600 0x55d4f25a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e1e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2595600 0x55d4f25a6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36906/0 (socket says 172.21.15.5:36906) 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.046+0000 7f4e1e7fc700 1 -- 172.21.15.5:0/991756579 learned_addr learned my addr 172.21.15.5:0/991756579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1f7fe700 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 0x55d4f259ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1effd700 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2594ca0 0x55d4f259e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1e7fc700 1 -- 172.21.15.5:0/991756579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 msgr2=0x55d4f259ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 0x55d4f259ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1e7fc700 1 -- 172.21.15.5:0/991756579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2594ca0 msgr2=0x55d4f259e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2594ca0 0x55d4f259e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1e7fc700 1 -- 172.21.15.5:0/991756579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4f23302d0 con 0x55d4f2595600 2023-10-07T00:13:40.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1effd700 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2594ca0 0x55d4f259e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.047+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2595600 0x55d4f25a6060 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4e140cbbc0 tx=0x7f4e1401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1429e398c3936b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e05ffb700 1 -- 172.21.15.5:0/991756579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140b3ea0 con 0x55d4f2595600 2023-10-07T00:13:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e05ffb700 1 -- 172.21.15.5:0/991756579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e1409bb70 con 0x55d4f2595600 2023-10-07T00:13:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e05ffb700 1 -- 172.21.15.5:0/991756579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14099810 con 0x55d4f2595600 2023-10-07T00:13:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e38c66b80 1 -- 172.21.15.5:0/991756579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2595600 msgr2=0x55d4f25a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2595600 0x55d4f25a6060 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4e140cbbc0 tx=0x7f4e1401a040 comp rx=0 tx=0).stop 2023-10-07T00:13:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e38c66b80 1 -- 172.21.15.5:0/991756579 shutdown_connections 2023-10-07T00:13:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 0x55d4f259ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2594ca0 0x55d4f259e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/991756579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2595600 0x55d4f25a6060 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.048+0000 7f4e38c66b80 1 -- 172.21.15.5:0/991756579 >> 172.21.15.5:0/991756579 conn(0x55d4f25002e0 msgr2=0x55d4f25994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.049+0000 7f4e38c66b80 1 -- 172.21.15.5:0/991756579 shutdown_connections 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.049+0000 7f4e38c66b80 1 -- 172.21.15.5:0/991756579 wait complete. 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.049+0000 7f4e38c66b80 1 -- start start 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.049+0000 7f4e38c66b80 1 Processor -- start 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.050+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f25a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.050+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f25a5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.050+0000 7f4e38c66b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 0x55d4f25fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.050+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f25a5b40 con 0x55d4f2594ca0 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.050+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f25feb90 con 0x55d4f2595600 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.050+0000 7f4e38c66b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f25fed50 con 0x55d4f25964f0 2023-10-07T00:13:40.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.050+0000 7f4e38c66b80 10 client.0 _ll_register_callbacks cb 0x7f4e1800fd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f25a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 0x55d4f25fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f25a4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36908/0 (socket says 172.21.15.5:36908) 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 -- 172.21.15.5:0/688123425 learned_addr learned my addr 172.21.15.5:0/688123425 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f25a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 -- 172.21.15.5:0/688123425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 msgr2=0x55d4f25fe650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 0x55d4f25fe650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 -- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 msgr2=0x55d4f25a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f25a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 -- 172.21.15.5:0/688123425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4f22f2ce0 con 0x55d4f2594ca0 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f25a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e1effd700 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f25a4f10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4e10031040 tx=0x7f4e10009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435886f444a72a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.051+0000 7f4e02ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.052+0000 7f4e02ff5700 1 -- 172.21.15.5:0/688123425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10009ed0 con 0x55d4f2594ca0 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.052+0000 7f4e38c66b80 1 -- 172.21.15.5:0/688123425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e10004390 con 0x55d4f2594ca0 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.052+0000 7f4e02ff5700 1 -- 172.21.15.5:0/688123425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4e10000e40 con 0x55d4f2594ca0 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.052+0000 7f4e02ff5700 1 -- 172.21.15.5:0/688123425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e10019aa0 con 0x55d4f2594ca0 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.052+0000 7f4e38c66b80 10 client.15840 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:40.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.052+0000 7f4e38c66b80 1 -- 172.21.15.5:0/688123425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f4e201a0ff0 con 0x55d4f2594ca0 2023-10-07T00:13:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.052+0000 7f4e02ff5700 1 -- 172.21.15.5:0/688123425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e10004390 con 0x55d4f2594ca0 2023-10-07T00:13:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.052+0000 7f4e02ff5700 1 -- 172.21.15.5:0/688123425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4e1003f020 con 0x55d4f2594ca0 2023-10-07T00:13:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.053+0000 7f4e38c66b80 10 client.15840 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.053+0000 7f4e38c66b80 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.053+0000 7f4e38c66b80 20 client.15840 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.053+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55d4f2600450 0x55d4f2602870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.053+0000 7f4e38c66b80 4 client.15840 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-07T00:13:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.053+0000 7f4e38c66b80 1 -- 172.21.15.5:0/688123425 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d4f24d7bb0 con 0x55d4f2600450 2023-10-07T00:13:40.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.053+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55d4f2600450 0x55d4f2602870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.054+0000 7f4e02ff5700 10 client.15840 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:40.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.054+0000 7f4e1e7fc700 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55d4f2600450 0x55d4f2602870 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=508dc52054dbf61f server_cookie=75ff686fce4741a8 in_seq=0 out_seq=0 2023-10-07T00:13:40.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e02ff5700 1 -- 172.21.15.5:0/688123425 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d4f24d7bb0 con 0x55d4f2600450 2023-10-07T00:13:40.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e02ff5700 10 client.15840 handle_command_reply: tid=0 2023-10-07T00:13:40.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 client.15840 shutdown 2023-10-07T00:13:40.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 -- 172.21.15.5:0/688123425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 msgr2=0x55d4f25a4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f25a4f10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4e10031040 tx=0x7f4e10009740 comp rx=0 tx=0).stop 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 -- 172.21.15.5:0/688123425 shutdown_connections 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55d4f2600450 0x55d4f2602870 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d4f25964f0 0x55d4f25fe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4f2594ca0 0x55d4f25a4f10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 --2- 172.21.15.5:0/688123425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d4f2595600 0x55d4f25a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.055+0000 7f4e38c66b80 1 -- 172.21.15.5:0/688123425 >> 172.21.15.5:0/688123425 conn(0x55d4f25002e0 msgr2=0x55d4f259e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.056+0000 7f4e02ff5700 0 client.15840 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.056+0000 7f4e38c66b80 1 -- 172.21.15.5:0/688123425 shutdown_connections 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.056+0000 7f4e38c66b80 1 -- 172.21.15.5:0/688123425 wait complete. 2023-10-07T00:13:40.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.056+0000 7f4e38c66b80 20 client.15840 trim_cache size 0 max 16384 2023-10-07T00:13:40.063 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:13:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2023-10-07T00:13:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "c74b600c-6075-4c9f-844e-1c32527b9d39", 2023-10-07T00:13:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2023-10-07T00:13:40.063 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4e080a1480 msgr2=0x7f4e080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4e080a1480 0x7f4e080a3940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800f590 tx=0x7f4e18009920 comp rx=0 tx=0).stop 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 msgr2=0x7f4e20199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 0x7f4e20199040 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4e14005910 tx=0x7f4e14005740 comp rx=0 tx=0).stop 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3183043457 shutdown_connections 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4e080a1480 0x7f4e080a3940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e20100880 0x7f4e201a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e200ff560 0x7f4e20198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 --2- 172.21.15.5:0/3183043457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e200ffec0 0x7f4e20199040 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3183043457 >> 172.21.15.5:0/3183043457 conn(0x7f4e200fb120 msgr2=0x7f4e200fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3183043457 shutdown_connections 2023-10-07T00:13:40.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.057+0000 7f4e1ffff700 1 -- 172.21.15.5:0/3183043457 wait complete. 2023-10-07T00:13:40.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:13:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.293+0000 7f810e9ff700 1 -- 172.21.15.5:0/2418838244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108104370 msgr2=0x7f8108106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.293+0000 7f810e9ff700 1 --2- 172.21.15.5:0/2418838244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108104370 0x7f8108106760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009990 tx=0x7f80fc009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.294+0000 7f810e9ff700 1 -- 172.21.15.5:0/2418838244 shutdown_connections 2023-10-07T00:13:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.294+0000 7f810e9ff700 1 --2- 172.21.15.5:0/2418838244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108106ca0 0x7f8108109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.294+0000 7f810e9ff700 1 --2- 172.21.15.5:0/2418838244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8108101a40 0x7f8108103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.294+0000 7f810e9ff700 1 --2- 172.21.15.5:0/2418838244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108104370 0x7f8108106760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.294+0000 7f810e9ff700 1 -- 172.21.15.5:0/2418838244 >> 172.21.15.5:0/2418838244 conn(0x7f81080fb450 msgr2=0x7f81080fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.294+0000 7f810e9ff700 1 -- 172.21.15.5:0/2418838244 shutdown_connections 2023-10-07T00:13:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.294+0000 7f810e9ff700 1 -- 172.21.15.5:0/2418838244 wait complete. 2023-10-07T00:13:40.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.295+0000 7f810e9ff700 1 Processor -- start 2023-10-07T00:13:40.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f810e9ff700 1 -- start start 2023-10-07T00:13:40.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f810e9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108101a40 0x7f8108196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f810e9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8108104370 0x7f81081970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f810e9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108106ca0 0x7f810819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f810e9ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810819e6f0 con 0x7f8108104370 2023-10-07T00:13:40.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f810e9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810819e830 con 0x7f8108106ca0 2023-10-07T00:13:40.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f810e9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810819e9c0 con 0x7f8108101a40 2023-10-07T00:13:40.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f81077fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8108104370 0x7f81081970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f81077fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8108104370 0x7f81081970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36922/0 (socket says 172.21.15.5:36922) 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.296+0000 7f81077fe700 1 -- 172.21.15.5:0/3019471844 learned_addr learned my addr 172.21.15.5:0/3019471844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f810cf9c700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108106ca0 0x7f810819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f8107fff700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108101a40 0x7f8108196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f81077fe700 1 -- 172.21.15.5:0/3019471844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108101a40 msgr2=0x7f8108196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f81077fe700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108101a40 0x7f8108196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f81077fe700 1 -- 172.21.15.5:0/3019471844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108106ca0 msgr2=0x7f810819e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f81077fe700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108106ca0 0x7f810819e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f81077fe700 1 -- 172.21.15.5:0/3019471844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0095f0 con 0x7f8108104370 2023-10-07T00:13:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f8107fff700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108101a40 0x7f8108196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.297+0000 7f81077fe700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8108104370 0x7f81081970b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0059d0 tx=0x7f80fc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.298+0000 7f81057fa700 1 -- 172.21.15.5:0/3019471844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc01d070 con 0x7f8108104370 2023-10-07T00:13:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.298+0000 7f810e9ff700 1 -- 172.21.15.5:0/3019471844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810819ec40 con 0x7f8108104370 2023-10-07T00:13:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.298+0000 7f81057fa700 1 -- 172.21.15.5:0/3019471844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f80fc00beb0 con 0x7f8108104370 2023-10-07T00:13:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.298+0000 7f81057fa700 1 -- 172.21.15.5:0/3019471844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00fe80 con 0x7f8108104370 2023-10-07T00:13:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.298+0000 7f810e9ff700 1 -- 172.21.15.5:0/3019471844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810819f140 con 0x7f8108104370 2023-10-07T00:13:40.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.303+0000 7f81057fa700 1 -- 172.21.15.5:0/3019471844 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f80fc00f640 con 0x7f8108104370 2023-10-07T00:13:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.304+0000 7f8122392b80 1 Processor -- start 2023-10-07T00:13:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.304+0000 7f8122392b80 1 -- start start 2023-10-07T00:13:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f8122392b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb8532a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f8122392b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb8533890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f8122392b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb85342f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f8122392b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb8496460 con 0x55beb8532fd0 2023-10-07T00:13:40.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f8122392b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb8487c20 con 0x55beb8533e70 2023-10-07T00:13:40.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f8122392b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb8485540 con 0x55beb8532670 2023-10-07T00:13:40.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f81057fa700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f80f00a1500 0x7f80f00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f81057fa700 1 -- 172.21.15.5:0/3019471844 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f80fc0ce140 con 0x7f8108104370 2023-10-07T00:13:40.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f8107fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb8533890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.305+0000 7f8107fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb8533890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36934/0 (socket says 172.21.15.5:36934) 2023-10-07T00:13:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f81077fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb85342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f8107fff700 1 -- 172.21.15.5:0/4139251514 learned_addr learned my addr 172.21.15.5:0/4139251514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f810cf9c700 1 --2- 172.21.15.5:0/4139251514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb8532a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f810cf9c700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f80f00a1500 0x7f80f00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f810cf9c700 1 -- 172.21.15.5:0/4139251514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 msgr2=0x55beb85342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f810cf9c700 1 --2- 172.21.15.5:0/4139251514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb85342f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f810cf9c700 1 -- 172.21.15.5:0/4139251514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 msgr2=0x55beb8533890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f810cf9c700 1 --2- 172.21.15.5:0/4139251514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb8533890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.306+0000 7f810cf9c700 1 -- 172.21.15.5:0/4139251514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55beb82abde0 con 0x55beb8532670 2023-10-07T00:13:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.307+0000 7f810cf9c700 1 --2- 172.21.15.5:0/4139251514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb8532a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8100008e60 tx=0x7f810001a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162ffeddf94b9e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.307+0000 7f810cf9c700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f80f00a1500 0x7f80f00a39c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f810001aa10 tx=0x7f8100018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.307+0000 7f80ee7fc700 1 -- 172.21.15.5:0/4139251514 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810000e040 con 0x55beb8532670 2023-10-07T00:13:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.307+0000 7f80ee7fc700 1 -- 172.21.15.5:0/4139251514 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f810000f040 con 0x55beb8532670 2023-10-07T00:13:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.307+0000 7f80ee7fc700 1 -- 172.21.15.5:0/4139251514 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100007bf0 con 0x55beb8532670 2023-10-07T00:13:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.308+0000 7f8122392b80 1 -- 172.21.15.5:0/4139251514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 msgr2=0x55beb8532a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.308+0000 7f8122392b80 1 --2- 172.21.15.5:0/4139251514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb8532a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8100008e60 tx=0x7f810001a6c0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.308+0000 7f8122392b80 1 -- 172.21.15.5:0/4139251514 shutdown_connections 2023-10-07T00:13:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.308+0000 7f8122392b80 1 --2- 172.21.15.5:0/4139251514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb85342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.308+0000 7f8122392b80 1 --2- 172.21.15.5:0/4139251514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb8532a90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.308+0000 7f8122392b80 1 --2- 172.21.15.5:0/4139251514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb8533890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.308+0000 7f8122392b80 1 -- 172.21.15.5:0/4139251514 >> 172.21.15.5:0/4139251514 conn(0x55beb84a2260 msgr2=0x55beb8529140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.309+0000 7f8122392b80 1 -- 172.21.15.5:0/4139251514 shutdown_connections 2023-10-07T00:13:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.309+0000 7f8122392b80 1 -- 172.21.15.5:0/4139251514 wait complete. 2023-10-07T00:13:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.309+0000 7f8122392b80 1 -- start start 2023-10-07T00:13:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.310+0000 7f8122392b80 1 Processor -- start 2023-10-07T00:13:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.310+0000 7f8122392b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.310+0000 7f8122392b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb853c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.310+0000 7f8122392b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8543920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.310+0000 7f8122392b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb8480e30 con 0x55beb8532fd0 2023-10-07T00:13:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.310+0000 7f8122392b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb841d710 con 0x55beb8533e70 2023-10-07T00:13:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.310+0000 7f8122392b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb841d3b0 con 0x55beb8532670 2023-10-07T00:13:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.310+0000 7f8122392b80 10 client.0 _ll_register_callbacks cb 0x55beb827a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.311+0000 7f8107fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.311+0000 7f810cf9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8543920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.311+0000 7f8107fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:49436/0 (socket says 172.21.15.5:49436) 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.311+0000 7f8107fff700 1 -- 172.21.15.5:0/3945800451 learned_addr learned my addr 172.21.15.5:0/3945800451 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.311+0000 7f81077fe700 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb853c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.311+0000 7f81077fe700 1 -- 172.21.15.5:0/3945800451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 msgr2=0x55beb853c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.311+0000 7f81077fe700 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.311+0000 7f81077fe700 1 -- 172.21.15.5:0/3945800451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 msgr2=0x55beb8543920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.312+0000 7f81077fe700 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8543920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.312+0000 7f81077fe700 1 -- 172.21.15.5:0/3945800451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8100008a40 con 0x55beb8532fd0 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.312+0000 7f81077fe700 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb853c8e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f80fc097970 tx=0x7f80fc09b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f878c5421fddddbb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.312+0000 7f80e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.312+0000 7f80e77fe700 1 -- 172.21.15.5:0/3945800451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0b3ea0 con 0x55beb8532fd0 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.312+0000 7f80e77fe700 1 -- 172.21.15.5:0/3945800451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f80fc00f460 con 0x55beb8532fd0 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.312+0000 7f8122392b80 1 -- 172.21.15.5:0/3945800451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55beb8520f10 con 0x55beb8532fd0 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.313+0000 7f80e77fe700 1 -- 172.21.15.5:0/3945800451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80fc09bb70 con 0x55beb8532fd0 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.313+0000 7f8122392b80 10 client.15852 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.313+0000 7f8122392b80 1 -- 172.21.15.5:0/3945800451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55beb8294c60 con 0x55beb8532fd0 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.313+0000 7f80e77fe700 1 -- 172.21.15.5:0/3945800451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55beb8520f10 con 0x55beb8532fd0 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.313+0000 7f80e77fe700 1 -- 172.21.15.5:0/3945800451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f80fc0a32e0 con 0x55beb8532fd0 2023-10-07T00:13:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.313+0000 7f8122392b80 10 client.15852 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.313+0000 7f8122392b80 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.313+0000 7f8122392b80 20 client.15852 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.314+0000 7f8122392b80 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55beb8547e80 0x55beb854a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.314+0000 7f8122392b80 4 client.15852 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.314+0000 7f8122392b80 1 -- 172.21.15.5:0/3945800451 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55beb8479e10 con 0x55beb8547e80 2023-10-07T00:13:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.314+0000 7f8107fff700 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55beb8547e80 0x55beb854a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.315+0000 7f8107fff700 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55beb8547e80 0x55beb854a2a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34ba9052b5c8ea61 server_cookie=6624e80fe96cf5a5 in_seq=0 out_seq=0 2023-10-07T00:13:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.315+0000 7f80e77fe700 10 client.15852 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:40.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f80e77fe700 1 -- 172.21.15.5:0/3945800451 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55beb8479e10 con 0x55beb8547e80 2023-10-07T00:13:40.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f80e77fe700 10 client.15852 handle_command_reply: tid=0 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 client.15852 shutdown 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 -- 172.21.15.5:0/3945800451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 msgr2=0x55beb853c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb853c8e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f80fc097970 tx=0x7f80fc09b9b0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 -- 172.21.15.5:0/3945800451 shutdown_connections 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55beb8547e80 0x55beb854a2a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8543920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 --2- 172.21.15.5:0/3945800451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532fd0 0x55beb853c8e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 -- 172.21.15.5:0/3945800451 >> 172.21.15.5:0/3945800451 conn(0x55beb84a2260 msgr2=0x55beb8528f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f80e77fe700 0 client.15852 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:40.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 -- 172.21.15.5:0/3945800451 shutdown_connections 2023-10-07T00:13:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.316+0000 7f8122392b80 1 -- 172.21.15.5:0/3945800451 wait complete. 2023-10-07T00:13:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.317+0000 7f8122392b80 20 client.15852 trim_cache size 0 max 16384 2023-10-07T00:13:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.340+0000 7f8122392b80 1 Processor -- start 2023-10-07T00:13:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.340+0000 7f8122392b80 1 -- start start 2023-10-07T00:13:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8122392b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532670 0x55beb8549e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8122392b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532fd0 0x55beb85438e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8122392b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8528f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8122392b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb8301920 con 0x55beb8532670 2023-10-07T00:13:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8122392b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb853b850 con 0x55beb8533e70 2023-10-07T00:13:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8122392b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb8547c50 con 0x55beb8532fd0 2023-10-07T00:13:40.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8107fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532670 0x55beb8549e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8107fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532670 0x55beb8549e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36948/0 (socket says 172.21.15.5:36948) 2023-10-07T00:13:40.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f8107fff700 1 -- 172.21.15.5:0/1634412411 learned_addr learned my addr 172.21.15.5:0/1634412411 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f810cf9c700 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8528f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.341+0000 7f81077fe700 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532fd0 0x55beb85438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.342+0000 7f810cf9c700 1 -- 172.21.15.5:0/1634412411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532fd0 msgr2=0x55beb85438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.342+0000 7f810cf9c700 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532fd0 0x55beb85438e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.342+0000 7f810cf9c700 1 -- 172.21.15.5:0/1634412411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532670 msgr2=0x55beb8549e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.342+0000 7f810cf9c700 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532670 0x55beb8549e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.342+0000 7f810cf9c700 1 -- 172.21.15.5:0/1634412411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55beb82d2250 con 0x55beb8533e70 2023-10-07T00:13:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.342+0000 7f810cf9c700 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8528f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f81000091c0 tx=0x7f8100005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87aca0fe0e4ada22 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.342+0000 7f80eeffd700 1 -- 172.21.15.5:0/1634412411 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810000e040 con 0x55beb8533e70 2023-10-07T00:13:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f80eeffd700 1 -- 172.21.15.5:0/1634412411 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8100003e90 con 0x55beb8533e70 2023-10-07T00:13:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f80eeffd700 1 -- 172.21.15.5:0/1634412411 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000057f0 con 0x55beb8533e70 2023-10-07T00:13:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f8122392b80 1 -- 172.21.15.5:0/1634412411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 msgr2=0x55beb8528f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f8122392b80 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8528f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f81000091c0 tx=0x7f8100005a20 comp rx=0 tx=0).stop 2023-10-07T00:13:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f8122392b80 1 -- 172.21.15.5:0/1634412411 shutdown_connections 2023-10-07T00:13:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f8122392b80 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8533e70 0x55beb8528f50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f8122392b80 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8532670 0x55beb8549e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f8122392b80 1 --2- 172.21.15.5:0/1634412411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532fd0 0x55beb85438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f8122392b80 1 -- 172.21.15.5:0/1634412411 >> 172.21.15.5:0/1634412411 conn(0x55beb84a2260 msgr2=0x55beb853a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.343+0000 7f8122392b80 1 -- 172.21.15.5:0/1634412411 shutdown_connections 2023-10-07T00:13:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.344+0000 7f8122392b80 1 -- 172.21.15.5:0/1634412411 wait complete. 2023-10-07T00:13:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.344+0000 7f8122392b80 1 -- start start 2023-10-07T00:13:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.344+0000 7f8122392b80 1 Processor -- start 2023-10-07T00:13:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f8122392b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f8122392b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8532fd0 0x55beb853fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f8122392b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8533e70 0x55beb8542e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f8122392b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb8543350 con 0x55beb8533e70 2023-10-07T00:13:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f8122392b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb85434c0 con 0x55beb8532fd0 2023-10-07T00:13:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f8122392b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb8543680 con 0x55beb8532670 2023-10-07T00:13:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f8122392b80 10 client.0 _ll_register_callbacks cb 0x7f80fc0cd040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f810cf9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8533e70 0x55beb8542e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f8107fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f810cf9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8533e70 0x55beb8542e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36964/0 (socket says 172.21.15.5:36964) 2023-10-07T00:13:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f810cf9c700 1 -- 172.21.15.5:0/1888892561 learned_addr learned my addr 172.21.15.5:0/1888892561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.345+0000 7f81077fe700 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8532fd0 0x55beb853fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f8107fff700 1 -- 172.21.15.5:0/1888892561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8532fd0 msgr2=0x55beb853fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f8107fff700 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8532fd0 0x55beb853fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f8107fff700 1 -- 172.21.15.5:0/1888892561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8533e70 msgr2=0x55beb8542e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:40.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f8107fff700 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8533e70 0x55beb8542e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f8107fff700 1 -- 172.21.15.5:0/1888892561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55beb82abde0 con 0x55beb8532670 2023-10-07T00:13:40.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f8107fff700 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853f8b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55beb8529f80 tx=0x7f80f8009cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e0b897cf6c961d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f80e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f80e77fe700 1 -- 172.21.15.5:0/1888892561 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8018040 con 0x55beb8532670 2023-10-07T00:13:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f8122392b80 1 -- 172.21.15.5:0/1888892561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f810000f040 con 0x55beb8532670 2023-10-07T00:13:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.346+0000 7f80e77fe700 1 -- 172.21.15.5:0/1888892561 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f80f801dc00 con 0x55beb8532670 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f80e77fe700 1 -- 172.21.15.5:0/1888892561 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80f801ddc0 con 0x55beb8532670 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f8122392b80 10 client.25621 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f8122392b80 1 -- 172.21.15.5:0/1888892561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55beb82aa2b0 con 0x55beb8532670 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f80e77fe700 1 -- 172.21.15.5:0/1888892561 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f810000f040 con 0x55beb8532670 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f80e77fe700 1 -- 172.21.15.5:0/1888892561 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f80f802e050 con 0x55beb8532670 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f8122392b80 10 client.25621 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f8122392b80 10 client.25621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f8122392b80 20 client.25621 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f8122392b80 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55beb859cfc0 0x55beb859f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f8122392b80 4 client.25621 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.347+0000 7f8122392b80 1 -- 172.21.15.5:0/1888892561 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55beb8479b30 con 0x55beb859cfc0 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.348+0000 7f81077fe700 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55beb859cfc0 0x55beb859f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.348+0000 7f81077fe700 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55beb859cfc0 0x55beb859f3e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ff50f6803ba04ad server_cookie=cc98dab9dc1fca1f in_seq=0 out_seq=0 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.348+0000 7f80e77fe700 10 client.25621 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f80e77fe700 1 -- 172.21.15.5:0/1888892561 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55beb8479b30 con 0x55beb859cfc0 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f80e77fe700 10 client.25621 handle_command_reply: tid=0 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 client.25621 shutdown 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 -- 172.21.15.5:0/1888892561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 msgr2=0x55beb853f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853f8b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55beb8529f80 tx=0x7f80f8009cf0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 -- 172.21.15.5:0/1888892561 shutdown_connections 2023-10-07T00:13:40.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55beb859cfc0 0x55beb859f3e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55beb8533e70 0x55beb8542e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beb8532670 0x55beb853f8b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 --2- 172.21.15.5:0/1888892561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55beb8532fd0 0x55beb853fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f80e77fe700 0 client.25621 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:40.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 -- 172.21.15.5:0/1888892561 >> 172.21.15.5:0/1888892561 conn(0x55beb84a2260 msgr2=0x55beb8528f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 -- 172.21.15.5:0/1888892561 shutdown_connections 2023-10-07T00:13:40.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.349+0000 7f8122392b80 1 -- 172.21.15.5:0/1888892561 wait complete. 2023-10-07T00:13:40.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f8122392b80 20 client.25621 trim_cache size 0 max 16384 2023-10-07T00:13:40.361 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:13:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-07T00:13:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-07T00:13:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "c74b600c-6075-4c9f-844e-1c32527b9d39": { 2023-10-07T00:13:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-07T00:13:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c74b600c-6075-4c9f-844e-1c32527b9d39", 2023-10-07T00:13:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-07T00:13:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:13:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:13:40.362 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:13:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 -- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f80f00a1500 msgr2=0x7f80f00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f80f00a1500 0x7f80f00a39c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f810001aa10 tx=0x7f8100018000 comp rx=0 tx=0).stop 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 -- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8108104370 msgr2=0x7f81081970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8108104370 0x7f81081970b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0059d0 tx=0x7f80fc0047b0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 -- 172.21.15.5:0/3019471844 shutdown_connections 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f80f00a1500 0x7f80f00a39c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108106ca0 0x7f810819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8108101a40 0x7f8108196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 --2- 172.21.15.5:0/3019471844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8108104370 0x7f81081970b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.350+0000 7f810e9ff700 1 -- 172.21.15.5:0/3019471844 >> 172.21.15.5:0/3019471844 conn(0x7f81080fb450 msgr2=0x7f81081026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.351+0000 7f810e9ff700 1 -- 172.21.15.5:0/3019471844 shutdown_connections 2023-10-07T00:13:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:13:40.351+0000 7f810e9ff700 1 -- 172.21.15.5:0/3019471844 wait complete. 2023-10-07T00:13:40.376 INFO:tasks.cephfs.filesystem:scrub status for tag:c74b600c-6075-4c9f-844e-1c32527b9d39 - {'path': '/', 'tag': 'c74b600c-6075-4c9f-844e-1c32527b9d39', 'options': 'recursive,force'} 2023-10-07T00:13:41.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:40 smithi005 ceph-mon[129406]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:40 smithi005 ceph-mon[129406]: scrub queued for path: / 2023-10-07T00:13:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:40 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:40 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:13:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:40 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:40 smithi088 ceph-mon[103111]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:41.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:40 smithi088 ceph-mon[103111]: scrub queued for path: / 2023-10-07T00:13:41.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:40 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:41.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:40 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:13:41.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:40 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:41.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:40 smithi112 ceph-mon[133548]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:41.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:40 smithi112 ceph-mon[133548]: scrub queued for path: / 2023-10-07T00:13:41.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:40 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:41.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:40 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:13:41.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:40 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:13:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.010+0000 7f431d3ff700 1 -- 172.21.15.5:0/1985143959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318102090 msgr2=0x7f4318102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.010+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1985143959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318102090 0x7f4318102510 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f430c009990 tx=0x7f430c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.011+0000 7f431d3ff700 1 -- 172.21.15.5:0/1985143959 shutdown_connections 2023-10-07T00:13:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.011+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1985143959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4318102a50 0x7f4318109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.011+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1985143959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4318100eb0 0x7f43181012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.011+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1985143959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318102090 0x7f4318102510 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.011+0000 7f431d3ff700 1 -- 172.21.15.5:0/1985143959 >> 172.21.15.5:0/1985143959 conn(0x7f43180fc470 msgr2=0x7f43180fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.011+0000 7f431d3ff700 1 -- 172.21.15.5:0/1985143959 shutdown_connections 2023-10-07T00:13:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.011+0000 7f431d3ff700 1 -- 172.21.15.5:0/1985143959 wait complete. 2023-10-07T00:13:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.012+0000 7f431d3ff700 1 Processor -- start 2023-10-07T00:13:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f431d3ff700 1 -- start start 2023-10-07T00:13:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f431d3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318100eb0 0x7f4318198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f431d3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4318102090 0x7f4318199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f431d3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4318102a50 0x7f43181a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f431d3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43181a0880 con 0x7f4318100eb0 2023-10-07T00:13:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f431d3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43181a09f0 con 0x7f4318102a50 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f431d3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43181a0bb0 con 0x7f4318102090 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f4316ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318100eb0 0x7f4318198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f4316ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318100eb0 0x7f4318198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36246/0 (socket says 172.21.15.5:36246) 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f4316ffd700 1 -- 172.21.15.5:0/1024141113 learned_addr learned my addr 172.21.15.5:0/1024141113 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.013+0000 7f43167fc700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4318102090 0x7f4318199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f43177fe700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4318102a50 0x7f43181a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f4316ffd700 1 -- 172.21.15.5:0/1024141113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4318102090 msgr2=0x7f4318199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f4316ffd700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4318102090 0x7f4318199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f4316ffd700 1 -- 172.21.15.5:0/1024141113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4318102a50 msgr2=0x7f43181a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f4316ffd700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4318102a50 0x7f43181a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f4316ffd700 1 -- 172.21.15.5:0/1024141113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0095f0 con 0x7f4318100eb0 2023-10-07T00:13:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f43177fe700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4318102a50 0x7f43181a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:13:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f4316ffd700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318100eb0 0x7f4318198d40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f430800e970 tx=0x7f430800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.014+0000 7f42fffff700 1 -- 172.21.15.5:0/1024141113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308009790 con 0x7f4318100eb0 2023-10-07T00:13:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.015+0000 7f42fffff700 1 -- 172.21.15.5:0/1024141113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f430800eec0 con 0x7f4318100eb0 2023-10-07T00:13:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.015+0000 7f431d3ff700 1 -- 172.21.15.5:0/1024141113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43181a0e90 con 0x7f4318100eb0 2023-10-07T00:13:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.015+0000 7f431d3ff700 1 -- 172.21.15.5:0/1024141113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43181a12c0 con 0x7f4318100eb0 2023-10-07T00:13:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.015+0000 7f42fffff700 1 -- 172.21.15.5:0/1024141113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308003c10 con 0x7f4318100eb0 2023-10-07T00:13:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.019+0000 7f4330df5b80 1 Processor -- start 2023-10-07T00:13:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.020+0000 7f42fffff700 1 -- 172.21.15.5:0/1024141113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f430800ccd0 con 0x7f4318100eb0 2023-10-07T00:13:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.020+0000 7f4330df5b80 1 -- start start 2023-10-07T00:13:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.020+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ecf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.020+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ed0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.020+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 0x55b2d5ed7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.020+0000 7f4330df5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5e37400 con 0x55b2d5ed0990 2023-10-07T00:13:42.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.020+0000 7f4330df5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5e28bc0 con 0x55b2d5ecffd0 2023-10-07T00:13:42.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.020+0000 7f4330df5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5e264e0 con 0x55b2d5eceec0 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.021+0000 7f43177fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ecf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.021+0000 7f43177fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ecf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53116/0 (socket says 172.21.15.5:53116) 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.021+0000 7f43167fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 0x55b2d5ed7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.021+0000 7f43177fe700 1 -- 172.21.15.5:0/466519147 learned_addr learned my addr 172.21.15.5:0/466519147 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.021+0000 7f4316ffd700 1 --2- 172.21.15.5:0/466519147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ed0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.022+0000 7f43177fe700 1 -- 172.21.15.5:0/466519147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 msgr2=0x55b2d5ed0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.022+0000 7f43177fe700 1 --2- 172.21.15.5:0/466519147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ed0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.022+0000 7f43177fe700 1 -- 172.21.15.5:0/466519147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 msgr2=0x55b2d5ed7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.022+0000 7f43177fe700 1 --2- 172.21.15.5:0/466519147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 0x55b2d5ed7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.022+0000 7f43177fe700 1 -- 172.21.15.5:0/466519147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2d5c4cd80 con 0x55b2d5eceec0 2023-10-07T00:13:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.023+0000 7f42fffff700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f43000a1580 0x7f43000a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.023+0000 7f42fffff700 1 -- 172.21.15.5:0/1024141113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4308014070 con 0x7f4318100eb0 2023-10-07T00:13:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.023+0000 7f43177fe700 1 --2- 172.21.15.5:0/466519147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ecf2e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4310009440 tx=0x7f4310009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7ccc5cfca6d15ca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.023+0000 7f4316ffd700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f43000a1580 0x7f43000a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.024+0000 7f42fd7fa700 1 -- 172.21.15.5:0/466519147 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000e070 con 0x55b2d5eceec0 2023-10-07T00:13:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.024+0000 7f42fd7fa700 1 -- 172.21.15.5:0/466519147 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f431000f040 con 0x55b2d5eceec0 2023-10-07T00:13:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.024+0000 7f42fd7fa700 1 -- 172.21.15.5:0/466519147 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310015b90 con 0x55b2d5eceec0 2023-10-07T00:13:42.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4316ffd700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f43000a1580 0x7f43000a3a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4308099e70 tx=0x7f4308004750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:42.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 -- 172.21.15.5:0/466519147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 msgr2=0x55b2d5ecf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 --2- 172.21.15.5:0/466519147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ecf2e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4310009440 tx=0x7f4310009920 comp rx=0 tx=0).stop 2023-10-07T00:13:42.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 -- 172.21.15.5:0/466519147 shutdown_connections 2023-10-07T00:13:42.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 --2- 172.21.15.5:0/466519147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 0x55b2d5ed7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 --2- 172.21.15.5:0/466519147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ecf2e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 --2- 172.21.15.5:0/466519147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ed0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 -- 172.21.15.5:0/466519147 >> 172.21.15.5:0/466519147 conn(0x55b2d5e43200 msgr2=0x55b2d5ec9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:42.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 -- 172.21.15.5:0/466519147 shutdown_connections 2023-10-07T00:13:42.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.025+0000 7f4330df5b80 1 -- 172.21.15.5:0/466519147 wait complete. 2023-10-07T00:13:42.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.026+0000 7f4330df5b80 1 -- start start 2023-10-07T00:13:42.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.026+0000 7f4330df5b80 1 Processor -- start 2023-10-07T00:13:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.028+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ed8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.028+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ed9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.028+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ed0990 0x55b2d5ee0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.028+0000 7f4330df5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5e21dd0 con 0x55b2d5ecffd0 2023-10-07T00:13:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.028+0000 7f4330df5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5dbe6b0 con 0x55b2d5ed0990 2023-10-07T00:13:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.028+0000 7f4330df5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5dbe350 con 0x55b2d5eceec0 2023-10-07T00:13:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.028+0000 7f4330df5b80 10 client.0 _ll_register_callbacks cb 0x55b2d5c1b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ed0990 0x55b2d5ee0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43167fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ed9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ed0990 0x55b2d5ee0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:33950/0 (socket says 172.21.15.5:33950) 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 -- 172.21.15.5:0/3963084729 learned_addr learned my addr 172.21.15.5:0/3963084729 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ed8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 -- 172.21.15.5:0/3963084729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 msgr2=0x55b2d5ed8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ed8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 -- 172.21.15.5:0/3963084729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ecffd0 msgr2=0x55b2d5ed9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ed9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.029+0000 7f43177fe700 1 -- 172.21.15.5:0/3963084729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43100090f0 con 0x55b2d5ed0990 2023-10-07T00:13:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.030+0000 7f43177fe700 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ed0990 0x55b2d5ee0150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4310013890 tx=0x7f4310014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73120c887fa3373c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.030+0000 7f42faff5700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.030+0000 7f42faff5700 1 -- 172.21.15.5:0/3963084729 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000e040 con 0x55b2d5ed0990 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.030+0000 7f4330df5b80 1 -- 172.21.15.5:0/3963084729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2d5ec1d50 con 0x55b2d5ed0990 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.030+0000 7f42faff5700 1 -- 172.21.15.5:0/3963084729 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f43100138f0 con 0x55b2d5ed0990 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.030+0000 7f42faff5700 1 -- 172.21.15.5:0/3963084729 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4310013ab0 con 0x55b2d5ed0990 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.030+0000 7f4330df5b80 10 client.25646 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f4330df5b80 1 -- 172.21.15.5:0/3963084729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b2d5c35c00 con 0x55b2d5ed0990 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f42faff5700 1 -- 172.21.15.5:0/3963084729 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b2d5ec1d50 con 0x55b2d5ed0990 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f42faff5700 1 -- 172.21.15.5:0/3963084729 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f431001c030 con 0x55b2d5ed0990 2023-10-07T00:13:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f4330df5b80 10 client.25646 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f4330df5b80 10 client.25646 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f4330df5b80 20 client.25646 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b2d5ee49d0 0x55b2d5ee6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f4330df5b80 4 client.25646 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.031+0000 7f4330df5b80 1 -- 172.21.15.5:0/3963084729 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2d5e1adb0 con 0x55b2d5ee49d0 2023-10-07T00:13:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.032+0000 7f43167fc700 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b2d5ee49d0 0x55b2d5ee6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.033+0000 7f42faff5700 10 client.25646 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.033+0000 7f43167fc700 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b2d5ee49d0 0x55b2d5ee6df0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3779315a0d4a0e37 server_cookie=b9aafac2a9c11102 in_seq=0 out_seq=0 2023-10-07T00:13:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f42faff5700 1 -- 172.21.15.5:0/3963084729 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b2d5e1adb0 con 0x55b2d5ee49d0 2023-10-07T00:13:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f42faff5700 10 client.25646 handle_command_reply: tid=0 2023-10-07T00:13:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 client.25646 shutdown 2023-10-07T00:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 -- 172.21.15.5:0/3963084729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ed0990 msgr2=0x55b2d5ee0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ed0990 0x55b2d5ee0150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4310013890 tx=0x7f4310014000 comp rx=0 tx=0).stop 2023-10-07T00:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 -- 172.21.15.5:0/3963084729 shutdown_connections 2023-10-07T00:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b2d5ee49d0 0x55b2d5ee6df0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ed0990 0x55b2d5ee0150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5ed8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3963084729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ed9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f42faff5700 0 client.25646 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 -- 172.21.15.5:0/3963084729 >> 172.21.15.5:0/3963084729 conn(0x55b2d5e43200 msgr2=0x55b2d5ec9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 -- 172.21.15.5:0/3963084729 shutdown_connections 2023-10-07T00:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.034+0000 7f4330df5b80 1 -- 172.21.15.5:0/3963084729 wait complete. 2023-10-07T00:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.035+0000 7f4330df5b80 20 client.25646 trim_cache size 0 max 16384 2023-10-07T00:13:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.055+0000 7f4330df5b80 1 Processor -- start 2023-10-07T00:13:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.055+0000 7f4330df5b80 1 -- start start 2023-10-07T00:13:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5eceec0 0x55b2d5eca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ee0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5ed0990 0x55b2d5ec9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f4330df5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5ed87a0 con 0x55b2d5eceec0 2023-10-07T00:13:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f4330df5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5ca28c0 con 0x55b2d5ecffd0 2023-10-07T00:13:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f4330df5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5ecf740 con 0x55b2d5ed0990 2023-10-07T00:13:42.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f43177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5eceec0 0x55b2d5eca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f43177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5eceec0 0x55b2d5eca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36268/0 (socket says 172.21.15.5:36268) 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f43177fe700 1 -- 172.21.15.5:0/3263830804 learned_addr learned my addr 172.21.15.5:0/3263830804 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f43167fc700 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ee0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.056+0000 7f43177fe700 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5ed0990 0x55b2d5ec9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.057+0000 7f43177fe700 1 -- 172.21.15.5:0/3263830804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5ed0990 msgr2=0x55b2d5ec9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.057+0000 7f43177fe700 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5ed0990 0x55b2d5ec9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.057+0000 7f43177fe700 1 -- 172.21.15.5:0/3263830804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 msgr2=0x55b2d5ee0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.057+0000 7f43177fe700 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ee0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.057+0000 7f43177fe700 1 -- 172.21.15.5:0/3263830804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2d5c731f0 con 0x55b2d5eceec0 2023-10-07T00:13:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.057+0000 7f43177fe700 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5eceec0 0x55b2d5eca990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4310009960 tx=0x7f4310016a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3c46d8cbaff28e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:42.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.057+0000 7f42fdffb700 1 -- 172.21.15.5:0/3263830804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000e040 con 0x55b2d5eceec0 2023-10-07T00:13:42.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.058+0000 7f42fdffb700 1 -- 172.21.15.5:0/3263830804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4310037030 con 0x55b2d5eceec0 2023-10-07T00:13:42.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.058+0000 7f42fdffb700 1 -- 172.21.15.5:0/3263830804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43100219b0 con 0x55b2d5eceec0 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.058+0000 7f4330df5b80 1 -- 172.21.15.5:0/3263830804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5eceec0 msgr2=0x55b2d5eca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.058+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5eceec0 0x55b2d5eca990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4310009960 tx=0x7f4310016a60 comp rx=0 tx=0).stop 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.058+0000 7f4330df5b80 1 -- 172.21.15.5:0/3263830804 shutdown_connections 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.058+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5ed0990 0x55b2d5ec9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.058+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5eceec0 0x55b2d5eca990 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.058+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3263830804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5ee0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.059+0000 7f4330df5b80 1 -- 172.21.15.5:0/3263830804 >> 172.21.15.5:0/3263830804 conn(0x55b2d5e43200 msgr2=0x55b2d5ec9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.059+0000 7f4330df5b80 1 -- 172.21.15.5:0/3263830804 shutdown_connections 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.059+0000 7f4330df5b80 1 -- 172.21.15.5:0/3263830804 wait complete. 2023-10-07T00:13:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.059+0000 7f4330df5b80 1 -- start start 2023-10-07T00:13:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.060+0000 7f4330df5b80 1 Processor -- start 2023-10-07T00:13:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.060+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5edd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.060+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5edd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.060+0000 7f4330df5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 0x55b2d5ede7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.060+0000 7f4330df5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5eded10 con 0x55b2d5ed0990 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.060+0000 7f4330df5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5edee80 con 0x55b2d5ecffd0 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.060+0000 7f4330df5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2d5edf040 con 0x55b2d5eceec0 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.060+0000 7f4330df5b80 10 client.0 _ll_register_callbacks cb 0x7f4310016e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43167fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5edd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 0x55b2d5ede7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43167fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5edd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:33968/0 (socket says 172.21.15.5:33968) 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43167fc700 1 -- 172.21.15.5:0/3726493376 learned_addr learned my addr 172.21.15.5:0/3726493376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43177fe700 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5edd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43167fc700 1 -- 172.21.15.5:0/3726493376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 msgr2=0x55b2d5edd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43167fc700 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5edd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43167fc700 1 -- 172.21.15.5:0/3726493376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 msgr2=0x55b2d5ede7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43167fc700 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 0x55b2d5ede7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.061+0000 7f43167fc700 1 -- 172.21.15.5:0/3726493376 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2d5c35c00 con 0x55b2d5ecffd0 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.062+0000 7f43167fc700 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5edd7c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f430c0059d0 tx=0x7f430c0051a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32fd8861fa1449ee server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.062+0000 7f42faff5700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.062+0000 7f42faff5700 1 -- 172.21.15.5:0/3726493376 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c01d040 con 0x55b2d5ecffd0 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.062+0000 7f4330df5b80 1 -- 172.21.15.5:0/3726493376 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f431000f040 con 0x55b2d5ecffd0 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.062+0000 7f42faff5700 1 -- 172.21.15.5:0/3726493376 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f430c005310 con 0x55b2d5ecffd0 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.062+0000 7f42faff5700 1 -- 172.21.15.5:0/3726493376 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f430c0054d0 con 0x55b2d5ecffd0 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.062+0000 7f4330df5b80 10 client.25652 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.062+0000 7f4330df5b80 1 -- 172.21.15.5:0/3726493376 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b2d5c4b250 con 0x55b2d5ecffd0 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.063+0000 7f42faff5700 1 -- 172.21.15.5:0/3726493376 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f431000f040 con 0x55b2d5ecffd0 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.063+0000 7f42faff5700 1 -- 172.21.15.5:0/3726493376 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f430c0039f0 con 0x55b2d5ecffd0 2023-10-07T00:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.063+0000 7f4330df5b80 10 client.25652 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.063+0000 7f4330df5b80 10 client.25652 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.063+0000 7f4330df5b80 20 client.25652 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.063+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b2d5f38d70 0x55b2d5f3b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.063+0000 7f4330df5b80 4 client.25652 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:13:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.063+0000 7f4330df5b80 1 -- 172.21.15.5:0/3726493376 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b2d5e1aad0 con 0x55b2d5f38d70 2023-10-07T00:13:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.064+0000 7f43177fe700 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b2d5f38d70 0x55b2d5f3b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.064+0000 7f43177fe700 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b2d5f38d70 0x55b2d5f3b160 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38e5c14e04558835 server_cookie=f2f7efe91b735fb6 in_seq=0 out_seq=0 2023-10-07T00:13:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.064+0000 7f42faff5700 10 client.25652 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.068+0000 7f42faff5700 1 -- 172.21.15.5:0/3726493376 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b2d5e1aad0 con 0x55b2d5f38d70 2023-10-07T00:13:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.068+0000 7f42faff5700 10 client.25652 handle_command_reply: tid=0 2023-10-07T00:13:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 client.25652 shutdown 2023-10-07T00:13:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 -- 172.21.15.5:0/3726493376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 msgr2=0x55b2d5edd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5edd7c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f430c0059d0 tx=0x7f430c0051a0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 -- 172.21.15.5:0/3726493376 shutdown_connections 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b2d5f38d70 0x55b2d5f3b160 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2d5ed0990 0x55b2d5ede7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b2d5eceec0 0x55b2d5edd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 --2- 172.21.15.5:0/3726493376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b2d5ecffd0 0x55b2d5edd7c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 -- 172.21.15.5:0/3726493376 >> 172.21.15.5:0/3726493376 conn(0x55b2d5e43200 msgr2=0x55b2d5ee0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f42faff5700 0 client.25652 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 -- 172.21.15.5:0/3726493376 shutdown_connections 2023-10-07T00:13:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.069+0000 7f4330df5b80 1 -- 172.21.15.5:0/3726493376 wait complete. 2023-10-07T00:13:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.070+0000 7f4330df5b80 20 client.25652 trim_cache size 0 max 16384 2023-10-07T00:13:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:13:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:13:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:13:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:13:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.070+0000 7f431d3ff700 1 -- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f43000a1580 msgr2=0x7f43000a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.070+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f43000a1580 0x7f43000a3a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4308099e70 tx=0x7f4308004750 comp rx=0 tx=0).stop 2023-10-07T00:13:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.070+0000 7f431d3ff700 1 -- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318100eb0 msgr2=0x7f4318198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.070+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318100eb0 0x7f4318198d40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f430800e970 tx=0x7f430800ec80 comp rx=0 tx=0).stop 2023-10-07T00:13:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.071+0000 7f431d3ff700 1 -- 172.21.15.5:0/1024141113 shutdown_connections 2023-10-07T00:13:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.071+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f43000a1580 0x7f43000a3a40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.071+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4318102a50 0x7f43181a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.071+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4318100eb0 0x7f4318198d40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.071+0000 7f431d3ff700 1 --2- 172.21.15.5:0/1024141113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4318102090 0x7f4318199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.071+0000 7f431d3ff700 1 -- 172.21.15.5:0/1024141113 >> 172.21.15.5:0/1024141113 conn(0x7f43180fc470 msgr2=0x7f4318107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.071+0000 7f431d3ff700 1 -- 172.21.15.5:0/1024141113 shutdown_connections 2023-10-07T00:13:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:42.071+0000 7f431d3ff700 1 -- 172.21.15.5:0/1024141113 wait complete. 2023-10-07T00:13:42.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:41 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:13:42.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:41 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:13:42.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:41 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:13:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:42 smithi005 ceph-mon[129406]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:13:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:42 smithi088 ceph-mon[103111]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:13:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:42 smithi112 ceph-mon[133548]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:13:45.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:44 smithi005 ceph-mon[129406]: pgmap v375: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-07T00:13:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:44 smithi088 ceph-mon[103111]: pgmap v375: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-07T00:13:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:44 smithi112 ceph-mon[133548]: pgmap v375: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-07T00:13:47.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:46 smithi005 ceph-mon[129406]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 255 B/s wr, 14 op/s 2023-10-07T00:13:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:46 smithi088 ceph-mon[103111]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 255 B/s wr, 14 op/s 2023-10-07T00:13:47.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:46 smithi112 ceph-mon[133548]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 255 B/s wr, 14 op/s 2023-10-07T00:13:49.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:48 smithi005 ceph-mon[129406]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:13:49.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:48 smithi088 ceph-mon[103111]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:13:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:48 smithi112 ceph-mon[133548]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:13:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:50 smithi005 ceph-mon[129406]: pgmap v378: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:13:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:50 smithi088 ceph-mon[103111]: pgmap v378: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:13:51.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:50 smithi112 ceph-mon[133548]: pgmap v378: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:13:53.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:52 smithi005 ceph-mon[129406]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 255 B/s wr, 13 op/s 2023-10-07T00:13:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:52 smithi088 ceph-mon[103111]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 255 B/s wr, 13 op/s 2023-10-07T00:13:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:52 smithi112 ceph-mon[133548]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 255 B/s wr, 13 op/s 2023-10-07T00:13:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:54 smithi005 ceph-mon[129406]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-07T00:13:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:54 smithi088 ceph-mon[103111]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-07T00:13:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:54 smithi112 ceph-mon[133548]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-07T00:13:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 -- 172.21.15.5:0/3212818630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c101980 msgr2=0x7f291c103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 --2- 172.21.15.5:0/3212818630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c101980 0x7f291c103d70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f290c0098f0 tx=0x7f290c009c00 comp rx=0 tx=0).stop 2023-10-07T00:13:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 -- 172.21.15.5:0/3212818630 shutdown_connections 2023-10-07T00:13:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 --2- 172.21.15.5:0/3212818630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c106be0 0x7f291c109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 --2- 172.21.15.5:0/3212818630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c101980 0x7f291c103d70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 --2- 172.21.15.5:0/3212818630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c1042b0 0x7f291c1066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 -- 172.21.15.5:0/3212818630 >> 172.21.15.5:0/3212818630 conn(0x7f291c0fb390 msgr2=0x7f291c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 -- 172.21.15.5:0/3212818630 shutdown_connections 2023-10-07T00:13:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.310+0000 7f29215ff700 1 -- 172.21.15.5:0/3212818630 wait complete. 2023-10-07T00:13:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.312+0000 7f29215ff700 1 Processor -- start 2023-10-07T00:13:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.312+0000 7f29215ff700 1 -- start start 2023-10-07T00:13:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.312+0000 7f29215ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c101980 0x7f291c101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.312+0000 7f29215ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c1042b0 0x7f291c0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f29215ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c106be0 0x7f291c0ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f29215ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c1a6ec0 con 0x7f291c101980 2023-10-07T00:13:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f29215ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c1a7030 con 0x7f291c1042b0 2023-10-07T00:13:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f29215ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c1a71f0 con 0x7f291c106be0 2023-10-07T00:13:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c106be0 0x7f291c0ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c101980 0x7f291c101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c106be0 0x7f291c0ffeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:44458/0 (socket says 172.21.15.5:44458) 2023-10-07T00:13:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291b7fe700 1 -- 172.21.15.5:0/1591876837 learned_addr learned my addr 172.21.15.5:0/1591876837 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291a7fc700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c1042b0 0x7f291c0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291affd700 1 -- 172.21.15.5:0/1591876837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c106be0 msgr2=0x7f291c0ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291affd700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c106be0 0x7f291c0ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291affd700 1 -- 172.21.15.5:0/1591876837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c1042b0 msgr2=0x7f291c0ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291affd700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c1042b0 0x7f291c0ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.313+0000 7f291affd700 1 -- 172.21.15.5:0/1591876837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100095f0 con 0x7f291c101980 2023-10-07T00:13:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.314+0000 7f291affd700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c101980 0x7f291c101310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f290c009230 tx=0x7f290c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.314+0000 7f2903fff700 1 -- 172.21.15.5:0/1591876837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c01c070 con 0x7f291c101980 2023-10-07T00:13:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.314+0000 7f2903fff700 1 -- 172.21.15.5:0/1591876837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f290c00f7b0 con 0x7f291c101980 2023-10-07T00:13:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.314+0000 7f29215ff700 1 -- 172.21.15.5:0/1591876837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c009520 con 0x7f291c101980 2023-10-07T00:13:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.315+0000 7f2903fff700 1 -- 172.21.15.5:0/1591876837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c003a00 con 0x7f291c101980 2023-10-07T00:13:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.315+0000 7f29215ff700 1 -- 172.21.15.5:0/1591876837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c1006e0 con 0x7f291c101980 2023-10-07T00:13:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.321+0000 7f2903fff700 1 -- 172.21.15.5:0/1591876837 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f290c020030 con 0x7f291c101980 2023-10-07T00:13:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.321+0000 7f2934e36b80 1 Processor -- start 2023-10-07T00:13:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.321+0000 7f2934e36b80 1 -- start start 2023-10-07T00:13:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.322+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e10552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.322+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 0x55a5e1056450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.322+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e105d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.322+0000 7f2934e36b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e0fbd400 con 0x55a5e1056990 2023-10-07T00:13:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.322+0000 7f2934e36b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e0faebc0 con 0x55a5e1055fd0 2023-10-07T00:13:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.322+0000 7f2934e36b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e0fac4e0 con 0x55a5e1054ec0 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e10552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e10552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:44466/0 (socket says 172.21.15.5:44466) 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291b7fe700 1 -- 172.21.15.5:0/1302054854 learned_addr learned my addr 172.21.15.5:0/1302054854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291a7fc700 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e105d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291affd700 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 0x55a5e1056450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291b7fe700 1 -- 172.21.15.5:0/1302054854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 msgr2=0x55a5e1056450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 0x55a5e1056450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291b7fe700 1 -- 172.21.15.5:0/1302054854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 msgr2=0x55a5e105d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e105d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.323+0000 7f291b7fe700 1 -- 172.21.15.5:0/1302054854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5e0dd2d80 con 0x55a5e1054ec0 2023-10-07T00:13:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.324+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e10552e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f291400e680 tx=0x7f2914009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594a683ae2d9b43e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.324+0000 7f29017fa700 1 -- 172.21.15.5:0/1302054854 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400e040 con 0x55a5e1054ec0 2023-10-07T00:13:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.324+0000 7f29017fa700 1 -- 172.21.15.5:0/1302054854 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f291400f040 con 0x55a5e1054ec0 2023-10-07T00:13:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.324+0000 7f29017fa700 1 -- 172.21.15.5:0/1302054854 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914004760 con 0x55a5e1054ec0 2023-10-07T00:13:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.325+0000 7f2903fff700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29040a1500 0x7f29040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.325+0000 7f2903fff700 1 -- 172.21.15.5:0/1591876837 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f290c0cdc30 con 0x7f291c101980 2023-10-07T00:13:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.325+0000 7f291affd700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29040a1500 0x7f29040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.325+0000 7f2934e36b80 1 -- 172.21.15.5:0/1302054854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 msgr2=0x55a5e10552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.325+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e10552e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f291400e680 tx=0x7f2914009920 comp rx=0 tx=0).stop 2023-10-07T00:13:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.326+0000 7f2934e36b80 1 -- 172.21.15.5:0/1302054854 shutdown_connections 2023-10-07T00:13:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.326+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e105d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.326+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e10552e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.326+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1302054854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 0x55a5e1056450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.326+0000 7f2934e36b80 1 -- 172.21.15.5:0/1302054854 >> 172.21.15.5:0/1302054854 conn(0x55a5e0fc9200 msgr2=0x55a5e104fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.326+0000 7f2934e36b80 1 -- 172.21.15.5:0/1302054854 shutdown_connections 2023-10-07T00:13:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.326+0000 7f2934e36b80 1 -- 172.21.15.5:0/1302054854 wait complete. 2023-10-07T00:13:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.326+0000 7f291affd700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29040a1500 0x7f29040a39c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f290c0979d0 tx=0x7f290c0a1040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.327+0000 7f2934e36b80 1 -- start start 2023-10-07T00:13:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.327+0000 7f2934e36b80 1 Processor -- start 2023-10-07T00:13:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.328+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e105ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.328+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 0x55a5e105f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.328+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e1066160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.328+0000 7f2934e36b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e0fa7dd0 con 0x55a5e1056990 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.328+0000 7f2934e36b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e0f446b0 con 0x55a5e1054ec0 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.328+0000 7f2934e36b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e0f44350 con 0x55a5e1055fd0 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.328+0000 7f2934e36b80 10 client.0 _ll_register_callbacks cb 0x55a5e0da17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.328+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e105ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e105ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:43714/0 (socket says 172.21.15.5:43714) 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291b7fe700 1 -- 172.21.15.5:0/2588707747 learned_addr learned my addr 172.21.15.5:0/2588707747 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291b7fe700 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e1066160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291a7fc700 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 0x55a5e105f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291b7fe700 1 -- 172.21.15.5:0/2588707747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 msgr2=0x55a5e105f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291b7fe700 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 0x55a5e105f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291b7fe700 1 -- 172.21.15.5:0/2588707747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 msgr2=0x55a5e1066160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291b7fe700 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e1066160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.329+0000 7f291b7fe700 1 -- 172.21.15.5:0/2588707747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291400e330 con 0x55a5e1054ec0 2023-10-07T00:13:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.330+0000 7f291b7fe700 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e105ebe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2914009500 tx=0x7f2914009e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f42b1d33246b5655 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.330+0000 7f28feff5700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:13:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.330+0000 7f28feff5700 1 -- 172.21.15.5:0/2588707747 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914003cd0 con 0x55a5e1054ec0 2023-10-07T00:13:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.330+0000 7f2934e36b80 1 -- 172.21.15.5:0/2588707747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5e1047d50 con 0x55a5e1054ec0 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.330+0000 7f28feff5700 1 -- 172.21.15.5:0/2588707747 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2914003e30 con 0x55a5e1054ec0 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.330+0000 7f28feff5700 1 -- 172.21.15.5:0/2588707747 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2914007500 con 0x55a5e1054ec0 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.330+0000 7f2934e36b80 10 client.25664 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f2934e36b80 1 -- 172.21.15.5:0/2588707747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a5e0dbbc00 con 0x55a5e1054ec0 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f28feff5700 1 -- 172.21.15.5:0/2588707747 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2914032020 con 0x55a5e1054ec0 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f28feff5700 1 -- 172.21.15.5:0/2588707747 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f291401e590 con 0x55a5e1054ec0 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f2934e36b80 10 client.25664 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f2934e36b80 10 client.25664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f2934e36b80 20 client.25664 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f2934e36b80 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a5e106a8f0 0x55a5e106cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f2934e36b80 4 client.25664 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:13:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.331+0000 7f2934e36b80 1 -- 172.21.15.5:0/2588707747 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5e0fa0db0 con 0x55a5e106a8f0 2023-10-07T00:13:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.332+0000 7f291a7fc700 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a5e106a8f0 0x55a5e106cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.333+0000 7f291a7fc700 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a5e106a8f0 0x55a5e106cd10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1957a9502efb7e6b server_cookie=3472b9af5e2f3454 in_seq=0 out_seq=0 2023-10-07T00:13:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.333+0000 7f28feff5700 10 client.25664 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.333+0000 7f28feff5700 1 -- 172.21.15.5:0/2588707747 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a5e0fa0db0 con 0x55a5e106a8f0 2023-10-07T00:13:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.333+0000 7f28feff5700 10 client.25664 handle_command_reply: tid=0 2023-10-07T00:13:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 client.25664 shutdown 2023-10-07T00:13:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 -- 172.21.15.5:0/2588707747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 msgr2=0x55a5e105ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e105ebe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2914009500 tx=0x7f2914009e10 comp rx=0 tx=0).stop 2023-10-07T00:13:55.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 -- 172.21.15.5:0/2588707747 shutdown_connections 2023-10-07T00:13:55.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a5e106a8f0 0x55a5e106cd10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e1066160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e105ebe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 --2- 172.21.15.5:0/2588707747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 0x55a5e105f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 -- 172.21.15.5:0/2588707747 >> 172.21.15.5:0/2588707747 conn(0x55a5e0fc9200 msgr2=0x55a5e104f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f28feff5700 0 client.25664 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 -- 172.21.15.5:0/2588707747 shutdown_connections 2023-10-07T00:13:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.334+0000 7f2934e36b80 1 -- 172.21.15.5:0/2588707747 wait complete. 2023-10-07T00:13:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.335+0000 7f2934e36b80 20 client.25664 trim_cache size 0 max 16384 2023-10-07T00:13:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.364+0000 7f2934e36b80 1 Processor -- start 2023-10-07T00:13:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.364+0000 7f2934e36b80 1 -- start start 2023-10-07T00:13:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.365+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e106c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.365+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 0x55a5e1066120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.365+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e105cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.365+0000 7f2934e36b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e0e288c0 con 0x55a5e1056990 2023-10-07T00:13:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.365+0000 7f2934e36b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e105e090 con 0x55a5e1054ec0 2023-10-07T00:13:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.365+0000 7f2934e36b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e1050f50 con 0x55a5e1055fd0 2023-10-07T00:13:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.365+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e106c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.365+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e106c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:43730/0 (socket says 172.21.15.5:43730) 2023-10-07T00:13:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291b7fe700 1 -- 172.21.15.5:0/1566595584 learned_addr learned my addr 172.21.15.5:0/1566595584 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e105cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291a7fc700 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 0x55a5e1066120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291b7fe700 1 -- 172.21.15.5:0/1566595584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 msgr2=0x55a5e1066120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 0x55a5e1066120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291b7fe700 1 -- 172.21.15.5:0/1566595584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 msgr2=0x55a5e105cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e105cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291b7fe700 1 -- 172.21.15.5:0/1566595584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5e0df91f0 con 0x55a5e1054ec0 2023-10-07T00:13:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.366+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e106c900 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f291400e680 tx=0x7f2914009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd57a09492848013 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.367+0000 7f2901ffb700 1 -- 172.21.15.5:0/1566595584 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914004330 con 0x55a5e1054ec0 2023-10-07T00:13:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.367+0000 7f2901ffb700 1 -- 172.21.15.5:0/1566595584 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2914032020 con 0x55a5e1054ec0 2023-10-07T00:13:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.367+0000 7f2901ffb700 1 -- 172.21.15.5:0/1566595584 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914007500 con 0x55a5e1054ec0 2023-10-07T00:13:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 -- 172.21.15.5:0/1566595584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 msgr2=0x55a5e106c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e106c900 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f291400e680 tx=0x7f2914009920 comp rx=0 tx=0).stop 2023-10-07T00:13:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 -- 172.21.15.5:0/1566595584 shutdown_connections 2023-10-07T00:13:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e105cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1054ec0 0x55a5e106c900 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1566595584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1055fd0 0x55a5e1066120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 -- 172.21.15.5:0/1566595584 >> 172.21.15.5:0/1566595584 conn(0x55a5e0fc9200 msgr2=0x55a5e1066990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 -- 172.21.15.5:0/1566595584 shutdown_connections 2023-10-07T00:13:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.368+0000 7f2934e36b80 1 -- 172.21.15.5:0/1566595584 wait complete. 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.369+0000 7f2934e36b80 1 -- start start 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.369+0000 7f2934e36b80 1 Processor -- start 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e1063850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 0x55a5e1063d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f2934e36b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e1064da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f2934e36b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e10652e0 con 0x55a5e1056990 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f2934e36b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e1065450 con 0x55a5e1055fd0 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f2934e36b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e1065610 con 0x55a5e1054ec0 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f2934e36b80 10 client.0 _ll_register_callbacks cb 0x7f2914004810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e1063850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e1063850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:44482/0 (socket says 172.21.15.5:44482) 2023-10-07T00:13:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f291b7fe700 1 -- 172.21.15.5:0/1044591016 learned_addr learned my addr 172.21.15.5:0/1044591016 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:13:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e1064da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.370+0000 7f291a7fc700 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 0x55a5e1063d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f291b7fe700 1 -- 172.21.15.5:0/1044591016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 msgr2=0x55a5e1063d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 0x55a5e1063d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f291b7fe700 1 -- 172.21.15.5:0/1044591016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 msgr2=0x55a5e1064da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:13:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e1064da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f291b7fe700 1 -- 172.21.15.5:0/1044591016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5e0dbbc00 con 0x55a5e1054ec0 2023-10-07T00:13:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f291b7fe700 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e1063850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2914009480 tx=0x7f291400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea2b17b73d9b423b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:13:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f28feff5700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:13:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f28feff5700 1 -- 172.21.15.5:0/1044591016 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140075c0 con 0x55a5e1054ec0 2023-10-07T00:13:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f2934e36b80 1 -- 172.21.15.5:0/1044591016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f291400f040 con 0x55a5e1054ec0 2023-10-07T00:13:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.371+0000 7f28feff5700 1 -- 172.21.15.5:0/1044591016 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2914033080 con 0x55a5e1054ec0 2023-10-07T00:13:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.372+0000 7f28feff5700 1 -- 172.21.15.5:0/1044591016 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2914007720 con 0x55a5e1054ec0 2023-10-07T00:13:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.372+0000 7f2934e36b80 10 client.25657 fetch_fsmap learned FSMap version 26 2023-10-07T00:13:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.372+0000 7f2934e36b80 1 -- 172.21.15.5:0/1044591016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a5e0dd1250 con 0x55a5e1054ec0 2023-10-07T00:13:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.372+0000 7f28feff5700 1 -- 172.21.15.5:0/1044591016 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f291400f040 con 0x55a5e1054ec0 2023-10-07T00:13:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.373+0000 7f28feff5700 1 -- 172.21.15.5:0/1044591016 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f29140157c0 con 0x55a5e1054ec0 2023-10-07T00:13:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.373+0000 7f2934e36b80 10 client.25657 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:13:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.373+0000 7f2934e36b80 10 client.25657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:13:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.373+0000 7f2934e36b80 20 client.25657 populate_metadata read hostname 'smithi005' 2023-10-07T00:13:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.373+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a5e10be930 0x55a5e10c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:13:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.373+0000 7f2934e36b80 4 client.25657 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:13:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.373+0000 7f2934e36b80 1 -- 172.21.15.5:0/1044591016 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a5e0fa0ad0 con 0x55a5e10be930 2023-10-07T00:13:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.374+0000 7f291a7fc700 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a5e10be930 0x55a5e10c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:13:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.374+0000 7f291a7fc700 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a5e10be930 0x55a5e10c0d20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1dc9be3ed8d900 server_cookie=dececab2b983a5c7 in_seq=0 out_seq=0 2023-10-07T00:13:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.374+0000 7f28feff5700 10 client.25657 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.378+0000 7f28feff5700 1 -- 172.21.15.5:0/1044591016 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a5e0fa0ad0 con 0x55a5e10be930 2023-10-07T00:13:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f28feff5700 10 client.25657 handle_command_reply: tid=0 2023-10-07T00:13:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 client.25657 shutdown 2023-10-07T00:13:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 -- 172.21.15.5:0/1044591016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 msgr2=0x55a5e1063850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e1063850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2914009480 tx=0x7f291400b040 comp rx=0 tx=0).stop 2023-10-07T00:13:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 -- 172.21.15.5:0/1044591016 shutdown_connections 2023-10-07T00:13:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55a5e10be930 0x55a5e10c0d20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5e1056990 0x55a5e1064da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a5e1054ec0 0x55a5e1063850 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f28feff5700 0 client.25657 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:13:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 --2- 172.21.15.5:0/1044591016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a5e1055fd0 0x55a5e1063d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 -- 172.21.15.5:0/1044591016 >> 172.21.15.5:0/1044591016 conn(0x55a5e0fc9200 msgr2=0x55a5e1066990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 -- 172.21.15.5:0/1044591016 shutdown_connections 2023-10-07T00:13:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.379+0000 7f2934e36b80 1 -- 172.21.15.5:0/1044591016 wait complete. 2023-10-07T00:13:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.380+0000 7f2934e36b80 20 client.25657 trim_cache size 0 max 16384 2023-10-07T00:13:55.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:13:55.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:13:55.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:13:55.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:13:55.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.380+0000 7f29215ff700 1 -- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29040a1500 msgr2=0x7f29040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29040a1500 0x7f29040a39c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f290c0979d0 tx=0x7f290c0a1040 comp rx=0 tx=0).stop 2023-10-07T00:13:55.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 -- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c101980 msgr2=0x7f291c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:13:55.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c101980 0x7f291c101310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f290c009230 tx=0x7f290c00b790 comp rx=0 tx=0).stop 2023-10-07T00:13:55.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 -- 172.21.15.5:0/1591876837 shutdown_connections 2023-10-07T00:13:55.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29040a1500 0x7f29040a39c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c106be0 0x7f291c0ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c101980 0x7f291c101310 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 --2- 172.21.15.5:0/1591876837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c1042b0 0x7f291c0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:13:55.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.381+0000 7f29215ff700 1 -- 172.21.15.5:0/1591876837 >> 172.21.15.5:0/1591876837 conn(0x7f291c0fb390 msgr2=0x7f291c1025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:13:55.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.382+0000 7f29215ff700 1 -- 172.21.15.5:0/1591876837 shutdown_connections 2023-10-07T00:13:55.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:13:55.382+0000 7f29215ff700 1 -- 172.21.15.5:0/1591876837 wait complete. 2023-10-07T00:13:57.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:56 smithi005 ceph-mon[129406]: pgmap v381: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2023-10-07T00:13:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:56 smithi088 ceph-mon[103111]: pgmap v381: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2023-10-07T00:13:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:56 smithi112 ceph-mon[133548]: pgmap v381: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2023-10-07T00:13:59.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:13:58 smithi005 ceph-mon[129406]: pgmap v382: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:13:58 smithi088 ceph-mon[103111]: pgmap v382: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:13:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:13:58 smithi112 ceph-mon[133548]: pgmap v382: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:14:01.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:00 smithi005 ceph-mon[129406]: pgmap v383: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:14:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:00 smithi088 ceph-mon[103111]: pgmap v383: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:14:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:00 smithi112 ceph-mon[133548]: pgmap v383: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:14:03.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:02 smithi005 ceph-mon[129406]: pgmap v384: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:14:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:02 smithi088 ceph-mon[103111]: pgmap v384: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:14:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:02 smithi112 ceph-mon[133548]: pgmap v384: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:14:05.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:04 smithi005 ceph-mon[129406]: pgmap v385: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:14:05.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:04 smithi088 ceph-mon[103111]: pgmap v385: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:14:05.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:04 smithi112 ceph-mon[133548]: pgmap v385: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-07T00:14:07.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:06 smithi005 ceph-mon[129406]: pgmap v386: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:14:07.199 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 62% (7512/12065) Updating files: 63% (7601/12065) Updating files: 64% (7722/12065) Updating files: 65% (7843/12065) Updating files: 66% (7963/12065) Updating files: 67% (8084/12065) Updating files: 68% (8205/12065) Updating files: 69% (8325/12065) Updating files: 70% (8446/12065) Updating files: 71% (8567/12065) Updating files: 72% (8687/12065) Updating files: 73% (8808/12065) Updating files: 74% (8929/12065) Updating files: 75% (9049/12065) Updating files: 76% (9170/12065) Updating files: 77% (9291/12065) Updating files: 78% (9411/12065) Updating files: 79% (9532/12065) Updating files: 80% (9652/12065) Updating files: 81% (9773/12065) Updating files: 82% (9894/12065) Updating files: 83% (10014/12065) Updating files: 84% (10135/12065) Updating files: 85% (10256/12065) Updating files: 86% (10376/12065) Updating files: 87% (10497/12065) Updating files: 88% (10618/12065) Updating files: 89% (10738/12065) Updating files: 90% (10859/12065) Updating files: 91% (10980/12065) Updating files: 92% (11100/12065) Updating files: 93% (11221/12065) Updating files: 94% (11342/12065) Updating files: 95% (11462/12065) Updating files: 96% (11583/12065) Updating files: 97% (11704/12065) Updating files: 98% (11824/12065) Updating files: 98% (11929/12065) Updating files: 99% (11945/12065) Updating files: 100% (12065/12065) Updating files: 100% (12065/12065), done. 2023-10-07T00:14:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:06 smithi088 ceph-mon[103111]: pgmap v386: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:14:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:06 smithi112 ceph-mon[133548]: pgmap v386: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-07T00:14:07.383 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to '14d8d032507701c76ca224e769ee65a96b660a8c'. 2023-10-07T00:14:07.383 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2023-10-07T00:14:07.384 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:07.385 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2023-10-07T00:14:07.385 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:07.385 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-07T00:14:07.385 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:07.385 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 14d8d032507 Merge remote-tracking branch 'rishabh/ceph-auth-caps-val-caps' into rishabh-cephfs-mon 2023-10-07T00:14:07.386 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-07T00:14:07.439 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-07T00:14:07.444 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-07T00:14:07.444 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-07T00:14:07.982 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-07T00:14:08.069 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-07T00:14:08.133 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-07T00:14:08.137 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-07T00:14:08.137 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-07T00:14:08.200 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-07T00:14:08.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:14:08.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-07T00:14:08.251 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2023-10-07T00:14:08.252 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2023-10-07T00:14:08.252 DEBUG:teuthology.orchestra.run.smithi005:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=14d8d032507701c76ca224e769ee65a96b660a8c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2023-10-07T00:14:08.358 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'getting blogbench' 2023-10-07T00:14:08.358 INFO:tasks.workunit.client.0.smithi005.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-10-07T00:14:08.358 INFO:tasks.workunit.client.0.smithi005.stdout:getting blogbench 2023-10-07T00:14:08.392 INFO:tasks.workunit.client.0.smithi005.stderr:--2023-10-07 00:14:08-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-10-07T00:14:08.393 INFO:tasks.workunit.client.0.smithi005.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-07T00:14:08.430 INFO:tasks.workunit.client.0.smithi005.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-07T00:14:08.465 INFO:tasks.workunit.client.0.smithi005.stderr:HTTP request sent, awaiting response... 200 OK 2023-10-07T00:14:08.466 INFO:tasks.workunit.client.0.smithi005.stderr:Length: 103355 (101K) [application/octet-stream] 2023-10-07T00:14:08.469 INFO:tasks.workunit.client.0.smithi005.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2023-10-07T00:14:08.474 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:08.537 INFO:tasks.workunit.client.0.smithi005.stderr: 0K .......... .......... .......... .......... .......... 49% 732K 0s 2023-10-07T00:14:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 -- 172.21.15.5:0/1372712693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854100f10 msgr2=0x7fd854101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1372712693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854100f10 0x7fd854101330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd844009990 tx=0x7fd844009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 -- 172.21.15.5:0/1372712693 shutdown_connections 2023-10-07T00:14:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1372712693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd854102a20 0x7fd854109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1372712693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854100f10 0x7fd854101330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1372712693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd854102060 0x7fd8541024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 -- 172.21.15.5:0/1372712693 >> 172.21.15.5:0/1372712693 conn(0x7fd8540fc480 msgr2=0x7fd8540fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 -- 172.21.15.5:0/1372712693 shutdown_connections 2023-10-07T00:14:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.543+0000 7fd8591ff700 1 -- 172.21.15.5:0/1372712693 wait complete. 2023-10-07T00:14:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.544+0000 7fd8591ff700 1 Processor -- start 2023-10-07T00:14:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.544+0000 7fd8591ff700 1 -- start start 2023-10-07T00:14:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.544+0000 7fd8591ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd854100f10 0x7fd854196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.544+0000 7fd8591ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854102060 0x7fd8541971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.544+0000 7fd8591ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd854102a20 0x7fd85419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.544+0000 7fd8591ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85419e800 con 0x7fd854102060 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.544+0000 7fd8591ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85419e970 con 0x7fd854100f10 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.544+0000 7fd8591ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85419eb30 con 0x7fd854102a20 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854102060 0x7fd8541971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854102060 0x7fd8541971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35930/0 (socket says 172.21.15.5:35930) 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 -- 172.21.15.5:0/1314104206 learned_addr learned my addr 172.21.15.5:0/1314104206 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd852d9d700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd854100f10 0x7fd854196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85359e700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd854102a20 0x7fd85419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 -- 172.21.15.5:0/1314104206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd854102a20 msgr2=0x7fd85419e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd854102a20 0x7fd85419e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 -- 172.21.15.5:0/1314104206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd854100f10 msgr2=0x7fd854196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd854100f10 0x7fd854196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 -- 172.21.15.5:0/1314104206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440095f0 con 0x7fd854102060 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85359e700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd854102a20 0x7fd85419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd85259c700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854102060 0x7fd8541971d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd84800b530 tx=0x7fd84800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd83bfff700 1 -- 172.21.15.5:0/1314104206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848011830 con 0x7fd854102060 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd83bfff700 1 -- 172.21.15.5:0/1314104206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd848011e20 con 0x7fd854102060 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd83bfff700 1 -- 172.21.15.5:0/1314104206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800f2e0 con 0x7fd854102060 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.545+0000 7fd8591ff700 1 -- 172.21.15.5:0/1314104206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85419ee10 con 0x7fd854102060 2023-10-07T00:14:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.546+0000 7fd8591ff700 1 -- 172.21.15.5:0/1314104206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85419f2c0 con 0x7fd854102060 2023-10-07T00:14:08.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.549+0000 7fd83bfff700 1 -- 172.21.15.5:0/1314104206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd848011990 con 0x7fd854102060 2023-10-07T00:14:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd86cab4b80 1 Processor -- start 2023-10-07T00:14:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd86cab4b80 1 -- start start 2023-10-07T00:14:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd83bfff700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd83c0a1500 0x7fd83c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd83bfff700 1 -- 172.21.15.5:0/1314104206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd8480cc830 con 0x7fd854102060 2023-10-07T00:14:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8a8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a80f400 con 0x55e35a8a8990 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a800bc0 con 0x55e35a8a6ec0 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a7fe4e0 con 0x55e35a8a7fd0 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.551+0000 7fd85359e700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd83c0a1500 0x7fd83c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd852d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35938/0 (socket says 172.21.15.5:35938) 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 -- 172.21.15.5:0/2370180647 learned_addr learned my addr 172.21.15.5:0/2370180647 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 -- 172.21.15.5:0/2370180647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 msgr2=0x55e35a8a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 --2- 172.21.15.5:0/2370180647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8a8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 -- 172.21.15.5:0/2370180647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a6ec0 msgr2=0x55e35a8a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 --2- 172.21.15.5:0/2370180647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 -- 172.21.15.5:0/2370180647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e35a624d80 con 0x55e35a8a8990 2023-10-07T00:14:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd852d9d700 1 --2- 172.21.15.5:0/2370180647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd83c0a1500 0x7fd83c0a39c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00ec60 tx=0x7fd84c009e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.552+0000 7fd85359e700 1 --2- 172.21.15.5:0/2370180647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8af220 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009340 tx=0x7fd84c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bf072ed7e8e9ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd8397fa700 1 -- 172.21.15.5:0/2370180647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c009bd0 con 0x55e35a8a8990 2023-10-07T00:14:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd8397fa700 1 -- 172.21.15.5:0/2370180647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd84c008c40 con 0x55e35a8a8990 2023-10-07T00:14:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd8397fa700 1 -- 172.21.15.5:0/2370180647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c01caf0 con 0x55e35a8a8990 2023-10-07T00:14:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2370180647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 msgr2=0x55e35a8af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/2370180647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8af220 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009340 tx=0x7fd84c018000 comp rx=0 tx=0).stop 2023-10-07T00:14:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2370180647 shutdown_connections 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/2370180647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8af220 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/2370180647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.553+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/2370180647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.554+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2370180647 >> 172.21.15.5:0/2370180647 conn(0x55e35a81b200 msgr2=0x55e35a8a1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.554+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2370180647 shutdown_connections 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.554+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2370180647 wait complete. 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.554+0000 7fd86cab4b80 1 -- start start 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.554+0000 7fd86cab4b80 1 Processor -- start 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 0x55e35a8b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a7fd0 0x55e35a8b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a7f9dd0 con 0x55e35a8a8990 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a7966b0 con 0x55e35a8a7fd0 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a796350 con 0x55e35a8a6ec0 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd86cab4b80 10 client.0 _ll_register_callbacks cb 0x55e35a5f37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd85359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd85359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35944/0 (socket says 172.21.15.5:35944) 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd85359e700 1 -- 172.21.15.5:0/3366835832 learned_addr learned my addr 172.21.15.5:0/3366835832 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd85259c700 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a7fd0 0x55e35a8b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.555+0000 7fd852d9d700 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 0x55e35a8b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd85359e700 1 -- 172.21.15.5:0/3366835832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 msgr2=0x55e35a8b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd85359e700 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 0x55e35a8b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd85359e700 1 -- 172.21.15.5:0/3366835832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a7fd0 msgr2=0x55e35a8b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd85359e700 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a7fd0 0x55e35a8b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd85359e700 1 -- 172.21.15.5:0/3366835832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd854109c70 con 0x55e35a8a8990 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd85359e700 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8bc5e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd84c004c20 tx=0x7fd84c009a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f52040485c6276a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd836ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd836ff5700 1 -- 172.21.15.5:0/3366835832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0089c0 con 0x55e35a8a8990 2023-10-07T00:14:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd86cab4b80 1 -- 172.21.15.5:0/3366835832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e35a899d50 con 0x55e35a8a8990 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd836ff5700 1 -- 172.21.15.5:0/3366835832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd84c006e40 con 0x55e35a8a8990 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd836ff5700 1 -- 172.21.15.5:0/3366835832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd84c01c7f0 con 0x55e35a8a8990 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd86cab4b80 10 client.15903 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.556+0000 7fd86cab4b80 1 -- 172.21.15.5:0/3366835832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fd84c016040 con 0x55e35a8a8990 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd836ff5700 1 -- 172.21.15.5:0/3366835832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e35a899d50 con 0x55e35a8a8990 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd836ff5700 1 -- 172.21.15.5:0/3366835832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd84c0258d0 con 0x55e35a8a8990 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd86cab4b80 10 client.15903 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd86cab4b80 10 client.15903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd86cab4b80 20 client.15903 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e35a8c0de0 0x55e35a8c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd86cab4b80 4 client.15903 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd86cab4b80 1 -- 172.21.15.5:0/3366835832 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e35a7f2db0 con 0x55e35a8c0de0 2023-10-07T00:14:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.557+0000 7fd852d9d700 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e35a8c0de0 0x55e35a8c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.558+0000 7fd836ff5700 10 client.15903 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.558+0000 7fd852d9d700 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e35a8c0de0 0x55e35a8c3200 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53058d1ed6d303b8 server_cookie=df604681d5ec5d32 in_seq=0 out_seq=0 2023-10-07T00:14:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd836ff5700 1 -- 172.21.15.5:0/3366835832 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e35a7f2db0 con 0x55e35a8c0de0 2023-10-07T00:14:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd836ff5700 10 client.15903 handle_command_reply: tid=0 2023-10-07T00:14:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 client.15903 shutdown 2023-10-07T00:14:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 -- 172.21.15.5:0/3366835832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 msgr2=0x55e35a8bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8bc5e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd84c004c20 tx=0x7fd84c009a80 comp rx=0 tx=0).stop 2023-10-07T00:14:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 -- 172.21.15.5:0/3366835832 shutdown_connections 2023-10-07T00:14:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e35a8c0de0 0x55e35a8c3200 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a8990 0x55e35a8bc5e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 0x55e35a8b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/3366835832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a7fd0 0x55e35a8b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd836ff5700 0 client.15903 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 -- 172.21.15.5:0/3366835832 >> 172.21.15.5:0/3366835832 conn(0x55e35a81b200 msgr2=0x55e35a8a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 -- 172.21.15.5:0/3366835832 shutdown_connections 2023-10-07T00:14:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 1 -- 172.21.15.5:0/3366835832 wait complete. 2023-10-07T00:14:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.559+0000 7fd86cab4b80 20 client.15903 trim_cache size 0 max 16384 2023-10-07T00:14:08.573 INFO:tasks.workunit.client.0.smithi005.stderr: 50K .......... .......... .......... .......... .......... 99% 1.39M 0s 2023-10-07T00:14:08.573 INFO:tasks.workunit.client.0.smithi005.stderr: 100K 100% 1779G=0.1s 2023-10-07T00:14:08.573 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:08.574 INFO:tasks.workunit.client.0.smithi005.stderr:2023-10-07 00:14:08 (977 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2023-10-07T00:14:08.574 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-10-07T00:14:08.575 INFO:tasks.workunit.client.0.smithi005.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2023-10-07T00:14:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd86cab4b80 1 Processor -- start 2023-10-07T00:14:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd86cab4b80 1 -- start start 2023-10-07T00:14:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a67a8c0 con 0x55e35a8a6ec0 2023-10-07T00:14:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a8a2a50 con 0x55e35a8a8990 2023-10-07T00:14:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a8ab450 con 0x55e35a8a7fd0 2023-10-07T00:14:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd852d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd852d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35954/0 (socket says 172.21.15.5:35954) 2023-10-07T00:14:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd85359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.576+0000 7fd852d9d700 1 -- 172.21.15.5:0/2801358527 learned_addr learned my addr 172.21.15.5:0/2801358527 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd85259c700 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd852d9d700 1 -- 172.21.15.5:0/2801358527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 msgr2=0x55e35a8bc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd852d9d700 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8bc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd852d9d700 1 -- 172.21.15.5:0/2801358527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 msgr2=0x55e35a8b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd852d9d700 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd852d9d700 1 -- 172.21.15.5:0/2801358527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e35a60dc00 con 0x55e35a8a6ec0 2023-10-07T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd85259c700 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd85359e700 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd852d9d700 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a83b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd844009990 tx=0x7fd844009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5978f30ec50574 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd839ffb700 1 -- 172.21.15.5:0/2801358527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84401d070 con 0x55e35a8a6ec0 2023-10-07T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd839ffb700 1 -- 172.21.15.5:0/2801358527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd84401e040 con 0x55e35a8a6ec0 2023-10-07T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.577+0000 7fd839ffb700 1 -- 172.21.15.5:0/2801358527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844005540 con 0x55e35a8a6ec0 2023-10-07T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2801358527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a6ec0 msgr2=0x55e35a8a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a83b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd844009990 tx=0x7fd844009310 comp rx=0 tx=0).stop 2023-10-07T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2801358527 shutdown_connections 2023-10-07T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a6ec0 0x55e35a8a83b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/2801358527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a7fd0 0x55e35a8bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2801358527 >> 172.21.15.5:0/2801358527 conn(0x55e35a81b200 msgr2=0x55e35a8c7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2801358527 shutdown_connections 2023-10-07T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.578+0000 7fd86cab4b80 1 -- 172.21.15.5:0/2801358527 wait complete. 2023-10-07T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 1 -- start start 2023-10-07T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 1 Processor -- start 2023-10-07T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 0x55e35a8b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a7fd0 0x55e35a8ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a8bba10 con 0x55e35a8a7fd0 2023-10-07T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a8bbb80 con 0x55e35a8a8990 2023-10-07T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e35a8bbd40 con 0x55e35a8a6ec0 2023-10-07T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd86cab4b80 10 client.0 _ll_register_callbacks cb 0x7fd844009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.579+0000 7fd85259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a7fd0 0x55e35a8ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a7fd0 0x55e35a8ba4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35968/0 (socket says 172.21.15.5:35968) 2023-10-07T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85259c700 1 -- 172.21.15.5:0/1860640062 learned_addr learned my addr 172.21.15.5:0/1860640062 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd852d9d700 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 0x55e35a8b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85359e700 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85259c700 1 -- 172.21.15.5:0/1860640062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 msgr2=0x55e35a8b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85259c700 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 0x55e35a8b9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85259c700 1 -- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 msgr2=0x55e35a8bb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85259c700 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8bb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85259c700 1 -- 172.21.15.5:0/1860640062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c016040 con 0x55e35a8a7fd0 2023-10-07T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85359e700 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8bb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd85259c700 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a7fd0 0x55e35a8ba4c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd8480997d0 tx=0x7fd848011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9734eea1cc0c8e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd836ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd836ff5700 1 -- 172.21.15.5:0/1860640062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848011c40 con 0x55e35a8a7fd0 2023-10-07T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd86cab4b80 1 -- 172.21.15.5:0/1860640062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd84c008c40 con 0x55e35a8a7fd0 2023-10-07T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.580+0000 7fd836ff5700 1 -- 172.21.15.5:0/1860640062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd84809a1d0 con 0x55e35a8a7fd0 2023-10-07T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd836ff5700 1 -- 172.21.15.5:0/1860640062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd848099ad0 con 0x55e35a8a7fd0 2023-10-07T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd86cab4b80 10 client.15909 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd86cab4b80 1 -- 172.21.15.5:0/1860640062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fd84400baf0 con 0x55e35a8a7fd0 2023-10-07T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd836ff5700 1 -- 172.21.15.5:0/1860640062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd84c008c40 con 0x55e35a8a7fd0 2023-10-07T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd836ff5700 1 -- 172.21.15.5:0/1860640062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd848099d30 con 0x55e35a8a7fd0 2023-10-07T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd86cab4b80 10 client.15909 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd86cab4b80 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd86cab4b80 20 client.15909 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e35a9157e0 0x55e35a917c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd86cab4b80 4 client.15909 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.581+0000 7fd86cab4b80 1 -- 172.21.15.5:0/1860640062 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e35a7f2ad0 con 0x55e35a9157e0 2023-10-07T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.582+0000 7fd852d9d700 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e35a9157e0 0x55e35a917c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.582+0000 7fd852d9d700 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e35a9157e0 0x55e35a917c00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19535d51fada4b55 server_cookie=bb483a9898e00886 in_seq=0 out_seq=0 2023-10-07T00:14:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.582+0000 7fd836ff5700 10 client.15909 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.597+0000 7fd836ff5700 1 -- 172.21.15.5:0/1860640062 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e35a7f2ad0 con 0x55e35a9157e0 2023-10-07T00:14:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.597+0000 7fd836ff5700 10 client.15909 handle_command_reply: tid=0 2023-10-07T00:14:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.597+0000 7fd86cab4b80 1 client.15909 shutdown 2023-10-07T00:14:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 -- 172.21.15.5:0/1860640062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a7fd0 msgr2=0x55e35a8ba4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a7fd0 0x55e35a8ba4c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd8480997d0 tx=0x7fd848011f90 comp rx=0 tx=0).stop 2023-10-07T00:14:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 -- 172.21.15.5:0/1860640062 shutdown_connections 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e35a9157e0 0x55e35a917c00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e35a8a8990 0x55e35a8bb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e35a8a6ec0 0x55e35a8b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd836ff5700 0 client.15909 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 --2- 172.21.15.5:0/1860640062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e35a8a7fd0 0x55e35a8ba4c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 -- 172.21.15.5:0/1860640062 >> 172.21.15.5:0/1860640062 conn(0x55e35a81b200 msgr2=0x55e35a8b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 -- 172.21.15.5:0/1860640062 shutdown_connections 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 1 -- 172.21.15.5:0/1860640062 wait complete. 2023-10-07T00:14:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.598+0000 7fd86cab4b80 20 client.15909 trim_cache size 0 max 16384 2023-10-07T00:14:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:14:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:14:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:14:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 -- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd83c0a1500 msgr2=0x7fd83c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd83c0a1500 0x7fd83c0a39c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00ec60 tx=0x7fd84c009e30 comp rx=0 tx=0).stop 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 -- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854102060 msgr2=0x7fd8541971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854102060 0x7fd8541971d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd84800b530 tx=0x7fd84800b840 comp rx=0 tx=0).stop 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 -- 172.21.15.5:0/1314104206 shutdown_connections 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd83c0a1500 0x7fd83c0a39c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd854102a20 0x7fd85419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd854100f10 0x7fd854196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 --2- 172.21.15.5:0/1314104206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd854102060 0x7fd8541971d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 -- 172.21.15.5:0/1314104206 >> 172.21.15.5:0/1314104206 conn(0x7fd8540fc480 msgr2=0x7fd854105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 -- 172.21.15.5:0/1314104206 shutdown_connections 2023-10-07T00:14:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:08.599+0000 7fd8591ff700 1 -- 172.21.15.5:0/1314104206 wait complete. 2023-10-07T00:14:08.622 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/ 2023-10-07T00:14:08.624 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/m4/ 2023-10-07T00:14:08.627 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/m4/acx_pthread.m4 2023-10-07T00:14:08.631 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/man/ 2023-10-07T00:14:08.634 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/man/blogbench.8 2023-10-07T00:14:08.637 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/man/Makefile.am 2023-10-07T00:14:08.640 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/man/Makefile.in 2023-10-07T00:14:08.644 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/ 2023-10-07T00:14:08.647 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/mysnprintf.c 2023-10-07T00:14:08.651 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/mysnprintf.h 2023-10-07T00:14:08.654 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/blogbench.c 2023-10-07T00:14:08.657 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/blogbench.h 2023-10-07T00:14:08.660 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/fakesnprintf.c 2023-10-07T00:14:08.663 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/fakesnprintf.h 2023-10-07T00:14:08.666 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/blogbench_p.h 2023-10-07T00:14:08.674 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/bsd-getopt_long.c 2023-10-07T00:14:08.675 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/bsd-getopt_long.h 2023-10-07T00:14:08.677 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/Makefile.am 2023-10-07T00:14:08.679 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/Makefile.in 2023-10-07T00:14:08.683 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/process.c 2023-10-07T00:14:08.686 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/globals.h 2023-10-07T00:14:08.688 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/commenter.c 2023-10-07T00:14:08.691 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/rewriter.c 2023-10-07T00:14:08.694 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/reader.c 2023-10-07T00:14:08.696 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/writer.c 2023-10-07T00:14:08.699 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/src/helpers.c 2023-10-07T00:14:08.702 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/NEWS 2023-10-07T00:14:08.705 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/compile 2023-10-07T00:14:08.707 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/depcomp 2023-10-07T00:14:08.711 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/aclocal.m4 2023-10-07T00:14:08.714 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/README 2023-10-07T00:14:08.717 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/configure 2023-10-07T00:14:08.730 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/configure.ac 2023-10-07T00:14:08.733 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/config.guess 2023-10-07T00:14:08.737 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/install-sh 2023-10-07T00:14:08.740 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/config.sub 2023-10-07T00:14:08.744 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/missing 2023-10-07T00:14:08.747 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/mkinstalldirs 2023-10-07T00:14:08.750 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/Makefile.am 2023-10-07T00:14:08.752 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/Makefile.in 2023-10-07T00:14:08.755 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/config.h.in 2023-10-07T00:14:08.757 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/AUTHORS 2023-10-07T00:14:08.760 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/INSTALL 2023-10-07T00:14:08.763 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/ChangeLog 2023-10-07T00:14:08.765 INFO:tasks.workunit.client.0.smithi005.stdout:blogbench-1.0/COPYING 2023-10-07T00:14:08.769 INFO:tasks.workunit.client.0.smithi005.stderr:+ cd blogbench-1.0/ 2023-10-07T00:14:08.772 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'making blogbench' 2023-10-07T00:14:08.772 INFO:tasks.workunit.client.0.smithi005.stderr:+ ./configure 2023-10-07T00:14:08.772 INFO:tasks.workunit.client.0.smithi005.stdout:making blogbench 2023-10-07T00:14:09.022 INFO:tasks.workunit.client.0.smithi005.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-10-07T00:14:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:08 smithi005 ceph-mon[129406]: pgmap v387: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2023-10-07T00:14:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:08 smithi088 ceph-mon[103111]: pgmap v387: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2023-10-07T00:14:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:08 smithi112 ceph-mon[133548]: pgmap v387: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2023-10-07T00:14:10.041 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether build environment is sane... yes 2023-10-07T00:14:10.076 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gawk... gawk 2023-10-07T00:14:10.132 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether make sets $(MAKE)... yes 2023-10-07T00:14:10.169 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gcc... gcc 2023-10-07T00:14:10.304 INFO:tasks.workunit.client.0.smithi005.stdout:checking for C compiler default output file name... a.out 2023-10-07T00:14:10.312 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether the C compiler works... yes 2023-10-07T00:14:10.318 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether we are cross compiling... no 2023-10-07T00:14:10.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:14:10.410 INFO:tasks.workunit.client.0.smithi005.stdout:checking for suffix of executables... 2023-10-07T00:14:10.505 INFO:tasks.workunit.client.0.smithi005.stdout:checking for suffix of object files... o 2023-10-07T00:14:10.600 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether we are using the GNU C compiler... yes 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.601+0000 7f77dffff700 1 -- 172.21.15.5:0/1544519096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102170 msgr2=0x7f77d81025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.601+0000 7f77dffff700 1 --2- 172.21.15.5:0/1544519096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102170 0x7f77d81025d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f77d40099c0 tx=0x7f77d4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.601+0000 7f77dffff700 1 -- 172.21.15.5:0/1544519096 shutdown_connections 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.601+0000 7f77dffff700 1 --2- 172.21.15.5:0/1544519096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77d8102b10 0x7f77d81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.601+0000 7f77dffff700 1 --2- 172.21.15.5:0/1544519096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77d8100f80 0x7f77d81013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.601+0000 7f77dffff700 1 --2- 172.21.15.5:0/1544519096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102170 0x7f77d81025d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.601+0000 7f77dffff700 1 -- 172.21.15.5:0/1544519096 >> 172.21.15.5:0/1544519096 conn(0x7f77d80fc510 msgr2=0x7f77d80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.602+0000 7f77dffff700 1 -- 172.21.15.5:0/1544519096 shutdown_connections 2023-10-07T00:14:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.602+0000 7f77dffff700 1 -- 172.21.15.5:0/1544519096 wait complete. 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.603+0000 7f77dffff700 1 Processor -- start 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.603+0000 7f77dffff700 1 -- start start 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.603+0000 7f77dffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77d8100f80 0x7f77d8074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.603+0000 7f77dffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77d8102170 0x7f77d80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.603+0000 7f77dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102b10 0x7f77d80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.603+0000 7f77dffff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8073f80 con 0x7f77d8102b10 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.603+0000 7f77dffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80740f0 con 0x7f77d8100f80 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.603+0000 7f77dffff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d81a0be0 con 0x7f77d8102170 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77d8100f80 0x7f77d8074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77d8100f80 0x7f77d8074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:35424/0 (socket says 172.21.15.5:35424) 2023-10-07T00:14:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77ddd9b700 1 -- 172.21.15.5:0/1269134806 learned_addr learned my addr 172.21.15.5:0/1269134806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77de59c700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102b10 0x7f77d80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77dd59a700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77d8102170 0x7f77d80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77ddd9b700 1 -- 172.21.15.5:0/1269134806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77d8102170 msgr2=0x7f77d80732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77d8102170 0x7f77d80732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77ddd9b700 1 -- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102b10 msgr2=0x7f77d80737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102b10 0x7f77d80737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.604+0000 7f77ddd9b700 1 -- 172.21.15.5:0/1269134806 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40095f0 con 0x7f77d8100f80 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.605+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77d8100f80 0x7f77d8074c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00d980 tx=0x7f77cc00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.605+0000 7f77caffd700 1 -- 172.21.15.5:0/1269134806 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc004020 con 0x7f77d8100f80 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.605+0000 7f77dffff700 1 -- 172.21.15.5:0/1269134806 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d81a0ec0 con 0x7f77d8100f80 2023-10-07T00:14:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.605+0000 7f77caffd700 1 -- 172.21.15.5:0/1269134806 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77cc00f690 con 0x7f77d8100f80 2023-10-07T00:14:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.605+0000 7f77caffd700 1 -- 172.21.15.5:0/1269134806 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0039e0 con 0x7f77d8100f80 2023-10-07T00:14:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.605+0000 7f77dffff700 1 -- 172.21.15.5:0/1269134806 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d81a1340 con 0x7f77d8100f80 2023-10-07T00:14:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.609+0000 7f77caffd700 1 -- 172.21.15.5:0/1269134806 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f77cc00f800 con 0x7f77d8100f80 2023-10-07T00:14:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.610+0000 7f77f3859b80 1 Processor -- start 2023-10-07T00:14:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.610+0000 7f77f3859b80 1 -- start start 2023-10-07T00:14:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0260 0x55bca27d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0bc0 0x55bca27d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d1a60 0x55bca27d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77f3859b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2738460 con 0x55bca27d1a60 2023-10-07T00:14:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77f3859b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2729c20 con 0x55bca27d0260 2023-10-07T00:14:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77f3859b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2727540 con 0x55bca27d0bc0 2023-10-07T00:14:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77caffd700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f77c40a1480 0x7f77c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77de59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0260 0x55bca27d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77caffd700 1 -- 172.21.15.5:0/1269134806 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f77cc0cc940 con 0x7f77d8100f80 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77de59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0260 0x55bca27d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:35438/0 (socket says 172.21.15.5:35438) 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.611+0000 7f77de59c700 1 -- 172.21.15.5:0/1478750936 learned_addr learned my addr 172.21.15.5:0/1478750936 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77dd59a700 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d1a60 0x55bca27d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0bc0 0x55bca27d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77de59c700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f77c40a1480 0x7f77c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77de59c700 1 -- 172.21.15.5:0/1478750936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0bc0 msgr2=0x55bca27d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77de59c700 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0bc0 0x55bca27d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77de59c700 1 -- 172.21.15.5:0/1478750936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d1a60 msgr2=0x55bca27d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77de59c700 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d1a60 0x55bca27d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77de59c700 1 -- 172.21.15.5:0/1478750936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bca254dde0 con 0x55bca27d0260 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.612+0000 7f77de59c700 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0260 0x55bca27d0680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009550 tx=0x7f77d0007b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28276570c44c9081 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.613+0000 7f77de59c700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f77c40a1480 0x7f77c40a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f77d0010000 tx=0x7f77d001c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.613+0000 7f77c3fff700 1 -- 172.21.15.5:0/1478750936 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0019c40 con 0x55bca27d0260 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.613+0000 7f77c3fff700 1 -- 172.21.15.5:0/1478750936 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77d000f040 con 0x55bca27d0260 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.613+0000 7f77c3fff700 1 -- 172.21.15.5:0/1478750936 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d001ab60 con 0x55bca27d0260 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 -- 172.21.15.5:0/1478750936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0260 msgr2=0x55bca27d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0260 0x55bca27d0680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009550 tx=0x7f77d0007b70 comp rx=0 tx=0).stop 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 -- 172.21.15.5:0/1478750936 shutdown_connections 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d1a60 0x55bca27d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0260 0x55bca27d0680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1478750936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0bc0 0x55bca27d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 -- 172.21.15.5:0/1478750936 >> 172.21.15.5:0/1478750936 conn(0x55bca2744260 msgr2=0x55bca27cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 -- 172.21.15.5:0/1478750936 shutdown_connections 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.614+0000 7f77f3859b80 1 -- 172.21.15.5:0/1478750936 wait complete. 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 1 -- start start 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 1 Processor -- start 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0260 0x55bca27da060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0bc0 0x55bca27da5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d1a60 0x55bca27e15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2722e30 con 0x55bca27d0bc0 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca26bf710 con 0x55bca27d1a60 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca26bf3b0 con 0x55bca27d0260 2023-10-07T00:14:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.615+0000 7f77f3859b80 10 client.0 _ll_register_callbacks cb 0x55bca251c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77de59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d1a60 0x55bca27e15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77dd59a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0bc0 0x55bca27da5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0260 0x55bca27da060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77de59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d1a60 0x55bca27e15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:35450/0 (socket says 172.21.15.5:35450) 2023-10-07T00:14:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77de59c700 1 -- 172.21.15.5:0/232802533 learned_addr learned my addr 172.21.15.5:0/232802533 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77ddd9b700 1 -- 172.21.15.5:0/232802533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d1a60 msgr2=0x55bca27e15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d1a60 0x55bca27e15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77ddd9b700 1 -- 172.21.15.5:0/232802533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0bc0 msgr2=0x55bca27da5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0bc0 0x55bca27da5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.616+0000 7f77ddd9b700 1 -- 172.21.15.5:0/232802533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d0011040 con 0x55bca27d0260 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0260 0x55bca27da060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77cc096650 tx=0x7f77cc00fc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a621d52b55dfda6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77c17fa700 1 -- 172.21.15.5:0/232802533 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc09a040 con 0x55bca27d0260 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77c17fa700 1 -- 172.21.15.5:0/232802533 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f77cc099be0 con 0x55bca27d0260 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77f3859b80 1 -- 172.21.15.5:0/232802533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bca27c2f10 con 0x55bca27d0260 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77c17fa700 1 -- 172.21.15.5:0/232802533 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77cc09dd30 con 0x55bca27d0260 2023-10-07T00:14:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77f3859b80 10 client.25678 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77f3859b80 1 -- 172.21.15.5:0/232802533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bca2536c60 con 0x55bca27d0260 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.617+0000 7f77c17fa700 1 -- 172.21.15.5:0/232802533 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bca27c2f10 con 0x55bca27d0260 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.618+0000 7f77c17fa700 1 -- 172.21.15.5:0/232802533 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77cc0a1ae0 con 0x55bca27d0260 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.618+0000 7f77f3859b80 10 client.25678 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.618+0000 7f77f3859b80 10 client.25678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.618+0000 7f77f3859b80 20 client.25678 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.618+0000 7f77f3859b80 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bca27e5dc0 0x55bca27e81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.618+0000 7f77f3859b80 4 client.25678 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.618+0000 7f77f3859b80 1 -- 172.21.15.5:0/232802533 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bca271be10 con 0x55bca27e5dc0 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.618+0000 7f77dd59a700 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bca27e5dc0 0x55bca27e81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.619+0000 7f77dd59a700 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bca27e5dc0 0x55bca27e81e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36b3969635f9466a server_cookie=5b5915337d9adfaf in_seq=0 out_seq=0 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.619+0000 7f77c17fa700 10 client.25678 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77c17fa700 1 -- 172.21.15.5:0/232802533 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bca271be10 con 0x55bca27e5dc0 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77c17fa700 10 client.25678 handle_command_reply: tid=0 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 client.25678 shutdown 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 -- 172.21.15.5:0/232802533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0260 msgr2=0x55bca27da060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0260 0x55bca27da060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77cc096650 tx=0x7f77cc00fc40 comp rx=0 tx=0).stop 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 -- 172.21.15.5:0/232802533 shutdown_connections 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bca27e5dc0 0x55bca27e81e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d1a60 0x55bca27e15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d0260 0x55bca27da060 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77c17fa700 0 client.25678 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 --2- 172.21.15.5:0/232802533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0bc0 0x55bca27da5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 -- 172.21.15.5:0/232802533 >> 172.21.15.5:0/232802533 conn(0x55bca2744260 msgr2=0x55bca27caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 -- 172.21.15.5:0/232802533 shutdown_connections 2023-10-07T00:14:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 1 -- 172.21.15.5:0/232802533 wait complete. 2023-10-07T00:14:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.620+0000 7f77f3859b80 20 client.25678 trim_cache size 0 max 16384 2023-10-07T00:14:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77f3859b80 1 Processor -- start 2023-10-07T00:14:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77f3859b80 1 -- start start 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27d4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 0x55bca27d4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 0x55bca27e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77f3859b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca25a3920 con 0x55bca27d0260 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77f3859b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca271be10 con 0x55bca27d0bc0 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77f3859b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca27e32d0 con 0x55bca27d1a60 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27d4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27d4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36012/0 (socket says 172.21.15.5:36012) 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.640+0000 7f77ddd9b700 1 -- 172.21.15.5:0/953642107 learned_addr learned my addr 172.21.15.5:0/953642107 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77dd59a700 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 0x55bca27d4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77de59c700 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 0x55bca27e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77ddd9b700 1 -- 172.21.15.5:0/953642107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 msgr2=0x55bca27e15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 0x55bca27e15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77ddd9b700 1 -- 172.21.15.5:0/953642107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 msgr2=0x55bca27d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 0x55bca27d4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77ddd9b700 1 -- 172.21.15.5:0/953642107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bca2574250 con 0x55bca27d0260 2023-10-07T00:14:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27d4a00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00d950 tx=0x7f77cc095f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510bdb9c7ecfea78 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77c8ff9700 1 -- 172.21.15.5:0/953642107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc099be0 con 0x55bca27d0260 2023-10-07T00:14:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77c8ff9700 1 -- 172.21.15.5:0/953642107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77cc09dd30 con 0x55bca27d0260 2023-10-07T00:14:10.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.641+0000 7f77c8ff9700 1 -- 172.21.15.5:0/953642107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0990d0 con 0x55bca27d0260 2023-10-07T00:14:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 -- 172.21.15.5:0/953642107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 msgr2=0x55bca27d4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27d4a00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00d950 tx=0x7f77cc095f20 comp rx=0 tx=0).stop 2023-10-07T00:14:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 -- 172.21.15.5:0/953642107 shutdown_connections 2023-10-07T00:14:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 0x55bca27e15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27d4a00 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 --2- 172.21.15.5:0/953642107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 0x55bca27d4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 -- 172.21.15.5:0/953642107 >> 172.21.15.5:0/953642107 conn(0x55bca2744260 msgr2=0x55bca27d8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:10.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 -- 172.21.15.5:0/953642107 shutdown_connections 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.642+0000 7f77f3859b80 1 -- 172.21.15.5:0/953642107 wait complete. 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 1 -- start start 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 1 Processor -- start 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 0x55bca27e1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 0x55bca27df580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca27dfc90 con 0x55bca27d0260 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca27dfe00 con 0x55bca27d0bc0 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca27dffc0 con 0x55bca27d1a60 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.643+0000 7f77f3859b80 10 client.0 _ll_register_callbacks cb 0x7f77cc099540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27e0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36026/0 (socket says 172.21.15.5:36026) 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 -- 172.21.15.5:0/1638272395 learned_addr learned my addr 172.21.15.5:0/1638272395 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77dd59a700 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 0x55bca27e1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77de59c700 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 0x55bca27df580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 -- 172.21.15.5:0/1638272395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 msgr2=0x55bca27df580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 0x55bca27df580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 -- 172.21.15.5:0/1638272395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 msgr2=0x55bca27e1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 0x55bca27e1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 -- 172.21.15.5:0/1638272395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bca2536c60 con 0x55bca27d0260 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77ddd9b700 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27e0f50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0998e0 tx=0x7f77cc00fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7be7bec967da81f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.644+0000 7f77c17fa700 1 -- 172.21.15.5:0/1638272395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc09a040 con 0x55bca27d0260 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77c17fa700 1 -- 172.21.15.5:0/1638272395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f77cc0a1f70 con 0x55bca27d0260 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 1 -- 172.21.15.5:0/1638272395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77d000f040 con 0x55bca27d0260 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77c17fa700 1 -- 172.21.15.5:0/1638272395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77cc099be0 con 0x55bca27d0260 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 10 client.15927 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 1 -- 172.21.15.5:0/1638272395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bca254c2b0 con 0x55bca27d0260 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77c17fa700 1 -- 172.21.15.5:0/1638272395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77d000f040 con 0x55bca27d0260 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77c17fa700 1 -- 172.21.15.5:0/1638272395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77cc098b40 con 0x55bca27d0260 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 20 client.15927 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:10.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bca283ab30 0x55bca283cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 4 client.15927 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:14:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.645+0000 7f77f3859b80 1 -- 172.21.15.5:0/1638272395 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bca271bb30 con 0x55bca283ab30 2023-10-07T00:14:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.646+0000 7f77dd59a700 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bca283ab30 0x55bca283cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.646+0000 7f77dd59a700 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bca283ab30 0x55bca283cf20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5011e034cae7470d server_cookie=70750f8c68cda31 in_seq=0 out_seq=0 2023-10-07T00:14:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.646+0000 7f77c17fa700 10 client.15927 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77c17fa700 1 -- 172.21.15.5:0/1638272395 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55bca271bb30 con 0x55bca283ab30 2023-10-07T00:14:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77c17fa700 10 client.15927 handle_command_reply: tid=0 2023-10-07T00:14:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 client.15927 shutdown 2023-10-07T00:14:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 -- 172.21.15.5:0/1638272395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 msgr2=0x55bca27e0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27e0f50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0998e0 tx=0x7f77cc00fbb0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 -- 172.21.15.5:0/1638272395 shutdown_connections 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bca283ab30 0x55bca283cf20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bca27d1a60 0x55bca27df580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bca27d0260 0x55bca27e0f50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 --2- 172.21.15.5:0/1638272395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bca27d0bc0 0x55bca27e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 -- 172.21.15.5:0/1638272395 >> 172.21.15.5:0/1638272395 conn(0x55bca2744260 msgr2=0x55bca27d4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77c17fa700 0 client.15927 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 -- 172.21.15.5:0/1638272395 shutdown_connections 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 1 -- 172.21.15.5:0/1638272395 wait complete. 2023-10-07T00:14:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.647+0000 7f77f3859b80 20 client.15927 trim_cache size 0 max 16384 2023-10-07T00:14:10.654 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:14:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2023-10-07T00:14:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2023-10-07T00:14:10.654 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 -- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f77c40a1480 msgr2=0x7f77c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f77c40a1480 0x7f77c40a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f77d0010000 tx=0x7f77d001c000 comp rx=0 tx=0).stop 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 -- 172.21.15.5:0/1269134806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77d8100f80 msgr2=0x7f77d8074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77d8100f80 0x7f77d8074c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00d980 tx=0x7f77cc00dc90 comp rx=0 tx=0).stop 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 -- 172.21.15.5:0/1269134806 shutdown_connections 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f77c40a1480 0x7f77c40a3940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102b10 0x7f77d80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77d8100f80 0x7f77d8074c60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 --2- 172.21.15.5:0/1269134806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77d8102170 0x7f77d80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 -- 172.21.15.5:0/1269134806 >> 172.21.15.5:0/1269134806 conn(0x7f77d80fc510 msgr2=0x7f77d80fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 -- 172.21.15.5:0/1269134806 shutdown_connections 2023-10-07T00:14:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.648+0000 7f77dffff700 1 -- 172.21.15.5:0/1269134806 wait complete. 2023-10-07T00:14:10.668 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-07T00:14:10.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:14:10.701 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether gcc accepts -g... yes 2023-10-07T00:14:10.813 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gcc option to accept ANSI C... none needed 2023-10-07T00:14:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.921+0000 7f20989ff700 1 -- 172.21.15.5:0/2441907742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20941021a0 msgr2=0x7f2094102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.921+0000 7f20989ff700 1 --2- 172.21.15.5:0/2441907742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20941021a0 0x7f2094102600 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f20880099c0 tx=0x7f2088009cd0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.921+0000 7f20989ff700 1 -- 172.21.15.5:0/2441907742 shutdown_connections 2023-10-07T00:14:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.921+0000 7f20989ff700 1 --2- 172.21.15.5:0/2441907742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2094102b40 0x7f20941093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.921+0000 7f20989ff700 1 --2- 172.21.15.5:0/2441907742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2094100fb0 0x7f20941013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.921+0000 7f20989ff700 1 --2- 172.21.15.5:0/2441907742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20941021a0 0x7f2094102600 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.922+0000 7f20989ff700 1 -- 172.21.15.5:0/2441907742 >> 172.21.15.5:0/2441907742 conn(0x7f20940fc520 msgr2=0x7f20940fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.922+0000 7f20989ff700 1 -- 172.21.15.5:0/2441907742 shutdown_connections 2023-10-07T00:14:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.922+0000 7f20989ff700 1 -- 172.21.15.5:0/2441907742 wait complete. 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.923+0000 7f20989ff700 1 Processor -- start 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.923+0000 7f20989ff700 1 -- start start 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.923+0000 7f20989ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2094100fb0 0x7f2094196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.923+0000 7f20989ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20941021a0 0x7f20941970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.923+0000 7f20989ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2094102b40 0x7f209419e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.923+0000 7f20989ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209419e730 con 0x7f2094100fb0 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.923+0000 7f20989ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209419e870 con 0x7f2094102b40 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.923+0000 7f20989ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209419ea00 con 0x7f20941021a0 2023-10-07T00:14:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2094100fb0 0x7f2094196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2094100fb0 0x7f2094196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36052/0 (socket says 172.21.15.5:36052) 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 -- 172.21.15.5:0/1879518105 learned_addr learned my addr 172.21.15.5:0/1879518105 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f2092d9d700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2094102b40 0x7f209419e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f2091d9b700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20941021a0 0x7f20941970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 -- 172.21.15.5:0/1879518105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20941021a0 msgr2=0x7f20941970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20941021a0 0x7f20941970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 -- 172.21.15.5:0/1879518105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2094102b40 msgr2=0x7f209419e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2094102b40 0x7f209419e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 -- 172.21.15.5:0/1879518105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880095f0 con 0x7f2094100fb0 2023-10-07T00:14:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.924+0000 7f209259c700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2094100fb0 0x7f2094196bb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f208400e970 tx=0x7f208400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.925+0000 7f20837fe700 1 -- 172.21.15.5:0/1879518105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084009790 con 0x7f2094100fb0 2023-10-07T00:14:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.925+0000 7f20837fe700 1 -- 172.21.15.5:0/1879518105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f208400c7e0 con 0x7f2094100fb0 2023-10-07T00:14:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.925+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209419ece0 con 0x7f2094100fb0 2023-10-07T00:14:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.925+0000 7f20837fe700 1 -- 172.21.15.5:0/1879518105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084003bd0 con 0x7f2094100fb0 2023-10-07T00:14:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.925+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209419f1a0 con 0x7f2094100fb0 2023-10-07T00:14:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.926+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209410c670 con 0x7f2094100fb0 2023-10-07T00:14:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.928+0000 7f20837fe700 1 -- 172.21.15.5:0/1879518105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f208400c950 con 0x7f2094100fb0 2023-10-07T00:14:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.929+0000 7f20837fe700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f207c0a1480 0x7f207c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:10.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.929+0000 7f20837fe700 1 -- 172.21.15.5:0/1879518105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2084014070 con 0x7f2094100fb0 2023-10-07T00:14:10.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.930+0000 7f2091d9b700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f207c0a1480 0x7f207c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:10.931 INFO:tasks.workunit.client.0.smithi005.stdout:checking for style of include used by make... GNU 2023-10-07T00:14:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.930+0000 7f2091d9b700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f207c0a1480 0x7f207c0a3940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2088009990 tx=0x7f2088005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:10.934+0000 7f20837fe700 1 -- 172.21.15.5:0/1879518105 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2084096500 con 0x7f2094100fb0 2023-10-07T00:14:11.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:10 smithi005 ceph-mon[129406]: pgmap v388: 97 pgs: 97 active+clean; 783 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-10-07T00:14:11.200 INFO:tasks.workunit.client.0.smithi005.stdout:checking dependency style of gcc... gcc3 2023-10-07T00:14:11.200 INFO:tasks.workunit.client.0.smithi005.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-10-07T00:14:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:10 smithi088 ceph-mon[103111]: pgmap v388: 97 pgs: 97 active+clean; 783 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-10-07T00:14:11.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.233+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2094107f30 con 0x7f2094100fb0 2023-10-07T00:14:11.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.233+0000 7f20837fe700 1 -- 172.21.15.5:0/1879518105 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11345 (secure 0 0 0) 0x7f2084099b20 con 0x7f2094100fb0 2023-10-07T00:14:11.235 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:14:11.235 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:11:20.652397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f207c0a1480 msgr2=0x7f207c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f207c0a1480 0x7f207c0a3940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2088009990 tx=0x7f2088005be0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2094100fb0 msgr2=0x7f2094196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2094100fb0 0x7f2094196bb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f208400e970 tx=0x7f208400ec80 comp rx=0 tx=0).stop 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 shutdown_connections 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f207c0a1480 0x7f207c0a3940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2094102b40 0x7f209419e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2094100fb0 0x7f2094196bb0 secure :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f208400e970 tx=0x7f208400ec80 comp rx=0 tx=0).stop 2023-10-07T00:14:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 --2- 172.21.15.5:0/1879518105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20941021a0 0x7f20941970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.236+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 >> 172.21.15.5:0/1879518105 conn(0x7f20940fc520 msgr2=0x7f20940fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.237+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 shutdown_connections 2023-10-07T00:14:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.237+0000 7f20989ff700 1 -- 172.21.15.5:0/1879518105 wait complete. 2023-10-07T00:14:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-10-07T00:14:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:10 smithi112 ceph-mon[133548]: pgmap v388: 97 pgs: 97 active+clean; 783 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-10-07T00:14:11.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-07T00:14:11.329 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to run the C preprocessor... gcc -E 2023-10-07T00:14:11.449 INFO:tasks.workunit.client.0.smithi005.stdout:checking for egrep... grep -E 2023-10-07T00:14:11.477 INFO:tasks.workunit.client.0.smithi005.stdout:checking for AIX... no 2023-10-07T00:14:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.481+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1568126503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 msgr2=0x7f3e44109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.481+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1568126503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 0x7f3e44109110 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00b0a0 tx=0x7f3e3c00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.481+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1568126503 shutdown_connections 2023-10-07T00:14:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.481+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1568126503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 0x7f3e44109110 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.482+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1568126503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e44101a40 0x7f3e44103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.482+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1568126503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e44104370 0x7f3e44106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.482+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1568126503 >> 172.21.15.5:0/1568126503 conn(0x7f3e440fb450 msgr2=0x7f3e440fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.482+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1568126503 shutdown_connections 2023-10-07T00:14:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.482+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1568126503 wait complete. 2023-10-07T00:14:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e4b7ff700 1 Processor -- start 2023-10-07T00:14:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e4b7ff700 1 -- start start 2023-10-07T00:14:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e4b7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e44101a40 0x7f3e441013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e4b7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e44104370 0x7f3e440ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e4b7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 0x7f3e440fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e4b7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441006d0 con 0x7f3e44106ca0 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e4b7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44100840 con 0x7f3e44104370 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e4b7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441a0cf0 con 0x7f3e44101a40 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e49d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 0x7f3e440fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e48d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e44104370 0x7f3e440ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e48d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e44104370 0x7f3e440ff9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:35496/0 (socket says 172.21.15.5:35496) 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e49d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 0x7f3e440fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36080/0 (socket says 172.21.15.5:36080) 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.483+0000 7f3e48d9a700 1 -- 172.21.15.5:0/1263672398 learned_addr learned my addr 172.21.15.5:0/1263672398 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e4959b700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e44101a40 0x7f3e441013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e48d9a700 1 -- 172.21.15.5:0/1263672398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e44101a40 msgr2=0x7f3e441013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e44101a40 0x7f3e441013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e48d9a700 1 -- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 msgr2=0x7f3e440fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 0x7f3e440fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e48d9a700 1 -- 172.21.15.5:0/1263672398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c009d00 con 0x7f3e44104370 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e44104370 0x7f3e440ff9f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400d950 tx=0x7f3e3400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e3a7fc700 1 -- 172.21.15.5:0/1263672398 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400f890 con 0x7f3e44104370 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e3a7fc700 1 -- 172.21.15.5:0/1263672398 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e3400fe80 con 0x7f3e44104370 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1263672398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e441a0fd0 con 0x7f3e44104370 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.484+0000 7f3e3a7fc700 1 -- 172.21.15.5:0/1263672398 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400e3b0 con 0x7f3e44104370 2023-10-07T00:14:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.485+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1263672398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e441a1400 con 0x7f3e44104370 2023-10-07T00:14:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.488+0000 7f3e3a7fc700 1 -- 172.21.15.5:0/1263672398 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3e34010460 con 0x7f3e44104370 2023-10-07T00:14:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.489+0000 7f3e5f1fdb80 1 Processor -- start 2023-10-07T00:14:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.489+0000 7f3e3a7fc700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3e300a1480 0x7f3e300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e5f1fdb80 1 -- start start 2023-10-07T00:14:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e3a7fc700 1 -- 172.21.15.5:0/1263672398 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3e340ccb10 con 0x7f3e44104370 2023-10-07T00:14:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3e300a1480 0x7f3e300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be1f4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be1f5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be1f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be15c460 con 0x55a6be1f4260 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be14dc20 con 0x55a6be1f5a60 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be14b540 con 0x55a6be1f4bc0 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e4959b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be1f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e4959b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be1f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36086/0 (socket says 172.21.15.5:36086) 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.490+0000 7f3e4959b700 1 -- 172.21.15.5:0/4248052853 learned_addr learned my addr 172.21.15.5:0/4248052853 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be1f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be1f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e4959b700 1 -- 172.21.15.5:0/4248052853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 msgr2=0x55a6be1f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e4959b700 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be1f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e4959b700 1 -- 172.21.15.5:0/4248052853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 msgr2=0x55a6be1f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e4959b700 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be1f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e4959b700 1 -- 172.21.15.5:0/4248052853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6bdf71de0 con 0x55a6be1f4260 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be1f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3e300a1480 0x7f3e300a3940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00b780 tx=0x7f3e3c009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e4959b700 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be1f4680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009d80 tx=0x7f3e40011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf8ac9b8c38e88c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e2f7fe700 1 -- 172.21.15.5:0/4248052853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40004230 con 0x55a6be1f4260 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e2f7fe700 1 -- 172.21.15.5:0/4248052853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e40004390 con 0x55a6be1f4260 2023-10-07T00:14:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.491+0000 7f3e2f7fe700 1 -- 172.21.15.5:0/4248052853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40019800 con 0x55a6be1f4260 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4248052853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 msgr2=0x55a6be1f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be1f4680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009d80 tx=0x7f3e40011720 comp rx=0 tx=0).stop 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4248052853 shutdown_connections 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be1f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be1f4680 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4248052853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be1f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4248052853 >> 172.21.15.5:0/4248052853 conn(0x55a6be168260 msgr2=0x55a6be1ef140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4248052853 shutdown_connections 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.492+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4248052853 wait complete. 2023-10-07T00:14:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 1 -- start start 2023-10-07T00:14:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 1 Processor -- start 2023-10-07T00:14:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4260 0x55a6be1fe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be1fe550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be205590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be146e30 con 0x55a6be1f4bc0 2023-10-07T00:14:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be0e3710 con 0x55a6be1f5a60 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be0e33b0 con 0x55a6be1f4260 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.493+0000 7f3e5f1fdb80 10 client.0 _ll_register_callbacks cb 0x55a6bdf40800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e48d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be1fe550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e49d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be205590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e48d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be1fe550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36088/0 (socket says 172.21.15.5:36088) 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e48d9a700 1 -- 172.21.15.5:0/3442222947 learned_addr learned my addr 172.21.15.5:0/3442222947 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e49d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be205590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:35516/0 (socket says 172.21.15.5:35516) 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e4959b700 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4260 0x55a6be1fe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e49d9c700 1 -- 172.21.15.5:0/3442222947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4260 msgr2=0x55a6be1fe010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4260 0x55a6be1fe010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e49d9c700 1 -- 172.21.15.5:0/3442222947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 msgr2=0x55a6be1fe550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be1fe550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e49d9c700 1 -- 172.21.15.5:0/3442222947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e400099e0 con 0x55a6be1f5a60 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be1fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be205590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00b070 tx=0x7f3e3c00b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cd799a189f26932 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.494+0000 7f3e2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.495+0000 7f3e2cff9700 1 -- 172.21.15.5:0/3442222947 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00e040 con 0x55a6be1f5a60 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.495+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3442222947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6be1e6f10 con 0x55a6be1f5a60 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.495+0000 7f3e2cff9700 1 -- 172.21.15.5:0/3442222947 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3e3c00bdf0 con 0x55a6be1f5a60 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.495+0000 7f3e2cff9700 1 -- 172.21.15.5:0/3442222947 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e3c01e870 con 0x55a6be1f5a60 2023-10-07T00:14:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.495+0000 7f3e5f1fdb80 10 client.25721 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.495+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3442222947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a6bdf5ac60 con 0x55a6be1f5a60 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.495+0000 7f3e2cff9700 1 -- 172.21.15.5:0/3442222947 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e3c038020 con 0x55a6be1f5a60 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e2cff9700 1 -- 172.21.15.5:0/3442222947 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3e3c027030 con 0x55a6be1f5a60 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e5f1fdb80 10 client.25721 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e5f1fdb80 10 client.25721 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e5f1fdb80 20 client.25721 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55a6be209e10 0x55a6be20c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e5f1fdb80 4 client.25721 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3442222947 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6be13fe10 con 0x55a6be209e10 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e4959b700 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55a6be209e10 0x55a6be20c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e2cff9700 10 client.25721 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.496+0000 7f3e4959b700 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55a6be209e10 0x55a6be20c230 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5efcaa12401208e1 server_cookie=14e3f8d5b23bc6f1 in_seq=0 out_seq=0 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.497+0000 7f3e2cff9700 1 -- 172.21.15.5:0/3442222947 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a6be13fe10 con 0x55a6be209e10 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.497+0000 7f3e2cff9700 10 client.25721 handle_command_reply: tid=0 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.497+0000 7f3e5f1fdb80 1 client.25721 shutdown 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.497+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3442222947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 msgr2=0x55a6be205590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.497+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be205590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00b070 tx=0x7f3e3c00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3442222947 shutdown_connections 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55a6be209e10 0x55a6be20c230 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be205590 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4260 0x55a6be1fe010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3442222947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be1fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3442222947 >> 172.21.15.5:0/3442222947 conn(0x55a6be168260 msgr2=0x55a6be1eef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e2cff9700 0 client.25721 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:14:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3442222947 shutdown_connections 2023-10-07T00:14:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3442222947 wait complete. 2023-10-07T00:14:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.498+0000 7f3e5f1fdb80 20 client.25721 trim_cache size 0 max 16384 2023-10-07T00:14:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.513+0000 7f3e5f1fdb80 1 Processor -- start 2023-10-07T00:14:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.513+0000 7f3e5f1fdb80 1 -- start start 2023-10-07T00:14:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f4260 0x55a6be1fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be205550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f5a60 0x55a6be1eef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bdfc7920 con 0x55a6be1f4bc0 2023-10-07T00:14:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be1f0270 con 0x55a6be1f4260 2023-10-07T00:14:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be1f4fa0 con 0x55a6be1f5a60 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e48d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be205550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e48d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be205550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36104/0 (socket says 172.21.15.5:36104) 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.514+0000 7f3e48d9a700 1 -- 172.21.15.5:0/3582552091 learned_addr learned my addr 172.21.15.5:0/3582552091 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f5a60 0x55a6be1eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e4959b700 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f4260 0x55a6be1fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e48d9a700 1 -- 172.21.15.5:0/3582552091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f5a60 msgr2=0x55a6be1eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f5a60 0x55a6be1eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e48d9a700 1 -- 172.21.15.5:0/3582552091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f4260 msgr2=0x55a6be1fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f4260 0x55a6be1fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e48d9a700 1 -- 172.21.15.5:0/3582552091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6bdf98250 con 0x55a6be1f4bc0 2023-10-07T00:14:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be205550 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3e34099d40 tx=0x7f3e34099810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b200670da8dc762d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e2ffff700 1 -- 172.21.15.5:0/3582552091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34014070 con 0x55a6be1f4bc0 2023-10-07T00:14:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e2ffff700 1 -- 172.21.15.5:0/3582552091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e34099db0 con 0x55a6be1f4bc0 2023-10-07T00:14:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.515+0000 7f3e2ffff700 1 -- 172.21.15.5:0/3582552091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3409a270 con 0x55a6be1f4bc0 2023-10-07T00:14:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3582552091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 msgr2=0x55a6be205550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be205550 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3e34099d40 tx=0x7f3e34099810 comp rx=0 tx=0).stop 2023-10-07T00:14:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3582552091 shutdown_connections 2023-10-07T00:14:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f5a60 0x55a6be1eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f4260 0x55a6be1fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/3582552091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4bc0 0x55a6be205550 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3582552091 >> 172.21.15.5:0/3582552091 conn(0x55a6be168260 msgr2=0x55a6be210b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3582552091 shutdown_connections 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.516+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/3582552091 wait complete. 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.517+0000 7f3e5f1fdb80 1 -- start start 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.517+0000 7f3e5f1fdb80 1 Processor -- start 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.518+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be2012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.518+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be2017f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.518+0000 7f3e5f1fdb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be204810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.518+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be204d50 con 0x55a6be1f4260 2023-10-07T00:14:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.518+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be204ec0 con 0x55a6be1f5a60 2023-10-07T00:14:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.518+0000 7f3e5f1fdb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6be205080 con 0x55a6be1f4bc0 2023-10-07T00:14:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.518+0000 7f3e5f1fdb80 10 client.0 _ll_register_callbacks cb 0x7f3e3c007ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:11.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.518+0000 7f3e4959b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be2012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e48d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be2017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e4959b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be2012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36110/0 (socket says 172.21.15.5:36110) 2023-10-07T00:14:11.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e4959b700 1 -- 172.21.15.5:0/4247988324 learned_addr learned my addr 172.21.15.5:0/4247988324 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be204810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e48d9a700 1 -- 172.21.15.5:0/4247988324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 msgr2=0x55a6be204810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be204810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e48d9a700 1 -- 172.21.15.5:0/4247988324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 msgr2=0x55a6be2012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be2012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e48d9a700 1 -- 172.21.15.5:0/4247988324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e441a1400 con 0x55a6be1f4bc0 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e49d9c700 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be204810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e4959b700 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be2012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e48d9a700 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be2017f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55a6be1e97d0 tx=0x7f3e34098150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3780b74ae93a8a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.519+0000 7f3e2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e2cff9700 1 -- 172.21.15.5:0/4247988324 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34014070 con 0x55a6be1f4bc0 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e2cff9700 1 -- 172.21.15.5:0/4247988324 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3e3409df00 con 0x55a6be1f4bc0 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4247988324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e40004390 con 0x55a6be1f4bc0 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e2cff9700 1 -- 172.21.15.5:0/4247988324 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e340a1cb0 con 0x55a6be1f4bc0 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e5f1fdb80 10 client.25702 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4247988324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a6bdf702b0 con 0x55a6be1f4bc0 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e2cff9700 1 -- 172.21.15.5:0/4247988324 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e40004390 con 0x55a6be1f4bc0 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e2cff9700 1 -- 172.21.15.5:0/4247988324 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3e34095c30 con 0x55a6be1f4bc0 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e5f1fdb80 10 client.25702 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e5f1fdb80 10 client.25702 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.520+0000 7f3e5f1fdb80 20 client.25702 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.521+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55a6be25e750 0x55a6be260b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.521+0000 7f3e5f1fdb80 4 client.25702 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.521+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4247988324 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a6be13fb30 con 0x55a6be25e750 2023-10-07T00:14:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.521+0000 7f3e4959b700 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55a6be25e750 0x55a6be260b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.521+0000 7f3e4959b700 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55a6be25e750 0x55a6be260b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d455ffda62cc2ef4 server_cookie=f8d56bcfa3e06b81 in_seq=0 out_seq=0 2023-10-07T00:14:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.521+0000 7f3e2cff9700 10 client.25702 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:14:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e2cff9700 1 -- 172.21.15.5:0/4247988324 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a6be13fb30 con 0x55a6be25e750 2023-10-07T00:14:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e2cff9700 10 client.25702 handle_command_reply: tid=0 2023-10-07T00:14:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 client.25702 shutdown 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4247988324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 msgr2=0x55a6be2017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be2017f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55a6be1e97d0 tx=0x7f3e34098150 comp rx=0 tx=0).stop 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4247988324 shutdown_connections 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55a6be25e750 0x55a6be260b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a6be1f5a60 0x55a6be204810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a6be1f4260 0x55a6be2012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 --2- 172.21.15.5:0/4247988324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a6be1f4bc0 0x55a6be2017f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4247988324 >> 172.21.15.5:0/4247988324 conn(0x55a6be168260 msgr2=0x55a6be1fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e2cff9700 0 client.25702 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:14:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.522+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4247988324 shutdown_connections 2023-10-07T00:14:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.523+0000 7f3e5f1fdb80 1 -- 172.21.15.5:0/4247988324 wait complete. 2023-10-07T00:14:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.523+0000 7f3e5f1fdb80 20 client.25702 trim_cache size 0 max 16384 2023-10-07T00:14:11.528 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3e300a1480 msgr2=0x7f3e300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3e300a1480 0x7f3e300a3940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00b780 tx=0x7f3e3c009580 comp rx=0 tx=0).stop 2023-10-07T00:14:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1263672398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e44104370 msgr2=0x7f3e440ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e44104370 0x7f3e440ff9f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400d950 tx=0x7f3e3400dc60 comp rx=0 tx=0).stop 2023-10-07T00:14:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1263672398 shutdown_connections 2023-10-07T00:14:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3e300a1480 0x7f3e300a3940 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e44106ca0 0x7f3e440fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e44101a40 0x7f3e441013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 --2- 172.21.15.5:0/1263672398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e44104370 0x7f3e440ff9f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1263672398 >> 172.21.15.5:0/1263672398 conn(0x7f3e440fb450 msgr2=0x7f3e441026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1263672398 shutdown_connections 2023-10-07T00:14:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.524+0000 7f3e4b7ff700 1 -- 172.21.15.5:0/1263672398 wait complete. 2023-10-07T00:14:11.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-07T00:14:11.654 INFO:tasks.workunit.client.0.smithi005.stdout:checking for library containing strerror... none required 2023-10-07T00:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 -- 172.21.15.5:0/856127390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da8102b50 msgr2=0x7f2da8109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/856127390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da8102b50 0x7f2da8109400 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009fc0 tx=0x7f2da000b330 comp rx=0 tx=0).stop 2023-10-07T00:14:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 -- 172.21.15.5:0/856127390 shutdown_connections 2023-10-07T00:14:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/856127390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da8102b50 0x7f2da8109400 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/856127390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2da8100fc0 0x7f2da81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/856127390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2da81021b0 0x7f2da8102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 -- 172.21.15.5:0/856127390 >> 172.21.15.5:0/856127390 conn(0x7f2da80fc530 msgr2=0x7f2da80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 -- 172.21.15.5:0/856127390 shutdown_connections 2023-10-07T00:14:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.769+0000 7f2daf7ff700 1 -- 172.21.15.5:0/856127390 wait complete. 2023-10-07T00:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.770+0000 7f2daf7ff700 1 Processor -- start 2023-10-07T00:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.770+0000 7f2daf7ff700 1 -- start start 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.770+0000 7f2daf7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2da8100fc0 0x7f2da8074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2daf7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da81021b0 0x7f2da80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2daf7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2da8102b50 0x7f2da80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2daf7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8073f80 con 0x7f2da81021b0 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2daf7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80740f0 con 0x7f2da8100fc0 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2daf7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da81a0d80 con 0x7f2da8102b50 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dacd9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da81021b0 0x7f2da80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dacd9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da81021b0 0x7f2da80732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36134/0 (socket says 172.21.15.5:36134) 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dacd9a700 1 -- 172.21.15.5:0/1203653792 learned_addr learned my addr 172.21.15.5:0/1203653792 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dadd9c700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2da8102b50 0x7f2da80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dad59b700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2da8100fc0 0x7f2da8074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dadd9c700 1 -- 172.21.15.5:0/1203653792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2da8100fc0 msgr2=0x7f2da8074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dadd9c700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2da8100fc0 0x7f2da8074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dadd9c700 1 -- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da81021b0 msgr2=0x7f2da80732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dadd9c700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da81021b0 0x7f2da80732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dadd9c700 1 -- 172.21.15.5:0/1203653792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da40095f0 con 0x7f2da8102b50 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.771+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da81021b0 0x7f2da80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.772+0000 7f2dadd9c700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2da8102b50 0x7f2da80737e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2da0015000 tx=0x7f2da0008c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.772+0000 7f2d9e7fc700 1 -- 172.21.15.5:0/1203653792 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da000e040 con 0x7f2da8102b50 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.772+0000 7f2d9e7fc700 1 -- 172.21.15.5:0/1203653792 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2da000bc00 con 0x7f2da8102b50 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.772+0000 7f2daf7ff700 1 -- 172.21.15.5:0/1203653792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da0009c40 con 0x7f2da8102b50 2023-10-07T00:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.772+0000 7f2d9e7fc700 1 -- 172.21.15.5:0/1203653792 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0005040 con 0x7f2da8102b50 2023-10-07T00:14:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.772+0000 7f2daf7ff700 1 -- 172.21.15.5:0/1203653792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da81a12f0 con 0x7f2da8102b50 2023-10-07T00:14:11.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.778+0000 7f2d9e7fc700 1 -- 172.21.15.5:0/1203653792 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2da001d470 con 0x7f2da8102b50 2023-10-07T00:14:11.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.778+0000 7f2dc31f3b80 1 Processor -- start 2023-10-07T00:14:11.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dc31f3b80 1 -- start start 2023-10-07T00:14:11.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dc260 0x56400a5dc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5dd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a544460 con 0x56400a5dcbc0 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a535c20 con 0x56400a5dda60 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a533540 con 0x56400a5dc260 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dad59b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dad59b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5dd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36136/0 (socket says 172.21.15.5:36136) 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2dad59b700 1 -- 172.21.15.5:0/887289265 learned_addr learned my addr 172.21.15.5:0/887289265 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.779+0000 7f2d9e7fc700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d940a1480 0x7f2d940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dc260 0x56400a5dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2d9e7fc700 1 -- 172.21.15.5:0/1203653792 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2da00ce050 con 0x7f2da8102b50 2023-10-07T00:14:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dadd9c700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d940a1480 0x7f2d940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dad59b700 1 -- 172.21.15.5:0/887289265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dc260 msgr2=0x56400a5dc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dad59b700 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dc260 0x56400a5dc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dad59b700 1 -- 172.21.15.5:0/887289265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 msgr2=0x56400a5ddee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dad59b700 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ddee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dad59b700 1 -- 172.21.15.5:0/887289265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56400a359de0 con 0x56400a5dcbc0 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dc260 0x56400a5dc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.780+0000 7f2dad59b700 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5dd480 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009fa0 tx=0x7f2da4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acb34fdfadd119f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.781+0000 7f2dadd9c700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d940a1480 0x7f2d940a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2da009b370 tx=0x7f2da0004f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.781+0000 7f2d937fe700 1 -- 172.21.15.5:0/887289265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4004a30 con 0x56400a5dcbc0 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.781+0000 7f2d937fe700 1 -- 172.21.15.5:0/887289265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2da40054b0 con 0x56400a5dcbc0 2023-10-07T00:14:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.781+0000 7f2d937fe700 1 -- 172.21.15.5:0/887289265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da40197d0 con 0x56400a5dcbc0 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.781+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/887289265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 msgr2=0x56400a5dd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.781+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5dd480 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009fa0 tx=0x7f2da4011720 comp rx=0 tx=0).stop 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.782+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/887289265 shutdown_connections 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.782+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ddee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.782+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dc260 0x56400a5dc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.782+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/887289265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5dd480 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.782+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/887289265 >> 172.21.15.5:0/887289265 conn(0x56400a550260 msgr2=0x56400a5d7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.782+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/887289265 shutdown_connections 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.782+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/887289265 wait complete. 2023-10-07T00:14:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.782+0000 7f2dc31f3b80 1 -- start start 2023-10-07T00:14:11.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dc31f3b80 1 Processor -- start 2023-10-07T00:14:11.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a52ee30 con 0x56400a5dc260 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a4cb710 con 0x56400a5dda60 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a4cb3b0 con 0x56400a5dcbc0 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dc31f3b80 10 client.0 _ll_register_callbacks cb 0x56400a328800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dacd9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dacd9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36146/0 (socket says 172.21.15.5:36146) 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.783+0000 7f2dacd9a700 1 -- 172.21.15.5:0/868584125 learned_addr learned my addr 172.21.15.5:0/868584125 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2dad59b700 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2dacd9a700 1 -- 172.21.15.5:0/868584125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 msgr2=0x56400a5e6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2dacd9a700 1 -- 172.21.15.5:0/868584125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 msgr2=0x56400a5ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2dacd9a700 1 -- 172.21.15.5:0/868584125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da4009bd0 con 0x56400a5dc260 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e5ff0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2d98003fb0 tx=0x7f2d98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ee8cfd291b3466 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2d90ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.784+0000 7f2d90ff9700 1 -- 172.21.15.5:0/868584125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98004830 con 0x56400a5dc260 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/868584125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56400a5cef10 con 0x56400a5dc260 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2d90ff9700 1 -- 172.21.15.5:0/868584125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2d98004990 con 0x56400a5dc260 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2d90ff9700 1 -- 172.21.15.5:0/868584125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d98004b50 con 0x56400a5dc260 2023-10-07T00:14:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2dc31f3b80 10 client.15963 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/868584125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56400a342c60 con 0x56400a5dc260 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2d90ff9700 1 -- 172.21.15.5:0/868584125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56400a5cef10 con 0x56400a5dc260 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2d90ff9700 1 -- 172.21.15.5:0/868584125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2d98004d40 con 0x56400a5dc260 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2dc31f3b80 10 client.15963 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2dc31f3b80 10 client.15963 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2dc31f3b80 20 client.15963 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.785+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x56400a5f1d80 0x56400a5f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.786+0000 7f2dc31f3b80 4 client.15963 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.786+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/868584125 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56400a527e10 con 0x56400a5f1d80 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.786+0000 7f2dad59b700 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x56400a5f1d80 0x56400a5f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.786+0000 7f2dad59b700 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x56400a5f1d80 0x56400a5f41a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e0c9dc5dc621443d server_cookie=ad213a6b0c8262b5 in_seq=0 out_seq=0 2023-10-07T00:14:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.786+0000 7f2d90ff9700 10 client.15963 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:14:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.787+0000 7f2d90ff9700 1 -- 172.21.15.5:0/868584125 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56400a527e10 con 0x56400a5f1d80 2023-10-07T00:14:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.787+0000 7f2d90ff9700 10 client.15963 handle_command_reply: tid=0 2023-10-07T00:14:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.787+0000 7f2dc31f3b80 1 client.15963 shutdown 2023-10-07T00:14:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.787+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/868584125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 msgr2=0x56400a5e5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.787+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e5ff0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2d98003fb0 tx=0x7f2d98004750 comp rx=0 tx=0).stop 2023-10-07T00:14:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/868584125 shutdown_connections 2023-10-07T00:14:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x56400a5f1d80 0x56400a5f41a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e5ff0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2d90ff9700 0 client.15963 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:14:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/868584125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/868584125 >> 172.21.15.5:0/868584125 conn(0x56400a550260 msgr2=0x56400a5d6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/868584125 shutdown_connections 2023-10-07T00:14:11.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/868584125 wait complete. 2023-10-07T00:14:11.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.788+0000 7f2dc31f3b80 20 client.15963 trim_cache size 0 max 16384 2023-10-07T00:14:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dc31f3b80 1 Processor -- start 2023-10-07T00:14:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dc31f3b80 1 -- start start 2023-10-07T00:14:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dc260 0x56400a5e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5ed530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dda60 0x56400a5e0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a3af920 con 0x56400a5dcbc0 2023-10-07T00:14:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a5dd220 con 0x56400a5dc260 2023-10-07T00:14:11.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a5dd690 con 0x56400a5dda60 2023-10-07T00:14:11.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dad59b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dad59b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5ed530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36156/0 (socket says 172.21.15.5:36156) 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dad59b700 1 -- 172.21.15.5:0/2818480963 learned_addr learned my addr 172.21.15.5:0/2818480963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.803+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dc260 0x56400a5e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2dad59b700 1 -- 172.21.15.5:0/2818480963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dda60 msgr2=0x56400a5e0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2dad59b700 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dda60 0x56400a5e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2dad59b700 1 -- 172.21.15.5:0/2818480963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dc260 msgr2=0x56400a5e3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2dad59b700 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dc260 0x56400a5e3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2dad59b700 1 -- 172.21.15.5:0/2818480963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56400a380250 con 0x56400a5dcbc0 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dc260 0x56400a5e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:11.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2dad59b700 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5ed530 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2da4005050 tx=0x7f2da4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2eaad35ce7b7853 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2d93fff700 1 -- 172.21.15.5:0/2818480963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da402a2e0 con 0x56400a5dcbc0 2023-10-07T00:14:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2d93fff700 1 -- 172.21.15.5:0/2818480963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2da402e070 con 0x56400a5dcbc0 2023-10-07T00:14:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.804+0000 7f2d93fff700 1 -- 172.21.15.5:0/2818480963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da40038e0 con 0x56400a5dcbc0 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/2818480963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 msgr2=0x56400a5ed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5ed530 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2da4005050 tx=0x7f2da4011720 comp rx=0 tx=0).stop 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/2818480963 shutdown_connections 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dda60 0x56400a5e0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dc260 0x56400a5e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/2818480963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dcbc0 0x56400a5ed530 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/2818480963 >> 172.21.15.5:0/2818480963 conn(0x56400a550260 msgr2=0x56400a5d6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/2818480963 shutdown_connections 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.805+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/2818480963 wait complete. 2023-10-07T00:14:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.806+0000 7f2dc31f3b80 1 -- start start 2023-10-07T00:14:11.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.806+0000 7f2dc31f3b80 1 Processor -- start 2023-10-07T00:14:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dc31f3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a5ed1c0 con 0x56400a5dc260 2023-10-07T00:14:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a5ed330 con 0x56400a5dda60 2023-10-07T00:14:11.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dc31f3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400a5ed4f0 con 0x56400a5dcbc0 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dc31f3b80 10 client.0 _ll_register_callbacks cb 0x56400a328800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dacd9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dacd9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36162/0 (socket says 172.21.15.5:36162) 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dacd9a700 1 -- 172.21.15.5:0/1844570932 learned_addr learned my addr 172.21.15.5:0/1844570932 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dad59b700 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.807+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2dacd9a700 1 -- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 msgr2=0x56400a5e9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2dacd9a700 1 -- 172.21.15.5:0/1844570932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 msgr2=0x56400a5ecc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ecc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2dacd9a700 1 -- 172.21.15.5:0/1844570932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56400a342c60 con 0x56400a5dc260 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2dad59b700 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2dacd9a700 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e9720 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2d98005370 tx=0x7f2d98000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5589cfb53f21494e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2d90ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.808+0000 7f2d90ff9700 1 -- 172.21.15.5:0/1844570932 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98010460 con 0x56400a5dc260 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/1844570932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2da40054b0 con 0x56400a5dc260 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2d90ff9700 1 -- 172.21.15.5:0/1844570932 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2d98000e40 con 0x56400a5dc260 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2d90ff9700 1 -- 172.21.15.5:0/1844570932 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d980105c0 con 0x56400a5dc260 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 10 client.15969 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/1844570932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56400a359de0 con 0x56400a5dc260 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2d90ff9700 1 -- 172.21.15.5:0/1844570932 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2da40054b0 con 0x56400a5dc260 2023-10-07T00:14:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2d90ff9700 1 -- 172.21.15.5:0/1844570932 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2d98004cc0 con 0x56400a5dc260 2023-10-07T00:14:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 10 client.15969 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 10 client.15969 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:14:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 20 client.15969 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x56400a646f10 0x56400a649300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 4 client.15969 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.809+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/1844570932 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56400a527b30 con 0x56400a646f10 2023-10-07T00:14:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.810+0000 7f2dad59b700 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x56400a646f10 0x56400a649300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.810+0000 7f2dad59b700 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x56400a646f10 0x56400a649300 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2d63a4031bbba3b9 server_cookie=bc97773185c99772 in_seq=0 out_seq=0 2023-10-07T00:14:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.810+0000 7f2d90ff9700 10 client.15969 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:14:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2d90ff9700 1 -- 172.21.15.5:0/1844570932 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56400a527b30 con 0x56400a646f10 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2d90ff9700 10 client.15969 handle_command_reply: tid=0 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 client.15969 shutdown 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/1844570932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 msgr2=0x56400a5e9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e9720 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2d98005370 tx=0x7f2d98000bc0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/1844570932 shutdown_connections 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x56400a646f10 0x56400a649300 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56400a5dda60 0x56400a5ecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56400a5dc260 0x56400a5e9720 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 --2- 172.21.15.5:0/1844570932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56400a5dcbc0 0x56400a5e9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/1844570932 >> 172.21.15.5:0/1844570932 conn(0x56400a550260 msgr2=0x56400a5e0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.811+0000 7f2d90ff9700 0 client.15969 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:14:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.812+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/1844570932 shutdown_connections 2023-10-07T00:14:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.812+0000 7f2dc31f3b80 1 -- 172.21.15.5:0/1844570932 wait complete. 2023-10-07T00:14:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.812+0000 7f2dc31f3b80 20 client.15969 trim_cache size 0 max 16384 2023-10-07T00:14:11.817 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.812+0000 7f2daf7ff700 1 -- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d940a1480 msgr2=0x7f2d940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.812+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d940a1480 0x7f2d940a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2da009b370 tx=0x7f2da0004f70 comp rx=0 tx=0).stop 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 -- 172.21.15.5:0/1203653792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2da8102b50 msgr2=0x7f2da80737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2da8102b50 0x7f2da80737e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2da0015000 tx=0x7f2da0008c80 comp rx=0 tx=0).stop 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 -- 172.21.15.5:0/1203653792 shutdown_connections 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d940a1480 0x7f2d940a3940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2da8102b50 0x7f2da80737e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2da8100fc0 0x7f2da8074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 --2- 172.21.15.5:0/1203653792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2da81021b0 0x7f2da80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:11.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 -- 172.21.15.5:0/1203653792 >> 172.21.15.5:0/1203653792 conn(0x7f2da80fc530 msgr2=0x7f2da8105690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:11.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 -- 172.21.15.5:0/1203653792 shutdown_connections 2023-10-07T00:14:11.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:11.813+0000 7f2daf7ff700 1 -- 172.21.15.5:0/1203653792 wait complete. 2023-10-07T00:14:11.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-07T00:14:12.001 INFO:tasks.workunit.client.0.smithi005.stdout:checking for ANSI C header files... yes 2023-10-07T00:14:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.064+0000 7f1256dff700 1 -- 172.21.15.5:0/329763879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250074ef0 msgr2=0x7f1250073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.064+0000 7f1256dff700 1 --2- 172.21.15.5:0/329763879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250074ef0 0x7f1250073340 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1244009990 tx=0x7f1244009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.065+0000 7f1256dff700 1 -- 172.21.15.5:0/329763879 shutdown_connections 2023-10-07T00:14:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.065+0000 7f1256dff700 1 --2- 172.21.15.5:0/329763879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1250108e80 0x7f125010b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.065+0000 7f1256dff700 1 --2- 172.21.15.5:0/329763879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250074ef0 0x7f1250073340 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.065+0000 7f1256dff700 1 --2- 172.21.15.5:0/329763879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1250073910 0x7f1250073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.065+0000 7f1256dff700 1 -- 172.21.15.5:0/329763879 >> 172.21.15.5:0/329763879 conn(0x7f12500fc530 msgr2=0x7f12500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.065+0000 7f1256dff700 1 -- 172.21.15.5:0/329763879 shutdown_connections 2023-10-07T00:14:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.065+0000 7f1256dff700 1 -- 172.21.15.5:0/329763879 wait complete. 2023-10-07T00:14:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f1256dff700 1 Processor -- start 2023-10-07T00:14:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f1256dff700 1 -- start start 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f1256dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1250073910 0x7f1250198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f1256dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1250074ef0 0x7f1250199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f1256dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250108e80 0x7f12501a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f1256dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501a0960 con 0x7f1250108e80 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f1256dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501a0aa0 con 0x7f1250074ef0 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f1256dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501a0c30 con 0x7f1250073910 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.066+0000 7f125539c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250108e80 0x7f12501a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f125539c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250108e80 0x7f12501a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47616/0 (socket says 172.21.15.5:47616) 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f1254b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1250073910 0x7f1250198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f125539c700 1 -- 172.21.15.5:0/1087586704 learned_addr learned my addr 172.21.15.5:0/1087586704 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f124ffff700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1250074ef0 0x7f1250199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f125539c700 1 -- 172.21.15.5:0/1087586704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1250073910 msgr2=0x7f1250198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f125539c700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1250073910 0x7f1250198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f125539c700 1 -- 172.21.15.5:0/1087586704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1250074ef0 msgr2=0x7f1250199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f125539c700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1250074ef0 0x7f1250199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f125539c700 1 -- 172.21.15.5:0/1087586704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c009520 con 0x7f1250108e80 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f124ffff700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1250074ef0 0x7f1250199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.067+0000 7f125539c700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250108e80 0x7f12501a0390 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f124800ef30 tx=0x7f124800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.068+0000 7f124dffb700 1 -- 172.21.15.5:0/1087586704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248018070 con 0x7f1250108e80 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.068+0000 7f124dffb700 1 -- 172.21.15.5:0/1087586704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f124800f040 con 0x7f1250108e80 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.068+0000 7f1256dff700 1 -- 172.21.15.5:0/1087586704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12440095f0 con 0x7f1250108e80 2023-10-07T00:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.068+0000 7f124dffb700 1 -- 172.21.15.5:0/1087586704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124800cc70 con 0x7f1250108e80 2023-10-07T00:14:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.068+0000 7f1256dff700 1 -- 172.21.15.5:0/1087586704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12501a11d0 con 0x7f1250108e80 2023-10-07T00:14:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.071+0000 7f124dffb700 1 -- 172.21.15.5:0/1087586704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1248007500 con 0x7f1250108e80 2023-10-07T00:14:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.072+0000 7f126a79bb80 1 Processor -- start 2023-10-07T00:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.073+0000 7f126a79bb80 1 -- start start 2023-10-07T00:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.073+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d086e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.073+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d087c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.073+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 0x55b96d0886f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.073+0000 7f126a79bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96cfe6460 con 0x55b96d088270 2023-10-07T00:14:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.073+0000 7f126a79bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96cfd7c20 con 0x55b96d086a70 2023-10-07T00:14:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.073+0000 7f126a79bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96cfd5540 con 0x55b96d0873d0 2023-10-07T00:14:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.073+0000 7f124dffb700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f12400a1500 0x7f12400a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f124dffb700 1 -- 172.21.15.5:0/1087586704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f12480cc870 con 0x7f1250108e80 2023-10-07T00:14:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f1254b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d087c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f124ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d086e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f1254b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d087c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53528/0 (socket says 172.21.15.5:53528) 2023-10-07T00:14:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f1254b9b700 1 -- 172.21.15.5:0/1033189536 learned_addr learned my addr 172.21.15.5:0/1033189536 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f124ffff700 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 0x55b96d0886f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f1254b9b700 1 -- 172.21.15.5:0/1033189536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 msgr2=0x55b96d086e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f1254b9b700 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d086e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f1254b9b700 1 -- 172.21.15.5:0/1033189536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 msgr2=0x55b96d0886f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f1254b9b700 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 0x55b96d0886f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f1254b9b700 1 -- 172.21.15.5:0/1033189536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b96cdfbde0 con 0x55b96d0873d0 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.074+0000 7f124ffff700 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d086e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.075+0000 7f125539c700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f12400a1500 0x7f12400a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.075+0000 7f1254b9b700 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d087c90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1244000c00 tx=0x7f1244005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae4f3ee6f04ff76 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.075+0000 7f125539c700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f12400a1500 0x7f12400a39c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f12480998a0 tx=0x7f1248004ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.075+0000 7f123affd700 1 -- 172.21.15.5:0/1033189536 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124401d070 con 0x55b96d0873d0 2023-10-07T00:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.075+0000 7f123affd700 1 -- 172.21.15.5:0/1033189536 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f124401e040 con 0x55b96d0873d0 2023-10-07T00:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.075+0000 7f123affd700 1 -- 172.21.15.5:0/1033189536 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400b710 con 0x55b96d0873d0 2023-10-07T00:14:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 -- 172.21.15.5:0/1033189536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 msgr2=0x55b96d087c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d087c90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1244000c00 tx=0x7f1244005bc0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 -- 172.21.15.5:0/1033189536 shutdown_connections 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 0x55b96d0886f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d086e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1033189536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d087c90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 -- 172.21.15.5:0/1033189536 >> 172.21.15.5:0/1033189536 conn(0x55b96cff2260 msgr2=0x55b96d079140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 -- 172.21.15.5:0/1033189536 shutdown_connections 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.076+0000 7f126a79bb80 1 -- 172.21.15.5:0/1033189536 wait complete. 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.077+0000 7f126a79bb80 1 -- start start 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.077+0000 7f126a79bb80 1 Processor -- start 2023-10-07T00:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d090790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 0x55b96d090cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 0x55b96d097d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f126a79bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96cfd0e30 con 0x55b96d086a70 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f126a79bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96cf6d710 con 0x55b96d0873d0 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f126a79bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96cf6d3b0 con 0x55b96d088270 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f126a79bb80 10 client.0 _ll_register_callbacks cb 0x55b96cdca800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d090790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d090790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47638/0 (socket says 172.21.15.5:47638) 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 -- 172.21.15.5:0/471542849 learned_addr learned my addr 172.21.15.5:0/471542849 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f1254b9b700 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 0x55b96d090cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 0x55b96d097d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 -- 172.21.15.5:0/471542849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 msgr2=0x55b96d097d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 0x55b96d097d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 -- 172.21.15.5:0/471542849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 msgr2=0x55b96d090cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 0x55b96d090cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.078+0000 7f124ffff700 1 -- 172.21.15.5:0/471542849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c012450 con 0x55b96d086a70 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.079+0000 7f124ffff700 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d090790 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f123c012ea0 tx=0x7f123c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8609ab0bb3b780 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.079+0000 7f122ffff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.079+0000 7f122ffff700 1 -- 172.21.15.5:0/471542849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c010ed0 con 0x55b96d086a70 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.079+0000 7f126a79bb80 1 -- 172.21.15.5:0/471542849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b96d070f10 con 0x55b96d086a70 2023-10-07T00:14:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.079+0000 7f122ffff700 1 -- 172.21.15.5:0/471542849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f123c004020 con 0x55b96d086a70 2023-10-07T00:14:12.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.079+0000 7f122ffff700 1 -- 172.21.15.5:0/471542849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f123c0041e0 con 0x55b96d086a70 2023-10-07T00:14:12.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.079+0000 7f126a79bb80 10 client.15981 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:12.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.079+0000 7f126a79bb80 1 -- 172.21.15.5:0/471542849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f125010bf30 con 0x55b96d086a70 2023-10-07T00:14:12.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.080+0000 7f122ffff700 1 -- 172.21.15.5:0/471542849 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b96d070f10 con 0x55b96d086a70 2023-10-07T00:14:12.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.080+0000 7f122ffff700 1 -- 172.21.15.5:0/471542849 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f123c0051e0 con 0x55b96d086a70 2023-10-07T00:14:12.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.080+0000 7f126a79bb80 10 client.15981 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.080+0000 7f126a79bb80 10 client.15981 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.080+0000 7f126a79bb80 20 client.15981 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.080+0000 7f126a79bb80 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55b96d09c510 0x55b96d09e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.080+0000 7f126a79bb80 4 client.15981 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.080+0000 7f126a79bb80 1 -- 172.21.15.5:0/471542849 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b96cfc9e10 con 0x55b96d09c510 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.081+0000 7f1254b9b700 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55b96d09c510 0x55b96d09e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.081+0000 7f1254b9b700 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55b96d09c510 0x55b96d09e930 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c43ebf72d61e4862 server_cookie=4f2d427a0c1afd14 in_seq=0 out_seq=0 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.081+0000 7f122ffff700 10 client.15981 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.082+0000 7f122ffff700 1 -- 172.21.15.5:0/471542849 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b96cfc9e10 con 0x55b96d09c510 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.082+0000 7f122ffff700 10 client.15981 handle_command_reply: tid=0 2023-10-07T00:14:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.082+0000 7f126a79bb80 1 client.15981 shutdown 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.082+0000 7f126a79bb80 1 -- 172.21.15.5:0/471542849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 msgr2=0x55b96d090790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.082+0000 7f126a79bb80 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d090790 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f123c012ea0 tx=0x7f123c009260 comp rx=0 tx=0).stop 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.082+0000 7f126a79bb80 1 -- 172.21.15.5:0/471542849 shutdown_connections 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.082+0000 7f126a79bb80 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55b96d09c510 0x55b96d09e930 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.082+0000 7f126a79bb80 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 0x55b96d097d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.083+0000 7f126a79bb80 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d090790 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.083+0000 7f126a79bb80 1 --2- 172.21.15.5:0/471542849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 0x55b96d090cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.083+0000 7f126a79bb80 1 -- 172.21.15.5:0/471542849 >> 172.21.15.5:0/471542849 conn(0x55b96cff2260 msgr2=0x55b96d078f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.083+0000 7f122ffff700 0 client.15981 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.083+0000 7f126a79bb80 1 -- 172.21.15.5:0/471542849 shutdown_connections 2023-10-07T00:14:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.083+0000 7f126a79bb80 1 -- 172.21.15.5:0/471542849 wait complete. 2023-10-07T00:14:12.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.083+0000 7f126a79bb80 20 client.15981 trim_cache size 0 max 16384 2023-10-07T00:14:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.098+0000 7f126a79bb80 1 Processor -- start 2023-10-07T00:14:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f126a79bb80 1 -- start start 2023-10-07T00:14:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d088650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d097cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 0x55b96d098600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f126a79bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96ce51920 con 0x55b96d088270 2023-10-07T00:14:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f126a79bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96d099a00 con 0x55b96d086a70 2023-10-07T00:14:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f126a79bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96d091980 con 0x55b96d0873d0 2023-10-07T00:14:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f124ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d088650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f124ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d088650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:32856/0 (socket says 172.21.15.5:32856) 2023-10-07T00:14:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f124ffff700 1 -- 172.21.15.5:0/3846907035 learned_addr learned my addr 172.21.15.5:0/3846907035 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.099+0000 7f124ffff700 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 0x55b96d098600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f1254b9b700 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d097cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f124ffff700 1 -- 172.21.15.5:0/3846907035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 msgr2=0x55b96d097cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f124ffff700 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d097cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f124ffff700 1 -- 172.21.15.5:0/3846907035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 msgr2=0x55b96d098600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f124ffff700 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 0x55b96d098600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f124ffff700 1 -- 172.21.15.5:0/3846907035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b96cde4c60 con 0x55b96d086a70 2023-10-07T00:14:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f124ffff700 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d088650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f123c009fd0 tx=0x7f123c015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24791fc18643db25 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f123b7fe700 1 -- 172.21.15.5:0/3846907035 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c010dd0 con 0x55b96d086a70 2023-10-07T00:14:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f123b7fe700 1 -- 172.21.15.5:0/3846907035 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f123c00ea50 con 0x55b96d086a70 2023-10-07T00:14:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.100+0000 7f123b7fe700 1 -- 172.21.15.5:0/3846907035 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c02b6e0 con 0x55b96d086a70 2023-10-07T00:14:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 -- 172.21.15.5:0/3846907035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 msgr2=0x55b96d088650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d088650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f123c009fd0 tx=0x7f123c015040 comp rx=0 tx=0).stop 2023-10-07T00:14:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 -- 172.21.15.5:0/3846907035 shutdown_connections 2023-10-07T00:14:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d088270 0x55b96d098600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d086a70 0x55b96d088650 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 --2- 172.21.15.5:0/3846907035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d0873d0 0x55b96d097cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 -- 172.21.15.5:0/3846907035 >> 172.21.15.5:0/3846907035 conn(0x55b96cff2260 msgr2=0x55b96d0a32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 -- 172.21.15.5:0/3846907035 shutdown_connections 2023-10-07T00:14:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.101+0000 7f126a79bb80 1 -- 172.21.15.5:0/3846907035 wait complete. 2023-10-07T00:14:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.102+0000 7f126a79bb80 1 -- start start 2023-10-07T00:14:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.102+0000 7f126a79bb80 1 Processor -- start 2023-10-07T00:14:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d0958d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 0x55b96d095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f126a79bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 0x55b96d096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f126a79bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96d097360 con 0x55b96d086a70 2023-10-07T00:14:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f126a79bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96d0974d0 con 0x55b96d0873d0 2023-10-07T00:14:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f126a79bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b96d097690 con 0x55b96d088270 2023-10-07T00:14:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f126a79bb80 10 client.0 _ll_register_callbacks cb 0x7f123c012c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f124ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d0958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f124ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d0958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47648/0 (socket says 172.21.15.5:47648) 2023-10-07T00:14:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f124ffff700 1 -- 172.21.15.5:0/1600024425 learned_addr learned my addr 172.21.15.5:0/1600024425 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f1254b9b700 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 0x55b96d095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f124ffff700 1 -- 172.21.15.5:0/1600024425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 msgr2=0x55b96d096e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f124ffff700 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 0x55b96d096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f124ffff700 1 -- 172.21.15.5:0/1600024425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 msgr2=0x55b96d095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f124ffff700 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 0x55b96d095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.103+0000 7f124ffff700 1 -- 172.21.15.5:0/1600024425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125010bf30 con 0x55b96d086a70 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.104+0000 7f124ffff700 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d0958d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f123c012e80 tx=0x7f123c005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f037e3e409c95472 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.104+0000 7f122ffff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.104+0000 7f122ffff700 1 -- 172.21.15.5:0/1600024425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c010dd0 con 0x55b96d086a70 2023-10-07T00:14:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.104+0000 7f126a79bb80 1 -- 172.21.15.5:0/1600024425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f124401e040 con 0x55b96d086a70 2023-10-07T00:14:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.104+0000 7f122ffff700 1 -- 172.21.15.5:0/1600024425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f123c033070 con 0x55b96d086a70 2023-10-07T00:14:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.104+0000 7f122ffff700 1 -- 172.21.15.5:0/1600024425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f123c02b480 con 0x55b96d086a70 2023-10-07T00:14:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.104+0000 7f126a79bb80 10 client.15987 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.104+0000 7f126a79bb80 1 -- 172.21.15.5:0/1600024425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b96ce22250 con 0x55b96d086a70 2023-10-07T00:14:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f122ffff700 1 -- 172.21.15.5:0/1600024425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f124401e040 con 0x55b96d086a70 2023-10-07T00:14:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f122ffff700 1 -- 172.21.15.5:0/1600024425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f123c020440 con 0x55b96d086a70 2023-10-07T00:14:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f126a79bb80 10 client.15987 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f126a79bb80 10 client.15987 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:14:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f126a79bb80 20 client.15987 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55b96d0f0df0 0x55b96d0f3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f126a79bb80 4 client.15987 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f126a79bb80 1 -- 172.21.15.5:0/1600024425 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b96cfc9b30 con 0x55b96d0f0df0 2023-10-07T00:14:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.105+0000 7f1254b9b700 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55b96d0f0df0 0x55b96d0f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f1254b9b700 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55b96d0f0df0 0x55b96d0f3210 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a508cfcb3704fe8 server_cookie=c8803a93130d85a5 in_seq=0 out_seq=0 2023-10-07T00:14:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f122ffff700 10 client.15987 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:14:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f122ffff700 1 -- 172.21.15.5:0/1600024425 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b96cfc9b30 con 0x55b96d0f0df0 2023-10-07T00:14:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f122ffff700 10 client.15987 handle_command_reply: tid=0 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 client.15987 shutdown 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 -- 172.21.15.5:0/1600024425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 msgr2=0x55b96d0958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d0958d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f123c012e80 tx=0x7f123c005820 comp rx=0 tx=0).stop 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 -- 172.21.15.5:0/1600024425 shutdown_connections 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55b96d0f0df0 0x55b96d0f3210 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b96d088270 0x55b96d096e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b96d086a70 0x55b96d0958d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 --2- 172.21.15.5:0/1600024425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b96d0873d0 0x55b96d095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f122ffff700 0 client.15987 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:14:12.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 -- 172.21.15.5:0/1600024425 >> 172.21.15.5:0/1600024425 conn(0x55b96cff2260 msgr2=0x55b96d098600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 -- 172.21.15.5:0/1600024425 shutdown_connections 2023-10-07T00:14:12.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.106+0000 7f126a79bb80 1 -- 172.21.15.5:0/1600024425 wait complete. 2023-10-07T00:14:12.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f126a79bb80 20 client.15987 trim_cache size 0 max 16384 2023-10-07T00:14:12.117 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:12.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:11 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1879518105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:14:12.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 -- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f12400a1500 msgr2=0x7f12400a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f12400a1500 0x7f12400a39c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f12480998a0 tx=0x7f1248004ad0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 -- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250108e80 msgr2=0x7f12501a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250108e80 0x7f12501a0390 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f124800ef30 tx=0x7f124800c3a0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 -- 172.21.15.5:0/1087586704 shutdown_connections 2023-10-07T00:14:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f12400a1500 0x7f12400a39c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1250108e80 0x7f12501a0390 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1250073910 0x7f1250198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 --2- 172.21.15.5:0/1087586704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1250074ef0 0x7f1250199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.107+0000 7f1256dff700 1 -- 172.21.15.5:0/1087586704 >> 172.21.15.5:0/1087586704 conn(0x7f12500fc530 msgr2=0x7f12500fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.108+0000 7f1256dff700 1 -- 172.21.15.5:0/1087586704 shutdown_connections 2023-10-07T00:14:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.108+0000 7f1256dff700 1 -- 172.21.15.5:0/1087586704 wait complete. 2023-10-07T00:14:12.120 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether time.h and sys/time.h may both be included... yes 2023-10-07T00:14:12.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-07T00:14:12.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:11 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1879518105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:14:12.236 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/types.h... yes 2023-10-07T00:14:12.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:11 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1879518105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:14:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 -- 172.21.15.5:0/3872246571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe750104370 msgr2=0x7fe750106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 --2- 172.21.15.5:0/3872246571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe750104370 0x7fe750106760 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe740009990 tx=0x7fe740009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 -- 172.21.15.5:0/3872246571 shutdown_connections 2023-10-07T00:14:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 --2- 172.21.15.5:0/3872246571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe750106ca0 0x7fe750109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 --2- 172.21.15.5:0/3872246571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe750101a40 0x7fe750103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 --2- 172.21.15.5:0/3872246571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe750104370 0x7fe750106760 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 -- 172.21.15.5:0/3872246571 >> 172.21.15.5:0/3872246571 conn(0x7fe7500fb410 msgr2=0x7fe7500fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 -- 172.21.15.5:0/3872246571 shutdown_connections 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.366+0000 7fe7587ff700 1 -- 172.21.15.5:0/3872246571 wait complete. 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.367+0000 7fe7587ff700 1 Processor -- start 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.367+0000 7fe7587ff700 1 -- start start 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe7587ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe750101a40 0x7fe750196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe7587ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe750104370 0x7fe7501970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe7587ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe750106ca0 0x7fe75019e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe7587ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019e700 con 0x7fe750106ca0 2023-10-07T00:14:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe7587ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019e840 con 0x7fe750104370 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe7587ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019e9d0 con 0x7fe750101a40 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe755d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe750104370 0x7fe7501970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe756d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe750106ca0 0x7fe75019e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe755d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe750104370 0x7fe7501970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:32878/0 (socket says 172.21.15.5:32878) 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe755d9a700 1 -- 172.21.15.5:0/1314503668 learned_addr learned my addr 172.21.15.5:0/1314503668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.368+0000 7fe75659b700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe750101a40 0x7fe750196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe755d9a700 1 -- 172.21.15.5:0/1314503668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe750101a40 msgr2=0x7fe750196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe755d9a700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe750101a40 0x7fe750196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe755d9a700 1 -- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe750106ca0 msgr2=0x7fe75019e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe755d9a700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe750106ca0 0x7fe75019e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe755d9a700 1 -- 172.21.15.5:0/1314503668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7400095f0 con 0x7fe750104370 2023-10-07T00:14:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe755d9a700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe750104370 0x7fe7501970c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7400098e0 tx=0x7fe740004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe7477fe700 1 -- 172.21.15.5:0/1314503668 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74001d070 con 0x7fe750104370 2023-10-07T00:14:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe7587ff700 1 -- 172.21.15.5:0/1314503668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75019ec50 con 0x7fe750104370 2023-10-07T00:14:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe7477fe700 1 -- 172.21.15.5:0/1314503668 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe74000bdb0 con 0x7fe750104370 2023-10-07T00:14:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.369+0000 7fe7477fe700 1 -- 172.21.15.5:0/1314503668 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740022d20 con 0x7fe750104370 2023-10-07T00:14:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.370+0000 7fe7587ff700 1 -- 172.21.15.5:0/1314503668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75019f0d0 con 0x7fe750104370 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.374+0000 7fe7477fe700 1 -- 172.21.15.5:0/1314503668 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe74000b920 con 0x7fe750104370 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.374+0000 7fe76c14db80 1 Processor -- start 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe76c14db80 1 -- start start 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a406680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a407480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a407ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe76c14db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a36e460 con 0x556e8a406260 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe76c14db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a35fc20 con 0x556e8a406bc0 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe76c14db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a35d540 con 0x556e8a407a60 2023-10-07T00:14:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe75659b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a407480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe756d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a406680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe75659b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a407480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:32880/0 (socket says 172.21.15.5:32880) 2023-10-07T00:14:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.375+0000 7fe75659b700 1 -- 172.21.15.5:0/1209233914 learned_addr learned my addr 172.21.15.5:0/1209233914 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe7477fe700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe73c0a1500 0x7fe73c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe755d9a700 1 --2- 172.21.15.5:0/1209233914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a407ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe75659b700 1 -- 172.21.15.5:0/1209233914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 msgr2=0x556e8a407ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe75659b700 1 --2- 172.21.15.5:0/1209233914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a407ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe75659b700 1 -- 172.21.15.5:0/1209233914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 msgr2=0x556e8a406680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe75659b700 1 --2- 172.21.15.5:0/1209233914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a406680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe75659b700 1 -- 172.21.15.5:0/1209233914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e8a183de0 con 0x556e8a406bc0 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe7477fe700 1 -- 172.21.15.5:0/1314503668 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe7400ce330 con 0x7fe750104370 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe756d9c700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe73c0a1500 0x7fe73c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe75659b700 1 --2- 172.21.15.5:0/1209233914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a407480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009d80 tx=0x7fe74c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f93ae6b932b722 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe744ff9700 1 -- 172.21.15.5:0/1209233914 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c004030 con 0x556e8a406bc0 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe744ff9700 1 -- 172.21.15.5:0/1209233914 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe74c003680 con 0x556e8a406bc0 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.376+0000 7fe744ff9700 1 -- 172.21.15.5:0/1209233914 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0166b0 con 0x556e8a406bc0 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 -- 172.21.15.5:0/1209233914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 msgr2=0x556e8a407480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1209233914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a407480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009d80 tx=0x7fe74c011720 comp rx=0 tx=0).stop 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe756d9c700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe73c0a1500 0x7fe73c0a39c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe748009ec0 tx=0x7fe748009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 -- 172.21.15.5:0/1209233914 shutdown_connections 2023-10-07T00:14:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1209233914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a407ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1209233914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a406680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1209233914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a407480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 -- 172.21.15.5:0/1209233914 >> 172.21.15.5:0/1209233914 conn(0x556e8a37a260 msgr2=0x556e8a401140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 -- 172.21.15.5:0/1209233914 shutdown_connections 2023-10-07T00:14:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.377+0000 7fe76c14db80 1 -- 172.21.15.5:0/1209233914 wait complete. 2023-10-07T00:14:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.378+0000 7fe76c14db80 1 -- start start 2023-10-07T00:14:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.378+0000 7fe76c14db80 1 Processor -- start 2023-10-07T00:14:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a40ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a406bc0 0x556e8a4104c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a407a60 0x556e8a417500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe76c14db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a358e30 con 0x556e8a406260 2023-10-07T00:14:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe76c14db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a2f5710 con 0x556e8a407a60 2023-10-07T00:14:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe76c14db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a2f53b0 con 0x556e8a406bc0 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe76c14db80 10 client.0 _ll_register_callbacks cb 0x556e8a152800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe75659b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a40ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe75659b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a40ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47684/0 (socket says 172.21.15.5:47684) 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.379+0000 7fe75659b700 1 -- 172.21.15.5:0/1424853615 learned_addr learned my addr 172.21.15.5:0/1424853615 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe756d9c700 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a407a60 0x556e8a417500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe755d9a700 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a406bc0 0x556e8a4104c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe75659b700 1 -- 172.21.15.5:0/1424853615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a406bc0 msgr2=0x556e8a4104c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe75659b700 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a406bc0 0x556e8a4104c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe75659b700 1 -- 172.21.15.5:0/1424853615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a407a60 msgr2=0x556e8a417500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe75659b700 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a407a60 0x556e8a417500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe75659b700 1 -- 172.21.15.5:0/1424853615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c0099e0 con 0x556e8a406260 2023-10-07T00:14:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe756d9c700 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a407a60 0x556e8a417500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe75659b700 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a40ff80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0097c0 tx=0x7fe74c003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828dc84cca7d5d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.380+0000 7fe739ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.381+0000 7fe739ffb700 1 -- 172.21.15.5:0/1424853615 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0043e0 con 0x556e8a406260 2023-10-07T00:14:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.381+0000 7fe76c14db80 1 -- 172.21.15.5:0/1424853615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e8a3f8f10 con 0x556e8a406260 2023-10-07T00:14:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.381+0000 7fe739ffb700 1 -- 172.21.15.5:0/1424853615 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe74c005040 con 0x556e8a406260 2023-10-07T00:14:12.386 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/stat.h... yes 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.381+0000 7fe739ffb700 1 -- 172.21.15.5:0/1424853615 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe74c005200 con 0x556e8a406260 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.381+0000 7fe76c14db80 10 client.15999 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.381+0000 7fe76c14db80 1 -- 172.21.15.5:0/1424853615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556e8a16cc60 con 0x556e8a406260 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.381+0000 7fe739ffb700 1 -- 172.21.15.5:0/1424853615 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556e8a3f8f10 con 0x556e8a406260 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.382+0000 7fe739ffb700 1 -- 172.21.15.5:0/1424853615 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe74c026040 con 0x556e8a406260 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.382+0000 7fe76c14db80 10 client.15999 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.382+0000 7fe76c14db80 10 client.15999 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.382+0000 7fe76c14db80 20 client.15999 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.382+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x556e8a41bcc0 0x556e8a41e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.382+0000 7fe76c14db80 4 client.15999 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.382+0000 7fe76c14db80 1 -- 172.21.15.5:0/1424853615 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e8a351e10 con 0x556e8a41bcc0 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.382+0000 7fe755d9a700 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x556e8a41bcc0 0x556e8a41e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.383+0000 7fe755d9a700 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x556e8a41bcc0 0x556e8a41e0e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c203ecea1788087 server_cookie=a3010ab826cbf594 in_seq=0 out_seq=0 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.383+0000 7fe739ffb700 10 client.15999 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.383+0000 7fe739ffb700 1 -- 172.21.15.5:0/1424853615 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556e8a351e10 con 0x556e8a41bcc0 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.383+0000 7fe739ffb700 10 client.15999 handle_command_reply: tid=0 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.383+0000 7fe76c14db80 1 client.15999 shutdown 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 -- 172.21.15.5:0/1424853615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 msgr2=0x556e8a40ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a40ff80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0097c0 tx=0x7fe74c003aa0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 -- 172.21.15.5:0/1424853615 shutdown_connections 2023-10-07T00:14:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x556e8a41bcc0 0x556e8a41e0e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a407a60 0x556e8a417500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a40ff80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe739ffb700 0 client.15999 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:14:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 --2- 172.21.15.5:0/1424853615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a406bc0 0x556e8a4104c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 -- 172.21.15.5:0/1424853615 >> 172.21.15.5:0/1424853615 conn(0x556e8a37a260 msgr2=0x556e8a400f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 -- 172.21.15.5:0/1424853615 shutdown_connections 2023-10-07T00:14:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 1 -- 172.21.15.5:0/1424853615 wait complete. 2023-10-07T00:14:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.384+0000 7fe76c14db80 20 client.15999 trim_cache size 0 max 16384 2023-10-07T00:14:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.399+0000 7fe76c14db80 1 Processor -- start 2023-10-07T00:14:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.399+0000 7fe76c14db80 1 -- start start 2023-10-07T00:14:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406260 0x556e8a40f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406bc0 0x556e8a4174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a40a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe76c14db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a1d9920 con 0x556e8a406bc0 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe76c14db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a40dba0 con 0x556e8a406260 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe76c14db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a407270 con 0x556e8a407a60 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe755d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406bc0 0x556e8a4174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe75659b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406260 0x556e8a40f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe75659b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406260 0x556e8a40f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:32910/0 (socket says 172.21.15.5:32910) 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe75659b700 1 -- 172.21.15.5:0/3384470446 learned_addr learned my addr 172.21.15.5:0/3384470446 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe756d9c700 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a40a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe75659b700 1 -- 172.21.15.5:0/3384470446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 msgr2=0x556e8a40a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe75659b700 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a40a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe75659b700 1 -- 172.21.15.5:0/3384470446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406bc0 msgr2=0x556e8a4174c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe75659b700 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406bc0 0x556e8a4174c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe75659b700 1 -- 172.21.15.5:0/3384470446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e8a1aa250 con 0x556e8a406260 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe756d9c700 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a40a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.400+0000 7fe755d9a700 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406bc0 0x556e8a4174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.401+0000 7fe75659b700 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406260 0x556e8a40f630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe74c011760 tx=0x7fe74c009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cea01c11a8e7ce server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.401+0000 7fe7457fa700 1 -- 172.21.15.5:0/3384470446 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c028460 con 0x556e8a406260 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.401+0000 7fe7457fa700 1 -- 172.21.15.5:0/3384470446 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe74c0285c0 con 0x556e8a406260 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.401+0000 7fe7457fa700 1 -- 172.21.15.5:0/3384470446 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c005570 con 0x556e8a406260 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 -- 172.21.15.5:0/3384470446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406260 msgr2=0x556e8a40f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406260 0x556e8a40f630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe74c011760 tx=0x7fe74c009750 comp rx=0 tx=0).stop 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 -- 172.21.15.5:0/3384470446 shutdown_connections 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a40a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406260 0x556e8a40f630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3384470446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406bc0 0x556e8a4174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 -- 172.21.15.5:0/3384470446 >> 172.21.15.5:0/3384470446 conn(0x556e8a37a260 msgr2=0x556e8a3ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 -- 172.21.15.5:0/3384470446 shutdown_connections 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 -- 172.21.15.5:0/3384470446 wait complete. 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.402+0000 7fe76c14db80 1 -- start start 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe76c14db80 1 Processor -- start 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a413280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a4137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe76c14db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a4167e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe76c14db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a416d20 con 0x556e8a406260 2023-10-07T00:14:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe76c14db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a416e90 con 0x556e8a406bc0 2023-10-07T00:14:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe76c14db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8a417050 con 0x556e8a407a60 2023-10-07T00:14:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe76c14db80 10 client.0 _ll_register_callbacks cb 0x7fe74c009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe75659b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a413280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe75659b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a413280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47698/0 (socket says 172.21.15.5:47698) 2023-10-07T00:14:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.403+0000 7fe75659b700 1 -- 172.21.15.5:0/3264519933 learned_addr learned my addr 172.21.15.5:0/3264519933 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe756d9c700 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a4167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe75659b700 1 -- 172.21.15.5:0/3264519933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 msgr2=0x556e8a4167e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe75659b700 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a4167e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe75659b700 1 -- 172.21.15.5:0/3264519933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 msgr2=0x556e8a4137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe75659b700 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a4137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe75659b700 1 -- 172.21.15.5:0/3264519933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75019f0d0 con 0x556e8a406260 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe75659b700 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a413280 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009cd0 tx=0x7fe74c003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9614b563feb43e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe739ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe739ffb700 1 -- 172.21.15.5:0/3264519933 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c005780 con 0x556e8a406260 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe739ffb700 1 -- 172.21.15.5:0/3264519933 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe74c028820 con 0x556e8a406260 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.404+0000 7fe76c14db80 1 -- 172.21.15.5:0/3264519933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe74c003680 con 0x556e8a406260 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe739ffb700 1 -- 172.21.15.5:0/3264519933 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe74c028a00 con 0x556e8a406260 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe76c14db80 10 client.16005 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe76c14db80 1 -- 172.21.15.5:0/3264519933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556e8a16cc60 con 0x556e8a406260 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe739ffb700 1 -- 172.21.15.5:0/3264519933 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe74c051020 con 0x556e8a406260 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe739ffb700 1 -- 172.21.15.5:0/3264519933 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe74c04b020 con 0x556e8a406260 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe76c14db80 10 client.16005 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe76c14db80 10 client.16005 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe76c14db80 20 client.16005 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x556e8a470620 0x556e8a472a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe76c14db80 4 client.16005 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.405+0000 7fe76c14db80 1 -- 172.21.15.5:0/3264519933 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556e8a351b30 con 0x556e8a470620 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.406+0000 7fe755d9a700 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x556e8a470620 0x556e8a472a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.406+0000 7fe755d9a700 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x556e8a470620 0x556e8a472a10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4fcebf8d5dca1fdd server_cookie=1a07b542f7fc0ab8 in_seq=0 out_seq=0 2023-10-07T00:14:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.406+0000 7fe739ffb700 10 client.16005 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.406+0000 7fe739ffb700 1 -- 172.21.15.5:0/3264519933 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556e8a351b30 con 0x556e8a470620 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.406+0000 7fe739ffb700 10 client.16005 handle_command_reply: tid=0 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.406+0000 7fe76c14db80 1 client.16005 shutdown 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 -- 172.21.15.5:0/3264519933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 msgr2=0x556e8a413280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a413280 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009cd0 tx=0x7fe74c003c40 comp rx=0 tx=0).stop 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 -- 172.21.15.5:0/3264519933 shutdown_connections 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x556e8a470620 0x556e8a472a10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556e8a407a60 0x556e8a4167e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e8a406260 0x556e8a413280 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 --2- 172.21.15.5:0/3264519933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e8a406bc0 0x556e8a4137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 -- 172.21.15.5:0/3264519933 >> 172.21.15.5:0/3264519933 conn(0x556e8a37a260 msgr2=0x556e8a40a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe739ffb700 0 client.16005 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:14:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 -- 172.21.15.5:0/3264519933 shutdown_connections 2023-10-07T00:14:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 1 -- 172.21.15.5:0/3264519933 wait complete. 2023-10-07T00:14:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.407+0000 7fe76c14db80 20 client.16005 trim_cache size 0 max 16384 2023-10-07T00:14:12.422 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 -- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe73c0a1500 msgr2=0x7fe73c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe73c0a1500 0x7fe73c0a39c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe748009ec0 tx=0x7fe748009040 comp rx=0 tx=0).stop 2023-10-07T00:14:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 -- 172.21.15.5:0/1314503668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe750104370 msgr2=0x7fe7501970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe750104370 0x7fe7501970c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7400098e0 tx=0x7fe740004730 comp rx=0 tx=0).stop 2023-10-07T00:14:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 -- 172.21.15.5:0/1314503668 shutdown_connections 2023-10-07T00:14:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe73c0a1500 0x7fe73c0a39c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe750106ca0 0x7fe75019e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe750101a40 0x7fe750196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 --2- 172.21.15.5:0/1314503668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe750104370 0x7fe7501970c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 -- 172.21.15.5:0/1314503668 >> 172.21.15.5:0/1314503668 conn(0x7fe7500fb410 msgr2=0x7fe7501026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 -- 172.21.15.5:0/1314503668 shutdown_connections 2023-10-07T00:14:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.408+0000 7fe7587ff700 1 -- 172.21.15.5:0/1314503668 wait complete. 2023-10-07T00:14:12.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-07T00:14:12.520 INFO:tasks.workunit.client.0.smithi005.stdout:checking for stdlib.h... yes 2023-10-07T00:14:12.651 INFO:tasks.workunit.client.0.smithi005.stdout:checking for string.h... yes 2023-10-07T00:14:12.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 -- 172.21.15.5:0/429796601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00100fc0 msgr2=0x7f2c001013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 --2- 172.21.15.5:0/429796601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00100fc0 0x7f2c001013e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00099c0 tx=0x7f2bf0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 -- 172.21.15.5:0/429796601 shutdown_connections 2023-10-07T00:14:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 --2- 172.21.15.5:0/429796601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c00102b50 0x7f2c00109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 --2- 172.21.15.5:0/429796601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00100fc0 0x7f2c001013e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 --2- 172.21.15.5:0/429796601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c001021b0 0x7f2c00102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 -- 172.21.15.5:0/429796601 >> 172.21.15.5:0/429796601 conn(0x7f2c000fc530 msgr2=0x7f2c000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 -- 172.21.15.5:0/429796601 shutdown_connections 2023-10-07T00:14:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.654+0000 7f2c04bff700 1 -- 172.21.15.5:0/429796601 wait complete. 2023-10-07T00:14:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.655+0000 7f2c04bff700 1 Processor -- start 2023-10-07T00:14:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.655+0000 7f2c04bff700 1 -- start start 2023-10-07T00:14:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.655+0000 7f2c04bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c00100fc0 0x7f2c00074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2c04bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c001021b0 0x7f2c000732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2c04bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00102b50 0x7f2c000737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2c04bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00073f80 con 0x7f2c00102b50 2023-10-07T00:14:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2c04bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c000740f0 con 0x7f2c001021b0 2023-10-07T00:14:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2c04bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c001a0c10 con 0x7f2c00100fc0 2023-10-07T00:14:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00102b50 0x7f2c000737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00102b50 0x7f2c000737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47718/0 (socket says 172.21.15.5:47718) 2023-10-07T00:14:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfdd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c001021b0 0x7f2c000732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfed9d700 1 -- 172.21.15.5:0/3577116125 learned_addr learned my addr 172.21.15.5:0/3577116125 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c00100fc0 0x7f2c00074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/3577116125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c00100fc0 msgr2=0x7f2c00074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c00100fc0 0x7f2c00074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00102b50 msgr2=0x7f2c000737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00102b50 0x7f2c000737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/3577116125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00095f0 con 0x7f2c001021b0 2023-10-07T00:14:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c00100fc0 0x7f2c00074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.656+0000 7f2bfed9d700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00102b50 0x7f2c000737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.657+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c001021b0 0x7f2c000732a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400d950 tx=0x7f2bf400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.657+0000 7f2bef7fe700 1 -- 172.21.15.5:0/3577116125 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4009930 con 0x7f2c001021b0 2023-10-07T00:14:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.657+0000 7f2bef7fe700 1 -- 172.21.15.5:0/3577116125 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bf4010460 con 0x7f2c001021b0 2023-10-07T00:14:12.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.657+0000 7f2bef7fe700 1 -- 172.21.15.5:0/3577116125 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400b5d0 con 0x7f2c001021b0 2023-10-07T00:14:12.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.657+0000 7f2c04bff700 1 -- 172.21.15.5:0/3577116125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c001a0ef0 con 0x7f2c001021b0 2023-10-07T00:14:12.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.657+0000 7f2c04bff700 1 -- 172.21.15.5:0/3577116125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c001a1370 con 0x7f2c001021b0 2023-10-07T00:14:12.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.661+0000 7f2bef7fe700 1 -- 172.21.15.5:0/3577116125 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2bf4009a90 con 0x7f2c001021b0 2023-10-07T00:14:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.662+0000 7f2c185a8b80 1 Processor -- start 2023-10-07T00:14:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.662+0000 7f2bef7fe700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be80a1500 0x7f2be80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.662+0000 7f2c185a8b80 1 -- start start 2023-10-07T00:14:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2bef7fe700 1 -- 172.21.15.5:0/3577116125 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2bf40cc8c0 con 0x7f2c001021b0 2023-10-07T00:14:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2bfed9d700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be80a1500 0x7f2be80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 0x5629014ed680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014edbc0 0x5629014ee480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562901455460 con 0x5629014eea60 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562901446c20 con 0x5629014edbc0 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562901444540 con 0x5629014ed260 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2bfed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2bfed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47734/0 (socket says 172.21.15.5:47734) 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2bfed9d700 1 -- 172.21.15.5:0/1589177950 learned_addr learned my addr 172.21.15.5:0/1589177950 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014edbc0 0x5629014ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.663+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 0x5629014ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/1589177950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 msgr2=0x5629014ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 0x5629014ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/1589177950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 msgr2=0x5629014eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2bfed9d700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be80a1500 0x7f2be80a39c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800cc10 tx=0x7f2bf8016300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/1589177950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56290126ade0 con 0x5629014edbc0 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014edbc0 0x5629014ee480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4099860 tx=0x7f2bf4099790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c0564c21c33279 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2becff9700 1 -- 172.21.15.5:0/1589177950 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf409a260 con 0x5629014edbc0 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2becff9700 1 -- 172.21.15.5:0/1589177950 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bf409ae90 con 0x5629014edbc0 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.664+0000 7f2becff9700 1 -- 172.21.15.5:0/1589177950 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4097f20 con 0x5629014edbc0 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1589177950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014edbc0 msgr2=0x5629014ee480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014edbc0 0x5629014ee480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4099860 tx=0x7f2bf4099790 comp rx=0 tx=0).stop 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1589177950 shutdown_connections 2023-10-07T00:14:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 0x5629014ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1589177950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014edbc0 0x5629014ee480 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1589177950 >> 172.21.15.5:0/1589177950 conn(0x562901461260 msgr2=0x5629014e8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1589177950 shutdown_connections 2023-10-07T00:14:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.665+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1589177950 wait complete. 2023-10-07T00:14:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 1 -- start start 2023-10-07T00:14:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 1 Processor -- start 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 0x5629014f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014eea60 0x5629014fe530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56290143fe30 con 0x5629014edbc0 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629013dc710 con 0x5629014eea60 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629013dc3b0 con 0x5629014ed260 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.666+0000 7f2c185a8b80 10 client.0 _ll_register_callbacks cb 0x562901239800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014eea60 0x5629014fe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014eea60 0x5629014fe530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:32958/0 (socket says 172.21.15.5:32958) 2023-10-07T00:14:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 -- 172.21.15.5:0/3392020596 learned_addr learned my addr 172.21.15.5:0/3392020596 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47740/0 (socket says 172.21.15.5:47740) 2023-10-07T00:14:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 0x5629014f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 -- 172.21.15.5:0/3392020596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 msgr2=0x5629014f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 0x5629014f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 -- 172.21.15.5:0/3392020596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 msgr2=0x5629014f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 -- 172.21.15.5:0/3392020596 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c001a1370 con 0x5629014eea60 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2bfed9d700 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014eea60 0x5629014fe530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80196e0 tx=0x7f2bf8004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e34013877e3f1b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.667+0000 7f2be5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.668+0000 7f2be5ffb700 1 -- 172.21.15.5:0/3392020596 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8003c10 con 0x5629014eea60 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.668+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3392020596 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629014dff10 con 0x5629014eea60 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.668+0000 7f2be5ffb700 1 -- 172.21.15.5:0/3392020596 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2bf8003d70 con 0x5629014eea60 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.668+0000 7f2be5ffb700 1 -- 172.21.15.5:0/3392020596 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bf8004030 con 0x5629014eea60 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.668+0000 7f2c185a8b80 10 client.25790 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.668+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3392020596 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562901253c60 con 0x5629014eea60 2023-10-07T00:14:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.668+0000 7f2be5ffb700 1 -- 172.21.15.5:0/3392020596 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bf8032020 con 0x5629014eea60 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.669+0000 7f2be5ffb700 1 -- 172.21.15.5:0/3392020596 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2bf80237a0 con 0x5629014eea60 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.669+0000 7f2c185a8b80 10 client.25790 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.669+0000 7f2c185a8b80 10 client.25790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.669+0000 7f2c185a8b80 20 client.25790 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.669+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x562901502df0 0x562901505210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.669+0000 7f2c185a8b80 4 client.25790 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.669+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3392020596 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562901438e10 con 0x562901502df0 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.669+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x562901502df0 0x562901505210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.670+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x562901502df0 0x562901505210 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d279b3ea9e4269ab server_cookie=26e981be3ce46622 in_seq=0 out_seq=0 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.670+0000 7f2be5ffb700 10 client.25790 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.670+0000 7f2be5ffb700 1 -- 172.21.15.5:0/3392020596 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562901438e10 con 0x562901502df0 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.670+0000 7f2be5ffb700 10 client.25790 handle_command_reply: tid=0 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.670+0000 7f2c185a8b80 1 client.25790 shutdown 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3392020596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014eea60 msgr2=0x5629014fe530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014eea60 0x5629014fe530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80196e0 tx=0x7f2bf8004b40 comp rx=0 tx=0).stop 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3392020596 shutdown_connections 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x562901502df0 0x562901505210 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014eea60 0x5629014fe530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2be5ffb700 0 client.25790 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014ed260 0x5629014f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3392020596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3392020596 >> 172.21.15.5:0/3392020596 conn(0x562901461260 msgr2=0x5629014e7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3392020596 shutdown_connections 2023-10-07T00:14:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3392020596 wait complete. 2023-10-07T00:14:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.671+0000 7f2c185a8b80 20 client.25790 trim_cache size 0 max 16384 2023-10-07T00:14:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.685+0000 7f2c185a8b80 1 Processor -- start 2023-10-07T00:14:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.685+0000 7f2c185a8b80 1 -- start start 2023-10-07T00:14:12.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.685+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.685+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014edbc0 0x5629014fe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.685+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629012c0920 con 0x5629014eea60 2023-10-07T00:14:12.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629014ee310 con 0x5629014ed260 2023-10-07T00:14:12.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629014f81a0 con 0x5629014edbc0 2023-10-07T00:14:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfe59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014e7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47750/0 (socket says 172.21.15.5:47750) 2023-10-07T00:14:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfed9d700 1 -- 172.21.15.5:0/3106827035 learned_addr learned my addr 172.21.15.5:0/3106827035 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014edbc0 0x5629014fe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfe59c700 1 -- 172.21.15.5:0/3106827035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014edbc0 msgr2=0x5629014fe4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014edbc0 0x5629014fe4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfe59c700 1 -- 172.21.15.5:0/3106827035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 msgr2=0x5629014e7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014e7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfe59c700 1 -- 172.21.15.5:0/3106827035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562901291250 con 0x5629014ed260 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.686+0000 7f2bfed9d700 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.687+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014f4ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009990 tx=0x7f2bf000bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1533d630a79712eb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.687+0000 7f2bed7fa700 1 -- 172.21.15.5:0/3106827035 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf000bd90 con 0x5629014ed260 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.687+0000 7f2bed7fa700 1 -- 172.21.15.5:0/3106827035 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bf001e040 con 0x5629014ed260 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.687+0000 7f2bed7fa700 1 -- 172.21.15.5:0/3106827035 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0004be0 con 0x5629014ed260 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3106827035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 msgr2=0x5629014f4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014f4ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009990 tx=0x7f2bf000bfd0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3106827035 shutdown_connections 2023-10-07T00:14:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014eea60 0x5629014e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014f4ec0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/3106827035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014edbc0 0x5629014fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3106827035 >> 172.21.15.5:0/3106827035 conn(0x562901461260 msgr2=0x5629014f5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3106827035 shutdown_connections 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 -- 172.21.15.5:0/3106827035 wait complete. 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 -- start start 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.688+0000 7f2c185a8b80 1 Processor -- start 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014fdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014fe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2c185a8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014eea60 0x5629014fc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629014fcd40 con 0x5629014edbc0 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629014fceb0 con 0x5629014ed260 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2c185a8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629014fd070 con 0x5629014eea60 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2c185a8b80 10 client.0 _ll_register_callbacks cb 0x562901239800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2bfdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014fe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2bfdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014fe4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47762/0 (socket says 172.21.15.5:47762) 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/1638516044 learned_addr learned my addr 172.21.15.5:0/1638516044 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.689+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014fdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2bfed9d700 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014eea60 0x5629014fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/1638516044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014eea60 msgr2=0x5629014fc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014eea60 0x5629014fc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 msgr2=0x5629014fdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014fdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2bfdd9b700 1 -- 172.21.15.5:0/1638516044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562901253c60 con 0x5629014edbc0 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2bfdd9b700 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014fe4a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4000c00 tx=0x7f2bf4010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb5a4fcddf30090 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2be5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2be5ffb700 1 -- 172.21.15.5:0/1638516044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf409a260 con 0x5629014edbc0 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1638516044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2bf409ae90 con 0x5629014edbc0 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.690+0000 7f2be5ffb700 1 -- 172.21.15.5:0/1638516044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2bf4084040 con 0x5629014edbc0 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2be5ffb700 1 -- 172.21.15.5:0/1638516044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bf409dcb0 con 0x5629014edbc0 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2c185a8b80 10 client.16023 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1638516044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f2c00109d50 con 0x5629014edbc0 2023-10-07T00:14:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2be5ffb700 1 -- 172.21.15.5:0/1638516044 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bf407c020 con 0x5629014edbc0 2023-10-07T00:14:12.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2be5ffb700 1 -- 172.21.15.5:0/1638516044 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2bf4099170 con 0x5629014edbc0 2023-10-07T00:14:12.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2c185a8b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:12.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2c185a8b80 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:12.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2c185a8b80 20 client.16023 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:12.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x562901557da0 0x56290155a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:12.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2c185a8b80 4 client.16023 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:12.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.691+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1638516044 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562901438b30 con 0x562901557da0 2023-10-07T00:14:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.692+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x562901557da0 0x56290155a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.692+0000 7f2be5ffb700 10 client.16023 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.692+0000 7f2bfe59c700 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x562901557da0 0x56290155a1c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aaf89c98a425af5 server_cookie=d49d9612195c01c8 in_seq=0 out_seq=0 2023-10-07T00:14:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2be5ffb700 1 -- 172.21.15.5:0/1638516044 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562901438b30 con 0x562901557da0 2023-10-07T00:14:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2be5ffb700 10 client.16023 handle_command_reply: tid=0 2023-10-07T00:14:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 client.16023 shutdown 2023-10-07T00:14:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1638516044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 msgr2=0x5629014fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014fe4a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4000c00 tx=0x7f2bf4010f30 comp rx=0 tx=0).stop 2023-10-07T00:14:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1638516044 shutdown_connections 2023-10-07T00:14:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x562901557da0 0x56290155a1c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629014eea60 0x5629014fc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5629014ed260 0x5629014fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2be5ffb700 0 client.16023 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 --2- 172.21.15.5:0/1638516044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5629014edbc0 0x5629014fe4a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1638516044 >> 172.21.15.5:0/1638516044 conn(0x562901461260 msgr2=0x5629014f19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1638516044 shutdown_connections 2023-10-07T00:14:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.693+0000 7f2c185a8b80 1 -- 172.21.15.5:0/1638516044 wait complete. 2023-10-07T00:14:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c185a8b80 20 client.16023 trim_cache size 0 max 16384 2023-10-07T00:14:12.704 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 -- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be80a1500 msgr2=0x7f2be80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be80a1500 0x7f2be80a39c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800cc10 tx=0x7f2bf8016300 comp rx=0 tx=0).stop 2023-10-07T00:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 -- 172.21.15.5:0/3577116125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c001021b0 msgr2=0x7f2c000732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c001021b0 0x7f2c000732a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400d950 tx=0x7f2bf400dc60 comp rx=0 tx=0).stop 2023-10-07T00:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 -- 172.21.15.5:0/3577116125 shutdown_connections 2023-10-07T00:14:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be80a1500 0x7f2be80a39c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c00102b50 0x7f2c000737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c00100fc0 0x7f2c00074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 --2- 172.21.15.5:0/3577116125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c001021b0 0x7f2c000732a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 -- 172.21.15.5:0/3577116125 >> 172.21.15.5:0/3577116125 conn(0x7f2c000fc530 msgr2=0x7f2c000fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 -- 172.21.15.5:0/3577116125 shutdown_connections 2023-10-07T00:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:12.694+0000 7f2c04bff700 1 -- 172.21.15.5:0/3577116125 wait complete. 2023-10-07T00:14:12.788 INFO:tasks.workunit.client.0.smithi005.stdout:checking for memory.h... yes 2023-10-07T00:14:12.915 INFO:tasks.workunit.client.0.smithi005.stdout:checking for strings.h... yes 2023-10-07T00:14:13.047 INFO:tasks.workunit.client.0.smithi005.stdout:checking for inttypes.h... yes 2023-10-07T00:14:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:12 smithi005 ceph-mon[129406]: pgmap v389: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 KiB/s wr, 16 op/s 2023-10-07T00:14:13.176 INFO:tasks.workunit.client.0.smithi005.stdout:checking for stdint.h... yes 2023-10-07T00:14:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:12 smithi088 ceph-mon[103111]: pgmap v389: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 KiB/s wr, 16 op/s 2023-10-07T00:14:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:12 smithi112 ceph-mon[133548]: pgmap v389: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 KiB/s wr, 16 op/s 2023-10-07T00:14:13.308 INFO:tasks.workunit.client.0.smithi005.stdout:checking for unistd.h... yes 2023-10-07T00:14:13.342 INFO:tasks.workunit.client.0.smithi005.stdout:checking for memory.h... (cached) yes 2023-10-07T00:14:13.368 INFO:tasks.workunit.client.0.smithi005.stdout:checking for strings.h... (cached) yes 2023-10-07T00:14:13.394 INFO:tasks.workunit.client.0.smithi005.stdout:checking for unistd.h... (cached) yes 2023-10-07T00:14:13.520 INFO:tasks.workunit.client.0.smithi005.stdout:checking locale.h usability... yes 2023-10-07T00:14:13.574 INFO:tasks.workunit.client.0.smithi005.stdout:checking locale.h presence... yes 2023-10-07T00:14:13.577 INFO:tasks.workunit.client.0.smithi005.stdout:checking for locale.h... yes 2023-10-07T00:14:13.613 INFO:tasks.workunit.client.0.smithi005.stdout:checking for stdlib.h... (cached) yes 2023-10-07T00:14:13.641 INFO:tasks.workunit.client.0.smithi005.stdout:checking for string.h... (cached) yes 2023-10-07T00:14:13.716 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-07T00:14:13.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-07T00:14:13.774 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/socket.h usability... yes 2023-10-07T00:14:13.833 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/socket.h presence... yes 2023-10-07T00:14:13.836 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/socket.h... yes 2023-10-07T00:14:13.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 -- 172.21.15.5:0/2394636356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10101a40 msgr2=0x7f8d10103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:13.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 --2- 172.21.15.5:0/2394636356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10101a40 0x7f8d10103e30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009990 tx=0x7f8d00009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 -- 172.21.15.5:0/2394636356 shutdown_connections 2023-10-07T00:14:13.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 --2- 172.21.15.5:0/2394636356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d10106ca0 0x7f8d10109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 --2- 172.21.15.5:0/2394636356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10101a40 0x7f8d10103e30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 --2- 172.21.15.5:0/2394636356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d10104370 0x7f8d10106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 -- 172.21.15.5:0/2394636356 >> 172.21.15.5:0/2394636356 conn(0x7f8d100fb450 msgr2=0x7f8d100fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:13.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 -- 172.21.15.5:0/2394636356 shutdown_connections 2023-10-07T00:14:13.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.946+0000 7f8d14dff700 1 -- 172.21.15.5:0/2394636356 wait complete. 2023-10-07T00:14:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.947+0000 7f8d14dff700 1 Processor -- start 2023-10-07T00:14:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.947+0000 7f8d14dff700 1 -- start start 2023-10-07T00:14:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d14dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d10101a40 0x7f8d101013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d14dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10104370 0x7f8d100ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d14dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d10106ca0 0x7f8d100fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d14dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101006d0 con 0x7f8d10101a40 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d14dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d10100840 con 0x7f8d10104370 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d14dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101a0c10 con 0x7f8d10106ca0 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d0e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d10101a40 0x7f8d101013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d0e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d10101a40 0x7f8d101013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47790/0 (socket says 172.21.15.5:47790) 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d0e59c700 1 -- 172.21.15.5:0/7863550 learned_addr learned my addr 172.21.15.5:0/7863550 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d10106ca0 0x7f8d100fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.948+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10104370 0x7f8d100ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8d0e59c700 1 -- 172.21.15.5:0/7863550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d10106ca0 msgr2=0x7f8d100fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d10106ca0 0x7f8d100fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8d0e59c700 1 -- 172.21.15.5:0/7863550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10104370 msgr2=0x7f8d100ff9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10104370 0x7f8d100ff9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8d0e59c700 1 -- 172.21.15.5:0/7863550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000095f0 con 0x7f8d10101a40 2023-10-07T00:14:13.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10104370 0x7f8d100ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:13.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d10101a40 0x7f8d101013b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8d00005910 tx=0x7f8d00005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:13.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8cff7fe700 1 -- 172.21.15.5:0/7863550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0001d070 con 0x7f8d10101a40 2023-10-07T00:14:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8cff7fe700 1 -- 172.21.15.5:0/7863550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d00022470 con 0x7f8d10101a40 2023-10-07T00:14:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8d14dff700 1 -- 172.21.15.5:0/7863550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d101a0e90 con 0x7f8d10101a40 2023-10-07T00:14:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.949+0000 7f8cff7fe700 1 -- 172.21.15.5:0/7863550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00022ea0 con 0x7f8d10101a40 2023-10-07T00:14:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.950+0000 7f8d14dff700 1 -- 172.21.15.5:0/7863550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d101a1200 con 0x7f8d10101a40 2023-10-07T00:14:13.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.953+0000 7f8cff7fe700 1 -- 172.21.15.5:0/7863550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8d0000ba60 con 0x7f8d10101a40 2023-10-07T00:14:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.954+0000 7f8d28753b80 1 Processor -- start 2023-10-07T00:14:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.954+0000 7f8d28753b80 1 -- start start 2023-10-07T00:14:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.954+0000 7f8cff7fe700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8cf80a1480 0x7f8cf80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8cff7fe700 1 -- 172.21.15.5:0/7863550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8d000ce0a0 con 0x7f8d10101a40 2023-10-07T00:14:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf103d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf103e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf103ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d28753b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf0fa54e0 con 0x55bcf103d2e0 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d28753b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf0f96ca0 con 0x55bcf103eae0 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d28753b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf0f945c0 con 0x55bcf103dc40 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8cf80a1480 0x7f8cf80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d0e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf103d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d0e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf103d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47800/0 (socket says 172.21.15.5:47800) 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.955+0000 7f8d0e59c700 1 -- 172.21.15.5:0/389946589 learned_addr learned my addr 172.21.15.5:0/389946589 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf103ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf103e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0e59c700 1 -- 172.21.15.5:0/389946589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 msgr2=0x55bcf103e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf103e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0e59c700 1 -- 172.21.15.5:0/389946589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 msgr2=0x55bcf103ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf103ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0e59c700 1 -- 172.21.15.5:0/389946589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcf0dbae60 con 0x55bcf103d2e0 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8cf80a1480 0x7f8cf80a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d10101a10 tx=0x7f8d08009ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf103d700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8d0009b3c0 tx=0x7f8d00004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d9b67c2351e596 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8cfcff9700 1 -- 172.21.15.5:0/389946589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0009ad90 con 0x55bcf103d2e0 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8cfcff9700 1 -- 172.21.15.5:0/389946589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d00022800 con 0x55bcf103d2e0 2023-10-07T00:14:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.956+0000 7f8cfcff9700 1 -- 172.21.15.5:0/389946589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d000997d0 con 0x55bcf103d2e0 2023-10-07T00:14:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.957+0000 7f8d28753b80 1 -- 172.21.15.5:0/389946589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 msgr2=0x55bcf103d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.957+0000 7f8d28753b80 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf103d700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8d0009b3c0 tx=0x7f8d00004320 comp rx=0 tx=0).stop 2023-10-07T00:14:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.957+0000 7f8d28753b80 1 -- 172.21.15.5:0/389946589 shutdown_connections 2023-10-07T00:14:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.957+0000 7f8d28753b80 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf103ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.957+0000 7f8d28753b80 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf103d700 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.957+0000 7f8d28753b80 1 --2- 172.21.15.5:0/389946589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf103e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.957+0000 7f8d28753b80 1 -- 172.21.15.5:0/389946589 >> 172.21.15.5:0/389946589 conn(0x55bcf0fb12e0 msgr2=0x55bcf10381c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.958+0000 7f8d28753b80 1 -- 172.21.15.5:0/389946589 shutdown_connections 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.958+0000 7f8d28753b80 1 -- 172.21.15.5:0/389946589 wait complete. 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.958+0000 7f8d28753b80 1 -- start start 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.958+0000 7f8d28753b80 1 Processor -- start 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103d2e0 0x55bcf1046d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103dc40 0x55bcf1047250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103eae0 0x55bcf104e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d28753b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf0f8feb0 con 0x55bcf103dc40 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d28753b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf0f2c790 con 0x55bcf103d2e0 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d28753b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf0f2c430 con 0x55bcf103eae0 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d28753b80 10 client.0 _ll_register_callbacks cb 0x55bcf0d89880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:13.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d0e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103d2e0 0x55bcf1046d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d0dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103dc40 0x55bcf1047250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d0e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103d2e0 0x55bcf1046d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:33012/0 (socket says 172.21.15.5:33012) 2023-10-07T00:14:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d0e59c700 1 -- 172.21.15.5:0/1044895254 learned_addr learned my addr 172.21.15.5:0/1044895254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.959+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103eae0 0x55bcf104e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d0e59c700 1 -- 172.21.15.5:0/1044895254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103eae0 msgr2=0x55bcf104e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103eae0 0x55bcf104e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d0e59c700 1 -- 172.21.15.5:0/1044895254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103dc40 msgr2=0x55bcf1047250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103dc40 0x55bcf1047250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d0e59c700 1 -- 172.21.15.5:0/1044895254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d101a1200 con 0x55bcf103d2e0 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103eae0 0x55bcf104e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103d2e0 0x55bcf1046d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000c010 tx=0x7f8d00005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2fa6dba628cec30 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8cf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/1044895254 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0009b430 con 0x55bcf103d2e0 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/1044895254 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8d0009a920 con 0x55bcf103d2e0 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d28753b80 1 -- 172.21.15.5:0/1044895254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bcf102ff90 con 0x55bcf103d2e0 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/1044895254 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d0009aae0 con 0x55bcf103d2e0 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d28753b80 10 client.25808 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.960+0000 7f8d28753b80 1 -- 172.21.15.5:0/1044895254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bcf0da3ce0 con 0x55bcf103d2e0 2023-10-07T00:14:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.961+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/1044895254 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d000a7080 con 0x55bcf103d2e0 2023-10-07T00:14:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.961+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/1044895254 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8d000a13c0 con 0x55bcf103d2e0 2023-10-07T00:14:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.961+0000 7f8d28753b80 10 client.25808 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.961+0000 7f8d28753b80 10 client.25808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.961+0000 7f8d28753b80 20 client.25808 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.961+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bcf10525c0 0x55bcf10549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.961+0000 7f8d28753b80 4 client.25808 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.961+0000 7f8d28753b80 1 -- 172.21.15.5:0/1044895254 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bcf0f88e90 con 0x55bcf10525c0 2023-10-07T00:14:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.962+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bcf10525c0 0x55bcf10549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.962+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bcf10525c0 0x55bcf10549e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb9d63e1e59ee6ad server_cookie=a583f6755f45d3c9 in_seq=0 out_seq=0 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.962+0000 7f8cf5ffb700 10 client.25808 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/1044895254 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bcf0f88e90 con 0x55bcf10525c0 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8cf5ffb700 10 client.25808 handle_command_reply: tid=0 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 client.25808 shutdown 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 -- 172.21.15.5:0/1044895254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103d2e0 msgr2=0x55bcf1046d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103d2e0 0x55bcf1046d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000c010 tx=0x7f8d00005a00 comp rx=0 tx=0).stop 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 -- 172.21.15.5:0/1044895254 shutdown_connections 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bcf10525c0 0x55bcf10549e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103eae0 0x55bcf104e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103d2e0 0x55bcf1046d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1044895254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103dc40 0x55bcf1047250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 -- 172.21.15.5:0/1044895254 >> 172.21.15.5:0/1044895254 conn(0x55bcf0fb12e0 msgr2=0x55bcf1037fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:13.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8cf5ffb700 0 client.25808 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:13.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 -- 172.21.15.5:0/1044895254 shutdown_connections 2023-10-07T00:14:13.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.963+0000 7f8d28753b80 1 -- 172.21.15.5:0/1044895254 wait complete. 2023-10-07T00:14:13.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.964+0000 7f8d28753b80 20 client.25808 trim_cache size 0 max 16384 2023-10-07T00:14:13.970 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/time.h usability... yes 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.989+0000 7f8d28753b80 1 Processor -- start 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d28753b80 1 -- start start 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf1044e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf1041950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d28753b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf0e109a0 con 0x55bcf103d2e0 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d28753b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf10325a0 con 0x55bcf103eae0 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d28753b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf1044bf0 con 0x55bcf103dc40 2023-10-07T00:14:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d0ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf1041950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d0ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf1041950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:33018/0 (socket says 172.21.15.5:33018) 2023-10-07T00:14:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.990+0000 7f8d0ed9d700 1 -- 172.21.15.5:0/1127641840 learned_addr learned my addr 172.21.15.5:0/1127641840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0ed9d700 1 -- 172.21.15.5:0/1127641840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 msgr2=0x55bcf104e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:13.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf1044e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0ed9d700 1 -- 172.21.15.5:0/1127641840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 msgr2=0x55bcf1044e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf1044e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0ed9d700 1 -- 172.21.15.5:0/1127641840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcf1059650 con 0x55bcf103eae0 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.991+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf1041950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d080048b0 tx=0x7f8d08015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b27462bb244934a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.992+0000 7f8cfd7fa700 1 -- 172.21.15.5:0/1127641840 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08004380 con 0x55bcf103eae0 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.992+0000 7f8cfd7fa700 1 -- 172.21.15.5:0/1127641840 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d0800f040 con 0x55bcf103eae0 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.992+0000 7f8cfd7fa700 1 -- 172.21.15.5:0/1127641840 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08018670 con 0x55bcf103eae0 2023-10-07T00:14:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.992+0000 7f8d28753b80 1 -- 172.21.15.5:0/1127641840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 msgr2=0x55bcf1041950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.992+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf1041950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d080048b0 tx=0x7f8d08015000 comp rx=0 tx=0).stop 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.993+0000 7f8d28753b80 1 -- 172.21.15.5:0/1127641840 shutdown_connections 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.993+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf1041950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.993+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf1044e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.993+0000 7f8d28753b80 1 --2- 172.21.15.5:0/1127641840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.993+0000 7f8d28753b80 1 -- 172.21.15.5:0/1127641840 >> 172.21.15.5:0/1127641840 conn(0x55bcf0fb12e0 msgr2=0x55bcf1037fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.993+0000 7f8d28753b80 1 -- 172.21.15.5:0/1127641840 shutdown_connections 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.993+0000 7f8d28753b80 1 -- 172.21.15.5:0/1127641840 wait complete. 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.993+0000 7f8d28753b80 1 -- start start 2023-10-07T00:14:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.994+0000 7f8d28753b80 1 Processor -- start 2023-10-07T00:14:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.994+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf104b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.994+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.994+0000 7f8d28753b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf10aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.994+0000 7f8d28753b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf104bd90 con 0x55bcf103d2e0 2023-10-07T00:14:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.994+0000 7f8d28753b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf10af1a0 con 0x55bcf103eae0 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.994+0000 7f8d28753b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcf10af360 con 0x55bcf103dc40 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.994+0000 7f8d28753b80 10 client.0 _ll_register_callbacks cb 0x7f8d00097770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf104b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf104b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47830/0 (socket says 172.21.15.5:47830) 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 -- 172.21.15.5:0/2792089896 learned_addr learned my addr 172.21.15.5:0/2792089896 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf10aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 -- 172.21.15.5:0/2792089896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 msgr2=0x55bcf104b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 -- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 msgr2=0x55bcf10aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf10aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 -- 172.21.15.5:0/2792089896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d04021a00 con 0x55bcf103d2e0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0ed9d700 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf10aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8d0e59c700 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf104b120 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8d0009b3c0 tx=0x7f8d00097140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463d993ed33a9636 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.995+0000 7f8cf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/2792089896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d000092b0 con 0x55bcf103d2e0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 1 -- 172.21.15.5:0/2792089896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d00022800 con 0x55bcf103d2e0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/2792089896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8d0009b430 con 0x55bcf103d2e0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/2792089896 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d000a3730 con 0x55bcf103d2e0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 10 client.16038 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 1 -- 172.21.15.5:0/2792089896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f8d080044e0 con 0x55bcf103d2e0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/2792089896 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d00022800 con 0x55bcf103d2e0 2023-10-07T00:14:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/2792089896 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8d0009a920 con 0x55bcf103d2e0 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 10 client.16038 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 20 client.16038 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bcf10b0b10 0x55bcf10b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 4 client.16038 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.996+0000 7f8d28753b80 1 -- 172.21.15.5:0/2792089896 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bcf0f88bb0 con 0x55bcf10b0b10 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.997+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bcf10b0b10 0x55bcf10b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.997+0000 7f8d0dd9b700 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bcf10b0b10 0x55bcf10b2f00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=681e258c05ef3183 server_cookie=8404b39491433963 in_seq=0 out_seq=0 2023-10-07T00:14:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.997+0000 7f8cf5ffb700 10 client.16038 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.998+0000 7f8cf5ffb700 1 -- 172.21.15.5:0/2792089896 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bcf0f88bb0 con 0x55bcf10b0b10 2023-10-07T00:14:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.998+0000 7f8cf5ffb700 10 client.16038 handle_command_reply: tid=0 2023-10-07T00:14:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.998+0000 7f8d28753b80 1 client.16038 shutdown 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 -- 172.21.15.5:0/2792089896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 msgr2=0x55bcf104b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf104b120 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8d0009b3c0 tx=0x7f8d00097140 comp rx=0 tx=0).stop 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 -- 172.21.15.5:0/2792089896 shutdown_connections 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55bcf10b0b10 0x55bcf10b2f00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55bcf103eae0 0x55bcf10aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bcf103d2e0 0x55bcf104b120 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 --2- 172.21.15.5:0/2792089896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bcf103dc40 0x55bcf104b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 -- 172.21.15.5:0/2792089896 >> 172.21.15.5:0/2792089896 conn(0x55bcf0fb12e0 msgr2=0x55bcf1046ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8cf5ffb700 0 client.16038 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 -- 172.21.15.5:0/2792089896 shutdown_connections 2023-10-07T00:14:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 1 -- 172.21.15.5:0/2792089896 wait complete. 2023-10-07T00:14:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:13.999+0000 7f8d28753b80 20 client.16038 trim_cache size 0 max 16384 2023-10-07T00:14:14.005 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:14:14.005 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2023-10-07T00:14:14.005 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "cdab0a6f-41d7-4f3a-9e8b-145f93a94ca0", 2023-10-07T00:14:14.005 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2023-10-07T00:14:14.005 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:14:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 -- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8cf80a1480 msgr2=0x7f8cf80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8cf80a1480 0x7f8cf80a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d10101a10 tx=0x7f8d08009ba0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 -- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d10101a40 msgr2=0x7f8d101013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d10101a40 0x7f8d101013b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8d00005910 tx=0x7f8d00005720 comp rx=0 tx=0).stop 2023-10-07T00:14:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 -- 172.21.15.5:0/7863550 shutdown_connections 2023-10-07T00:14:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8cf80a1480 0x7f8cf80a3940 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d10106ca0 0x7f8d100fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d10101a40 0x7f8d101013b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 --2- 172.21.15.5:0/7863550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d10104370 0x7f8d100ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 -- 172.21.15.5:0/7863550 >> 172.21.15.5:0/7863550 conn(0x7f8d100fb450 msgr2=0x7f8d101026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 -- 172.21.15.5:0/7863550 shutdown_connections 2023-10-07T00:14:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.000+0000 7f8d14dff700 1 -- 172.21.15.5:0/7863550 wait complete. 2023-10-07T00:14:14.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:14:14.047 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/time.h presence... yes 2023-10-07T00:14:14.050 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/time.h... yes 2023-10-07T00:14:14.211 INFO:tasks.workunit.client.0.smithi005.stdout:checking fcntl.h usability... yes 2023-10-07T00:14:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 -- 172.21.15.5:0/1349544035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 msgr2=0x7f4158073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1349544035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 0x7f4158073d90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4148009990 tx=0x7f4148009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 -- 172.21.15.5:0/1349544035 shutdown_connections 2023-10-07T00:14:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1349544035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4158108e40 0x7f415810b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1349544035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158074ef0 0x7f4158073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1349544035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 0x7f4158073d90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 -- 172.21.15.5:0/1349544035 >> 172.21.15.5:0/1349544035 conn(0x7f41580fc510 msgr2=0x7f41580fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 -- 172.21.15.5:0/1349544035 shutdown_connections 2023-10-07T00:14:14.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.239+0000 7f415f9ff700 1 -- 172.21.15.5:0/1349544035 wait complete. 2023-10-07T00:14:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.240+0000 7f415f9ff700 1 Processor -- start 2023-10-07T00:14:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.240+0000 7f415f9ff700 1 -- start start 2023-10-07T00:14:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415f9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 0x7f4158198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415f9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4158074ef0 0x7f41581993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415f9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158108e40 0x7f41581a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415f9ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41581a0a20 con 0x7f4158073910 2023-10-07T00:14:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415f9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41581a0b60 con 0x7f4158108e40 2023-10-07T00:14:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415f9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41581a0cf0 con 0x7f4158074ef0 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415d79b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 0x7f4158198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415d79b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 0x7f4158198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47844/0 (socket says 172.21.15.5:47844) 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415d79b700 1 -- 172.21.15.5:0/1726760880 learned_addr learned my addr 172.21.15.5:0/1726760880 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415df9c700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158108e40 0x7f41581a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.241+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4158074ef0 0x7f41581993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415d79b700 1 -- 172.21.15.5:0/1726760880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4158074ef0 msgr2=0x7f41581993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415d79b700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4158074ef0 0x7f41581993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415d79b700 1 -- 172.21.15.5:0/1726760880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158108e40 msgr2=0x7f41581a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415d79b700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158108e40 0x7f41581a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415d79b700 1 -- 172.21.15.5:0/1726760880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480095f0 con 0x7f4158073910 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415df9c700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158108e40 0x7f41581a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415d79b700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 0x7f4158198ea0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f415400e9a0 tx=0x7f415400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f414e7fc700 1 -- 172.21.15.5:0/1726760880 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154009790 con 0x7f4158073910 2023-10-07T00:14:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f414e7fc700 1 -- 172.21.15.5:0/1726760880 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4154010430 con 0x7f4158073910 2023-10-07T00:14:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415f9ff700 1 -- 172.21.15.5:0/1726760880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41581a0fd0 con 0x7f4158073910 2023-10-07T00:14:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f414e7fc700 1 -- 172.21.15.5:0/1726760880 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400cea0 con 0x7f4158073910 2023-10-07T00:14:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.242+0000 7f415f9ff700 1 -- 172.21.15.5:0/1726760880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41581a13f0 con 0x7f4158073910 2023-10-07T00:14:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.246+0000 7f414e7fc700 1 -- 172.21.15.5:0/1726760880 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f41540105a0 con 0x7f4158073910 2023-10-07T00:14:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.247+0000 7f4173370b80 1 Processor -- start 2023-10-07T00:14:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.247+0000 7f414e7fc700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41440a1480 0x7f41440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.247+0000 7f4173370b80 1 -- start start 2023-10-07T00:14:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.247+0000 7f414e7fc700 1 -- 172.21.15.5:0/1726760880 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4154014070 con 0x7f4158073910 2023-10-07T00:14:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f4173370b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c5e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f4173370b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c5f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f4173370b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 0x559bf4c5fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f4173370b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4bc6460 con 0x559bf4c5ebc0 2023-10-07T00:14:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f4173370b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4bb7c20 con 0x559bf4c5fa60 2023-10-07T00:14:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f4173370b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4bb5540 con 0x559bf4c5e260 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f415df9c700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41440a1480 0x7f41440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f415cf9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c5f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f415cf9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c5f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47846/0 (socket says 172.21.15.5:47846) 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f415cf9a700 1 -- 172.21.15.5:0/1896937928 learned_addr learned my addr 172.21.15.5:0/1896937928 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f415d79b700 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c5e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.248+0000 7f415df9c700 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 0x559bf4c5fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f415df9c700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41440a1480 0x7f41440a3940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4150009550 tx=0x7f41500079a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f415cf9a700 1 -- 172.21.15.5:0/1896937928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 msgr2=0x559bf4c5e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c5e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f415cf9a700 1 -- 172.21.15.5:0/1896937928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 msgr2=0x559bf4c5fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 0x559bf4c5fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f415cf9a700 1 -- 172.21.15.5:0/1896937928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bf49dbde0 con 0x559bf4c5ebc0 2023-10-07T00:14:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c5f480 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4148009990 tx=0x7f4148005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fdee3eca5186e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f41437fe700 1 -- 172.21.15.5:0/1896937928 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414801d070 con 0x559bf4c5ebc0 2023-10-07T00:14:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f41437fe700 1 -- 172.21.15.5:0/1896937928 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f414801e040 con 0x559bf4c5ebc0 2023-10-07T00:14:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.249+0000 7f41437fe700 1 -- 172.21.15.5:0/1896937928 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800b710 con 0x559bf4c5ebc0 2023-10-07T00:14:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 -- 172.21.15.5:0/1896937928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 msgr2=0x559bf4c5f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c5f480 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4148009990 tx=0x7f4148005f00 comp rx=0 tx=0).stop 2023-10-07T00:14:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 -- 172.21.15.5:0/1896937928 shutdown_connections 2023-10-07T00:14:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 0x559bf4c5fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c5e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 --2- 172.21.15.5:0/1896937928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c5f480 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 -- 172.21.15.5:0/1896937928 >> 172.21.15.5:0/1896937928 conn(0x559bf4bd2260 msgr2=0x559bf4c59140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 -- 172.21.15.5:0/1896937928 shutdown_connections 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.250+0000 7f4173370b80 1 -- 172.21.15.5:0/1896937928 wait complete. 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.251+0000 7f4173370b80 1 -- start start 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.251+0000 7f4173370b80 1 Processor -- start 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f4173370b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c68010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f4173370b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c68550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f4173370b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 0x559bf4c6f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f4173370b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4bb0e30 con 0x559bf4c5ebc0 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f4173370b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4b4d710 con 0x559bf4c5fa60 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f4173370b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4b4d3b0 con 0x559bf4c5e260 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f4173370b80 10 client.0 _ll_register_callbacks cb 0x559bf49aa800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415cf9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c68550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415cf9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c68550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47856/0 (socket says 172.21.15.5:47856) 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415cf9a700 1 -- 172.21.15.5:0/7736911 learned_addr learned my addr 172.21.15.5:0/7736911 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415df9c700 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 0x559bf4c6f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415d79b700 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c68010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415cf9a700 1 -- 172.21.15.5:0/7736911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 msgr2=0x559bf4c68010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415cf9a700 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c68010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415cf9a700 1 -- 172.21.15.5:0/7736911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 msgr2=0x559bf4c6f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415cf9a700 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 0x559bf4c6f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415cf9a700 1 -- 172.21.15.5:0/7736911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415810bef0 con 0x559bf4c5ebc0 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.252+0000 7f415d79b700 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c68010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.253+0000 7f415cf9a700 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c68550 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f414800b460 tx=0x7f41480053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93baf2acde3b1016 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.253+0000 7f4140ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.253+0000 7f4140ff9700 1 -- 172.21.15.5:0/7736911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414801d070 con 0x559bf4c5ebc0 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.253+0000 7f4173370b80 1 -- 172.21.15.5:0/7736911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559bf4c50f10 con 0x559bf4c5ebc0 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.253+0000 7f4140ff9700 1 -- 172.21.15.5:0/7736911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f414800b920 con 0x559bf4c5ebc0 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.253+0000 7f4140ff9700 1 -- 172.21.15.5:0/7736911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4148003d40 con 0x559bf4c5ebc0 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.253+0000 7f4173370b80 10 client.16050 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.253+0000 7f4173370b80 1 -- 172.21.15.5:0/7736911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559bf49c4c60 con 0x559bf4c5ebc0 2023-10-07T00:14:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f4140ff9700 1 -- 172.21.15.5:0/7736911 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f414803d020 con 0x559bf4c5ebc0 2023-10-07T00:14:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f4140ff9700 1 -- 172.21.15.5:0/7736911 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4148004cc0 con 0x559bf4c5ebc0 2023-10-07T00:14:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f4173370b80 10 client.16050 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f4173370b80 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f4173370b80 20 client.16050 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f4173370b80 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559bf4c73930 0x559bf4c75d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f4173370b80 4 client.16050 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f4173370b80 1 -- 172.21.15.5:0/7736911 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559bf4ba9e10 con 0x559bf4c73930 2023-10-07T00:14:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.254+0000 7f415d79b700 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559bf4c73930 0x559bf4c75d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.255+0000 7f415d79b700 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559bf4c73930 0x559bf4c75d50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68102e575c659d22 server_cookie=160f5388b82d98e2 in_seq=0 out_seq=0 2023-10-07T00:14:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.255+0000 7f4140ff9700 10 client.16050 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.255+0000 7f4140ff9700 1 -- 172.21.15.5:0/7736911 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559bf4ba9e10 con 0x559bf4c73930 2023-10-07T00:14:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4140ff9700 10 client.16050 handle_command_reply: tid=0 2023-10-07T00:14:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 client.16050 shutdown 2023-10-07T00:14:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 -- 172.21.15.5:0/7736911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 msgr2=0x559bf4c68550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c68550 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f414800b460 tx=0x7f41480053a0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 -- 172.21.15.5:0/7736911 shutdown_connections 2023-10-07T00:14:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559bf4c73930 0x559bf4c75d50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5fa60 0x559bf4c6f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5e260 0x559bf4c68010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 --2- 172.21.15.5:0/7736911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5ebc0 0x559bf4c68550 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4140ff9700 0 client.16050 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 -- 172.21.15.5:0/7736911 >> 172.21.15.5:0/7736911 conn(0x559bf4bd2260 msgr2=0x559bf4c58f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 -- 172.21.15.5:0/7736911 shutdown_connections 2023-10-07T00:14:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 1 -- 172.21.15.5:0/7736911 wait complete. 2023-10-07T00:14:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.256+0000 7f4173370b80 20 client.16050 trim_cache size 0 max 16384 2023-10-07T00:14:14.267 INFO:tasks.workunit.client.0.smithi005.stdout:checking fcntl.h presence... yes 2023-10-07T00:14:14.270 INFO:tasks.workunit.client.0.smithi005.stdout:checking for fcntl.h... yes 2023-10-07T00:14:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.276+0000 7f4173370b80 1 Processor -- start 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.276+0000 7f4173370b80 1 -- start start 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.276+0000 7f4173370b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5e260 0x559bf4c629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.276+0000 7f4173370b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5ebc0 0x559bf4c62f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.276+0000 7f4173370b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5fa60 0x559bf4c6f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.276+0000 7f4173370b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4a31920 con 0x559bf4c5fa60 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.276+0000 7f4173370b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4c674c0 con 0x559bf4c5e260 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.276+0000 7f4173370b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4c67b80 con 0x559bf4c5ebc0 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5e260 0x559bf4c629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5e260 0x559bf4c629d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:33076/0 (socket says 172.21.15.5:33076) 2023-10-07T00:14:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 -- 172.21.15.5:0/1230284958 learned_addr learned my addr 172.21.15.5:0/1230284958 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415df9c700 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5fa60 0x559bf4c6f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5ebc0 0x559bf4c62f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 -- 172.21.15.5:0/1230284958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5ebc0 msgr2=0x559bf4c62f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5ebc0 0x559bf4c62f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 -- 172.21.15.5:0/1230284958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5fa60 msgr2=0x559bf4c6f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5fa60 0x559bf4c6f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 -- 172.21.15.5:0/1230284958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bf4a02250 con 0x559bf4c5e260 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.277+0000 7f415d79b700 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5e260 0x559bf4c629d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f415409a140 tx=0x7f41540ca860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe89af6e08e829 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4143fff700 1 -- 172.21.15.5:0/1230284958 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154099b10 con 0x559bf4c5e260 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4143fff700 1 -- 172.21.15.5:0/1230284958 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f415409a1b0 con 0x559bf4c5e260 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4143fff700 1 -- 172.21.15.5:0/1230284958 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540996a0 con 0x559bf4c5e260 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4173370b80 1 -- 172.21.15.5:0/1230284958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5e260 msgr2=0x559bf4c629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4173370b80 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5e260 0x559bf4c629d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f415409a140 tx=0x7f41540ca860 comp rx=0 tx=0).stop 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4173370b80 1 -- 172.21.15.5:0/1230284958 shutdown_connections 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4173370b80 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5fa60 0x559bf4c6f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4173370b80 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5e260 0x559bf4c629d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4173370b80 1 --2- 172.21.15.5:0/1230284958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5ebc0 0x559bf4c62f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.278+0000 7f4173370b80 1 -- 172.21.15.5:0/1230284958 >> 172.21.15.5:0/1230284958 conn(0x559bf4bd2260 msgr2=0x559bf4c66ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.279+0000 7f4173370b80 1 -- 172.21.15.5:0/1230284958 shutdown_connections 2023-10-07T00:14:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.279+0000 7f4173370b80 1 -- 172.21.15.5:0/1230284958 wait complete. 2023-10-07T00:14:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.279+0000 7f4173370b80 1 -- start start 2023-10-07T00:14:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.279+0000 7f4173370b80 1 Processor -- start 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f4173370b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5e260 0x559bf4c6f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f4173370b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5ebc0 0x559bf4c6f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f4173370b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5fa60 0x559bf4c6d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f4173370b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4c6de70 con 0x559bf4c5e260 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f4173370b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4c6dfe0 con 0x559bf4c5ebc0 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f4173370b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf4c6e1a0 con 0x559bf4c5fa60 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f4173370b80 10 client.0 _ll_register_callbacks cb 0x7f4154011ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f415d79b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5e260 0x559bf4c6f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f415d79b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5e260 0x559bf4c6f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47868/0 (socket says 172.21.15.5:47868) 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f415d79b700 1 -- 172.21.15.5:0/1176093024 learned_addr learned my addr 172.21.15.5:0/1176093024 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5ebc0 0x559bf4c6f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.280+0000 7f415df9c700 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5fa60 0x559bf4c6d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f415d79b700 1 -- 172.21.15.5:0/1176093024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5fa60 msgr2=0x559bf4c6d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f415d79b700 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5fa60 0x559bf4c6d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f415d79b700 1 -- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5ebc0 msgr2=0x559bf4c6f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f415d79b700 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5ebc0 0x559bf4c6f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f415d79b700 1 -- 172.21.15.5:0/1176093024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41581a13f0 con 0x559bf4c5e260 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5ebc0 0x559bf4c6f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f415d79b700 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5e260 0x559bf4c6f0b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f41540966b0 tx=0x7f415409a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a3b650bda19105 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f4140ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f4140ff9700 1 -- 172.21.15.5:0/1176093024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540b8480 con 0x559bf4c5e260 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f4173370b80 1 -- 172.21.15.5:0/1176093024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f414801e040 con 0x559bf4c5e260 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f4140ff9700 1 -- 172.21.15.5:0/1176093024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f415409e300 con 0x559bf4c5e260 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f4140ff9700 1 -- 172.21.15.5:0/1176093024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4154099b10 con 0x559bf4c5e260 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f4173370b80 10 client.16056 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.281+0000 7f4173370b80 1 -- 172.21.15.5:0/1176093024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559bf49da2b0 con 0x559bf4c5e260 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f4140ff9700 1 -- 172.21.15.5:0/1176093024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f414801e040 con 0x559bf4c5e260 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f4140ff9700 1 -- 172.21.15.5:0/1176093024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4154095fa0 con 0x559bf4c5e260 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f4173370b80 10 client.16056 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f4173370b80 10 client.16056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f4173370b80 20 client.16056 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f4173370b80 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559bf4cc8a90 0x559bf4ccaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f4173370b80 4 client.16056 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:14:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f4173370b80 1 -- 172.21.15.5:0/1176093024 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559bf4ba9b30 con 0x559bf4cc8a90 2023-10-07T00:14:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.282+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559bf4cc8a90 0x559bf4ccaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.283+0000 7f415cf9a700 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559bf4cc8a90 0x559bf4ccaeb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b33b53c12b1ddf6 server_cookie=d713d7e1533838ca in_seq=0 out_seq=0 2023-10-07T00:14:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.283+0000 7f4140ff9700 10 client.16056 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.284+0000 7f4140ff9700 1 -- 172.21.15.5:0/1176093024 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559bf4ba9b30 con 0x559bf4cc8a90 2023-10-07T00:14:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.284+0000 7f4140ff9700 10 client.16056 handle_command_reply: tid=0 2023-10-07T00:14:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.284+0000 7f4173370b80 1 client.16056 shutdown 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.284+0000 7f4173370b80 1 -- 172.21.15.5:0/1176093024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5e260 msgr2=0x559bf4c6f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.284+0000 7f4173370b80 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5e260 0x559bf4c6f0b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f41540966b0 tx=0x7f415409a9c0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 1 -- 172.21.15.5:0/1176093024 shutdown_connections 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559bf4cc8a90 0x559bf4ccaeb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559bf4c5fa60 0x559bf4c6d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559bf4c5e260 0x559bf4c6f0b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 1 --2- 172.21.15.5:0/1176093024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559bf4c5ebc0 0x559bf4c6f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 1 -- 172.21.15.5:0/1176093024 >> 172.21.15.5:0/1176093024 conn(0x559bf4bd2260 msgr2=0x559bf4c629d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4140ff9700 0 client.16056 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 1 -- 172.21.15.5:0/1176093024 shutdown_connections 2023-10-07T00:14:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 1 -- 172.21.15.5:0/1176093024 wait complete. 2023-10-07T00:14:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f4173370b80 20 client.16056 trim_cache size 0 max 16384 2023-10-07T00:14:14.291 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:14:14.291 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-07T00:14:14.291 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-07T00:14:14.291 INFO:teuthology.orchestra.run.smithi005.stdout: "cdab0a6f-41d7-4f3a-9e8b-145f93a94ca0": { 2023-10-07T00:14:14.291 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-07T00:14:14.291 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "cdab0a6f-41d7-4f3a-9e8b-145f93a94ca0", 2023-10-07T00:14:14.291 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-07T00:14:14.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:14:14.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:14:14.292 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:14:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f415f9ff700 1 -- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41440a1480 msgr2=0x7f41440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41440a1480 0x7f41440a3940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4150009550 tx=0x7f41500079a0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f415f9ff700 1 -- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 msgr2=0x7f4158198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.285+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 0x7f4158198ea0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f415400e9a0 tx=0x7f415400ecb0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.286+0000 7f415f9ff700 1 -- 172.21.15.5:0/1726760880 shutdown_connections 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.286+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41440a1480 0x7f41440a3940 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.286+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158108e40 0x7f41581a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.286+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4158073910 0x7f4158198ea0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.286+0000 7f415f9ff700 1 --2- 172.21.15.5:0/1726760880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4158074ef0 0x7f41581993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.286+0000 7f415f9ff700 1 -- 172.21.15.5:0/1726760880 >> 172.21.15.5:0/1726760880 conn(0x7f41580fc510 msgr2=0x7f41580fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.286+0000 7f415f9ff700 1 -- 172.21.15.5:0/1726760880 shutdown_connections 2023-10-07T00:14:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:14.286+0000 7f415f9ff700 1 -- 172.21.15.5:0/1726760880 wait complete. 2023-10-07T00:14:14.306 INFO:tasks.cephfs.filesystem:scrub status for tag:cdab0a6f-41d7-4f3a-9e8b-145f93a94ca0 - {'path': '/', 'tag': 'cdab0a6f-41d7-4f3a-9e8b-145f93a94ca0', 'options': 'recursive,force'} 2023-10-07T00:14:14.401 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/fcntl.h usability... yes 2023-10-07T00:14:14.453 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/fcntl.h presence... yes 2023-10-07T00:14:14.456 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/fcntl.h... yes 2023-10-07T00:14:14.602 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/param.h usability... yes 2023-10-07T00:14:14.657 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/param.h presence... yes 2023-10-07T00:14:14.660 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/param.h... yes 2023-10-07T00:14:14.772 INFO:tasks.workunit.client.0.smithi005.stdout:checking ioctl.h usability... no 2023-10-07T00:14:14.831 INFO:tasks.workunit.client.0.smithi005.stdout:checking ioctl.h presence... no 2023-10-07T00:14:14.834 INFO:tasks.workunit.client.0.smithi005.stdout:checking for ioctl.h... no 2023-10-07T00:14:14.950 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/ioctl.h usability... yes 2023-10-07T00:14:15.007 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/ioctl.h presence... yes 2023-10-07T00:14:15.010 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/ioctl.h... yes 2023-10-07T00:14:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:14 smithi005 ceph-mon[129406]: pgmap v390: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 22 op/s 2023-10-07T00:14:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:14 smithi005 ceph-mon[129406]: scrub queued for path: / 2023-10-07T00:14:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:14 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:14 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:14 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:15.134 INFO:tasks.workunit.client.0.smithi005.stdout:checking return type of signal handlers... void 2023-10-07T00:14:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:14 smithi088 ceph-mon[103111]: pgmap v390: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 22 op/s 2023-10-07T00:14:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:14 smithi088 ceph-mon[103111]: scrub queued for path: / 2023-10-07T00:14:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:14 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:14 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:14 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:14 smithi112 ceph-mon[133548]: pgmap v390: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 22 op/s 2023-10-07T00:14:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:14 smithi112 ceph-mon[133548]: scrub queued for path: / 2023-10-07T00:14:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:14 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:14 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:14 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:15.248 INFO:tasks.workunit.client.0.smithi005.stdout:checking for size_t... yes 2023-10-07T00:14:15.349 INFO:tasks.workunit.client.0.smithi005.stdout:checking for dev_t... yes 2023-10-07T00:14:15.458 INFO:tasks.workunit.client.0.smithi005.stdout:checking for short... yes 2023-10-07T00:14:15.619 INFO:tasks.workunit.client.0.smithi005.stdout:checking size of short... 2 2023-10-07T00:14:15.728 INFO:tasks.workunit.client.0.smithi005.stdout:checking for int... yes 2023-10-07T00:14:15.888 INFO:tasks.workunit.client.0.smithi005.stdout:checking size of int... 4 2023-10-07T00:14:16.005 INFO:tasks.workunit.client.0.smithi005.stdout:checking for long... yes 2023-10-07T00:14:16.165 INFO:tasks.workunit.client.0.smithi005.stdout:checking size of long... 8 2023-10-07T00:14:16.273 INFO:tasks.workunit.client.0.smithi005.stdout:checking for long long... yes 2023-10-07T00:14:16.427 INFO:tasks.workunit.client.0.smithi005.stdout:checking size of long long... 8 2023-10-07T00:14:16.535 INFO:tasks.workunit.client.0.smithi005.stdout:checking for ssize_t... yes 2023-10-07T00:14:16.652 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sig_atomic_t... yes 2023-10-07T00:14:16.734 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether gcc needs -traditional... no 2023-10-07T00:14:16.827 INFO:tasks.workunit.client.0.smithi005.stdout:checking for an ANSI C-conforming const... yes 2023-10-07T00:14:16.903 INFO:tasks.workunit.client.0.smithi005.stdout:checking for inline... inline 2023-10-07T00:14:17.051 INFO:tasks.workunit.client.0.smithi005.stdout:checking for working alloca.h... yes 2023-10-07T00:14:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:16 smithi005 ceph-mon[129406]: pgmap v391: 97 pgs: 97 active+clean; 3.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 240 KiB/s wr, 41 op/s 2023-10-07T00:14:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:16 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:14:17.182 INFO:tasks.workunit.client.0.smithi005.stdout:checking for alloca... yes 2023-10-07T00:14:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:16 smithi088 ceph-mon[103111]: pgmap v391: 97 pgs: 97 active+clean; 3.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 240 KiB/s wr, 41 op/s 2023-10-07T00:14:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:16 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:14:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:16 smithi112 ceph-mon[133548]: pgmap v391: 97 pgs: 97 active+clean; 3.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 240 KiB/s wr, 41 op/s 2023-10-07T00:14:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:16 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:14:17.324 INFO:tasks.workunit.client.0.smithi005.stdout:checking for working memcmp... yes 2023-10-07T00:14:17.642 INFO:tasks.workunit.client.0.smithi005.stdout:checking for strftime... yes 2023-10-07T00:14:17.643 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2023-10-07T00:14:17.794 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether stat accepts an empty string... no 2023-10-07T00:14:17.946 INFO:tasks.workunit.client.0.smithi005.stdout:checking for vprintf... yes 2023-10-07T00:14:18.112 INFO:tasks.workunit.client.0.smithi005.stdout:checking for _doprnt... no 2023-10-07T00:14:18.187 INFO:tasks.workunit.client.0.smithi005.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-10-07T00:14:18.227 INFO:tasks.workunit.client.0.smithi005.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-10-07T00:14:18.369 INFO:tasks.workunit.client.0.smithi005.stdout:checking for the pthreads library -lpthreads... no 2023-10-07T00:14:18.537 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether pthreads work without any flags... no 2023-10-07T00:14:18.592 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether pthreads work with -Kthread... no 2023-10-07T00:14:18.644 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether pthreads work with -kthread... no 2023-10-07T00:14:18.752 INFO:tasks.workunit.client.0.smithi005.stdout:checking for the pthreads library -llthread... no 2023-10-07T00:14:18.892 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether pthreads work with -pthread... yes 2023-10-07T00:14:19.024 INFO:tasks.workunit.client.0.smithi005.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2023-10-07T00:14:19.025 INFO:tasks.workunit.client.0.smithi005.stdout:checking if more special flags are required for pthreads... no 2023-10-07T00:14:19.025 INFO:tasks.workunit.client.0.smithi005.stdout:checking for cc_r... gcc 2023-10-07T00:14:19.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:18 smithi005 ceph-mon[129406]: pgmap v392: 97 pgs: 97 active+clean; 3.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 261 KiB/s wr, 57 op/s 2023-10-07T00:14:19.181 INFO:tasks.workunit.client.0.smithi005.stdout:checking for setrlimit... yes 2023-10-07T00:14:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:18 smithi088 ceph-mon[103111]: pgmap v392: 97 pgs: 97 active+clean; 3.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 261 KiB/s wr, 57 op/s 2023-10-07T00:14:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:18 smithi112 ceph-mon[133548]: pgmap v392: 97 pgs: 97 active+clean; 3.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 261 KiB/s wr, 57 op/s 2023-10-07T00:14:19.357 INFO:tasks.workunit.client.0.smithi005.stdout:checking for setproctitle... no 2023-10-07T00:14:19.507 INFO:tasks.workunit.client.0.smithi005.stdout:checking for getopt_long... yes 2023-10-07T00:14:19.664 INFO:tasks.workunit.client.0.smithi005.stdout:checking for strtoull... yes 2023-10-07T00:14:19.819 INFO:tasks.workunit.client.0.smithi005.stdout:checking for strtoq... yes 2023-10-07T00:14:19.984 INFO:tasks.workunit.client.0.smithi005.stdout:checking for snprintf... yes 2023-10-07T00:14:20.152 INFO:tasks.workunit.client.0.smithi005.stdout:checking for vsnprintf... yes 2023-10-07T00:14:20.314 INFO:tasks.workunit.client.0.smithi005.stdout:checking for vfprintf... yes 2023-10-07T00:14:20.472 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gethostname... yes 2023-10-07T00:14:20.631 INFO:tasks.workunit.client.0.smithi005.stdout:checking for setlocale... yes 2023-10-07T00:14:20.792 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sync... yes 2023-10-07T00:14:20.946 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether snprintf is C99 conformant... done 2023-10-07T00:14:20.980 INFO:tasks.workunit.client.0.smithi005.stdout:configure: creating ./config.status 2023-10-07T00:14:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:20 smithi005 ceph-mon[129406]: pgmap v393: 97 pgs: 97 active+clean; 3.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 282 KiB/s wr, 71 op/s 2023-10-07T00:14:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:20 smithi088 ceph-mon[103111]: pgmap v393: 97 pgs: 97 active+clean; 3.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 282 KiB/s wr, 71 op/s 2023-10-07T00:14:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:20 smithi112 ceph-mon[133548]: pgmap v393: 97 pgs: 97 active+clean; 3.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 282 KiB/s wr, 71 op/s 2023-10-07T00:14:21.472 INFO:tasks.workunit.client.0.smithi005.stdout:config.status: creating Makefile 2023-10-07T00:14:21.527 INFO:tasks.workunit.client.0.smithi005.stdout:config.status: creating src/Makefile 2023-10-07T00:14:21.587 INFO:tasks.workunit.client.0.smithi005.stdout:config.status: creating man/Makefile 2023-10-07T00:14:21.620 INFO:tasks.workunit.client.0.smithi005.stdout:config.status: creating config.h 2023-10-07T00:14:21.752 INFO:tasks.workunit.client.0.smithi005.stdout:config.status: executing depfiles commands 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 -- 172.21.15.5:0/1237550583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 msgr2=0x7f4998102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 --2- 172.21.15.5:0/1237550583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 0x7f4998102510 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f498c009990 tx=0x7f498c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 -- 172.21.15.5:0/1237550583 shutdown_connections 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 --2- 172.21.15.5:0/1237550583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4998102a50 0x7f4998109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 --2- 172.21.15.5:0/1237550583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4998100eb0 0x7f49981012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 --2- 172.21.15.5:0/1237550583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 0x7f4998102510 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 -- 172.21.15.5:0/1237550583 >> 172.21.15.5:0/1237550583 conn(0x7f49980fc470 msgr2=0x7f49980fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 -- 172.21.15.5:0/1237550583 shutdown_connections 2023-10-07T00:14:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.765+0000 7f499cdff700 1 -- 172.21.15.5:0/1237550583 wait complete. 2023-10-07T00:14:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.766+0000 7f499cdff700 1 Processor -- start 2023-10-07T00:14:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f499cdff700 1 -- start start 2023-10-07T00:14:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f499cdff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4998100eb0 0x7f4998074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f499cdff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 0x7f49980732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f499cdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4998102a50 0x7f49980737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f499cdff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998073f80 con 0x7f4998102090 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f499cdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49980740f0 con 0x7f4998102a50 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f499cdff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49981a0b70 con 0x7f4998100eb0 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f4995d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 0x7f49980732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f4995d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 0x7f49980732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47890/0 (socket says 172.21.15.5:47890) 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f4995d9b700 1 -- 172.21.15.5:0/3197937232 learned_addr learned my addr 172.21.15.5:0/3197937232 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.767+0000 7f4996d9d700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4998102a50 0x7f49980737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f499659c700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4998100eb0 0x7f4998074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f4995d9b700 1 -- 172.21.15.5:0/3197937232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4998100eb0 msgr2=0x7f4998074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f4995d9b700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4998100eb0 0x7f4998074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f4995d9b700 1 -- 172.21.15.5:0/3197937232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4998102a50 msgr2=0x7f49980737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f4995d9b700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4998102a50 0x7f49980737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f4995d9b700 1 -- 172.21.15.5:0/3197937232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0095f0 con 0x7f4998102090 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f499659c700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4998100eb0 0x7f4998074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f4995d9b700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 0x7f49980732a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f498c0059d0 tx=0x7f498c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.768+0000 7f49877fe700 1 -- 172.21.15.5:0/3197937232 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c01d070 con 0x7f4998102090 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.769+0000 7f49877fe700 1 -- 172.21.15.5:0/3197937232 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f498c00bd70 con 0x7f4998102090 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.769+0000 7f49877fe700 1 -- 172.21.15.5:0/3197937232 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c022cb0 con 0x7f4998102090 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.769+0000 7f499cdff700 1 -- 172.21.15.5:0/3197937232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49981a0df0 con 0x7f4998102090 2023-10-07T00:14:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.769+0000 7f499cdff700 1 -- 172.21.15.5:0/3197937232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49981a11c0 con 0x7f4998102090 2023-10-07T00:14:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.772+0000 7f49877fe700 1 -- 172.21.15.5:0/3197937232 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f498c022470 con 0x7f4998102090 2023-10-07T00:14:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.774+0000 7f49b0765b80 1 Processor -- start 2023-10-07T00:14:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.774+0000 7f49b0765b80 1 -- start start 2023-10-07T00:14:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.774+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf4ec0 0x5639bcbf52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.774+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcbf6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.774+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 0x5639bcbfd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f49b0765b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcb5d400 con 0x5639bcbf6990 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f49b0765b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcb4ebc0 con 0x5639bcbf5fd0 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f49b0765b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcb4c4e0 con 0x5639bcbf4ec0 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f49877fe700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f49800a1500 0x7f49800a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f49877fe700 1 -- 172.21.15.5:0/3197937232 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f498c0ce340 con 0x7f4998102090 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f4996d9d700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f49800a1500 0x7f49800a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f4995d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 0x5639bcbfd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f499659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcbf6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f499659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcbf6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:33114/0 (socket says 172.21.15.5:33114) 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f499659c700 1 -- 172.21.15.5:0/3490744664 learned_addr learned my addr 172.21.15.5:0/3490744664 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.775+0000 7f4996d9d700 1 --2- 172.21.15.5:0/3490744664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf4ec0 0x5639bcbf52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f499659c700 1 -- 172.21.15.5:0/3490744664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf4ec0 msgr2=0x5639bcbf52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f499659c700 1 --2- 172.21.15.5:0/3490744664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf4ec0 0x5639bcbf52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f499659c700 1 -- 172.21.15.5:0/3490744664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 msgr2=0x5639bcbfd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f499659c700 1 --2- 172.21.15.5:0/3490744664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 0x5639bcbfd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f499659c700 1 -- 172.21.15.5:0/3490744664 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639bc972d80 con 0x5639bcbf5fd0 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f4996d9d700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f49800a1500 0x7f49800a39c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f49980752c0 tx=0x7f4990009c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f499659c700 1 --2- 172.21.15.5:0/3490744664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcbf6450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f498800bd40 tx=0x7f498800f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938ad862b2e05d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f4984ff9700 1 -- 172.21.15.5:0/3490744664 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800fda0 con 0x5639bcbf5fd0 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f4984ff9700 1 -- 172.21.15.5:0/3490744664 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f498800be90 con 0x5639bcbf5fd0 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.776+0000 7f4984ff9700 1 -- 172.21.15.5:0/3490744664 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498801b700 con 0x5639bcbf5fd0 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 -- 172.21.15.5:0/3490744664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 msgr2=0x5639bcbf6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 --2- 172.21.15.5:0/3490744664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcbf6450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f498800bd40 tx=0x7f498800f640 comp rx=0 tx=0).stop 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 -- 172.21.15.5:0/3490744664 shutdown_connections 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 --2- 172.21.15.5:0/3490744664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 0x5639bcbfd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 --2- 172.21.15.5:0/3490744664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf4ec0 0x5639bcbf52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 --2- 172.21.15.5:0/3490744664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcbf6450 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 -- 172.21.15.5:0/3490744664 >> 172.21.15.5:0/3490744664 conn(0x5639bcb69200 msgr2=0x5639bcbefbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 -- 172.21.15.5:0/3490744664 shutdown_connections 2023-10-07T00:14:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.777+0000 7f49b0765b80 1 -- 172.21.15.5:0/3490744664 wait complete. 2023-10-07T00:14:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.778+0000 7f49b0765b80 1 -- start start 2023-10-07T00:14:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.778+0000 7f49b0765b80 1 Processor -- start 2023-10-07T00:14:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.778+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf4ec0 0x5639bcbfebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf5fd0 0x5639bcbff100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 0x5639bcc06140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f49b0765b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcb47dd0 con 0x5639bcbf6990 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f49b0765b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcae46b0 con 0x5639bcbf4ec0 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f49b0765b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcae4350 con 0x5639bcbf5fd0 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f49b0765b80 10 client.0 _ll_register_callbacks cb 0x5639bc9417a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f499659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf4ec0 0x5639bcbfebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f4996d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 0x5639bcc06140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f499659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf4ec0 0x5639bcbfebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:33124/0 (socket says 172.21.15.5:33124) 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f499659c700 1 -- 172.21.15.5:0/543476043 learned_addr learned my addr 172.21.15.5:0/543476043 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f4995d9b700 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf5fd0 0x5639bcbff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f499659c700 1 -- 172.21.15.5:0/543476043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf5fd0 msgr2=0x5639bcbff100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f499659c700 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf5fd0 0x5639bcbff100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f499659c700 1 -- 172.21.15.5:0/543476043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 msgr2=0x5639bcc06140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f499659c700 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 0x5639bcc06140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f499659c700 1 -- 172.21.15.5:0/543476043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498800b9a0 con 0x5639bcbf4ec0 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.779+0000 7f4995d9b700 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf5fd0 0x5639bcbff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.780+0000 7f499659c700 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf4ec0 0x5639bcbfebc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4988000c00 tx=0x7f498800fdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12e8faa7af9c7ff7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.780+0000 7f497dffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.780+0000 7f497dffb700 1 -- 172.21.15.5:0/543476043 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988020070 con 0x5639bcbf4ec0 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.780+0000 7f49b0765b80 1 -- 172.21.15.5:0/543476043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639bcbe7d50 con 0x5639bcbf4ec0 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.780+0000 7f497dffb700 1 -- 172.21.15.5:0/543476043 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4988011440 con 0x5639bcbf4ec0 2023-10-07T00:14:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.780+0000 7f497dffb700 1 -- 172.21.15.5:0/543476043 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4988011600 con 0x5639bcbf4ec0 2023-10-07T00:14:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.780+0000 7f49b0765b80 10 client.25844 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f49b0765b80 1 -- 172.21.15.5:0/543476043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5639bc95bc00 con 0x5639bcbf4ec0 2023-10-07T00:14:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f497dffb700 1 -- 172.21.15.5:0/543476043 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4988035080 con 0x5639bcbf4ec0 2023-10-07T00:14:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f497dffb700 1 -- 172.21.15.5:0/543476043 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f498802f030 con 0x5639bcbf4ec0 2023-10-07T00:14:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f49b0765b80 10 client.25844 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f49b0765b80 10 client.25844 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f49b0765b80 20 client.25844 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f49b0765b80 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5639bcc0a920 0x5639bcc0cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f49b0765b80 4 client.25844 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.781+0000 7f49b0765b80 1 -- 172.21.15.5:0/543476043 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639bcb40db0 con 0x5639bcc0a920 2023-10-07T00:14:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.782+0000 7f4995d9b700 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5639bcc0a920 0x5639bcc0cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.782+0000 7f497dffb700 10 client.25844 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.782+0000 7f4995d9b700 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5639bcc0a920 0x5639bcc0cd40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3df62ffbe3b895b3 server_cookie=a31eca616878d78c in_seq=0 out_seq=0 2023-10-07T00:14:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f497dffb700 1 -- 172.21.15.5:0/543476043 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5639bcb40db0 con 0x5639bcc0a920 2023-10-07T00:14:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f497dffb700 10 client.25844 handle_command_reply: tid=0 2023-10-07T00:14:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 client.25844 shutdown 2023-10-07T00:14:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 -- 172.21.15.5:0/543476043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf4ec0 msgr2=0x5639bcbfebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf4ec0 0x5639bcbfebc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4988000c00 tx=0x7f498800fdd0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 -- 172.21.15.5:0/543476043 shutdown_connections 2023-10-07T00:14:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5639bcc0a920 0x5639bcc0cd40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf6990 0x5639bcc06140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf4ec0 0x5639bcbfebc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 --2- 172.21.15.5:0/543476043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf5fd0 0x5639bcbff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f497dffb700 0 client.25844 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 -- 172.21.15.5:0/543476043 >> 172.21.15.5:0/543476043 conn(0x5639bcb69200 msgr2=0x5639bcbef250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 -- 172.21.15.5:0/543476043 shutdown_connections 2023-10-07T00:14:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.783+0000 7f49b0765b80 1 -- 172.21.15.5:0/543476043 wait complete. 2023-10-07T00:14:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.784+0000 7f49b0765b80 20 client.25844 trim_cache size 0 max 16384 2023-10-07T00:14:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.800+0000 7f49b0765b80 1 Processor -- start 2023-10-07T00:14:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.800+0000 7f49b0765b80 1 -- start start 2023-10-07T00:14:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcbef250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc06100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 0x5639bcbfd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f49b0765b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bc9c88c0 con 0x5639bcbf4ec0 2023-10-07T00:14:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f49b0765b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcbfcb30 con 0x5639bcbf5fd0 2023-10-07T00:14:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f49b0765b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcbfa420 con 0x5639bcbf6990 2023-10-07T00:14:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f499659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcbef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f4995d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc06100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f499659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcbef250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47916/0 (socket says 172.21.15.5:47916) 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f499659c700 1 -- 172.21.15.5:0/1666122684 learned_addr learned my addr 172.21.15.5:0/1666122684 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f4996d9d700 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 0x5639bcbfd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f499659c700 1 -- 172.21.15.5:0/1666122684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 msgr2=0x5639bcbfd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f499659c700 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 0x5639bcbfd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f499659c700 1 -- 172.21.15.5:0/1666122684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 msgr2=0x5639bcc06100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.801+0000 7f499659c700 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc06100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.802+0000 7f499659c700 1 -- 172.21.15.5:0/1666122684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639bc9991f0 con 0x5639bcbf4ec0 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.802+0000 7f4995d9b700 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc06100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.802+0000 7f499659c700 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcbef250 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f498800bd60 tx=0x7f498800b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8add514d656220 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:21.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.802+0000 7f49857fa700 1 -- 172.21.15.5:0/1666122684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988020070 con 0x5639bcbf4ec0 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.802+0000 7f49857fa700 1 -- 172.21.15.5:0/1666122684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5639bcbe7d50 con 0x5639bcbf4ec0 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.802+0000 7f49857fa700 1 -- 172.21.15.5:0/1666122684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988004380 con 0x5639bcbf4ec0 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 -- 172.21.15.5:0/1666122684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 msgr2=0x5639bcbef250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcbef250 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f498800bd60 tx=0x7f498800b5e0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 -- 172.21.15.5:0/1666122684 shutdown_connections 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 0x5639bcbfd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcbef250 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 --2- 172.21.15.5:0/1666122684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc06100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 -- 172.21.15.5:0/1666122684 >> 172.21.15.5:0/1666122684 conn(0x5639bcb69200 msgr2=0x5639bcc116a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 -- 172.21.15.5:0/1666122684 shutdown_connections 2023-10-07T00:14:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.803+0000 7f49b0765b80 1 -- 172.21.15.5:0/1666122684 wait complete. 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.804+0000 7f49b0765b80 1 -- start start 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.804+0000 7f49b0765b80 1 Processor -- start 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.804+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcc03800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.804+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc03d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f49b0765b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 0x5639bcc04d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f49b0765b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcc05290 con 0x5639bcbf4ec0 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f49b0765b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcc05400 con 0x5639bcbf5fd0 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f49b0765b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639bcc055c0 con 0x5639bcbf6990 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f49b0765b80 10 client.0 _ll_register_callbacks cb 0x7f498c009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f499659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcc03800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f499659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcc03800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47924/0 (socket says 172.21.15.5:47924) 2023-10-07T00:14:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f499659c700 1 -- 172.21.15.5:0/201639479 learned_addr learned my addr 172.21.15.5:0/201639479 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f4995d9b700 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc03d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f4996d9d700 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 0x5639bcc04d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f499659c700 1 -- 172.21.15.5:0/201639479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 msgr2=0x5639bcc04d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f499659c700 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 0x5639bcc04d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f499659c700 1 -- 172.21.15.5:0/201639479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 msgr2=0x5639bcc03d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f499659c700 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc03d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.805+0000 7f499659c700 1 -- 172.21.15.5:0/201639479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49981a11c0 con 0x5639bcbf4ec0 2023-10-07T00:14:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f499659c700 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcc03800 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f498800b390 tx=0x7f498801b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254d15a23a5ad063 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f497dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f497dffb700 1 -- 172.21.15.5:0/201639479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988020040 con 0x5639bcbf4ec0 2023-10-07T00:14:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f49b0765b80 1 -- 172.21.15.5:0/201639479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f498800be90 con 0x5639bcbf4ec0 2023-10-07T00:14:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f497dffb700 1 -- 172.21.15.5:0/201639479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4988000e40 con 0x5639bcbf4ec0 2023-10-07T00:14:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f497dffb700 1 -- 172.21.15.5:0/201639479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f498800fdb0 con 0x5639bcbf4ec0 2023-10-07T00:14:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f49b0765b80 10 client.16074 fetch_fsmap learned FSMap version 26 2023-10-07T00:14:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f49b0765b80 1 -- 172.21.15.5:0/201639479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5639bc95bc00 con 0x5639bcbf4ec0 2023-10-07T00:14:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.806+0000 7f497dffb700 1 -- 172.21.15.5:0/201639479 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f498804a020 con 0x5639bcbf4ec0 2023-10-07T00:14:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.807+0000 7f497dffb700 1 -- 172.21.15.5:0/201639479 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4988044020 con 0x5639bcbf4ec0 2023-10-07T00:14:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.807+0000 7f49b0765b80 10 client.16074 fetch_fsmap finished waiting for FSMap version 26 2023-10-07T00:14:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.807+0000 7f49b0765b80 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.807+0000 7f49b0765b80 20 client.16074 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:21.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.807+0000 7f49b0765b80 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5639bcc5ec00 0x5639bcc60ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:21.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.807+0000 7f49b0765b80 4 client.16074 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:14:21.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.807+0000 7f49b0765b80 1 -- 172.21.15.5:0/201639479 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5639bcb40ad0 con 0x5639bcc5ec00 2023-10-07T00:14:21.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.807+0000 7f4995d9b700 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5639bcc5ec00 0x5639bcc60ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:21.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.808+0000 7f497dffb700 10 client.16074 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:21.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.808+0000 7f4995d9b700 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5639bcc5ec00 0x5639bcc60ff0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9667f5ee2ce88844 server_cookie=be8995af7b60e3dd in_seq=0 out_seq=0 2023-10-07T00:14:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f497dffb700 1 -- 172.21.15.5:0/201639479 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5639bcb40ad0 con 0x5639bcc5ec00 2023-10-07T00:14:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f497dffb700 10 client.16074 handle_command_reply: tid=0 2023-10-07T00:14:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 client.16074 shutdown 2023-10-07T00:14:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 -- 172.21.15.5:0/201639479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 msgr2=0x5639bcc03800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcc03800 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f498800b390 tx=0x7f498801b640 comp rx=0 tx=0).stop 2023-10-07T00:14:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 -- 172.21.15.5:0/201639479 shutdown_connections 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5639bcc5ec00 0x5639bcc60ff0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639bcbf6990 0x5639bcc04d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5639bcbf4ec0 0x5639bcc03800 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 --2- 172.21.15.5:0/201639479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5639bcbf5fd0 0x5639bcc03d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 -- 172.21.15.5:0/201639479 >> 172.21.15.5:0/201639479 conn(0x5639bcb69200 msgr2=0x5639bcbfd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f497dffb700 0 client.16074 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 -- 172.21.15.5:0/201639479 shutdown_connections 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.849+0000 7f49b0765b80 1 -- 172.21.15.5:0/201639479 wait complete. 2023-10-07T00:14:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f49b0765b80 20 client.16074 trim_cache size 0 max 16384 2023-10-07T00:14:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:14:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:14:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:14:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 -- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f49800a1500 msgr2=0x7f49800a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f49800a1500 0x7f49800a39c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f49980752c0 tx=0x7f4990009c50 comp rx=0 tx=0).stop 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 -- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 msgr2=0x7f49980732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 0x7f49980732a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f498c0059d0 tx=0x7f498c003a50 comp rx=0 tx=0).stop 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 -- 172.21.15.5:0/3197937232 shutdown_connections 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f49800a1500 0x7f49800a39c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4998102a50 0x7f49980737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4998100eb0 0x7f4998074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 --2- 172.21.15.5:0/3197937232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4998102090 0x7f49980732a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.850+0000 7f499cdff700 1 -- 172.21.15.5:0/3197937232 >> 172.21.15.5:0/3197937232 conn(0x7f49980fc470 msgr2=0x7f4998105690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.851+0000 7f499cdff700 1 -- 172.21.15.5:0/3197937232 shutdown_connections 2023-10-07T00:14:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:21.851+0000 7f499cdff700 1 -- 172.21.15.5:0/3197937232 wait complete. 2023-10-07T00:14:22.212 INFO:tasks.workunit.client.0.smithi005.stderr:+ make 2023-10-07T00:14:22.243 INFO:tasks.workunit.client.0.smithi005.stdout:make all-recursive 2023-10-07T00:14:22.256 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-10-07T00:14:22.266 INFO:tasks.workunit.client.0.smithi005.stdout:Making all in src 2023-10-07T00:14:22.315 INFO:tasks.workunit.client.0.smithi005.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-10-07T00:14:22.315 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2023-10-07T00:14:22.315 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2023-10-07T00:14:22.470 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2023-10-07T00:14:22.471 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2023-10-07T00:14:22.728 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2023-10-07T00:14:22.728 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2023-10-07T00:14:22.968 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2023-10-07T00:14:22.968 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2023-10-07T00:14:23.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:22 smithi005 ceph-mon[129406]: pgmap v394: 97 pgs: 97 active+clean; 4.8 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 413 KiB/s wr, 90 op/s 2023-10-07T00:14:23.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:22 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:22 smithi088 ceph-mon[103111]: pgmap v394: 97 pgs: 97 active+clean; 4.8 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 413 KiB/s wr, 90 op/s 2023-10-07T00:14:23.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:22 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:23.211 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2023-10-07T00:14:23.211 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2023-10-07T00:14:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:22 smithi112 ceph-mon[133548]: pgmap v394: 97 pgs: 97 active+clean; 4.8 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 413 KiB/s wr, 90 op/s 2023-10-07T00:14:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:22 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:23.465 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2023-10-07T00:14:23.465 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2023-10-07T00:14:23.701 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2023-10-07T00:14:23.701 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2023-10-07T00:14:23.972 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2023-10-07T00:14:23.972 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2023-10-07T00:14:24.201 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2023-10-07T00:14:24.201 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2023-10-07T00:14:24.427 INFO:tasks.workunit.client.0.smithi005.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2023-10-07T00:14:24.427 INFO:tasks.workunit.client.0.smithi005.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2023-10-07T00:14:24.593 INFO:tasks.workunit.client.0.smithi005.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2023-10-07T00:14:24.730 INFO:tasks.workunit.client.0.smithi005.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-10-07T00:14:24.732 INFO:tasks.workunit.client.0.smithi005.stdout:Making all in man 2023-10-07T00:14:24.753 INFO:tasks.workunit.client.0.smithi005.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-10-07T00:14:24.753 INFO:tasks.workunit.client.0.smithi005.stdout:make[2]: Nothing to be done for 'all'. 2023-10-07T00:14:24.753 INFO:tasks.workunit.client.0.smithi005.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-10-07T00:14:24.768 INFO:tasks.workunit.client.0.smithi005.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-10-07T00:14:24.773 INFO:tasks.workunit.client.0.smithi005.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-10-07T00:14:24.775 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-10-07T00:14:24.777 INFO:tasks.workunit.client.0.smithi005.stderr:+ cd src 2023-10-07T00:14:24.780 INFO:tasks.workunit.client.0.smithi005.stderr:+ mkdir blogtest_in 2023-10-07T00:14:24.786 INFO:tasks.workunit.client.0.smithi005.stdout:running blogbench 2023-10-07T00:14:24.786 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'running blogbench' 2023-10-07T00:14:24.786 INFO:tasks.workunit.client.0.smithi005.stderr:+ ./blogbench -d blogtest_in 2023-10-07T00:14:24.788 INFO:tasks.workunit.client.0.smithi005.stdout: 2023-10-07T00:14:24.788 INFO:tasks.workunit.client.0.smithi005.stdout:Frequency = 10 secs 2023-10-07T00:14:24.788 INFO:tasks.workunit.client.0.smithi005.stdout:Scratch dir = [blogtest_in] 2023-10-07T00:14:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:24 smithi005 ceph-mon[129406]: pgmap v395: 97 pgs: 97 active+clean; 4.9 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 414 KiB/s wr, 107 op/s 2023-10-07T00:14:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:24 smithi088 ceph-mon[103111]: pgmap v395: 97 pgs: 97 active+clean; 4.9 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 414 KiB/s wr, 107 op/s 2023-10-07T00:14:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:24 smithi112 ceph-mon[133548]: pgmap v395: 97 pgs: 97 active+clean; 4.9 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 414 KiB/s wr, 107 op/s 2023-10-07T00:14:27.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:26 smithi005 ceph-mon[129406]: pgmap v396: 97 pgs: 97 active+clean; 5.7 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 482 KiB/s wr, 145 op/s 2023-10-07T00:14:27.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:26 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:14:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:26 smithi088 ceph-mon[103111]: pgmap v396: 97 pgs: 97 active+clean; 5.7 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 482 KiB/s wr, 145 op/s 2023-10-07T00:14:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:26 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:14:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:26 smithi112 ceph-mon[133548]: pgmap v396: 97 pgs: 97 active+clean; 5.7 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 482 KiB/s wr, 145 op/s 2023-10-07T00:14:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:26 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:14:27.751 INFO:tasks.workunit.client.0.smithi005.stdout:Spawning 3 writers... 2023-10-07T00:14:27.752 INFO:tasks.workunit.client.0.smithi005.stdout:Spawning 1 rewriters... 2023-10-07T00:14:27.752 INFO:tasks.workunit.client.0.smithi005.stdout:Spawning 5 commenters... 2023-10-07T00:14:27.752 INFO:tasks.workunit.client.0.smithi005.stdout:Spawning 100 readers... 2023-10-07T00:14:27.764 INFO:tasks.workunit.client.0.smithi005.stdout:Benchmarking for 30 iterations. 2023-10-07T00:14:27.764 INFO:tasks.workunit.client.0.smithi005.stdout:The test will run during 5 minutes. 2023-10-07T00:14:27.764 INFO:tasks.workunit.client.0.smithi005.stdout: 2023-10-07T00:14:27.764 INFO:tasks.workunit.client.0.smithi005.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2023-10-07T00:14:28.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: pgmap v397: 97 pgs: 97 active+clean; 5.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 344 KiB/s wr, 137 op/s 2023-10-07T00:14:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:14:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:14:28.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:27 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: pgmap v397: 97 pgs: 97 active+clean; 5.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 344 KiB/s wr, 137 op/s 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:14:28.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:27 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: pgmap v397: 97 pgs: 97 active+clean; 5.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 344 KiB/s wr, 137 op/s 2023-10-07T00:14:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:14:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:14:28.453 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:27 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:14:31.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:30 smithi005 ceph-mon[129406]: pgmap v398: 97 pgs: 97 active+clean; 6.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 417 KiB/s wr, 126 op/s 2023-10-07T00:14:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:30 smithi088 ceph-mon[103111]: pgmap v398: 97 pgs: 97 active+clean; 6.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 417 KiB/s wr, 126 op/s 2023-10-07T00:14:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:30 smithi112 ceph-mon[133548]: pgmap v398: 97 pgs: 97 active+clean; 6.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 417 KiB/s wr, 126 op/s 2023-10-07T00:14:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:32 smithi005 ceph-mon[129406]: pgmap v399: 97 pgs: 97 active+clean; 9.6 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 641 KiB/s wr, 122 op/s 2023-10-07T00:14:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:32 smithi088 ceph-mon[103111]: pgmap v399: 97 pgs: 97 active+clean; 9.6 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 641 KiB/s wr, 122 op/s 2023-10-07T00:14:33.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:32 smithi112 ceph-mon[133548]: pgmap v399: 97 pgs: 97 active+clean; 9.6 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 641 KiB/s wr, 122 op/s 2023-10-07T00:14:35.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.083+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3484548358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4ec10f730 msgr2=0x7ff4ec111b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:35.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.083+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3484548358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4ec10f730 0x7ff4ec111b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400b0a0 tx=0x7ff4e400b3b0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.083+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3484548358 shutdown_connections 2023-10-07T00:14:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.083+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3484548358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4ec10f730 0x7ff4ec111b20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.083+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3484548358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4ec107eb0 0x7ff4ec1082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.083+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3484548358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec108810 0x7ff4ec10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.083+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3484548358 >> 172.21.15.5:0/3484548358 conn(0x7ff4ec06dcf0 msgr2=0x7ff4ec070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.083+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3484548358 shutdown_connections 2023-10-07T00:14:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.084+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3484548358 wait complete. 2023-10-07T00:14:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.085+0000 7ff4f3dff700 1 Processor -- start 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.085+0000 7ff4f3dff700 1 -- start start 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f3dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec107eb0 0x7ff4ec10ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f3dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4ec108810 0x7ff4ec109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f3dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4ec10f730 0x7ff4ec1096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f3dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1a3310 con 0x7ff4ec10f730 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f3dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1a3480 con 0x7ff4ec108810 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f3dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1a3640 con 0x7ff4ec107eb0 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f1b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec107eb0 0x7ff4ec10ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f1b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec107eb0 0x7ff4ec10ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43808/0 (socket says 172.21.15.5:43808) 2023-10-07T00:14:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.086+0000 7ff4f1b9b700 1 -- 172.21.15.5:0/3186754123 learned_addr learned my addr 172.21.15.5:0/3186754123 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.087+0000 7ff4f1b9b700 1 -- 172.21.15.5:0/3186754123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4ec108810 msgr2=0x7ff4ec109180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-07T00:14:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.087+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4ec108810 0x7ff4ec109180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.087+0000 7ff4f1b9b700 1 -- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4ec10f730 msgr2=0x7ff4ec1096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.087+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4ec10f730 0x7ff4ec1096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.087+0000 7ff4f1b9b700 1 -- 172.21.15.5:0/3186754123 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009d00 con 0x7ff4ec107eb0 2023-10-07T00:14:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.087+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec107eb0 0x7ff4ec10ab40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800e970 tx=0x7ff4e800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.088+0000 7ff4e2ffd700 1 -- 172.21.15.5:0/3186754123 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8009790 con 0x7ff4ec107eb0 2023-10-07T00:14:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.088+0000 7ff4e2ffd700 1 -- 172.21.15.5:0/3186754123 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4e80044b0 con 0x7ff4ec107eb0 2023-10-07T00:14:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.088+0000 7ff4e2ffd700 1 -- 172.21.15.5:0/3186754123 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8003dd0 con 0x7ff4ec107eb0 2023-10-07T00:14:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.089+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3186754123 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec1a3920 con 0x7ff4ec107eb0 2023-10-07T00:14:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.089+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3186754123 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec1a3db0 con 0x7ff4ec107eb0 2023-10-07T00:14:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.095+0000 7ff4e2ffd700 1 -- 172.21.15.5:0/3186754123 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff4e8003f30 con 0x7ff4ec107eb0 2023-10-07T00:14:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.095+0000 7ff507733b80 1 Processor -- start 2023-10-07T00:14:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.096+0000 7ff507733b80 1 -- start start 2023-10-07T00:14:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.097+0000 7ff507733b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a562e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.097+0000 7ff507733b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a56fd0 0x55c520a57450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.097+0000 7ff507733b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a5e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.097+0000 7ff507733b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5209be400 con 0x55c520a55ec0 2023-10-07T00:14:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.097+0000 7ff507733b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5209afbc0 con 0x55c520a57990 2023-10-07T00:14:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.097+0000 7ff507733b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5209ad4e0 con 0x55c520a56fd0 2023-10-07T00:14:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.097+0000 7ff4f139a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a5e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.098+0000 7ff4f139a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a5e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56974/0 (socket says 172.21.15.5:56974) 2023-10-07T00:14:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.098+0000 7ff4f139a700 1 -- 172.21.15.5:0/3719609551 learned_addr learned my addr 172.21.15.5:0/3719609551 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.098+0000 7ff4f239c700 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.098+0000 7ff4f139a700 1 -- 172.21.15.5:0/3719609551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a56fd0 msgr2=0x55c520a57450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:35.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a56fd0 0x55c520a57450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4e2ffd700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4d80a1650 0x7ff4d80a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4f139a700 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a56fd0 0x55c520a57450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4f139a700 1 -- 172.21.15.5:0/3719609551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 msgr2=0x55c520a562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:35.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4f139a700 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4f139a700 1 -- 172.21.15.5:0/3719609551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5207d3d80 con 0x55c520a57990 2023-10-07T00:14:35.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4e2ffd700 1 -- 172.21.15.5:0/3186754123 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4e8014070 con 0x7ff4ec107eb0 2023-10-07T00:14:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4f239c700 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.100+0000 7ff4f139a700 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a5e220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00bb10 tx=0x7ff4dc00be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b7a47fe8446fa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.101+0000 7ff4f239c700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4d80a1650 0x7ff4d80a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.101+0000 7ff4d7fff700 1 -- 172.21.15.5:0/3719609551 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc004a30 con 0x55c520a57990 2023-10-07T00:14:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.101+0000 7ff4d7fff700 1 -- 172.21.15.5:0/3719609551 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4dc00dc60 con 0x55c520a57990 2023-10-07T00:14:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.101+0000 7ff4d7fff700 1 -- 172.21.15.5:0/3719609551 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0054b0 con 0x55c520a57990 2023-10-07T00:14:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.102+0000 7ff507733b80 1 -- 172.21.15.5:0/3719609551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 msgr2=0x55c520a5e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.102+0000 7ff507733b80 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a5e220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00bb10 tx=0x7ff4dc00be20 comp rx=0 tx=0).stop 2023-10-07T00:14:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.102+0000 7ff507733b80 1 -- 172.21.15.5:0/3719609551 shutdown_connections 2023-10-07T00:14:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.102+0000 7ff507733b80 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a5e220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.102+0000 7ff507733b80 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.102+0000 7ff507733b80 1 --2- 172.21.15.5:0/3719609551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a56fd0 0x55c520a57450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.102+0000 7ff507733b80 1 -- 172.21.15.5:0/3719609551 >> 172.21.15.5:0/3719609551 conn(0x55c5209ca200 msgr2=0x55c520a50bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:35.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.103+0000 7ff507733b80 1 -- 172.21.15.5:0/3719609551 shutdown_connections 2023-10-07T00:14:35.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.103+0000 7ff507733b80 1 -- 172.21.15.5:0/3719609551 wait complete. 2023-10-07T00:14:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.103+0000 7ff4f239c700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4d80a1650 0x7ff4d80a3b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400b780 tx=0x7ff4e40099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.104+0000 7ff507733b80 1 -- start start 2023-10-07T00:14:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.104+0000 7ff507733b80 1 Processor -- start 2023-10-07T00:14:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff507733b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a5fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff507733b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a5ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff507733b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a57990 0x55c520a66fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff507733b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5209a8dd0 con 0x55c520a55ec0 2023-10-07T00:14:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff507733b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5209456b0 con 0x55c520a56fd0 2023-10-07T00:14:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff507733b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c520945350 con 0x55c520a57990 2023-10-07T00:14:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff507733b80 10 client.0 _ll_register_callbacks cb 0x55c5207a27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff4f239c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a57990 0x55c520a66fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff4f239c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a57990 0x55c520a66fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43830/0 (socket says 172.21.15.5:43830) 2023-10-07T00:14:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff4f239c700 1 -- 172.21.15.5:0/3579908189 learned_addr learned my addr 172.21.15.5:0/3579908189 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.105+0000 7ff4f139a700 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a5ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.106+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a5fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.106+0000 7ff4f239c700 1 -- 172.21.15.5:0/3579908189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 msgr2=0x55c520a5ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.106+0000 7ff4f239c700 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a5ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.106+0000 7ff4f239c700 1 -- 172.21.15.5:0/3579908189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 msgr2=0x55c520a5fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.106+0000 7ff4f239c700 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a5fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.106+0000 7ff4f239c700 1 -- 172.21.15.5:0/3579908189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec112450 con 0x55c520a57990 2023-10-07T00:14:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.106+0000 7ff4f239c700 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a57990 0x55c520a66fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009610 tx=0x7ff4e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd1fd514b540ca61 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.106+0000 7ff4d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.107+0000 7ff4d57fa700 1 -- 172.21.15.5:0/3579908189 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400e040 con 0x55c520a57990 2023-10-07T00:14:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.107+0000 7ff4d57fa700 1 -- 172.21.15.5:0/3579908189 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4e401d450 con 0x55c520a57990 2023-10-07T00:14:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.107+0000 7ff507733b80 1 -- 172.21.15.5:0/3579908189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c520a48d50 con 0x55c520a57990 2023-10-07T00:14:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.107+0000 7ff4d57fa700 1 -- 172.21.15.5:0/3579908189 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4e401d610 con 0x55c520a57990 2023-10-07T00:14:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff507733b80 10 client.25822 fetch_fsmap learned FSMap version 28 2023-10-07T00:14:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff507733b80 1 -- 172.21.15.5:0/3579908189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7ff4dc00b740 con 0x55c520a57990 2023-10-07T00:14:35.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:34 smithi005 ceph-mon[129406]: pgmap v400: 97 pgs: 97 active+clean; 12 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 724 KiB/s wr, 120 op/s 2023-10-07T00:14:35.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:34 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff4d57fa700 1 -- 172.21.15.5:0/3579908189 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c520a48d50 con 0x55c520a57990 2023-10-07T00:14:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff4d57fa700 1 -- 172.21.15.5:0/3579908189 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff4e4030070 con 0x55c520a57990 2023-10-07T00:14:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff507733b80 10 client.25822 fetch_fsmap finished waiting for FSMap version 28 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff507733b80 10 client.25822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff507733b80 20 client.25822 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff507733b80 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c520a6b860 0x55c520a6dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff507733b80 4 client.25822 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.108+0000 7ff507733b80 1 -- 172.21.15.5:0/3579908189 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5209a1db0 con 0x55c520a6b860 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.109+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c520a6b860 0x55c520a6dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.110+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c520a6b860 0x55c520a6dc80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6303bcf988fe4ac server_cookie=167d996e45d23e2a in_seq=0 out_seq=0 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.110+0000 7ff4d57fa700 10 client.25822 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.110+0000 7ff4d57fa700 1 -- 172.21.15.5:0/3579908189 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c5209a1db0 con 0x55c520a6b860 2023-10-07T00:14:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.110+0000 7ff4d57fa700 10 client.25822 handle_command_reply: tid=0 2023-10-07T00:14:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 client.25822 shutdown 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 -- 172.21.15.5:0/3579908189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a57990 msgr2=0x55c520a66fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a57990 0x55c520a66fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009610 tx=0x7ff4e4009780 comp rx=0 tx=0).stop 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 -- 172.21.15.5:0/3579908189 shutdown_connections 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c520a6b860 0x55c520a6dc80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a57990 0x55c520a66fe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a55ec0 0x55c520a5fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 --2- 172.21.15.5:0/3579908189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a5ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 -- 172.21.15.5:0/3579908189 >> 172.21.15.5:0/3579908189 conn(0x55c5209ca200 msgr2=0x55c520a50250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff4d57fa700 0 client.25822 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.111+0000 7ff507733b80 1 -- 172.21.15.5:0/3579908189 shutdown_connections 2023-10-07T00:14:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.112+0000 7ff507733b80 1 -- 172.21.15.5:0/3579908189 wait complete. 2023-10-07T00:14:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.112+0000 7ff507733b80 20 client.25822 trim_cache size 0 max 16384 2023-10-07T00:14:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.137+0000 7ff507733b80 1 Processor -- start 2023-10-07T00:14:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.137+0000 7ff507733b80 1 -- start start 2023-10-07T00:14:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.137+0000 7ff507733b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a5e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.137+0000 7ff507733b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a66f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.137+0000 7ff507733b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a57990 0x55c520a50b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.137+0000 7ff507733b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5208298c0 con 0x55c520a57990 2023-10-07T00:14:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.137+0000 7ff507733b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c520a5f5d0 con 0x55c520a56fd0 2023-10-07T00:14:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.137+0000 7ff507733b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c520a6e010 con 0x55c520a55ec0 2023-10-07T00:14:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.138+0000 7ff4f1b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a5e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.138+0000 7ff4f139a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a66f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.138+0000 7ff4f139a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a66f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56986/0 (socket says 172.21.15.5:56986) 2023-10-07T00:14:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.138+0000 7ff4f139a700 1 -- 172.21.15.5:0/3340543139 learned_addr learned my addr 172.21.15.5:0/3340543139 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.139+0000 7ff4f139a700 1 -- 172.21.15.5:0/3340543139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 msgr2=0x55c520a5e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.139+0000 7ff4f139a700 1 --2- 172.21.15.5:0/3340543139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a5e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.139+0000 7ff4f139a700 1 -- 172.21.15.5:0/3340543139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a57990 msgr2=0x55c520a50b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.139+0000 7ff4f139a700 1 --2- 172.21.15.5:0/3340543139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a57990 0x55c520a50b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.139+0000 7ff4f139a700 1 -- 172.21.15.5:0/3340543139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5207bcc00 con 0x55c520a56fd0 2023-10-07T00:14:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.139+0000 7ff4f139a700 1 --2- 172.21.15.5:0/3340543139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a66f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc005b00 tx=0x7ff4dc00b550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29bc25075755f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.140+0000 7ff4e0bff700 1 -- 172.21.15.5:0/3340543139 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00d9d0 con 0x55c520a56fd0 2023-10-07T00:14:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.140+0000 7ff4e0bff700 1 -- 172.21.15.5:0/3340543139 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4dc014070 con 0x55c520a56fd0 2023-10-07T00:14:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.140+0000 7ff4e0bff700 1 -- 172.21.15.5:0/3340543139 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc003a80 con 0x55c520a56fd0 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 -- 172.21.15.5:0/3340543139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 msgr2=0x55c520a66f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 --2- 172.21.15.5:0/3340543139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a66f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc005b00 tx=0x7ff4dc00b550 comp rx=0 tx=0).stop 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 -- 172.21.15.5:0/3340543139 shutdown_connections 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 --2- 172.21.15.5:0/3340543139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a57990 0x55c520a50b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 --2- 172.21.15.5:0/3340543139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a5e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 --2- 172.21.15.5:0/3340543139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a56fd0 0x55c520a66f00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 -- 172.21.15.5:0/3340543139 >> 172.21.15.5:0/3340543139 conn(0x55c5209ca200 msgr2=0x55c520a72620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 -- 172.21.15.5:0/3340543139 shutdown_connections 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.141+0000 7ff507733b80 1 -- 172.21.15.5:0/3340543139 wait complete. 2023-10-07T00:14:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.142+0000 7ff507733b80 1 -- start start 2023-10-07T00:14:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.142+0000 7ff507733b80 1 Processor -- start 2023-10-07T00:14:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.142+0000 7ff507733b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a64ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.142+0000 7ff507733b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a56fd0 0x55c520a65400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff507733b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a66410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff507733b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c520a66950 con 0x55c520a56fd0 2023-10-07T00:14:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff507733b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c520a66ac0 con 0x55c520a57990 2023-10-07T00:14:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff507733b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c520a66c80 con 0x55c520a55ec0 2023-10-07T00:14:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff507733b80 10 client.0 _ll_register_callbacks cb 0x7ff4e4007e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff4f1b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a64ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff4f1b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a64ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43860/0 (socket says 172.21.15.5:43860) 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff4f1b9b700 1 -- 172.21.15.5:0/2827958381 learned_addr learned my addr 172.21.15.5:0/2827958381 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.143+0000 7ff4f239c700 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a66410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.144+0000 7ff4f139a700 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a56fd0 0x55c520a65400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.144+0000 7ff4f239c700 1 -- 172.21.15.5:0/2827958381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 msgr2=0x55c520a64ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.144+0000 7ff4f239c700 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a64ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.144+0000 7ff4f239c700 1 -- 172.21.15.5:0/2827958381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a56fd0 msgr2=0x55c520a65400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.144+0000 7ff4f239c700 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a56fd0 0x55c520a65400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.144+0000 7ff4f239c700 1 -- 172.21.15.5:0/2827958381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5207d3d80 con 0x55c520a57990 2023-10-07T00:14:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.145+0000 7ff4f239c700 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a66410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40062a0 tx=0x7ff4e4009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3672692f48e67161 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.145+0000 7ff4d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.145+0000 7ff4d57fa700 1 -- 172.21.15.5:0/2827958381 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4005aa0 con 0x55c520a57990 2023-10-07T00:14:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.145+0000 7ff4d57fa700 1 -- 172.21.15.5:0/2827958381 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4e4012b70 con 0x55c520a57990 2023-10-07T00:14:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.145+0000 7ff507733b80 1 -- 172.21.15.5:0/2827958381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4dc00dc60 con 0x55c520a57990 2023-10-07T00:14:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.145+0000 7ff4d57fa700 1 -- 172.21.15.5:0/2827958381 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4e4012d30 con 0x55c520a57990 2023-10-07T00:14:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.145+0000 7ff507733b80 10 client.25865 fetch_fsmap learned FSMap version 28 2023-10-07T00:14:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.145+0000 7ff507733b80 1 -- 172.21.15.5:0/2827958381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c5207fa1f0 con 0x55c520a57990 2023-10-07T00:14:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.146+0000 7ff4d57fa700 1 -- 172.21.15.5:0/2827958381 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4dc00dc60 con 0x55c520a57990 2023-10-07T00:14:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.146+0000 7ff4d57fa700 1 -- 172.21.15.5:0/2827958381 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff4e4039030 con 0x55c520a57990 2023-10-07T00:14:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.146+0000 7ff507733b80 10 client.25865 fetch_fsmap finished waiting for FSMap version 28 2023-10-07T00:14:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.146+0000 7ff507733b80 10 client.25865 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.146+0000 7ff507733b80 20 client.25865 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.146+0000 7ff507733b80 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c520ac05a0 0x55c520ac29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.146+0000 7ff507733b80 4 client.25865 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:14:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.146+0000 7ff507733b80 1 -- 172.21.15.5:0/2827958381 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c5209a1ad0 con 0x55c520ac05a0 2023-10-07T00:14:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.147+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c520ac05a0 0x55c520ac29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.148+0000 7ff4f1b9b700 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c520ac05a0 0x55c520ac29c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb30bb4c0bf1dbc3 server_cookie=52e51c18339bc290 in_seq=0 out_seq=0 2023-10-07T00:14:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.148+0000 7ff4d57fa700 10 client.25865 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.165+0000 7ff4d57fa700 1 -- 172.21.15.5:0/2827958381 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c5209a1ad0 con 0x55c520ac05a0 2023-10-07T00:14:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.165+0000 7ff4d57fa700 10 client.25865 handle_command_reply: tid=0 2023-10-07T00:14:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 client.25865 shutdown 2023-10-07T00:14:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 -- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 msgr2=0x55c520a66410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a66410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40062a0 tx=0x7ff4e4009c50 comp rx=0 tx=0).stop 2023-10-07T00:14:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 -- 172.21.15.5:0/2827958381 shutdown_connections 2023-10-07T00:14:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c520ac05a0 0x55c520ac29c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c520a57990 0x55c520a66410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c520a55ec0 0x55c520a64ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 --2- 172.21.15.5:0/2827958381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c520a56fd0 0x55c520a65400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff507733b80 1 -- 172.21.15.5:0/2827958381 >> 172.21.15.5:0/2827958381 conn(0x55c5209ca200 msgr2=0x55c520a67810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.166+0000 7ff4d57fa700 0 client.25865 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.167+0000 7ff507733b80 1 -- 172.21.15.5:0/2827958381 shutdown_connections 2023-10-07T00:14:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.167+0000 7ff507733b80 1 -- 172.21.15.5:0/2827958381 wait complete. 2023-10-07T00:14:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.167+0000 7ff507733b80 20 client.25865 trim_cache size 0 max 16384 2023-10-07T00:14:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:14:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:14:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:14:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:14:35.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4d80a1650 msgr2=0x7ff4d80a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4d80a1650 0x7ff4d80a3b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400b780 tx=0x7ff4e40099e0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3186754123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec107eb0 msgr2=0x7ff4ec10ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec107eb0 0x7ff4ec10ab40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800e970 tx=0x7ff4e800ed30 comp rx=0 tx=0).stop 2023-10-07T00:14:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3186754123 shutdown_connections 2023-10-07T00:14:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4d80a1650 0x7ff4d80a3b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4ec10f730 0x7ff4ec1096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec107eb0 0x7ff4ec10ab40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 --2- 172.21.15.5:0/3186754123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4ec108810 0x7ff4ec109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:35.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3186754123 >> 172.21.15.5:0/3186754123 conn(0x7ff4ec06dcf0 msgr2=0x7ff4ec06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:35.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3186754123 shutdown_connections 2023-10-07T00:14:35.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:35.168+0000 7ff4f3dff700 1 -- 172.21.15.5:0/3186754123 wait complete. 2023-10-07T00:14:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:34 smithi088 ceph-mon[103111]: pgmap v400: 97 pgs: 97 active+clean; 12 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 724 KiB/s wr, 120 op/s 2023-10-07T00:14:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:34 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:34 smithi112 ceph-mon[133548]: pgmap v400: 97 pgs: 97 active+clean; 12 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 724 KiB/s wr, 120 op/s 2023-10-07T00:14:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:34 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:36 smithi005 ceph-mon[129406]: pgmap v401: 97 pgs: 97 active+clean; 18 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-10-07T00:14:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:36 smithi088 ceph-mon[103111]: pgmap v401: 97 pgs: 97 active+clean; 18 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-10-07T00:14:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:36 smithi112 ceph-mon[133548]: pgmap v401: 97 pgs: 97 active+clean; 18 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-10-07T00:14:37.764 INFO:tasks.workunit.client.0.smithi005.stdout: 6 6630 406 2625 259 1299 350 2023-10-07T00:14:39.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:38 smithi005 ceph-mon[129406]: pgmap v402: 97 pgs: 97 active+clean; 22 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.4 MiB/s wr, 109 op/s 2023-10-07T00:14:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:38 smithi088 ceph-mon[103111]: pgmap v402: 97 pgs: 97 active+clean; 22 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.4 MiB/s wr, 109 op/s 2023-10-07T00:14:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:38 smithi112 ceph-mon[133548]: pgmap v402: 97 pgs: 97 active+clean; 22 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.4 MiB/s wr, 109 op/s 2023-10-07T00:14:40.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:39 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:40.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:39 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:40.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:39 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:40 smithi005 ceph-mon[129406]: pgmap v403: 97 pgs: 97 active+clean; 26 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2023-10-07T00:14:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:40 smithi088 ceph-mon[103111]: pgmap v403: 97 pgs: 97 active+clean; 26 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2023-10-07T00:14:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:40 smithi112 ceph-mon[133548]: pgmap v403: 97 pgs: 97 active+clean; 26 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2023-10-07T00:14:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:42 smithi005 ceph-mon[129406]: pgmap v404: 97 pgs: 97 active+clean; 32 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2023-10-07T00:14:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:42 smithi088 ceph-mon[103111]: pgmap v404: 97 pgs: 97 active+clean; 32 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2023-10-07T00:14:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:42 smithi112 ceph-mon[133548]: pgmap v404: 97 pgs: 97 active+clean; 32 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2023-10-07T00:14:44.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:14:44.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.620+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2879258193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab00ffe70 msgr2=0x7f1ab0100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.620+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2879258193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab00ffe70 0x7f1ab0100290 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009990 tx=0x7f1aa0009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.621+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2879258193 shutdown_connections 2023-10-07T00:14:44.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.621+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2879258193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ab0101a10 0x7f1ab0108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.621+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2879258193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab00ffe70 0x7f1ab0100290 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.621+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2879258193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab0101050 0x7f1ab01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.622+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2879258193 >> 172.21.15.5:0/2879258193 conn(0x7f1ab00fb450 msgr2=0x7f1ab00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:44.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.622+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2879258193 shutdown_connections 2023-10-07T00:14:44.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.622+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2879258193 wait complete. 2023-10-07T00:14:44.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.624+0000 7f1ab73ff700 1 Processor -- start 2023-10-07T00:14:44.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.624+0000 7f1ab73ff700 1 -- start start 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab73ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab00ffe70 0x7f1ab019d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab73ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ab0101050 0x7f1ab019d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab73ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab0101a10 0x7f1ab01a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab73ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab01a4db0 con 0x7f1ab0101050 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab73ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab018fb80 con 0x7f1ab0101a10 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab73ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab018fd10 con 0x7f1ab00ffe70 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ab0101050 0x7f1ab019d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ab0101050 0x7f1ab019d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40296/0 (socket says 172.21.15.5:40296) 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab499a700 1 -- 172.21.15.5:0/2776257458 learned_addr learned my addr 172.21.15.5:0/2776257458 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab599c700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab0101a10 0x7f1ab01a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.625+0000 7f1ab519b700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab00ffe70 0x7f1ab019d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.626+0000 7f1ab599c700 1 -- 172.21.15.5:0/2776257458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab00ffe70 msgr2=0x7f1ab019d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.626+0000 7f1ab599c700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab00ffe70 0x7f1ab019d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.626+0000 7f1ab599c700 1 -- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ab0101050 msgr2=0x7f1ab019d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.626+0000 7f1ab599c700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ab0101050 0x7f1ab019d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.626+0000 7f1ab599c700 1 -- 172.21.15.5:0/2776257458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00095f0 con 0x7f1ab0101a10 2023-10-07T00:14:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.627+0000 7f1ab599c700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab0101a10 0x7f1ab01a47e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0078c0 tx=0x7f1aac007bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.627+0000 7f1aa67fc700 1 -- 172.21.15.5:0/2776257458 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac010070 con 0x7f1ab0101a10 2023-10-07T00:14:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.627+0000 7f1aa67fc700 1 -- 172.21.15.5:0/2776257458 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aac0044b0 con 0x7f1ab0101a10 2023-10-07T00:14:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.627+0000 7f1aa67fc700 1 -- 172.21.15.5:0/2776257458 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00a8c0 con 0x7f1ab0101a10 2023-10-07T00:14:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.627+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2776257458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab018fff0 con 0x7f1ab0101a10 2023-10-07T00:14:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.627+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2776257458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab01904b0 con 0x7f1ab0101a10 2023-10-07T00:14:44.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.634+0000 7f1acac8ab80 1 Processor -- start 2023-10-07T00:14:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.636+0000 7f1aa67fc700 1 -- 172.21.15.5:0/2776257458 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1aac003f40 con 0x7f1ab0101a10 2023-10-07T00:14:44.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.637+0000 7f1acac8ab80 1 -- start start 2023-10-07T00:14:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.637+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f89f1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.637+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89f2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.637+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.637+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f8959460 con 0x5580f89f1260 2023-10-07T00:14:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.637+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f894ac20 con 0x5580f89f2a60 2023-10-07T00:14:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.637+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f8948540 con 0x5580f89f1bc0 2023-10-07T00:14:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab519b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab519b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54882/0 (socket says 172.21.15.5:54882) 2023-10-07T00:14:44.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab519b700 1 -- 172.21.15.5:0/1494731672 learned_addr learned my addr 172.21.15.5:0/1494731672 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:44.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab499a700 1 --2- 172.21.15.5:0/1494731672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab519b700 1 -- 172.21.15.5:0/1494731672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 msgr2=0x5580f89f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:44.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab519b700 1 --2- 172.21.15.5:0/1494731672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab519b700 1 -- 172.21.15.5:0/1494731672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 msgr2=0x5580f89f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:44.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab519b700 1 --2- 172.21.15.5:0/1494731672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f89f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.638+0000 7f1ab519b700 1 -- 172.21.15.5:0/1494731672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580f876ede0 con 0x5580f89f1bc0 2023-10-07T00:14:44.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.639+0000 7f1aa67fc700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1a9c0a1550 0x7f1a9c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.639+0000 7f1aa67fc700 1 -- 172.21.15.5:0/2776257458 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1aac0cbda0 con 0x7f1ab0101a10 2023-10-07T00:14:44.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.639+0000 7f1ab519b700 1 --2- 172.21.15.5:0/1494731672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89f2480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0100bc0 tx=0x7f1aa0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5a493b4b92b18d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:44.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.640+0000 7f1a9b7fe700 1 -- 172.21.15.5:0/1494731672 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa001d070 con 0x5580f89f1bc0 2023-10-07T00:14:44.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.640+0000 7f1a9b7fe700 1 -- 172.21.15.5:0/1494731672 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aa001e040 con 0x5580f89f1bc0 2023-10-07T00:14:44.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.640+0000 7f1a9b7fe700 1 -- 172.21.15.5:0/1494731672 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00047f0 con 0x5580f89f1bc0 2023-10-07T00:14:44.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.640+0000 7f1ab499a700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1a9c0a1550 0x7f1a9c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.641+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1494731672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 msgr2=0x5580f89f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.641+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1494731672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89f2480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0100bc0 tx=0x7f1aa0009f90 comp rx=0 tx=0).stop 2023-10-07T00:14:44.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.642+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1494731672 shutdown_connections 2023-10-07T00:14:44.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.642+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1494731672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.642+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1494731672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f89f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.642+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1494731672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89f2480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.642+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1494731672 >> 172.21.15.5:0/1494731672 conn(0x5580f8965260 msgr2=0x5580f89ec140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:44.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.642+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1494731672 shutdown_connections 2023-10-07T00:14:44.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.643+0000 7f1ab499a700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1a9c0a1550 0x7f1a9c0a3a10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8007fd0 tx=0x7f1aa8007d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:44.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.643+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1494731672 wait complete. 2023-10-07T00:14:44.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.644+0000 7f1acac8ab80 1 -- start start 2023-10-07T00:14:44.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.644+0000 7f1acac8ab80 1 Processor -- start 2023-10-07T00:14:44.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.645+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1260 0x5580f89fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.645+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1bc0 0x5580f89fb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.645+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a02560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.645+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f8943e30 con 0x5580f89f1bc0 2023-10-07T00:14:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.645+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f88e0710 con 0x5580f89f2a60 2023-10-07T00:14:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.645+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f88e03b0 con 0x5580f89f1260 2023-10-07T00:14:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.645+0000 7f1acac8ab80 10 client.0 _ll_register_callbacks cb 0x5580f873d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.646+0000 7f1ab599c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a02560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.646+0000 7f1ab599c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a02560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55470/0 (socket says 172.21.15.5:55470) 2023-10-07T00:14:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.646+0000 7f1ab599c700 1 -- 172.21.15.5:0/703179507 learned_addr learned my addr 172.21.15.5:0/703179507 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.646+0000 7f1ab519b700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1260 0x5580f89fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.646+0000 7f1ab499a700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1bc0 0x5580f89fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.646+0000 7f1ab519b700 1 -- 172.21.15.5:0/703179507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 msgr2=0x5580f8a02560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.647+0000 7f1ab519b700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a02560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.647+0000 7f1ab519b700 1 -- 172.21.15.5:0/703179507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1bc0 msgr2=0x5580f89fb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.647+0000 7f1ab519b700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1bc0 0x5580f89fb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.647+0000 7f1ab519b700 1 -- 172.21.15.5:0/703179507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab0108c60 con 0x5580f89f1260 2023-10-07T00:14:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.647+0000 7f1ab599c700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a02560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.647+0000 7f1ab499a700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1bc0 0x5580f89fb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.647+0000 7f1ab519b700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1260 0x5580f89fafe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00098e0 tx=0x7f1aa0003f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e87aad007a01043f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.647+0000 7f1a98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.648+0000 7f1a98ff9700 1 -- 172.21.15.5:0/703179507 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa001d070 con 0x5580f89f1260 2023-10-07T00:14:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.648+0000 7f1a98ff9700 1 -- 172.21.15.5:0/703179507 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1aa0005030 con 0x5580f89f1260 2023-10-07T00:14:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.648+0000 7f1acac8ab80 1 -- 172.21.15.5:0/703179507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580f89e3f10 con 0x5580f89f1260 2023-10-07T00:14:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.649+0000 7f1a98ff9700 1 -- 172.21.15.5:0/703179507 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa00051f0 con 0x5580f89f1260 2023-10-07T00:14:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.649+0000 7f1acac8ab80 10 client.25837 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.649+0000 7f1acac8ab80 1 -- 172.21.15.5:0/703179507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5580f8757c60 con 0x5580f89f1260 2023-10-07T00:14:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.650+0000 7f1a98ff9700 1 -- 172.21.15.5:0/703179507 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5580f89e3f10 con 0x5580f89f1260 2023-10-07T00:14:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.650+0000 7f1a98ff9700 1 -- 172.21.15.5:0/703179507 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1aa0033070 con 0x5580f89f1260 2023-10-07T00:14:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.650+0000 7f1acac8ab80 10 client.25837 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.650+0000 7f1acac8ab80 10 client.25837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.650+0000 7f1acac8ab80 20 client.25837 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.650+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5580f8a06890 0x5580f8a08cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.650+0000 7f1acac8ab80 4 client.25837 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.650+0000 7f1acac8ab80 1 -- 172.21.15.5:0/703179507 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580f893ce10 con 0x5580f8a06890 2023-10-07T00:14:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.651+0000 7f1ab499a700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5580f8a06890 0x5580f8a08cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.652+0000 7f1a98ff9700 10 client.25837 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.652+0000 7f1ab499a700 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5580f8a06890 0x5580f8a08cb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99b9b5cef7b9e410 server_cookie=884f12985d617f4c in_seq=0 out_seq=0 2023-10-07T00:14:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.653+0000 7f1a98ff9700 1 -- 172.21.15.5:0/703179507 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5580f893ce10 con 0x5580f8a06890 2023-10-07T00:14:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.653+0000 7f1a98ff9700 10 client.25837 handle_command_reply: tid=0 2023-10-07T00:14:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.653+0000 7f1acac8ab80 1 client.25837 shutdown 2023-10-07T00:14:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 -- 172.21.15.5:0/703179507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1260 msgr2=0x5580f89fafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1260 0x5580f89fafe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00098e0 tx=0x7f1aa0003f30 comp rx=0 tx=0).stop 2023-10-07T00:14:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 -- 172.21.15.5:0/703179507 shutdown_connections 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5580f8a06890 0x5580f8a08cb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a02560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1260 0x5580f89fafe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/703179507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1bc0 0x5580f89fb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 -- 172.21.15.5:0/703179507 >> 172.21.15.5:0/703179507 conn(0x5580f8965260 msgr2=0x5580f89ebf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1a98ff9700 0 client.25837 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 -- 172.21.15.5:0/703179507 shutdown_connections 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.654+0000 7f1acac8ab80 1 -- 172.21.15.5:0/703179507 wait complete. 2023-10-07T00:14:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.655+0000 7f1acac8ab80 20 client.25837 trim_cache size 0 max 16384 2023-10-07T00:14:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.689+0000 7f1acac8ab80 1 Processor -- start 2023-10-07T00:14:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.689+0000 7f1acac8ab80 1 -- start start 2023-10-07T00:14:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.689+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f8a02e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.689+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f8a02520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.689+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.689+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f87c4920 con 0x5580f89f1260 2023-10-07T00:14:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.689+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f89e8a80 con 0x5580f89f2a60 2023-10-07T00:14:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.689+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f89f22b0 con 0x5580f89f1bc0 2023-10-07T00:14:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.690+0000 7f1ab519b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f8a02e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.690+0000 7f1ab519b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f8a02e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40334/0 (socket says 172.21.15.5:40334) 2023-10-07T00:14:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.690+0000 7f1ab519b700 1 -- 172.21.15.5:0/316177723 learned_addr learned my addr 172.21.15.5:0/316177723 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.690+0000 7f1ab499a700 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f8a02520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.690+0000 7f1ab599c700 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.691+0000 7f1ab599c700 1 -- 172.21.15.5:0/316177723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 msgr2=0x5580f8a02520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.691+0000 7f1ab599c700 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f8a02520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.691+0000 7f1ab599c700 1 -- 172.21.15.5:0/316177723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 msgr2=0x5580f8a02e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.691+0000 7f1ab599c700 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f8a02e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.691+0000 7f1ab599c700 1 -- 172.21.15.5:0/316177723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580f8795250 con 0x5580f89f2a60 2023-10-07T00:14:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.691+0000 7f1ab599c700 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f5970 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1aac095630 tx=0x7f1aac0057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19560445570d283b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.692+0000 7f1a9bfff700 1 -- 172.21.15.5:0/316177723 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac099830 con 0x5580f89f2a60 2023-10-07T00:14:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.692+0000 7f1a9bfff700 1 -- 172.21.15.5:0/316177723 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aac099130 con 0x5580f89f2a60 2023-10-07T00:14:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.692+0000 7f1a9bfff700 1 -- 172.21.15.5:0/316177723 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac003930 con 0x5580f89f2a60 2023-10-07T00:14:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.692+0000 7f1acac8ab80 1 -- 172.21.15.5:0/316177723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 msgr2=0x5580f89f5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.692+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f5970 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1aac095630 tx=0x7f1aac0057e0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.693+0000 7f1acac8ab80 1 -- 172.21.15.5:0/316177723 shutdown_connections 2023-10-07T00:14:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.693+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f89f5970 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.693+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f8a02e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.693+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/316177723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f8a02520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.693+0000 7f1acac8ab80 1 -- 172.21.15.5:0/316177723 >> 172.21.15.5:0/316177723 conn(0x5580f8965260 msgr2=0x5580f89eabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.693+0000 7f1acac8ab80 1 -- 172.21.15.5:0/316177723 shutdown_connections 2023-10-07T00:14:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.693+0000 7f1acac8ab80 1 -- 172.21.15.5:0/316177723 wait complete. 2023-10-07T00:14:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.694+0000 7f1acac8ab80 1 -- start start 2023-10-07T00:14:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.694+0000 7f1acac8ab80 1 Processor -- start 2023-10-07T00:14:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f89fe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1acac8ab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f8a01f20 con 0x5580f89f1260 2023-10-07T00:14:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f8a02090 con 0x5580f89f2a60 2023-10-07T00:14:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1acac8ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580f8a02250 con 0x5580f89f1bc0 2023-10-07T00:14:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1acac8ab80 10 client.0 _ll_register_callbacks cb 0x7f1aa0009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1ab519b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f89fe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1ab519b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f89fe480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40350/0 (socket says 172.21.15.5:40350) 2023-10-07T00:14:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1ab519b700 1 -- 172.21.15.5:0/1556227801 learned_addr learned my addr 172.21.15.5:0/1556227801 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.695+0000 7f1ab499a700 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.696+0000 7f1ab599c700 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.696+0000 7f1ab499a700 1 -- 172.21.15.5:0/1556227801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 msgr2=0x5580f8a019e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.696+0000 7f1ab499a700 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a019e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.696+0000 7f1ab499a700 1 -- 172.21.15.5:0/1556227801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 msgr2=0x5580f89fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.696+0000 7f1ab499a700 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f89fe480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.696+0000 7f1ab499a700 1 -- 172.21.15.5:0/1556227801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab01904b0 con 0x5580f89f1bc0 2023-10-07T00:14:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.697+0000 7f1ab499a700 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89fe9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5580f89f9ae0 tx=0x7f1aa8004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a389110e696f4a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.697+0000 7f1a98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.697+0000 7f1a98ff9700 1 -- 172.21.15.5:0/1556227801 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80272e0 con 0x5580f89f1bc0 2023-10-07T00:14:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.697+0000 7f1a98ff9700 1 -- 172.21.15.5:0/1556227801 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1aa8027440 con 0x5580f89f1bc0 2023-10-07T00:14:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.697+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1556227801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1aa001e040 con 0x5580f89f1bc0 2023-10-07T00:14:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.698+0000 7f1a98ff9700 1 -- 172.21.15.5:0/1556227801 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa8003a00 con 0x5580f89f1bc0 2023-10-07T00:14:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.698+0000 7f1acac8ab80 10 client.25843 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.698+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1556227801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5580f876d2b0 con 0x5580f89f1bc0 2023-10-07T00:14:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.698+0000 7f1a98ff9700 1 -- 172.21.15.5:0/1556227801 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aa001e040 con 0x5580f89f1bc0 2023-10-07T00:14:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.699+0000 7f1a98ff9700 1 -- 172.21.15.5:0/1556227801 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1aa8025400 con 0x5580f89f1bc0 2023-10-07T00:14:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.699+0000 7f1acac8ab80 10 client.25843 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.699+0000 7f1acac8ab80 10 client.25843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.699+0000 7f1acac8ab80 20 client.25843 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.699+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5580f8a5b810 0x5580f8a5dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.699+0000 7f1acac8ab80 4 client.25843 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:14:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.699+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1556227801 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5580f893cb30 con 0x5580f8a5b810 2023-10-07T00:14:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.699+0000 7f1ab519b700 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5580f8a5b810 0x5580f8a5dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.701+0000 7f1ab519b700 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5580f8a5b810 0x5580f8a5dc30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c039919f862c0c45 server_cookie=6faea6dfa7e255e8 in_seq=0 out_seq=0 2023-10-07T00:14:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.701+0000 7f1a98ff9700 10 client.25843 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.702+0000 7f1a98ff9700 1 -- 172.21.15.5:0/1556227801 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5580f893cb30 con 0x5580f8a5b810 2023-10-07T00:14:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.702+0000 7f1a98ff9700 10 client.25843 handle_command_reply: tid=0 2023-10-07T00:14:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.702+0000 7f1acac8ab80 1 client.25843 shutdown 2023-10-07T00:14:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.703+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1556227801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 msgr2=0x5580f89fe9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.703+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89fe9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5580f89f9ae0 tx=0x7f1aa8004b40 comp rx=0 tx=0).stop 2023-10-07T00:14:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1556227801 shutdown_connections 2023-10-07T00:14:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5580f8a5b810 0x5580f8a5dc30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5580f89f2a60 0x5580f8a019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5580f89f1260 0x5580f89fe480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 1 --2- 172.21.15.5:0/1556227801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580f89f1bc0 0x5580f89fe9c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1556227801 >> 172.21.15.5:0/1556227801 conn(0x5580f8965260 msgr2=0x5580f8a02e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1a98ff9700 0 client.25843 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:44.706 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:14:44.706 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2023-10-07T00:14:44.707 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2023-10-07T00:14:44.707 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:14:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1556227801 shutdown_connections 2023-10-07T00:14:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 1 -- 172.21.15.5:0/1556227801 wait complete. 2023-10-07T00:14:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.704+0000 7f1acac8ab80 20 client.25843 trim_cache size 0 max 16384 2023-10-07T00:14:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1a9c0a1550 msgr2=0x7f1a9c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1a9c0a1550 0x7f1a9c0a3a10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8007fd0 tx=0x7f1aa8007d60 comp rx=0 tx=0).stop 2023-10-07T00:14:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2776257458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab0101a10 msgr2=0x7f1ab01a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab0101a10 0x7f1ab01a47e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0078c0 tx=0x7f1aac007bd0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2776257458 shutdown_connections 2023-10-07T00:14:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f1a9c0a1550 0x7f1a9c0a3a10 secure :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8007fd0 tx=0x7f1aa8007d60 comp rx=0 tx=0).stop 2023-10-07T00:14:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab0101a10 0x7f1ab01a47e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab00ffe70 0x7f1ab019d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 --2- 172.21.15.5:0/2776257458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ab0101050 0x7f1ab019d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2776257458 >> 172.21.15.5:0/2776257458 conn(0x7f1ab00fb450 msgr2=0x7f1ab00fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.705+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2776257458 shutdown_connections 2023-10-07T00:14:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:44.706+0000 7f1ab73ff700 1 -- 172.21.15.5:0/2776257458 wait complete. 2023-10-07T00:14:44.734 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-07T00:14:44.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:14:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.046+0000 7fc1e45ff700 1 -- 172.21.15.5:0/3520785405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1dc074e70 msgr2=0x7fc1dc0732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.046+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/3520785405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1dc074e70 0x7fc1dc0732c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009990 tx=0x7fc1d8009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.046+0000 7fc1e45ff700 1 -- 172.21.15.5:0/3520785405 shutdown_connections 2023-10-07T00:14:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.046+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/3520785405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1dc108ea0 0x7fc1dc10b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.046+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/3520785405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1dc074e70 0x7fc1dc0732c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.046+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/3520785405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1dc073890 0x7fc1dc073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.046+0000 7fc1e45ff700 1 -- 172.21.15.5:0/3520785405 >> 172.21.15.5:0/3520785405 conn(0x7fc1dc0fc520 msgr2=0x7fc1dc0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.047+0000 7fc1e45ff700 1 -- 172.21.15.5:0/3520785405 shutdown_connections 2023-10-07T00:14:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.047+0000 7fc1e45ff700 1 -- 172.21.15.5:0/3520785405 wait complete. 2023-10-07T00:14:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.048+0000 7fc1e45ff700 1 Processor -- start 2023-10-07T00:14:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.048+0000 7fc1e45ff700 1 -- start start 2023-10-07T00:14:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.049+0000 7fc1e45ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1dc073890 0x7fc1dc104350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.049+0000 7fc1e45ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1dc074e70 0x7fc1dc104890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.049+0000 7fc1e45ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1dc108ea0 0x7fc1dc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.049+0000 7fc1e45ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc101680 con 0x7fc1dc108ea0 2023-10-07T00:14:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.049+0000 7fc1e45ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc1017f0 con 0x7fc1dc074e70 2023-10-07T00:14:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.049+0000 7fc1e45ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc1019b0 con 0x7fc1dc073890 2023-10-07T00:14:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.052+0000 7fc1e1b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1dc074e70 0x7fc1dc104890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.052+0000 7fc1e1b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1dc074e70 0x7fc1dc104890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55514/0 (socket says 172.21.15.5:55514) 2023-10-07T00:14:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.052+0000 7fc1e1b9a700 1 -- 172.21.15.5:0/2651949884 learned_addr learned my addr 172.21.15.5:0/2651949884 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.052+0000 7fc1e2b9c700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1dc108ea0 0x7fc1dc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.053+0000 7fc1e239b700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1dc073890 0x7fc1dc104350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.053+0000 7fc1e2b9c700 1 -- 172.21.15.5:0/2651949884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1dc073890 msgr2=0x7fc1dc104350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.053+0000 7fc1e2b9c700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1dc073890 0x7fc1dc104350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.053+0000 7fc1e2b9c700 1 -- 172.21.15.5:0/2651949884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1dc074e70 msgr2=0x7fc1dc104890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.053+0000 7fc1e2b9c700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1dc074e70 0x7fc1dc104890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.053+0000 7fc1e2b9c700 1 -- 172.21.15.5:0/2651949884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80095f0 con 0x7fc1dc108ea0 2023-10-07T00:14:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.054+0000 7fc1e1b9a700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1dc074e70 0x7fc1dc104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.054+0000 7fc1e2b9c700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1dc108ea0 0x7fc1dc100ee0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400be20 tx=0x7fc1d4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.054+0000 7fc1d37fe700 1 -- 172.21.15.5:0/2651949884 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d400cc10 con 0x7fc1dc108ea0 2023-10-07T00:14:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.054+0000 7fc1d37fe700 1 -- 172.21.15.5:0/2651949884 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1d400cd70 con 0x7fc1dc108ea0 2023-10-07T00:14:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.054+0000 7fc1d37fe700 1 -- 172.21.15.5:0/2651949884 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40125c0 con 0x7fc1dc108ea0 2023-10-07T00:14:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.055+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc198b80 con 0x7fc1dc108ea0 2023-10-07T00:14:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.055+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc1990c0 con 0x7fc1dc108ea0 2023-10-07T00:14:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.056+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1dc1075a0 con 0x7fc1dc108ea0 2023-10-07T00:14:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.059+0000 7fc1d37fe700 1 -- 172.21.15.5:0/2651949884 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc1d4014440 con 0x7fc1dc108ea0 2023-10-07T00:14:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.062+0000 7fc1d37fe700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1c80a1500 0x7fc1c80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.062+0000 7fc1d37fe700 1 -- 172.21.15.5:0/2651949884 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc1d4006e40 con 0x7fc1dc108ea0 2023-10-07T00:14:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.066+0000 7fc1e239b700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1c80a1500 0x7fc1c80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.067+0000 7fc1e239b700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1c80a1500 0x7fc1c80a39c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8006010 tx=0x7fc1d800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.067+0000 7fc1d37fe700 1 -- 172.21.15.5:0/2651949884 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc1d404f100 con 0x7fc1dc108ea0 2023-10-07T00:14:45.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:44 smithi005 ceph-mon[129406]: pgmap v405: 97 pgs: 97 active+clean; 36 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 2.4 MiB/s wr, 152 op/s 2023-10-07T00:14:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:44 smithi088 ceph-mon[103111]: pgmap v405: 97 pgs: 97 active+clean; 36 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 2.4 MiB/s wr, 152 op/s 2023-10-07T00:14:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:44 smithi112 ceph-mon[133548]: pgmap v405: 97 pgs: 97 active+clean; 36 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 2.4 MiB/s wr, 152 op/s 2023-10-07T00:14:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.541+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1dc10e920 con 0x7fc1dc108ea0 2023-10-07T00:14:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.542+0000 7fc1d37fe700 1 -- 172.21.15.5:0/2651949884 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+11351 (secure 0 0 0) 0x7fc1d4095c20 con 0x7fc1dc108ea0 2023-10-07T00:14:45.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:14:45.547 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:14:38.498528+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:14:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1c80a1500 msgr2=0x7fc1c80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1c80a1500 0x7fc1c80a39c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8006010 tx=0x7fc1d800b260 comp rx=0 tx=0).stop 2023-10-07T00:14:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1dc108ea0 msgr2=0x7fc1dc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1dc108ea0 0x7fc1dc100ee0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400be20 tx=0x7fc1d4009ed0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 shutdown_connections 2023-10-07T00:14:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1c80a1500 0x7fc1c80a39c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1dc108ea0 0x7fc1dc100ee0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1dc073890 0x7fc1dc104350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 --2- 172.21.15.5:0/2651949884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1dc074e70 0x7fc1dc104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.547+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 >> 172.21.15.5:0/2651949884 conn(0x7fc1dc0fc520 msgr2=0x7fc1dc0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.548+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 shutdown_connections 2023-10-07T00:14:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.548+0000 7fc1e45ff700 1 -- 172.21.15.5:0/2651949884 wait complete. 2023-10-07T00:14:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2023-10-07T00:14:45.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-07T00:14:45.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:45 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2651949884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:14:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.874+0000 7f63d01ff700 1 -- 172.21.15.5:0/1819191598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 msgr2=0x7f63c81079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.874+0000 7f63d01ff700 1 --2- 172.21.15.5:0/1819191598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 0x7f63c81079f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00b0a0 tx=0x7f63bc00b3b0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.875+0000 7f63d01ff700 1 -- 172.21.15.5:0/1819191598 shutdown_connections 2023-10-07T00:14:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.875+0000 7f63d01ff700 1 --2- 172.21.15.5:0/1819191598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63c8109160 0x7f63c810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.875+0000 7f63d01ff700 1 --2- 172.21.15.5:0/1819191598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 0x7f63c81079f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.875+0000 7f63d01ff700 1 --2- 172.21.15.5:0/1819191598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63c81087c0 0x7f63c8108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.875+0000 7f63d01ff700 1 -- 172.21.15.5:0/1819191598 >> 172.21.15.5:0/1819191598 conn(0x7f63c8076540 msgr2=0x7f63c80789a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.875+0000 7f63d01ff700 1 -- 172.21.15.5:0/1819191598 shutdown_connections 2023-10-07T00:14:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.875+0000 7f63d01ff700 1 -- 172.21.15.5:0/1819191598 wait complete. 2023-10-07T00:14:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.876+0000 7f63d01ff700 1 Processor -- start 2023-10-07T00:14:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.878+0000 7f63d01ff700 1 -- start start 2023-10-07T00:14:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.878+0000 7f63d01ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 0x7f63c807e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.878+0000 7f63d01ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63c81087c0 0x7f63c807ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.878+0000 7f63d01ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63c8109160 0x7f63c81ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.878+0000 7f63d01ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c807f290 con 0x7f63c81087c0 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.878+0000 7f63d01ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c81ad900 con 0x7f63c8109160 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.878+0000 7f63d01ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c81ada40 con 0x7f63c81075d0 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 0x7f63c807e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 0x7f63c807e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54954/0 (socket says 172.21.15.5:54954) 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 -- 172.21.15.5:0/2212072922 learned_addr learned my addr 172.21.15.5:0/2212072922 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cd79a700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63c81087c0 0x7f63c807ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 -- 172.21.15.5:0/2212072922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63c8109160 msgr2=0x7f63c81ad3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63c8109160 0x7f63c81ad3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 -- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63c81087c0 msgr2=0x7f63c807ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63c81087c0 0x7f63c807ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 -- 172.21.15.5:0/2212072922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc009d00 con 0x7f63c81075d0 2023-10-07T00:14:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.879+0000 7f63cdf9b700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 0x7f63c807e6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00b780 tx=0x7f63bc00be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.880+0000 7f63c6ffd700 1 -- 172.21.15.5:0/2212072922 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc00e040 con 0x7f63c81075d0 2023-10-07T00:14:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.880+0000 7f63c6ffd700 1 -- 172.21.15.5:0/2212072922 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63bc004e60 con 0x7f63c81075d0 2023-10-07T00:14:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.880+0000 7f63d01ff700 1 -- 172.21.15.5:0/2212072922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c81adc70 con 0x7f63c81075d0 2023-10-07T00:14:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.880+0000 7f63c6ffd700 1 -- 172.21.15.5:0/2212072922 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0052a0 con 0x7f63c81075d0 2023-10-07T00:14:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.880+0000 7f63d01ff700 1 -- 172.21.15.5:0/2212072922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c81ae0f0 con 0x7f63c81075d0 2023-10-07T00:14:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.887+0000 7f63e3b53b80 1 Processor -- start 2023-10-07T00:14:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.887+0000 7f63e3b53b80 1 -- start start 2023-10-07T00:14:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.887+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fcd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.887+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcdbc0 0x558fd3fce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.887+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcea60 0x558fd3fceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.887+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3f35460 con 0x558fd3fcdbc0 2023-10-07T00:14:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.887+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3f26c20 con 0x558fd3fcd260 2023-10-07T00:14:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.887+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3f24540 con 0x558fd3fcea60 2023-10-07T00:14:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.888+0000 7f63c6ffd700 1 -- 172.21.15.5:0/2212072922 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f63bc005400 con 0x7f63c81075d0 2023-10-07T00:14:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.889+0000 7f63cd79a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcea60 0x558fd3fceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.889+0000 7f63ce79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fcd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.889+0000 7f63ce79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fcd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55524/0 (socket says 172.21.15.5:55524) 2023-10-07T00:14:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.889+0000 7f63ce79c700 1 -- 172.21.15.5:0/658410367 learned_addr learned my addr 172.21.15.5:0/658410367 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.890+0000 7f63cdf9b700 1 --2- 172.21.15.5:0/658410367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcdbc0 0x558fd3fce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.890+0000 7f63ce79c700 1 -- 172.21.15.5:0/658410367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcea60 msgr2=0x558fd3fceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.890+0000 7f63ce79c700 1 --2- 172.21.15.5:0/658410367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcea60 0x558fd3fceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.890+0000 7f63ce79c700 1 -- 172.21.15.5:0/658410367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcdbc0 msgr2=0x558fd3fce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.890+0000 7f63ce79c700 1 --2- 172.21.15.5:0/658410367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcdbc0 0x558fd3fce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.890+0000 7f63ce79c700 1 -- 172.21.15.5:0/658410367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fd3d4ade0 con 0x558fd3fcd260 2023-10-07T00:14:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.891+0000 7f63ce79c700 1 --2- 172.21.15.5:0/658410367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fcd680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63c000ba20 tx=0x7f63c000bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63a8d6cc34baee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.891+0000 7f63b3fff700 1 -- 172.21.15.5:0/658410367 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0004a30 con 0x558fd3fcd260 2023-10-07T00:14:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.891+0000 7f63b3fff700 1 -- 172.21.15.5:0/658410367 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63c000b4d0 con 0x558fd3fcd260 2023-10-07T00:14:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.891+0000 7f63b3fff700 1 -- 172.21.15.5:0/658410367 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0005310 con 0x558fd3fcd260 2023-10-07T00:14:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.891+0000 7f63c6ffd700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f63b80a1530 0x7f63b80a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.892+0000 7f63c6ffd700 1 -- 172.21.15.5:0/2212072922 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f63bc0ce3e0 con 0x7f63c81075d0 2023-10-07T00:14:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.892+0000 7f63e3b53b80 1 -- 172.21.15.5:0/658410367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 msgr2=0x558fd3fcd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.892+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/658410367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fcd680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63c000ba20 tx=0x7f63c000bd30 comp rx=0 tx=0).stop 2023-10-07T00:14:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.893+0000 7f63e3b53b80 1 -- 172.21.15.5:0/658410367 shutdown_connections 2023-10-07T00:14:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.893+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/658410367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcea60 0x558fd3fceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.893+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/658410367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fcd680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.893+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/658410367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcdbc0 0x558fd3fce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.893+0000 7f63e3b53b80 1 -- 172.21.15.5:0/658410367 >> 172.21.15.5:0/658410367 conn(0x558fd3f41260 msgr2=0x558fd3fc8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:45.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.893+0000 7f63cdf9b700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f63b80a1530 0x7f63b80a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.893+0000 7f63e3b53b80 1 -- 172.21.15.5:0/658410367 shutdown_connections 2023-10-07T00:14:45.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.893+0000 7f63e3b53b80 1 -- 172.21.15.5:0/658410367 wait complete. 2023-10-07T00:14:45.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.894+0000 7f63e3b53b80 1 -- start start 2023-10-07T00:14:45.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.894+0000 7f63cdf9b700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f63b80a1530 0x7f63b80a39f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f63bc09b410 tx=0x7f63bc01df90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:45.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.894+0000 7f63e3b53b80 1 Processor -- start 2023-10-07T00:14:45.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.895+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcd260 0x558fd3fd7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.895+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.895+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcea60 0x558fd3fde5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.895+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3f1fe30 con 0x558fd3fcd260 2023-10-07T00:14:45.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.895+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3ebc710 con 0x558fd3fcea60 2023-10-07T00:14:45.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.895+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3ebc3b0 con 0x558fd3fcdbc0 2023-10-07T00:14:45.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.895+0000 7f63e3b53b80 10 client.0 _ll_register_callbacks cb 0x558fd3d19800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:45.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63cd79a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63cd79a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54976/0 (socket says 172.21.15.5:54976) 2023-10-07T00:14:45.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63ce79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcd260 0x558fd3fd7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63cd79a700 1 -- 172.21.15.5:0/3635984406 learned_addr learned my addr 172.21.15.5:0/3635984406 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:45.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63cd79a700 1 -- 172.21.15.5:0/3635984406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcea60 msgr2=0x558fd3fde5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63cd79a700 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcea60 0x558fd3fde5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63cd79a700 1 -- 172.21.15.5:0/3635984406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcd260 msgr2=0x558fd3fd7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63cd79a700 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcd260 0x558fd3fd7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.896+0000 7f63cd79a700 1 -- 172.21.15.5:0/3635984406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c000b650 con 0x558fd3fcdbc0 2023-10-07T00:14:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.897+0000 7f63cd79a700 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd7570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f63b4012700 tx=0x7f63b4012a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a95df61c0a3d061 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.897+0000 7f63b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.897+0000 7f63b17fa700 1 -- 172.21.15.5:0/3635984406 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4004230 con 0x558fd3fcdbc0 2023-10-07T00:14:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.897+0000 7f63e3b53b80 1 -- 172.21.15.5:0/3635984406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fd3f18e10 con 0x558fd3fcdbc0 2023-10-07T00:14:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.897+0000 7f63b17fa700 1 -- 172.21.15.5:0/3635984406 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f63b4004390 con 0x558fd3fcdbc0 2023-10-07T00:14:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63b17fa700 1 -- 172.21.15.5:0/3635984406 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63b4004590 con 0x558fd3fcdbc0 2023-10-07T00:14:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63e3b53b80 10 client.25861 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63e3b53b80 1 -- 172.21.15.5:0/3635984406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558fd3d33c60 con 0x558fd3fcdbc0 2023-10-07T00:14:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63b17fa700 1 -- 172.21.15.5:0/3635984406 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558fd3f18e10 con 0x558fd3fcdbc0 2023-10-07T00:14:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63b17fa700 1 -- 172.21.15.5:0/3635984406 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f63b4024020 con 0x558fd3fcdbc0 2023-10-07T00:14:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63e3b53b80 10 client.25861 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63e3b53b80 10 client.25861 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:14:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63e3b53b80 20 client.25861 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.898+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x558fd3fe2e10 0x558fd3fe5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.899+0000 7f63e3b53b80 4 client.25861 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.899+0000 7f63e3b53b80 1 -- 172.21.15.5:0/3635984406 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fd3f18b30 con 0x558fd3fe2e10 2023-10-07T00:14:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.900+0000 7f63ce79c700 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x558fd3fe2e10 0x558fd3fe5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.901+0000 7f63ce79c700 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x558fd3fe2e10 0x558fd3fe5230 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=781873783a29cdc4 server_cookie=8ae5e8a24c827ed8 in_seq=0 out_seq=0 2023-10-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.901+0000 7f63b17fa700 10 client.25861 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:14:45.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.902+0000 7f63b17fa700 1 -- 172.21.15.5:0/3635984406 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558fd3f18b30 con 0x558fd3fe2e10 2023-10-07T00:14:45.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.902+0000 7f63b17fa700 10 client.25861 handle_command_reply: tid=0 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.902+0000 7f63e3b53b80 1 client.25861 shutdown 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.902+0000 7f63e3b53b80 1 -- 172.21.15.5:0/3635984406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 msgr2=0x558fd3fd7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.902+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd7570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f63b4012700 tx=0x7f63b4012a10 comp rx=0 tx=0).stop 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63e3b53b80 1 -- 172.21.15.5:0/3635984406 shutdown_connections 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x558fd3fe2e10 0x558fd3fe5230 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcea60 0x558fd3fde5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcd260 0x558fd3fd7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63b17fa700 0 client.25861 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:14:45.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/3635984406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd7570 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63e3b53b80 1 -- 172.21.15.5:0/3635984406 >> 172.21.15.5:0/3635984406 conn(0x558fd3f41260 msgr2=0x558fd3fc7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:45.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63e3b53b80 1 -- 172.21.15.5:0/3635984406 shutdown_connections 2023-10-07T00:14:45.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.903+0000 7f63e3b53b80 1 -- 172.21.15.5:0/3635984406 wait complete. 2023-10-07T00:14:45.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.904+0000 7f63e3b53b80 20 client.25861 trim_cache size 0 max 16384 2023-10-07T00:14:45.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63e3b53b80 1 Processor -- start 2023-10-07T00:14:45.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63e3b53b80 1 -- start start 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcd260 0x558fd3fcee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcdbc0 0x558fd3fde570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fd5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3da0920 con 0x558fd3fcea60 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3fd6bd0 con 0x558fd3fcdbc0 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3fd81d0 con 0x558fd3fcd260 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63cd79a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcdbc0 0x558fd3fde570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63cd79a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcdbc0 0x558fd3fde570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55542/0 (socket says 172.21.15.5:55542) 2023-10-07T00:14:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.929+0000 7f63cd79a700 1 -- 172.21.15.5:0/2700818617 learned_addr learned my addr 172.21.15.5:0/2700818617 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.930+0000 7f63ce79c700 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcd260 0x558fd3fcee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.930+0000 7f63ce79c700 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fd5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.930+0000 7f63ce79c700 1 -- 172.21.15.5:0/2700818617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcdbc0 msgr2=0x558fd3fde570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.930+0000 7f63ce79c700 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcdbc0 0x558fd3fde570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.930+0000 7f63ce79c700 1 -- 172.21.15.5:0/2700818617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 msgr2=0x558fd3fd5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.930+0000 7f63ce79c700 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fd5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.930+0000 7f63ce79c700 1 -- 172.21.15.5:0/2700818617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fd3d71250 con 0x558fd3fcd260 2023-10-07T00:14:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.930+0000 7f63ce79c700 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcd260 0x558fd3fcee40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63c0004fd0 tx=0x7f63c0005920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78b628999b700cef server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.931+0000 7f63c4ff9700 1 -- 172.21.15.5:0/2700818617 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0027340 con 0x558fd3fcd260 2023-10-07T00:14:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.931+0000 7f63c4ff9700 1 -- 172.21.15.5:0/2700818617 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63c0014070 con 0x558fd3fcd260 2023-10-07T00:14:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.931+0000 7f63c4ff9700 1 -- 172.21.15.5:0/2700818617 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000d7d0 con 0x558fd3fcd260 2023-10-07T00:14:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 -- 172.21.15.5:0/2700818617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcd260 msgr2=0x558fd3fcee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcd260 0x558fd3fcee40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63c0004fd0 tx=0x7f63c0005920 comp rx=0 tx=0).stop 2023-10-07T00:14:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 -- 172.21.15.5:0/2700818617 shutdown_connections 2023-10-07T00:14:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fd5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcd260 0x558fd3fcee40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/2700818617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcdbc0 0x558fd3fde570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 -- 172.21.15.5:0/2700818617 >> 172.21.15.5:0/2700818617 conn(0x558fd3f41260 msgr2=0x558fd3fc6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 -- 172.21.15.5:0/2700818617 shutdown_connections 2023-10-07T00:14:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.932+0000 7f63e3b53b80 1 -- 172.21.15.5:0/2700818617 wait complete. 2023-10-07T00:14:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 1 -- start start 2023-10-07T00:14:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 1 Processor -- start 2023-10-07T00:14:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fd86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fddb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3fde090 con 0x558fd3fcea60 2023-10-07T00:14:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3fde200 con 0x558fd3fcd260 2023-10-07T00:14:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd3fde3c0 con 0x558fd3fcdbc0 2023-10-07T00:14:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.933+0000 7f63e3b53b80 10 client.0 _ll_register_callbacks cb 0x7f63b4009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.934+0000 7f63ce79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.934+0000 7f63ce79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fddb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40434/0 (socket says 172.21.15.5:40434) 2023-10-07T00:14:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.934+0000 7f63ce79c700 1 -- 172.21.15.5:0/1621343961 learned_addr learned my addr 172.21.15.5:0/1621343961 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.934+0000 7f63ce79c700 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fd86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.935+0000 7f63cd79a700 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.936+0000 7f63ce79c700 1 -- 172.21.15.5:0/1621343961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 msgr2=0x558fd3fd8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.936+0000 7f63ce79c700 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.936+0000 7f63ce79c700 1 -- 172.21.15.5:0/1621343961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 msgr2=0x558fd3fddb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.936+0000 7f63ce79c700 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fddb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.936+0000 7f63ce79c700 1 -- 172.21.15.5:0/1621343961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c002f040 con 0x558fd3fcd260 2023-10-07T00:14:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.936+0000 7f63ce79c700 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fd86f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63c000d5c0 tx=0x7f63c000bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf7c75de0a726b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.936+0000 7f63b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.936+0000 7f63b17fa700 1 -- 172.21.15.5:0/1621343961 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0005270 con 0x558fd3fcd260 2023-10-07T00:14:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.937+0000 7f63e3b53b80 1 -- 172.21.15.5:0/1621343961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fd3fbff10 con 0x558fd3fcd260 2023-10-07T00:14:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.937+0000 7f63b17fa700 1 -- 172.21.15.5:0/1621343961 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f63c00053d0 con 0x558fd3fcd260 2023-10-07T00:14:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.937+0000 7f63b17fa700 1 -- 172.21.15.5:0/1621343961 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63c0005590 con 0x558fd3fcd260 2023-10-07T00:14:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.937+0000 7f63e3b53b80 10 client.25898 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.937+0000 7f63e3b53b80 1 -- 172.21.15.5:0/1621343961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558fd3d492b0 con 0x558fd3fcd260 2023-10-07T00:14:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.937+0000 7f63b17fa700 1 -- 172.21.15.5:0/1621343961 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63c003e020 con 0x558fd3fcd260 2023-10-07T00:14:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.938+0000 7f63b17fa700 1 -- 172.21.15.5:0/1621343961 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f63c00037a0 con 0x558fd3fcd260 2023-10-07T00:14:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.938+0000 7f63e3b53b80 10 client.25898 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.938+0000 7f63e3b53b80 10 client.25898 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:14:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.938+0000 7f63e3b53b80 20 client.25898 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.938+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x558fd4048900 0x558fd404acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.938+0000 7f63e3b53b80 4 client.25898 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.938+0000 7f63e3b53b80 1 -- 172.21.15.5:0/1621343961 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558fd3d6bf70 con 0x558fd4048900 2023-10-07T00:14:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.938+0000 7f63cd79a700 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x558fd4048900 0x558fd404acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.939+0000 7f63b17fa700 10 client.25898 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:14:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.939+0000 7f63cd79a700 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x558fd4048900 0x558fd404acf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8c08bda7f39625bf server_cookie=29bc0947491ab1a1 in_seq=0 out_seq=0 2023-10-07T00:14:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63b17fa700 1 -- 172.21.15.5:0/1621343961 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558fd3d6bf70 con 0x558fd4048900 2023-10-07T00:14:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63b17fa700 10 client.25898 handle_command_reply: tid=0 2023-10-07T00:14:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 client.25898 shutdown 2023-10-07T00:14:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 -- 172.21.15.5:0/1621343961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 msgr2=0x558fd3fd86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fd86f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63c000d5c0 tx=0x7f63c000bd30 comp rx=0 tx=0).stop 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 -- 172.21.15.5:0/1621343961 shutdown_connections 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd3fcea60 0x558fd3fddb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x558fd4048900 0x558fd404acf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558fd3fcd260 0x558fd3fd86f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 --2- 172.21.15.5:0/1621343961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558fd3fcdbc0 0x558fd3fd8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63b17fa700 0 client.25898 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.940+0000 7f63e3b53b80 1 -- 172.21.15.5:0/1621343961 >> 172.21.15.5:0/1621343961 conn(0x558fd3f41260 msgr2=0x558fd3fc6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.941+0000 7f63e3b53b80 1 -- 172.21.15.5:0/1621343961 shutdown_connections 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.941+0000 7f63e3b53b80 1 -- 172.21.15.5:0/1621343961 wait complete. 2023-10-07T00:14:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.941+0000 7f63e3b53b80 20 client.25898 trim_cache size 0 max 16384 2023-10-07T00:14:45.944 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.941+0000 7f63d01ff700 1 -- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f63b80a1530 msgr2=0x7f63b80a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f63b80a1530 0x7f63b80a39f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f63bc09b410 tx=0x7f63bc01df90 comp rx=0 tx=0).stop 2023-10-07T00:14:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 -- 172.21.15.5:0/2212072922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 msgr2=0x7f63c807e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 0x7f63c807e6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00b780 tx=0x7f63bc00be10 comp rx=0 tx=0).stop 2023-10-07T00:14:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 -- 172.21.15.5:0/2212072922 shutdown_connections 2023-10-07T00:14:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f63b80a1530 0x7f63b80a39f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63c8109160 0x7f63c81ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c81075d0 0x7f63c807e6f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 --2- 172.21.15.5:0/2212072922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63c81087c0 0x7f63c807ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 -- 172.21.15.5:0/2212072922 >> 172.21.15.5:0/2212072922 conn(0x7f63c8076540 msgr2=0x7f63c810bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 -- 172.21.15.5:0/2212072922 shutdown_connections 2023-10-07T00:14:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:45.942+0000 7f63d01ff700 1 -- 172.21.15.5:0/2212072922 wait complete. 2023-10-07T00:14:45.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-07T00:14:46.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:45 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2651949884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:14:46.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:45 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2651949884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:14:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.282+0000 7f6e52dff700 1 -- 172.21.15.5:0/2778286365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c1021a0 msgr2=0x7f6e4c104630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.282+0000 7f6e52dff700 1 --2- 172.21.15.5:0/2778286365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c1021a0 0x7f6e4c104630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009990 tx=0x7f6e38009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.283+0000 7f6e52dff700 1 -- 172.21.15.5:0/2778286365 shutdown_connections 2023-10-07T00:14:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.283+0000 7f6e52dff700 1 --2- 172.21.15.5:0/2778286365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e4c104b70 0x7f6e4c104ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.283+0000 7f6e52dff700 1 --2- 172.21.15.5:0/2778286365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e4c0ff830 0x7f6e4c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.283+0000 7f6e52dff700 1 --2- 172.21.15.5:0/2778286365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c1021a0 0x7f6e4c104630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.283+0000 7f6e52dff700 1 -- 172.21.15.5:0/2778286365 >> 172.21.15.5:0/2778286365 conn(0x7f6e4c0fb450 msgr2=0x7f6e4c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.283+0000 7f6e52dff700 1 -- 172.21.15.5:0/2778286365 shutdown_connections 2023-10-07T00:14:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.283+0000 7f6e52dff700 1 -- 172.21.15.5:0/2778286365 wait complete. 2023-10-07T00:14:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.285+0000 7f6e52dff700 1 Processor -- start 2023-10-07T00:14:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.285+0000 7f6e52dff700 1 -- start start 2023-10-07T00:14:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.285+0000 7f6e52dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c0ff830 0x7f6e4c19d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.285+0000 7f6e52dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e4c1021a0 0x7f6e4c19d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.285+0000 7f6e52dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e4c104b70 0x7f6e4c1a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.285+0000 7f6e52dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1a4d60 con 0x7f6e4c1021a0 2023-10-07T00:14:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.285+0000 7f6e52dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1a4ea0 con 0x7f6e4c104b70 2023-10-07T00:14:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.285+0000 7f6e52dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1a5030 con 0x7f6e4c0ff830 2023-10-07T00:14:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e50b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c0ff830 0x7f6e4c19d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e5139c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e4c104b70 0x7f6e4c1a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e5139c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e4c104b70 0x7f6e4c1a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55556/0 (socket says 172.21.15.5:55556) 2023-10-07T00:14:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e5139c700 1 -- 172.21.15.5:0/997897094 learned_addr learned my addr 172.21.15.5:0/997897094 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e4c1021a0 0x7f6e4c19d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e5139c700 1 -- 172.21.15.5:0/997897094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c0ff830 msgr2=0x7f6e4c19d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e5139c700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c0ff830 0x7f6e4c19d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e5139c700 1 -- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e4c1021a0 msgr2=0x7f6e4c19d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e5139c700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e4c1021a0 0x7f6e4c19d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e5139c700 1 -- 172.21.15.5:0/997897094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40009520 con 0x7f6e4c104b70 2023-10-07T00:14:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e4c1021a0 0x7f6e4c19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.286+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c0ff830 0x7f6e4c19d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.287+0000 7f6e5139c700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e4c104b70 0x7f6e4c1a4790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400ef30 tx=0x7f6e4400c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.287+0000 7f6e49ffb700 1 -- 172.21.15.5:0/997897094 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44018070 con 0x7f6e4c104b70 2023-10-07T00:14:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.287+0000 7f6e49ffb700 1 -- 172.21.15.5:0/997897094 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e4400f040 con 0x7f6e4c104b70 2023-10-07T00:14:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.287+0000 7f6e49ffb700 1 -- 172.21.15.5:0/997897094 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44003d70 con 0x7f6e4c104b70 2023-10-07T00:14:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.287+0000 7f6e52dff700 1 -- 172.21.15.5:0/997897094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e380095f0 con 0x7f6e4c104b70 2023-10-07T00:14:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.287+0000 7f6e52dff700 1 -- 172.21.15.5:0/997897094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c1a55e0 con 0x7f6e4c104b70 2023-10-07T00:14:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.293+0000 7f6e49ffb700 1 -- 172.21.15.5:0/997897094 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6e44004ad0 con 0x7f6e4c104b70 2023-10-07T00:14:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.296+0000 7f6e666e6b80 1 Processor -- start 2023-10-07T00:14:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.296+0000 7f6e666e6b80 1 -- start start 2023-10-07T00:14:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.296+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123260 0x5653da123680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.296+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123bc0 0x5653da124480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.296+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da124ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.296+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da08b460 con 0x5653da124a60 2023-10-07T00:14:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.296+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da07cc20 con 0x5653da123bc0 2023-10-07T00:14:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.296+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da07a540 con 0x5653da123260 2023-10-07T00:14:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.297+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123260 0x5653da123680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.297+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123260 0x5653da123680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55016/0 (socket says 172.21.15.5:55016) 2023-10-07T00:14:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.297+0000 7f6e4bfff700 1 -- 172.21.15.5:0/4078570604 learned_addr learned my addr 172.21.15.5:0/4078570604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.297+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da124ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.297+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123bc0 0x5653da124480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.298+0000 7f6e4bfff700 1 -- 172.21.15.5:0/4078570604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123bc0 msgr2=0x5653da124480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.298+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123bc0 0x5653da124480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.298+0000 7f6e4bfff700 1 -- 172.21.15.5:0/4078570604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 msgr2=0x5653da124ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.298+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da124ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.298+0000 7f6e4bfff700 1 -- 172.21.15.5:0/4078570604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653d9ea0de0 con 0x5653da123260 2023-10-07T00:14:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.299+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123260 0x5653da123680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800b2e0 tx=0x7f6e3801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2df38da6ec9048 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.299+0000 7f6e36ffd700 1 -- 172.21.15.5:0/4078570604 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38003960 con 0x5653da123260 2023-10-07T00:14:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.299+0000 7f6e36ffd700 1 -- 172.21.15.5:0/4078570604 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e3801e070 con 0x5653da123260 2023-10-07T00:14:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.299+0000 7f6e36ffd700 1 -- 172.21.15.5:0/4078570604 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38004950 con 0x5653da123260 2023-10-07T00:14:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.299+0000 7f6e49ffb700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6e3c0a1500 0x7f6e3c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.299+0000 7f6e49ffb700 1 -- 172.21.15.5:0/997897094 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6e440cca10 con 0x7f6e4c104b70 2023-10-07T00:14:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.300+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123bc0 0x5653da124480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.300+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6e3c0a1500 0x7f6e3c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.300+0000 7f6e666e6b80 1 -- 172.21.15.5:0/4078570604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123260 msgr2=0x5653da123680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.300+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123260 0x5653da123680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800b2e0 tx=0x7f6e3801a040 comp rx=0 tx=0).stop 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e666e6b80 1 -- 172.21.15.5:0/4078570604 shutdown_connections 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da124ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123260 0x5653da123680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/4078570604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123bc0 0x5653da124480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e666e6b80 1 -- 172.21.15.5:0/4078570604 >> 172.21.15.5:0/4078570604 conn(0x5653da097260 msgr2=0x5653da11e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6e3c0a1500 0x7f6e3c0a39c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009eb0 tx=0x7f6e40009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e666e6b80 1 -- 172.21.15.5:0/4078570604 shutdown_connections 2023-10-07T00:14:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e666e6b80 1 -- 172.21.15.5:0/4078570604 wait complete. 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.301+0000 7f6e666e6b80 1 -- start start 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.302+0000 7f6e666e6b80 1 Processor -- start 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.302+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da123260 0x5653da12d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.302+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da12d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.302+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 0x5653da1345b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.302+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da075e30 con 0x5653da123260 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.302+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da012710 con 0x5653da124a60 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.302+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da0123b0 con 0x5653da123bc0 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e666e6b80 10 client.0 _ll_register_callbacks cb 0x5653d9e6f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da12d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da12d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55030/0 (socket says 172.21.15.5:55030) 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e4bfff700 1 -- 172.21.15.5:0/613683606 learned_addr learned my addr 172.21.15.5:0/613683606 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da123260 0x5653da12d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e4bfff700 1 -- 172.21.15.5:0/613683606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 msgr2=0x5653da1345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 0x5653da1345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e4bfff700 1 -- 172.21.15.5:0/613683606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da123260 msgr2=0x5653da12d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da123260 0x5653da12d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.303+0000 7f6e4bfff700 1 -- 172.21.15.5:0/613683606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c105b20 con 0x5653da123bc0 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.304+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da123260 0x5653da12d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.304+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da12d570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009ce0 tx=0x7f6e38004590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3149f81719876e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.304+0000 7f6e2bfff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.304+0000 7f6e2bfff700 1 -- 172.21.15.5:0/613683606 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38005450 con 0x5653da123bc0 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.304+0000 7f6e2bfff700 1 -- 172.21.15.5:0/613683606 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6e380055b0 con 0x5653da123bc0 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.304+0000 7f6e666e6b80 1 -- 172.21.15.5:0/613683606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653da115f10 con 0x5653da123bc0 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e2bfff700 1 -- 172.21.15.5:0/613683606 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e380046f0 con 0x5653da123bc0 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e666e6b80 10 client.25873 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e666e6b80 1 -- 172.21.15.5:0/613683606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5653d9e89c60 con 0x5653da123bc0 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e2bfff700 1 -- 172.21.15.5:0/613683606 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653da115f10 con 0x5653da123bc0 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e2bfff700 1 -- 172.21.15.5:0/613683606 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6e3800bb60 con 0x5653da123bc0 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e666e6b80 10 client.25873 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e666e6b80 10 client.25873 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e666e6b80 20 client.25873 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x5653da1388e0 0x5653da13ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e666e6b80 4 client.25873 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.305+0000 7f6e666e6b80 1 -- 172.21.15.5:0/613683606 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653da06ee10 con 0x5653da1388e0 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.306+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x5653da1388e0 0x5653da13ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.307+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x5653da1388e0 0x5653da13ad00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=89bd46632bbd5a72 server_cookie=f63ab6f2b89b09f3 in_seq=0 out_seq=0 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.307+0000 7f6e2bfff700 10 client.25873 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e2bfff700 1 -- 172.21.15.5:0/613683606 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5653da06ee10 con 0x5653da1388e0 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e2bfff700 10 client.25873 handle_command_reply: tid=0 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 client.25873 shutdown 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 -- 172.21.15.5:0/613683606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 msgr2=0x5653da12d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da12d570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009ce0 tx=0x7f6e38004590 comp rx=0 tx=0).stop 2023-10-07T00:14:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 -- 172.21.15.5:0/613683606 shutdown_connections 2023-10-07T00:14:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x5653da1388e0 0x5653da13ad00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 0x5653da1345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da123260 0x5653da12d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/613683606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da12d570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.308+0000 7f6e666e6b80 1 -- 172.21.15.5:0/613683606 >> 172.21.15.5:0/613683606 conn(0x5653da097260 msgr2=0x5653da11df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.309+0000 7f6e2bfff700 0 client.25873 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:14:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.309+0000 7f6e666e6b80 1 -- 172.21.15.5:0/613683606 shutdown_connections 2023-10-07T00:14:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.309+0000 7f6e666e6b80 1 -- 172.21.15.5:0/613683606 wait complete. 2023-10-07T00:14:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.309+0000 7f6e666e6b80 20 client.25873 trim_cache size 0 max 16384 2023-10-07T00:14:46.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.329+0000 7f6e666e6b80 1 Processor -- start 2023-10-07T00:14:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.329+0000 7f6e666e6b80 1 -- start start 2023-10-07T00:14:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123260 0x5653da134ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da134570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da1279d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653d9ef6920 con 0x5653da124a60 2023-10-07T00:14:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da12c4e0 con 0x5653da123260 2023-10-07T00:14:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da12cbd0 con 0x5653da123bc0 2023-10-07T00:14:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e50b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123260 0x5653da134ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e50b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123260 0x5653da134ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55584/0 (socket says 172.21.15.5:55584) 2023-10-07T00:14:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.330+0000 7f6e50b9b700 1 -- 172.21.15.5:0/175738273 learned_addr learned my addr 172.21.15.5:0/175738273 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da134570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e50b9b700 1 -- 172.21.15.5:0/175738273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 msgr2=0x5653da134570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da134570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e50b9b700 1 -- 172.21.15.5:0/175738273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 msgr2=0x5653da1279d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e5139c700 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da1279d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da1279d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e50b9b700 1 -- 172.21.15.5:0/175738273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653d9ec7250 con 0x5653da123260 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da134570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e5139c700 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da1279d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.331+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123260 0x5653da134ea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6e40027cc0 tx=0x7f6e40015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177796e07ac6d81e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.332+0000 7f6e377fe700 1 -- 172.21.15.5:0/175738273 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4002c070 con 0x5653da123260 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.332+0000 7f6e377fe700 1 -- 172.21.15.5:0/175738273 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e4001ee50 con 0x5653da123260 2023-10-07T00:14:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.332+0000 7f6e377fe700 1 -- 172.21.15.5:0/175738273 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40021040 con 0x5653da123260 2023-10-07T00:14:46.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 -- 172.21.15.5:0/175738273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123260 msgr2=0x5653da134ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123260 0x5653da134ea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6e40027cc0 tx=0x7f6e40015000 comp rx=0 tx=0).stop 2023-10-07T00:14:46.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 -- 172.21.15.5:0/175738273 shutdown_connections 2023-10-07T00:14:46.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da124a60 0x5653da1279d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da123260 0x5653da134ea0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6e40027cc0 tx=0x7f6e40015000 comp rx=0 tx=0).stop 2023-10-07T00:14:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/175738273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da134570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 -- 172.21.15.5:0/175738273 >> 172.21.15.5:0/175738273 conn(0x5653da097260 msgr2=0x5653da12bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 -- 172.21.15.5:0/175738273 shutdown_connections 2023-10-07T00:14:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.333+0000 7f6e666e6b80 1 -- 172.21.15.5:0/175738273 wait complete. 2023-10-07T00:14:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.334+0000 7f6e666e6b80 1 -- start start 2023-10-07T00:14:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.334+0000 7f6e666e6b80 1 Processor -- start 2023-10-07T00:14:46.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.334+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da133d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.334+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 0x5653da134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.334+0000 7f6e666e6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da132350 0x5653da1327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.334+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da132d10 con 0x5653da132350 2023-10-07T00:14:46.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.334+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da132e80 con 0x5653da124a60 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.335+0000 7f6e666e6b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653da132fc0 con 0x5653da123bc0 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.335+0000 7f6e666e6b80 10 client.0 _ll_register_callbacks cb 0x7f6e440097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.335+0000 7f6e50b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.335+0000 7f6e50b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da133d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55060/0 (socket says 172.21.15.5:55060) 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.335+0000 7f6e50b9b700 1 -- 172.21.15.5:0/1747384260 learned_addr learned my addr 172.21.15.5:0/1747384260 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.335+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 0x5653da134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e5139c700 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da132350 0x5653da1327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e50b9b700 1 -- 172.21.15.5:0/1747384260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 msgr2=0x5653da134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 0x5653da134280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e50b9b700 1 -- 172.21.15.5:0/1747384260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da132350 msgr2=0x5653da1327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da132350 0x5653da1327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e50b9b700 1 -- 172.21.15.5:0/1747384260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653d9e89c60 con 0x5653da123bc0 2023-10-07T00:14:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e5139c700 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da132350 0x5653da1327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e50b9b700 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da133d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6e40027c90 tx=0x7f6e400274e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5652e47ddee3e591 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.336+0000 7f6e2bfff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:46.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.337+0000 7f6e2bfff700 1 -- 172.21.15.5:0/1747384260 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40034070 con 0x5653da123bc0 2023-10-07T00:14:46.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.337+0000 7f6e2bfff700 1 -- 172.21.15.5:0/1747384260 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6e4001e9c0 con 0x5653da123bc0 2023-10-07T00:14:46.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.337+0000 7f6e666e6b80 1 -- 172.21.15.5:0/1747384260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e3801e070 con 0x5653da123bc0 2023-10-07T00:14:46.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.337+0000 7f6e2bfff700 1 -- 172.21.15.5:0/1747384260 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e40021050 con 0x5653da123bc0 2023-10-07T00:14:46.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.337+0000 7f6e666e6b80 10 client.25879 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:46.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.337+0000 7f6e666e6b80 1 -- 172.21.15.5:0/1747384260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f6e40027970 con 0x5653da123bc0 2023-10-07T00:14:46.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.338+0000 7f6e2bfff700 1 -- 172.21.15.5:0/1747384260 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e3801e070 con 0x5653da123bc0 2023-10-07T00:14:46.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.338+0000 7f6e2bfff700 1 -- 172.21.15.5:0/1747384260 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6e40037020 con 0x5653da123bc0 2023-10-07T00:14:46.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.338+0000 7f6e666e6b80 10 client.25879 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:46.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.338+0000 7f6e666e6b80 10 client.25879 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:14:46.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.338+0000 7f6e666e6b80 20 client.25879 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:46.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.338+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x5653da19ebc0 0x5653da1a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.338+0000 7f6e666e6b80 4 client.25879 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:46.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.338+0000 7f6e666e6b80 1 -- 172.21.15.5:0/1747384260 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5653da06eb30 con 0x5653da19ebc0 2023-10-07T00:14:46.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.339+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x5653da19ebc0 0x5653da1a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.339+0000 7f6e4bfff700 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x5653da19ebc0 0x5653da1a0fe0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c65d66f322b1774 server_cookie=d5be2616167a40a in_seq=0 out_seq=0 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e2bfff700 10 client.25879 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e2bfff700 1 -- 172.21.15.5:0/1747384260 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5653da06eb30 con 0x5653da19ebc0 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e2bfff700 10 client.25879 handle_command_reply: tid=0 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 client.25879 shutdown 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 -- 172.21.15.5:0/1747384260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 msgr2=0x5653da133d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da133d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6e40027c90 tx=0x7f6e400274e0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 -- 172.21.15.5:0/1747384260 shutdown_connections 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x5653da19ebc0 0x5653da1a0fe0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653da132350 0x5653da1327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653da123bc0 0x5653da133d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 --2- 172.21.15.5:0/1747384260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5653da124a60 0x5653da134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.340+0000 7f6e666e6b80 1 -- 172.21.15.5:0/1747384260 >> 172.21.15.5:0/1747384260 conn(0x5653da097260 msgr2=0x5653da134ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.341+0000 7f6e2bfff700 0 client.25879 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:14:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.341+0000 7f6e666e6b80 1 -- 172.21.15.5:0/1747384260 shutdown_connections 2023-10-07T00:14:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.341+0000 7f6e666e6b80 1 -- 172.21.15.5:0/1747384260 wait complete. 2023-10-07T00:14:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.341+0000 7f6e666e6b80 20 client.25879 trim_cache size 0 max 16384 2023-10-07T00:14:46.344 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 -- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6e3c0a1500 msgr2=0x7f6e3c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6e3c0a1500 0x7f6e3c0a39c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009eb0 tx=0x7f6e40009260 comp rx=0 tx=0).stop 2023-10-07T00:14:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 -- 172.21.15.5:0/997897094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e4c104b70 msgr2=0x7f6e4c1a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e4c104b70 0x7f6e4c1a4790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400ef30 tx=0x7f6e4400c450 comp rx=0 tx=0).stop 2023-10-07T00:14:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 -- 172.21.15.5:0/997897094 shutdown_connections 2023-10-07T00:14:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f6e3c0a1500 0x7f6e3c0a39c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e4c104b70 0x7f6e4c1a4790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e4c0ff830 0x7f6e4c19d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 --2- 172.21.15.5:0/997897094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e4c1021a0 0x7f6e4c19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.342+0000 7f6e52dff700 1 -- 172.21.15.5:0/997897094 >> 172.21.15.5:0/997897094 conn(0x7f6e4c0fb450 msgr2=0x7f6e4c1004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.343+0000 7f6e52dff700 1 -- 172.21.15.5:0/997897094 shutdown_connections 2023-10-07T00:14:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.343+0000 7f6e52dff700 1 -- 172.21.15.5:0/997897094 wait complete. 2023-10-07T00:14:46.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-07T00:14:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.706+0000 7f18435ff700 1 -- 172.21.15.5:0/2553298214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 msgr2=0x7f183c101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.706+0000 7f18435ff700 1 --2- 172.21.15.5:0/2553298214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 0x7f183c101c60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18380098f0 tx=0x7f1838009c00 comp rx=0 tx=0).stop 2023-10-07T00:14:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.706+0000 7f18435ff700 1 -- 172.21.15.5:0/2553298214 shutdown_connections 2023-10-07T00:14:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.706+0000 7f18435ff700 1 --2- 172.21.15.5:0/2553298214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c104b70 0x7f183c104ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.706+0000 7f18435ff700 1 --2- 172.21.15.5:0/2553298214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 0x7f183c101c60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.706+0000 7f18435ff700 1 --2- 172.21.15.5:0/2553298214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f183c1021a0 0x7f183c104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.706+0000 7f18435ff700 1 -- 172.21.15.5:0/2553298214 >> 172.21.15.5:0/2553298214 conn(0x7f183c0fb450 msgr2=0x7f183c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.707+0000 7f18435ff700 1 -- 172.21.15.5:0/2553298214 shutdown_connections 2023-10-07T00:14:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.707+0000 7f18435ff700 1 -- 172.21.15.5:0/2553298214 wait complete. 2023-10-07T00:14:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.708+0000 7f18435ff700 1 Processor -- start 2023-10-07T00:14:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f18435ff700 1 -- start start 2023-10-07T00:14:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f18435ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 0x7f183c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f18435ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1021a0 0x7f183c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f18435ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f183c104b70 0x7f183c1ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f18435ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c070320 con 0x7f183c104b70 2023-10-07T00:14:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f18435ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c070460 con 0x7f183c1021a0 2023-10-07T00:14:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f18435ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c105e80 con 0x7f183c0ff830 2023-10-07T00:14:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f184139b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 0x7f183c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f1841b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f183c104b70 0x7f183c1ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f184139b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 0x7f183c06f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55084/0 (socket says 172.21.15.5:55084) 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f1841b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f183c104b70 0x7f183c1ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40512/0 (socket says 172.21.15.5:40512) 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.710+0000 7f184139b700 1 -- 172.21.15.5:0/1655059404 learned_addr learned my addr 172.21.15.5:0/1655059404 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.711+0000 7f1840b9a700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1021a0 0x7f183c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.711+0000 7f1841b9c700 1 -- 172.21.15.5:0/1655059404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 msgr2=0x7f183c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.711+0000 7f1841b9c700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 0x7f183c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.711+0000 7f1841b9c700 1 -- 172.21.15.5:0/1655059404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1021a0 msgr2=0x7f183c06fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.711+0000 7f1841b9c700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1021a0 0x7f183c06fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.711+0000 7f1841b9c700 1 -- 172.21.15.5:0/1655059404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838009520 con 0x7f183c104b70 2023-10-07T00:14:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.711+0000 7f1840b9a700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1021a0 0x7f183c06fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:14:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.711+0000 7f1841b9c700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f183c104b70 0x7f183c1ad330 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f183400efc0 tx=0x7f183400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.712+0000 7f18327fc700 1 -- 172.21.15.5:0/1655059404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834018070 con 0x7f183c104b70 2023-10-07T00:14:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.712+0000 7f18327fc700 1 -- 172.21.15.5:0/1655059404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f183400f040 con 0x7f183c104b70 2023-10-07T00:14:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.712+0000 7f18327fc700 1 -- 172.21.15.5:0/1655059404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400cc20 con 0x7f183c104b70 2023-10-07T00:14:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.712+0000 7f18435ff700 1 -- 172.21.15.5:0/1655059404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c106100 con 0x7f183c104b70 2023-10-07T00:14:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.712+0000 7f18435ff700 1 -- 172.21.15.5:0/1655059404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c1065c0 con 0x7f183c104b70 2023-10-07T00:14:46.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.717+0000 7f1856e7cb80 1 Processor -- start 2023-10-07T00:14:46.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.720+0000 7f18327fc700 1 -- 172.21.15.5:0/1655059404 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1834004ad0 con 0x7f183c104b70 2023-10-07T00:14:46.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.720+0000 7f1856e7cb80 1 -- start start 2023-10-07T00:14:46.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32ddf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddfbc0 0x55aa32de0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32de0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32d47460 con 0x55aa32ddfbc0 2023-10-07T00:14:46.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32d38c20 con 0x55aa32de0a60 2023-10-07T00:14:46.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32d36540 con 0x55aa32ddf260 2023-10-07T00:14:46.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1840b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32ddf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1840b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32ddf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55086/0 (socket says 172.21.15.5:55086) 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1840b9a700 1 -- 172.21.15.5:0/395800527 learned_addr learned my addr 172.21.15.5:0/395800527 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.721+0000 7f1840b9a700 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32de0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f184139b700 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddfbc0 0x55aa32de0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f1840b9a700 1 -- 172.21.15.5:0/395800527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 msgr2=0x55aa32ddf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f1840b9a700 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32ddf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f1840b9a700 1 -- 172.21.15.5:0/395800527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddfbc0 msgr2=0x55aa32de0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f1840b9a700 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddfbc0 0x55aa32de0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f1840b9a700 1 -- 172.21.15.5:0/395800527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa32b5cde0 con 0x55aa32de0a60 2023-10-07T00:14:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f1840b9a700 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32de0ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f182c013cf0 tx=0x7f182c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef86216cdfee38a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f18277fe700 1 -- 172.21.15.5:0/395800527 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c013170 con 0x55aa32de0a60 2023-10-07T00:14:46.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f18327fc700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18280a1500 0x7f18280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.722+0000 7f18277fe700 1 -- 172.21.15.5:0/395800527 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f182c0132d0 con 0x55aa32de0a60 2023-10-07T00:14:46.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.723+0000 7f18327fc700 1 -- 172.21.15.5:0/1655059404 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f18340ce1c0 con 0x7f183c104b70 2023-10-07T00:14:46.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.723+0000 7f18277fe700 1 -- 172.21.15.5:0/395800527 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c005540 con 0x55aa32de0a60 2023-10-07T00:14:46.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.723+0000 7f1856e7cb80 1 -- 172.21.15.5:0/395800527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 msgr2=0x55aa32de0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.723+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32de0ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f182c013cf0 tx=0x7f182c0047c0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.724+0000 7f184139b700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18280a1500 0x7f18280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.724+0000 7f1856e7cb80 1 -- 172.21.15.5:0/395800527 shutdown_connections 2023-10-07T00:14:46.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.724+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32de0ee0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.724+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32ddf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.724+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/395800527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddfbc0 0x55aa32de0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.724+0000 7f1856e7cb80 1 -- 172.21.15.5:0/395800527 >> 172.21.15.5:0/395800527 conn(0x55aa32d53260 msgr2=0x55aa32dda140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.725+0000 7f184139b700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18280a1500 0x7f18280a39c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1838009fd0 tx=0x7f1838019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.725+0000 7f1856e7cb80 1 -- 172.21.15.5:0/395800527 shutdown_connections 2023-10-07T00:14:46.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.725+0000 7f1856e7cb80 1 -- 172.21.15.5:0/395800527 wait complete. 2023-10-07T00:14:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.725+0000 7f1856e7cb80 1 -- start start 2023-10-07T00:14:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.726+0000 7f1856e7cb80 1 Processor -- start 2023-10-07T00:14:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.727+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddf260 0x55aa32de9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.727+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.727+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 0x55aa32df0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.727+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32d31e30 con 0x55aa32de0a60 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.727+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32cce710 con 0x55aa32ddf260 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.727+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32cce3b0 con 0x55aa32ddfbc0 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.727+0000 7f1856e7cb80 10 client.0 _ll_register_callbacks cb 0x55aa32b2b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f1840b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f1840b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55094/0 (socket says 172.21.15.5:55094) 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f1840b9a700 1 -- 172.21.15.5:0/322819272 learned_addr learned my addr 172.21.15.5:0/322819272 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f184139b700 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddf260 0x55aa32de9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f1841b9c700 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 0x55aa32df0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f184139b700 1 -- 172.21.15.5:0/322819272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 msgr2=0x55aa32de95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f184139b700 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f184139b700 1 -- 172.21.15.5:0/322819272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 msgr2=0x55aa32df0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.728+0000 7f184139b700 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 0x55aa32df0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.729+0000 7f184139b700 1 -- 172.21.15.5:0/322819272 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c01b040 con 0x55aa32ddf260 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.729+0000 7f184139b700 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddf260 0x55aa32de9080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f18380098c0 tx=0x7f1838009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=520bc36fbc6a2922 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.729+0000 7f1824ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.730+0000 7f1824ff9700 1 -- 172.21.15.5:0/322819272 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838028070 con 0x55aa32ddf260 2023-10-07T00:14:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.730+0000 7f1856e7cb80 1 -- 172.21.15.5:0/322819272 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa32dd1f10 con 0x55aa32ddf260 2023-10-07T00:14:46.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.730+0000 7f1824ff9700 1 -- 172.21.15.5:0/322819272 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1838005040 con 0x55aa32ddf260 2023-10-07T00:14:46.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.730+0000 7f1824ff9700 1 -- 172.21.15.5:0/322819272 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f183801c040 con 0x55aa32ddf260 2023-10-07T00:14:46.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.730+0000 7f1856e7cb80 10 client.25925 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:46.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.730+0000 7f1856e7cb80 1 -- 172.21.15.5:0/322819272 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55aa32b45c60 con 0x55aa32ddf260 2023-10-07T00:14:46.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.730+0000 7f1824ff9700 1 -- 172.21.15.5:0/322819272 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f183803c080 con 0x55aa32ddf260 2023-10-07T00:14:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.731+0000 7f1824ff9700 1 -- 172.21.15.5:0/322819272 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1838036030 con 0x55aa32ddf260 2023-10-07T00:14:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.731+0000 7f1856e7cb80 10 client.25925 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.731+0000 7f1856e7cb80 10 client.25925 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:14:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.731+0000 7f1856e7cb80 20 client.25925 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.731+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55aa32df4e30 0x55aa32df7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.731+0000 7f1856e7cb80 4 client.25925 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.731+0000 7f1856e7cb80 1 -- 172.21.15.5:0/322819272 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa32d2ae10 con 0x55aa32df4e30 2023-10-07T00:14:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.732+0000 7f1840b9a700 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55aa32df4e30 0x55aa32df7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.733+0000 7f1840b9a700 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55aa32df4e30 0x55aa32df7250 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6feec7780b19cbbf server_cookie=9637acda698e2c4a in_seq=0 out_seq=0 2023-10-07T00:14:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.733+0000 7f1824ff9700 10 client.25925 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:14:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.733+0000 7f1824ff9700 1 -- 172.21.15.5:0/322819272 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aa32d2ae10 con 0x55aa32df4e30 2023-10-07T00:14:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.733+0000 7f1824ff9700 10 client.25925 handle_command_reply: tid=0 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 client.25925 shutdown 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 -- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddf260 msgr2=0x55aa32de9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddf260 0x55aa32de9080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f18380098c0 tx=0x7f1838009c00 comp rx=0 tx=0).stop 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 -- 172.21.15.5:0/322819272 shutdown_connections 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55aa32df4e30 0x55aa32df7250 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 0x55aa32df0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddf260 0x55aa32de9080 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/322819272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1856e7cb80 1 -- 172.21.15.5:0/322819272 >> 172.21.15.5:0/322819272 conn(0x55aa32d53260 msgr2=0x55aa32dd9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.734+0000 7f1824ff9700 0 client.25925 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:14:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.735+0000 7f1856e7cb80 1 -- 172.21.15.5:0/322819272 shutdown_connections 2023-10-07T00:14:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.735+0000 7f1856e7cb80 1 -- 172.21.15.5:0/322819272 wait complete. 2023-10-07T00:14:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.735+0000 7f1856e7cb80 20 client.25925 trim_cache size 0 max 16384 2023-10-07T00:14:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.758+0000 7f1856e7cb80 1 Processor -- start 2023-10-07T00:14:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.758+0000 7f1856e7cb80 1 -- start start 2023-10-07T00:14:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.758+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddf260 0x55aa32de3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.758+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.758+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32df05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.758+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32de8c50 con 0x55aa32ddf260 2023-10-07T00:14:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.758+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32bb2920 con 0x55aa32de0a60 2023-10-07T00:14:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.758+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32dea0d0 con 0x55aa32ddfbc0 2023-10-07T00:14:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1840b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1840b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55110/0 (socket says 172.21.15.5:55110) 2023-10-07T00:14:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1840b9a700 1 -- 172.21.15.5:0/589958320 learned_addr learned my addr 172.21.15.5:0/589958320 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f184139b700 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddf260 0x55aa32de3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1841b9c700 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32df05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1840b9a700 1 -- 172.21.15.5:0/589958320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 msgr2=0x55aa32df05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1840b9a700 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32df05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1840b9a700 1 -- 172.21.15.5:0/589958320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddf260 msgr2=0x55aa32de3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1840b9a700 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddf260 0x55aa32de3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.759+0000 7f1840b9a700 1 -- 172.21.15.5:0/589958320 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa32b83250 con 0x55aa32ddfbc0 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.760+0000 7f1840b9a700 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de3eb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f182c013cf0 tx=0x7f182c024040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d77e71f8fee2ca82 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.760+0000 7f1827fff700 1 -- 172.21.15.5:0/589958320 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c027040 con 0x55aa32ddfbc0 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.760+0000 7f1827fff700 1 -- 172.21.15.5:0/589958320 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f182c0044b0 con 0x55aa32ddfbc0 2023-10-07T00:14:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.760+0000 7f1827fff700 1 -- 172.21.15.5:0/589958320 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c004c90 con 0x55aa32ddfbc0 2023-10-07T00:14:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.761+0000 7f1856e7cb80 1 -- 172.21.15.5:0/589958320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 msgr2=0x55aa32de3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.761+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de3eb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f182c013cf0 tx=0x7f182c024040 comp rx=0 tx=0).stop 2023-10-07T00:14:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.762+0000 7f1856e7cb80 1 -- 172.21.15.5:0/589958320 shutdown_connections 2023-10-07T00:14:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.762+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32de0a60 0x55aa32df05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.762+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32ddf260 0x55aa32de3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.762+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/589958320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddfbc0 0x55aa32de3eb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.762+0000 7f1856e7cb80 1 -- 172.21.15.5:0/589958320 >> 172.21.15.5:0/589958320 conn(0x55aa32d53260 msgr2=0x55aa32df0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.762+0000 7f1856e7cb80 1 -- 172.21.15.5:0/589958320 shutdown_connections 2023-10-07T00:14:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.762+0000 7f1856e7cb80 1 -- 172.21.15.5:0/589958320 wait complete. 2023-10-07T00:14:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.762+0000 7f1856e7cb80 1 -- start start 2023-10-07T00:14:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.763+0000 7f1856e7cb80 1 Processor -- start 2023-10-07T00:14:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.763+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32dec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.763+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddfbc0 0x55aa32deca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.763+0000 7f1856e7cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 0x55aa32defa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.763+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32deffb0 con 0x55aa32de0a60 2023-10-07T00:14:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.763+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32df0120 con 0x55aa32ddfbc0 2023-10-07T00:14:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.763+0000 7f1856e7cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa32df02e0 con 0x55aa32ddf260 2023-10-07T00:14:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.764+0000 7f1856e7cb80 10 client.0 _ll_register_callbacks cb 0x7f183800b870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.764+0000 7f184139b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32dec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.764+0000 7f184139b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32dec510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55116/0 (socket says 172.21.15.5:55116) 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.764+0000 7f184139b700 1 -- 172.21.15.5:0/1952464858 learned_addr learned my addr 172.21.15.5:0/1952464858 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.764+0000 7f184139b700 1 -- 172.21.15.5:0/1952464858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddfbc0 msgr2=0x55aa32deca50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.765+0000 7f184139b700 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddfbc0 0x55aa32deca50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.765+0000 7f184139b700 1 -- 172.21.15.5:0/1952464858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 msgr2=0x55aa32defa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.765+0000 7f184139b700 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 0x55aa32defa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.765+0000 7f184139b700 1 -- 172.21.15.5:0/1952464858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa32b5cde0 con 0x55aa32ddf260 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.765+0000 7f184139b700 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32dec510 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f183800fa30 tx=0x7f183800bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b04ab851b1edbe14 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.765+0000 7f1824ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.766+0000 7f1824ff9700 1 -- 172.21.15.5:0/1952464858 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183803f070 con 0x55aa32ddf260 2023-10-07T00:14:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.766+0000 7f1824ff9700 1 -- 172.21.15.5:0/1952464858 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1838029070 con 0x55aa32ddf260 2023-10-07T00:14:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.766+0000 7f1856e7cb80 1 -- 172.21.15.5:0/1952464858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f182c0132d0 con 0x55aa32ddf260 2023-10-07T00:14:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.768+0000 7f1824ff9700 1 -- 172.21.15.5:0/1952464858 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1838028030 con 0x55aa32ddf260 2023-10-07T00:14:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.768+0000 7f1856e7cb80 10 client.25897 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.768+0000 7f1856e7cb80 1 -- 172.21.15.5:0/1952464858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55aa32b5b2b0 con 0x55aa32ddf260 2023-10-07T00:14:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.768+0000 7f1824ff9700 1 -- 172.21.15.5:0/1952464858 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f182c0132d0 con 0x55aa32ddf260 2023-10-07T00:14:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.768+0000 7f1824ff9700 1 -- 172.21.15.5:0/1952464858 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1838042030 con 0x55aa32ddf260 2023-10-07T00:14:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.769+0000 7f1856e7cb80 10 client.25897 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.769+0000 7f1856e7cb80 10 client.25897 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:14:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.769+0000 7f1856e7cb80 20 client.25897 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.769+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55aa32e498c0 0x55aa32e4bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.769+0000 7f1856e7cb80 4 client.25897 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.769+0000 7f1856e7cb80 1 -- 172.21.15.5:0/1952464858 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55aa32d2ab30 con 0x55aa32e498c0 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.770+0000 7f1840b9a700 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55aa32e498c0 0x55aa32e4bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.770+0000 7f1840b9a700 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55aa32e498c0 0x55aa32e4bce0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e2b579226580aeb server_cookie=335e673da81f0844 in_seq=0 out_seq=0 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.770+0000 7f1824ff9700 10 client.25897 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.770+0000 7f1824ff9700 1 -- 172.21.15.5:0/1952464858 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55aa32d2ab30 con 0x55aa32e498c0 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.770+0000 7f1824ff9700 10 client.25897 handle_command_reply: tid=0 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.770+0000 7f1856e7cb80 1 client.25897 shutdown 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 -- 172.21.15.5:0/1952464858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 msgr2=0x55aa32dec510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32dec510 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f183800fa30 tx=0x7f183800bcb0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 -- 172.21.15.5:0/1952464858 shutdown_connections 2023-10-07T00:14:46.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x55aa32e498c0 0x55aa32e4bce0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa32de0a60 0x55aa32defa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa32ddf260 0x55aa32dec510 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 --2- 172.21.15.5:0/1952464858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55aa32ddfbc0 0x55aa32deca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1824ff9700 0 client.25897 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:14:46.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 -- 172.21.15.5:0/1952464858 >> 172.21.15.5:0/1952464858 conn(0x55aa32d53260 msgr2=0x55aa32de3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 -- 172.21.15.5:0/1952464858 shutdown_connections 2023-10-07T00:14:46.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.771+0000 7f1856e7cb80 1 -- 172.21.15.5:0/1952464858 wait complete. 2023-10-07T00:14:46.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.772+0000 7f1856e7cb80 20 client.25897 trim_cache size 0 max 16384 2023-10-07T00:14:46.774 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 -- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18280a1500 msgr2=0x7f18280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18280a1500 0x7f18280a39c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1838009fd0 tx=0x7f1838019040 comp rx=0 tx=0).stop 2023-10-07T00:14:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 -- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f183c104b70 msgr2=0x7f183c1ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f183c104b70 0x7f183c1ad330 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f183400efc0 tx=0x7f183400c3a0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 -- 172.21.15.5:0/1655059404 shutdown_connections 2023-10-07T00:14:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18280a1500 0x7f18280a39c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f183c104b70 0x7f183c1ad330 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c0ff830 0x7f183c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 --2- 172.21.15.5:0/1655059404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1021a0 0x7f183c06fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 -- 172.21.15.5:0/1655059404 >> 172.21.15.5:0/1655059404 conn(0x7f183c0fb450 msgr2=0x7f183c102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 -- 172.21.15.5:0/1655059404 shutdown_connections 2023-10-07T00:14:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:46.773+0000 7f18435ff700 1 -- 172.21.15.5:0/1655059404 wait complete. 2023-10-07T00:14:46.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-07T00:14:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.102+0000 7f93719ff700 1 -- 172.21.15.5:0/685840059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f936c100190 msgr2=0x7f936c100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.102+0000 7f93719ff700 1 --2- 172.21.15.5:0/685840059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f936c100190 0x7f936c100610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93540098f0 tx=0x7f9354009c00 comp rx=0 tx=0).stop 2023-10-07T00:14:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.103+0000 7f93719ff700 1 -- 172.21.15.5:0/685840059 shutdown_connections 2023-10-07T00:14:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.103+0000 7f93719ff700 1 --2- 172.21.15.5:0/685840059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936c100b50 0x7f936c100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.103+0000 7f93719ff700 1 --2- 172.21.15.5:0/685840059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f936c0ff830 0x7f936c0ffc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.103+0000 7f93719ff700 1 --2- 172.21.15.5:0/685840059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f936c100190 0x7f936c100610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.103+0000 7f93719ff700 1 -- 172.21.15.5:0/685840059 >> 172.21.15.5:0/685840059 conn(0x7f936c0fb450 msgr2=0x7f936c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.103+0000 7f93719ff700 1 -- 172.21.15.5:0/685840059 shutdown_connections 2023-10-07T00:14:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.103+0000 7f93719ff700 1 -- 172.21.15.5:0/685840059 wait complete. 2023-10-07T00:14:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.104+0000 7f93719ff700 1 Processor -- start 2023-10-07T00:14:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.104+0000 7f93719ff700 1 -- start start 2023-10-07T00:14:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.104+0000 7f93719ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f936c0ff830 0x7f936c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.104+0000 7f93719ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f936c100190 0x7f936c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.105+0000 7f93719ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936c100b50 0x7f936c1a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.105+0000 7f93719ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1a09a0 con 0x7f936c100b50 2023-10-07T00:14:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.105+0000 7f93719ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1a0ae0 con 0x7f936c100190 2023-10-07T00:14:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.105+0000 7f93719ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1a0c70 con 0x7f936c0ff830 2023-10-07T00:14:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.105+0000 7f936affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f936c0ff830 0x7f936c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.105+0000 7f936affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f936c0ff830 0x7f936c198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55130/0 (socket says 172.21.15.5:55130) 2023-10-07T00:14:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.105+0000 7f936affd700 1 -- 172.21.15.5:0/951973188 learned_addr learned my addr 172.21.15.5:0/951973188 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.105+0000 7f936b7fe700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936c100b50 0x7f936c1a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.106+0000 7f93627fc700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f936c100190 0x7f936c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.106+0000 7f936affd700 1 -- 172.21.15.5:0/951973188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f936c100190 msgr2=0x7f936c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.106+0000 7f936affd700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f936c100190 0x7f936c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.106+0000 7f936affd700 1 -- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936c100b50 msgr2=0x7f936c1a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.106+0000 7f936affd700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936c100b50 0x7f936c1a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.106+0000 7f936affd700 1 -- 172.21.15.5:0/951973188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9354009520 con 0x7f936c0ff830 2023-10-07T00:14:47.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.107+0000 7f936affd700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f936c0ff830 0x7f936c198e20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f935c0060b0 tx=0x7f935c007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:46 smithi005 ceph-mon[129406]: pgmap v406: 97 pgs: 97 active+clean; 44 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 2.9 MiB/s wr, 166 op/s 2023-10-07T00:14:47.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.107+0000 7f93709fd700 1 -- 172.21.15.5:0/951973188 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c00de20 con 0x7f936c0ff830 2023-10-07T00:14:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.107+0000 7f93709fd700 1 -- 172.21.15.5:0/951973188 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f935c00f040 con 0x7f936c0ff830 2023-10-07T00:14:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.107+0000 7f93709fd700 1 -- 172.21.15.5:0/951973188 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c014690 con 0x7f936c0ff830 2023-10-07T00:14:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.108+0000 7f93719ff700 1 -- 172.21.15.5:0/951973188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c101aa0 con 0x7f936c0ff830 2023-10-07T00:14:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.108+0000 7f93719ff700 1 -- 172.21.15.5:0/951973188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c101f60 con 0x7f936c0ff830 2023-10-07T00:14:47.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.113+0000 7f93709fd700 1 -- 172.21.15.5:0/951973188 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f935c015400 con 0x7f936c0ff830 2023-10-07T00:14:47.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.114+0000 7f93853e1b80 1 Processor -- start 2023-10-07T00:14:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.115+0000 7f93853e1b80 1 -- start start 2023-10-07T00:14:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.116+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 0x555e95750680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.116+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95751480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.116+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95751a60 0x555e95751ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.116+0000 7f93853e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e956b8460 con 0x555e95750260 2023-10-07T00:14:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.116+0000 7f93853e1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e956a9c20 con 0x555e95750bc0 2023-10-07T00:14:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.116+0000 7f93853e1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e956a7540 con 0x555e95751a60 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f93627fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95751a60 0x555e95751ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f93627fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95751a60 0x555e95751ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55132/0 (socket says 172.21.15.5:55132) 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f93627fc700 1 -- 172.21.15.5:0/3165393397 learned_addr learned my addr 172.21.15.5:0/3165393397 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f936b7fe700 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 0x555e95750680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f936affd700 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95751480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f93627fc700 1 -- 172.21.15.5:0/3165393397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 msgr2=0x555e95751480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f93627fc700 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95751480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f93627fc700 1 -- 172.21.15.5:0/3165393397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 msgr2=0x555e95750680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f93627fc700 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 0x555e95750680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.117+0000 7f93627fc700 1 -- 172.21.15.5:0/3165393397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e954cdde0 con 0x555e95751a60 2023-10-07T00:14:47.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.118+0000 7f93709fd700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93580a1580 0x7f93580a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.118+0000 7f93627fc700 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95751a60 0x555e95751ee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93540098f0 tx=0x7f9354009480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b06ae819b4f86d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.118+0000 7f93709fd700 1 -- 172.21.15.5:0/951973188 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f935c0cc590 con 0x7f936c0ff830 2023-10-07T00:14:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.119+0000 7f9361ffb700 1 -- 172.21.15.5:0/3165393397 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935401c040 con 0x555e95751a60 2023-10-07T00:14:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.119+0000 7f9361ffb700 1 -- 172.21.15.5:0/3165393397 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f935400b560 con 0x555e95751a60 2023-10-07T00:14:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.119+0000 7f9361ffb700 1 -- 172.21.15.5:0/3165393397 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354005370 con 0x555e95751a60 2023-10-07T00:14:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.119+0000 7f936b7fe700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93580a1580 0x7f93580a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.120+0000 7f93853e1b80 1 -- 172.21.15.5:0/3165393397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95751a60 msgr2=0x555e95751ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.120+0000 7f93853e1b80 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95751a60 0x555e95751ee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93540098f0 tx=0x7f9354009480 comp rx=0 tx=0).stop 2023-10-07T00:14:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.121+0000 7f93853e1b80 1 -- 172.21.15.5:0/3165393397 shutdown_connections 2023-10-07T00:14:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.121+0000 7f93853e1b80 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95751a60 0x555e95751ee0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.121+0000 7f93853e1b80 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 0x555e95750680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.121+0000 7f93853e1b80 1 --2- 172.21.15.5:0/3165393397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95751480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.121+0000 7f93853e1b80 1 -- 172.21.15.5:0/3165393397 >> 172.21.15.5:0/3165393397 conn(0x555e956c4260 msgr2=0x555e9574b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.121+0000 7f936b7fe700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93580a1580 0x7f93580a3a40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9364005fd0 tx=0x7f9364009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.122+0000 7f93853e1b80 1 -- 172.21.15.5:0/3165393397 shutdown_connections 2023-10-07T00:14:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.122+0000 7f93853e1b80 1 -- 172.21.15.5:0/3165393397 wait complete. 2023-10-07T00:14:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.122+0000 7f93853e1b80 1 -- start start 2023-10-07T00:14:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.123+0000 7f93853e1b80 1 Processor -- start 2023-10-07T00:14:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750260 0x555e9576b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e9576b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95772580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f93853e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e956a2e30 con 0x555e95751a60 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f93853e1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9563f710 con 0x555e95750260 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f93853e1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9563f3b0 con 0x555e95750bc0 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f93853e1b80 10 client.0 _ll_register_callbacks cb 0x555e9549c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f936affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750260 0x555e9576b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f936affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750260 0x555e9576b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55682/0 (socket says 172.21.15.5:55682) 2023-10-07T00:14:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.124+0000 7f936affd700 1 -- 172.21.15.5:0/2272386670 learned_addr learned my addr 172.21.15.5:0/2272386670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f936affd700 1 -- 172.21.15.5:0/2272386670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 msgr2=0x555e9576b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f936affd700 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e9576b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f936affd700 1 -- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 msgr2=0x555e95772580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f936b7fe700 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95772580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f936affd700 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95772580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f936affd700 1 -- 172.21.15.5:0/2272386670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c10bfc0 con 0x555e95750260 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f936b7fe700 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95772580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f936affd700 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750260 0x555e9576b000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f935c095d30 tx=0x7f935c007490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=737f973f2d48b3ed server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.125+0000 7f934affd700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.126+0000 7f934affd700 1 -- 172.21.15.5:0/2272386670 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c099190 con 0x555e95750260 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.126+0000 7f934affd700 1 -- 172.21.15.5:0/2272386670 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f935c015a00 con 0x555e95750260 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.126+0000 7f93853e1b80 1 -- 172.21.15.5:0/2272386670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e95742f10 con 0x555e95750260 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.126+0000 7f934affd700 1 -- 172.21.15.5:0/2272386670 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f935c099f30 con 0x555e95750260 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.126+0000 7f93853e1b80 10 client.25940 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.126+0000 7f93853e1b80 1 -- 172.21.15.5:0/2272386670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555e954b6c60 con 0x555e95750260 2023-10-07T00:14:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.127+0000 7f934affd700 1 -- 172.21.15.5:0/2272386670 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555e95742f10 con 0x555e95750260 2023-10-07T00:14:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.127+0000 7f934affd700 1 -- 172.21.15.5:0/2272386670 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f935c0b90b0 con 0x555e95750260 2023-10-07T00:14:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.127+0000 7f93853e1b80 10 client.25940 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.127+0000 7f93853e1b80 10 client.25940 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:14:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.127+0000 7f93853e1b80 20 client.25940 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.127+0000 7f93853e1b80 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x555e95776dd0 0x555e957791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.127+0000 7f93853e1b80 4 client.25940 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.127+0000 7f93853e1b80 1 -- 172.21.15.5:0/2272386670 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e9569be10 con 0x555e95776dd0 2023-10-07T00:14:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.130+0000 7f93627fc700 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x555e95776dd0 0x555e957791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.130+0000 7f93627fc700 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x555e95776dd0 0x555e957791f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1fcaa0d6e0e0e569 server_cookie=353da2546de2e3d6 in_seq=0 out_seq=0 2023-10-07T00:14:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.131+0000 7f934affd700 10 client.25940 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:14:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f934affd700 1 -- 172.21.15.5:0/2272386670 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555e9569be10 con 0x555e95776dd0 2023-10-07T00:14:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f934affd700 10 client.25940 handle_command_reply: tid=0 2023-10-07T00:14:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 client.25940 shutdown 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 -- 172.21.15.5:0/2272386670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750260 msgr2=0x555e9576b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750260 0x555e9576b000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f935c095d30 tx=0x7f935c007490 comp rx=0 tx=0).stop 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 -- 172.21.15.5:0/2272386670 shutdown_connections 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x555e95776dd0 0x555e957791f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95772580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750260 0x555e9576b000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 --2- 172.21.15.5:0/2272386670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e9576b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f93853e1b80 1 -- 172.21.15.5:0/2272386670 >> 172.21.15.5:0/2272386670 conn(0x555e956c4260 msgr2=0x555e9574af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.135+0000 7f934affd700 0 client.25940 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:14:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.136+0000 7f93853e1b80 1 -- 172.21.15.5:0/2272386670 shutdown_connections 2023-10-07T00:14:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.136+0000 7f93853e1b80 1 -- 172.21.15.5:0/2272386670 wait complete. 2023-10-07T00:14:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.136+0000 7f93853e1b80 20 client.25940 trim_cache size 0 max 16384 2023-10-07T00:14:47.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.161+0000 7f93853e1b80 1 Processor -- start 2023-10-07T00:14:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.161+0000 7f93853e1b80 1 -- start start 2023-10-07T00:14:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.161+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 0x555e95757e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.161+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e95772540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.161+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95751a60 0x555e9574af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.161+0000 7f93853e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9576a340 con 0x555e95750260 2023-10-07T00:14:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.161+0000 7f93853e1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e95523920 con 0x555e95751a60 2023-10-07T00:14:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.161+0000 7f93853e1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9576a4b0 con 0x555e95750bc0 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f93627fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e95772540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f93627fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e95772540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55142/0 (socket says 172.21.15.5:55142) 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f93627fc700 1 -- 172.21.15.5:0/914480146 learned_addr learned my addr 172.21.15.5:0/914480146 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f936b7fe700 1 --2- 172.21.15.5:0/914480146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95751a60 0x555e9574af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f93627fc700 1 -- 172.21.15.5:0/914480146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95751a60 msgr2=0x555e9574af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f93627fc700 1 --2- 172.21.15.5:0/914480146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95751a60 0x555e9574af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f93627fc700 1 -- 172.21.15.5:0/914480146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 msgr2=0x555e95757e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f93627fc700 1 --2- 172.21.15.5:0/914480146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 0x555e95757e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.162+0000 7f93627fc700 1 -- 172.21.15.5:0/914480146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e954f4250 con 0x555e95750bc0 2023-10-07T00:14:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.163+0000 7f93627fc700 1 --2- 172.21.15.5:0/914480146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e95772540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9354009810 tx=0x7f9354005900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4148325f50a67605 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.163+0000 7f9362ffd700 1 -- 172.21.15.5:0/914480146 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354033030 con 0x555e95750bc0 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.164+0000 7f9362ffd700 1 -- 172.21.15.5:0/914480146 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f935400f460 con 0x555e95750bc0 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.164+0000 7f9362ffd700 1 -- 172.21.15.5:0/914480146 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935401c040 con 0x555e95750bc0 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 -- 172.21.15.5:0/914480146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 msgr2=0x555e95772540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 --2- 172.21.15.5:0/914480146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e95772540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9354009810 tx=0x7f9354005900 comp rx=0 tx=0).stop 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 -- 172.21.15.5:0/914480146 shutdown_connections 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 --2- 172.21.15.5:0/914480146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95751a60 0x555e9574af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 --2- 172.21.15.5:0/914480146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95750260 0x555e95757e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 --2- 172.21.15.5:0/914480146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750bc0 0x555e95772540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 -- 172.21.15.5:0/914480146 >> 172.21.15.5:0/914480146 conn(0x555e956c4260 msgr2=0x555e95778de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 -- 172.21.15.5:0/914480146 shutdown_connections 2023-10-07T00:14:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.165+0000 7f93853e1b80 1 -- 172.21.15.5:0/914480146 wait complete. 2023-10-07T00:14:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.166+0000 7f93853e1b80 1 -- start start 2023-10-07T00:14:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.166+0000 7f93853e1b80 1 Processor -- start 2023-10-07T00:14:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.167+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750260 0x555e9576e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.167+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95770c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.167+0000 7f93853e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95771160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.167+0000 7f93853e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e95771870 con 0x555e95751a60 2023-10-07T00:14:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.167+0000 7f93853e1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e957719e0 con 0x555e95750bc0 2023-10-07T00:14:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.167+0000 7f93853e1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e95771ba0 con 0x555e95750260 2023-10-07T00:14:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.167+0000 7f93853e1b80 10 client.0 _ll_register_callbacks cb 0x7f935c015d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.167+0000 7f93627fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95770c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f936affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750260 0x555e9576e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f93627fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95770c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55702/0 (socket says 172.21.15.5:55702) 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f93627fc700 1 -- 172.21.15.5:0/1821238761 learned_addr learned my addr 172.21.15.5:0/1821238761 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f936affd700 1 -- 172.21.15.5:0/1821238761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 msgr2=0x555e95770c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f936b7fe700 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95771160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f936affd700 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95770c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f936affd700 1 -- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 msgr2=0x555e95771160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f936affd700 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95771160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f936affd700 1 -- 172.21.15.5:0/1821238761 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e954cdde0 con 0x555e95750260 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.168+0000 7f936b7fe700 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95771160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.169+0000 7f936affd700 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750260 0x555e9576e6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f935c097b80 tx=0x7f935c0b92e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2822ae1559521c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.169+0000 7f934affd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.169+0000 7f934affd700 1 -- 172.21.15.5:0/1821238761 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c099600 con 0x555e95750260 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.169+0000 7f934affd700 1 -- 172.21.15.5:0/1821238761 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f935c015a00 con 0x555e95750260 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.169+0000 7f93853e1b80 1 -- 172.21.15.5:0/1821238761 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f935400b560 con 0x555e95750260 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.169+0000 7f934affd700 1 -- 172.21.15.5:0/1821238761 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f935c084310 con 0x555e95750260 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.169+0000 7f93853e1b80 10 client.25912 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.169+0000 7f93853e1b80 1 -- 172.21.15.5:0/1821238761 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555e954cc2b0 con 0x555e95750260 2023-10-07T00:14:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.170+0000 7f934affd700 1 -- 172.21.15.5:0/1821238761 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f935400b560 con 0x555e95750260 2023-10-07T00:14:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.170+0000 7f934affd700 1 -- 172.21.15.5:0/1821238761 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f935c098d20 con 0x555e95750260 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.170+0000 7f93853e1b80 10 client.25912 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.170+0000 7f93853e1b80 10 client.25912 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.170+0000 7f93853e1b80 20 client.25912 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.170+0000 7f93853e1b80 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x555e957dc5a0 0x555e957de9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.170+0000 7f93853e1b80 4 client.25912 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.170+0000 7f93853e1b80 1 -- 172.21.15.5:0/1821238761 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555e9569bb30 con 0x555e957dc5a0 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.171+0000 7f93627fc700 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x555e957dc5a0 0x555e957de9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.171+0000 7f93627fc700 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x555e957dc5a0 0x555e957de9c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53df3fc1fc2a10b5 server_cookie=cda92c36848a0eb3 in_seq=0 out_seq=0 2023-10-07T00:14:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.171+0000 7f934affd700 10 client.25912 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:14:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.174+0000 7f934affd700 1 -- 172.21.15.5:0/1821238761 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555e9569bb30 con 0x555e957dc5a0 2023-10-07T00:14:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.174+0000 7f934affd700 10 client.25912 handle_command_reply: tid=0 2023-10-07T00:14:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.174+0000 7f93853e1b80 1 client.25912 shutdown 2023-10-07T00:14:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.174+0000 7f93853e1b80 1 -- 172.21.15.5:0/1821238761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750260 msgr2=0x555e9576e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.174+0000 7f93853e1b80 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750260 0x555e9576e6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f935c097b80 tx=0x7f935c0b92e0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 1 -- 172.21.15.5:0/1821238761 shutdown_connections 2023-10-07T00:14:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x555e957dc5a0 0x555e957de9c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e95751a60 0x555e95771160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e95750260 0x555e9576e6d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 1 --2- 172.21.15.5:0/1821238761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e95750bc0 0x555e95770c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f934affd700 0 client.25912 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:14:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 1 -- 172.21.15.5:0/1821238761 >> 172.21.15.5:0/1821238761 conn(0x555e956c4260 msgr2=0x555e95754970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 1 -- 172.21.15.5:0/1821238761 shutdown_connections 2023-10-07T00:14:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 1 -- 172.21.15.5:0/1821238761 wait complete. 2023-10-07T00:14:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.175+0000 7f93853e1b80 20 client.25912 trim_cache size 0 max 16384 2023-10-07T00:14:47.178 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.176+0000 7f93719ff700 1 -- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93580a1580 msgr2=0x7f93580a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.176+0000 7f93719ff700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93580a1580 0x7f93580a3a40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9364005fd0 tx=0x7f9364009310 comp rx=0 tx=0).stop 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.176+0000 7f93719ff700 1 -- 172.21.15.5:0/951973188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f936c0ff830 msgr2=0x7f936c198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.176+0000 7f93719ff700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f936c0ff830 0x7f936c198e20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f935c0060b0 tx=0x7f935c007f90 comp rx=0 tx=0).stop 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.177+0000 7f93719ff700 1 -- 172.21.15.5:0/951973188 shutdown_connections 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.177+0000 7f93719ff700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f93580a1580 0x7f93580a3a40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.177+0000 7f93719ff700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936c100b50 0x7f936c1a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.177+0000 7f93719ff700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f936c0ff830 0x7f936c198e20 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f935c0060b0 tx=0x7f935c007f90 comp rx=0 tx=0).stop 2023-10-07T00:14:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.177+0000 7f93719ff700 1 --2- 172.21.15.5:0/951973188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f936c100190 0x7f936c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.177+0000 7f93719ff700 1 -- 172.21.15.5:0/951973188 >> 172.21.15.5:0/951973188 conn(0x7f936c0fb450 msgr2=0x7f936c0fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.177+0000 7f93719ff700 1 -- 172.21.15.5:0/951973188 shutdown_connections 2023-10-07T00:14:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.177+0000 7f93719ff700 1 -- 172.21.15.5:0/951973188 wait complete. 2023-10-07T00:14:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:46 smithi088 ceph-mon[103111]: pgmap v406: 97 pgs: 97 active+clean; 44 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 2.9 MiB/s wr, 166 op/s 2023-10-07T00:14:47.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-07T00:14:47.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:46 smithi112 ceph-mon[133548]: pgmap v406: 97 pgs: 97 active+clean; 44 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 2.9 MiB/s wr, 166 op/s 2023-10-07T00:14:47.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.515+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1998799229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ba40ff830 msgr2=0x7f0ba4101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.515+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1998799229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ba40ff830 0x7f0ba4101c60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b0a0 tx=0x7f0b9400b3b0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.515+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1998799229 shutdown_connections 2023-10-07T00:14:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.515+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1998799229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ba4104b70 0x7f0ba4104ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.515+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1998799229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ba40ff830 0x7f0ba4101c60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.515+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1998799229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ba41021a0 0x7f0ba4104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.515+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1998799229 >> 172.21.15.5:0/1998799229 conn(0x7f0ba40fb450 msgr2=0x7f0ba40fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.515+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1998799229 shutdown_connections 2023-10-07T00:14:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.516+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1998799229 wait complete. 2023-10-07T00:14:47.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.517+0000 7f0ba9fff700 1 Processor -- start 2023-10-07T00:14:47.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.518+0000 7f0ba9fff700 1 -- start start 2023-10-07T00:14:47.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.518+0000 7f0ba9fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ba40ff830 0x7f0ba419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.518+0000 7f0ba9fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ba41021a0 0x7f0ba419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.518+0000 7f0ba9fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ba4104b70 0x7f0ba41a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.518+0000 7f0ba9fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba41a4ce0 con 0x7f0ba41021a0 2023-10-07T00:14:47.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.518+0000 7f0ba9fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba41a4e20 con 0x7f0ba40ff830 2023-10-07T00:14:47.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.518+0000 7f0ba9fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba41a4fb0 con 0x7f0ba4104b70 2023-10-07T00:14:47.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0b9affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ba41021a0 0x7f0ba419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0b9affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ba41021a0 0x7f0ba419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40604/0 (socket says 172.21.15.5:40604) 2023-10-07T00:14:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0b9affd700 1 -- 172.21.15.5:0/1307516499 learned_addr learned my addr 172.21.15.5:0/1307516499 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0ba37fe700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ba40ff830 0x7f0ba419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0ba3fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ba4104b70 0x7f0ba41a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0b9affd700 1 -- 172.21.15.5:0/1307516499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ba4104b70 msgr2=0x7f0ba41a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0b9affd700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ba4104b70 0x7f0ba41a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0b9affd700 1 -- 172.21.15.5:0/1307516499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ba40ff830 msgr2=0x7f0ba419d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0b9affd700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ba40ff830 0x7f0ba419d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.519+0000 7f0b9affd700 1 -- 172.21.15.5:0/1307516499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b94009d00 con 0x7f0ba41021a0 2023-10-07T00:14:47.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.520+0000 7f0b9affd700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ba41021a0 0x7f0ba419d6a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00e9a0 tx=0x7f0b8c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.520+0000 7f0ba17fa700 1 -- 172.21.15.5:0/1307516499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c009790 con 0x7f0ba41021a0 2023-10-07T00:14:47.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.520+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1307516499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba41a5290 con 0x7f0ba41021a0 2023-10-07T00:14:47.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.520+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1307516499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba41a57f0 con 0x7f0ba41021a0 2023-10-07T00:14:47.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.520+0000 7f0ba17fa700 1 -- 172.21.15.5:0/1307516499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8c00cbd0 con 0x7f0ba41021a0 2023-10-07T00:14:47.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.520+0000 7f0ba17fa700 1 -- 172.21.15.5:0/1307516499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c018680 con 0x7f0ba41021a0 2023-10-07T00:14:47.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.525+0000 7f0ba17fa700 1 -- 172.21.15.5:0/1307516499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0b8c0187e0 con 0x7f0ba41021a0 2023-10-07T00:14:47.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.527+0000 7f0bbd9efb80 1 Processor -- start 2023-10-07T00:14:47.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.527+0000 7f0ba17fa700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0b900a15d0 0x7f0b900a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.527+0000 7f0ba17fa700 1 -- 172.21.15.5:0/1307516499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0b8c014070 con 0x7f0ba41021a0 2023-10-07T00:14:47.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.528+0000 7f0bbd9efb80 1 -- start start 2023-10-07T00:14:47.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.528+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56865680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.528+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865bc0 0x564c56866480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.528+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 0x564c56866ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.528+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c567cd460 con 0x564c56866a60 2023-10-07T00:14:47.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.528+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c567bec20 con 0x564c56865bc0 2023-10-07T00:14:47.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.528+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c567bc540 con 0x564c56865260 2023-10-07T00:14:47.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.528+0000 7f0ba3fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0b900a15d0 0x7f0b900a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0b9affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865bc0 0x564c56866480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56865680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0b9affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865bc0 0x564c56866480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55730/0 (socket says 172.21.15.5:55730) 2023-10-07T00:14:47.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0b9affd700 1 -- 172.21.15.5:0/582121086 learned_addr learned my addr 172.21.15.5:0/582121086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0b9affd700 1 -- 172.21.15.5:0/582121086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 msgr2=0x564c56865680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0b9affd700 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56865680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0b9affd700 1 -- 172.21.15.5:0/582121086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 msgr2=0x564c56866ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0ba3fff700 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 0x564c56866ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0b9affd700 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 0x564c56866ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0b9affd700 1 -- 172.21.15.5:0/582121086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c565e2de0 con 0x564c56865bc0 2023-10-07T00:14:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.529+0000 7f0ba3fff700 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 0x564c56866ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.530+0000 7f0b9affd700 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865bc0 0x564c56866480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c000c00 tx=0x7f0b8c099a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682633e32799dbb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.530+0000 7f0ba3fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0b900a15d0 0x7f0b900a3a90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00ae00 tx=0x7f0b9c0126d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.530+0000 7f0b99ffb700 1 -- 172.21.15.5:0/582121086 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c09a0f0 con 0x564c56865bc0 2023-10-07T00:14:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.530+0000 7f0b99ffb700 1 -- 172.21.15.5:0/582121086 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8c09e240 con 0x564c56865bc0 2023-10-07T00:14:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.530+0000 7f0b99ffb700 1 -- 172.21.15.5:0/582121086 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c099840 con 0x564c56865bc0 2023-10-07T00:14:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.531+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/582121086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865bc0 msgr2=0x564c56866480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.531+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865bc0 0x564c56866480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c000c00 tx=0x7f0b8c099a50 comp rx=0 tx=0).stop 2023-10-07T00:14:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.531+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/582121086 shutdown_connections 2023-10-07T00:14:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.531+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 0x564c56866ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.531+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56865680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.531+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/582121086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865bc0 0x564c56866480 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.531+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/582121086 >> 172.21.15.5:0/582121086 conn(0x564c567d9260 msgr2=0x564c56860140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.532+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/582121086 shutdown_connections 2023-10-07T00:14:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.532+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/582121086 wait complete. 2023-10-07T00:14:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.532+0000 7f0bbd9efb80 1 -- start start 2023-10-07T00:14:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.533+0000 7f0bbd9efb80 1 Processor -- start 2023-10-07T00:14:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.533+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56880090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.533+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56865bc0 0x564c568805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.533+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c56887610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.533+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c567b7e30 con 0x564c56865bc0 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.533+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c56754710 con 0x564c56866a60 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.533+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c567543b0 con 0x564c56865260 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.533+0000 7f0bbd9efb80 10 client.0 _ll_register_callbacks cb 0x564c565b1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.534+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56880090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.534+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56880090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55186/0 (socket says 172.21.15.5:55186) 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.534+0000 7f0ba37fe700 1 -- 172.21.15.5:0/2550135608 learned_addr learned my addr 172.21.15.5:0/2550135608 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.534+0000 7f0ba37fe700 1 -- 172.21.15.5:0/2550135608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 msgr2=0x564c56887610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T00:14:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.534+0000 7f0ba37fe700 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c56887610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.534+0000 7f0ba37fe700 1 -- 172.21.15.5:0/2550135608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56865bc0 msgr2=0x564c568805d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.534+0000 7f0ba37fe700 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56865bc0 0x564c568805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.534+0000 7f0ba37fe700 1 -- 172.21.15.5:0/2550135608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba41a57f0 con 0x564c56865260 2023-10-07T00:14:47.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.535+0000 7f0ba37fe700 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56880090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0b94015000 tx=0x7f0b94007830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4652aa1020eca75b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.535+0000 7f0b82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:14:47.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.535+0000 7f0b82ffd700 1 -- 172.21.15.5:0/2550135608 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400e040 con 0x564c56865260 2023-10-07T00:14:47.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.535+0000 7f0b82ffd700 1 -- 172.21.15.5:0/2550135608 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0b94005040 con 0x564c56865260 2023-10-07T00:14:47.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.535+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2550135608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c56857f10 con 0x564c56865260 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0b82ffd700 1 -- 172.21.15.5:0/2550135608 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b94005240 con 0x564c56865260 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0bbd9efb80 10 client.25924 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2550135608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564c565cbc60 con 0x564c56865260 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0b82ffd700 1 -- 172.21.15.5:0/2550135608 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564c56857f10 con 0x564c56865260 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0b82ffd700 1 -- 172.21.15.5:0/2550135608 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0b94025030 con 0x564c56865260 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0bbd9efb80 10 client.25924 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0bbd9efb80 10 client.25924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0bbd9efb80 20 client.25924 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564c5688bf00 0x564c5688e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0bbd9efb80 4 client.25924 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.536+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2550135608 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c567b0e10 con 0x564c5688bf00 2023-10-07T00:14:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.537+0000 7f0b9affd700 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564c5688bf00 0x564c5688e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.537+0000 7f0b9affd700 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564c5688bf00 0x564c5688e320 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee9a88ce0cb30b5 server_cookie=a31c8d39c287f39f in_seq=0 out_seq=0 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.537+0000 7f0b82ffd700 10 client.25924 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.538+0000 7f0b82ffd700 1 -- 172.21.15.5:0/2550135608 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564c567b0e10 con 0x564c5688bf00 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.538+0000 7f0b82ffd700 10 client.25924 handle_command_reply: tid=0 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.538+0000 7f0bbd9efb80 1 client.25924 shutdown 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2550135608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 msgr2=0x564c56880090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56880090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0b94015000 tx=0x7f0b94007830 comp rx=0 tx=0).stop 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2550135608 shutdown_connections 2023-10-07T00:14:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564c5688bf00 0x564c5688e320 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c56887610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56880090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2550135608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56865bc0 0x564c568805d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2550135608 >> 172.21.15.5:0/2550135608 conn(0x564c567d9260 msgr2=0x564c5685ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0b82ffd700 0 client.25924 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2550135608 shutdown_connections 2023-10-07T00:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.539+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2550135608 wait complete. 2023-10-07T00:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.540+0000 7f0bbd9efb80 20 client.25924 trim_cache size 0 max 16384 2023-10-07T00:14:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.562+0000 7f0bbd9efb80 1 Processor -- start 2023-10-07T00:14:47.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.562+0000 7f0bbd9efb80 1 -- start start 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.562+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865260 0x564c56869970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.562+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865bc0 0x564c56869eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.562+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 0x564c56887530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.563+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c56638920 con 0x564c56866a60 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.563+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c56881110 con 0x564c56865260 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.563+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c56861270 con 0x564c56865bc0 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.563+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865260 0x564c56869970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.563+0000 7f0b9affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865bc0 0x564c56869eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.563+0000 7f0b9affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865bc0 0x564c56869eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55188/0 (socket says 172.21.15.5:55188) 2023-10-07T00:14:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.563+0000 7f0b9affd700 1 -- 172.21.15.5:0/2823147744 learned_addr learned my addr 172.21.15.5:0/2823147744 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.564+0000 7f0b9affd700 1 -- 172.21.15.5:0/2823147744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865260 msgr2=0x564c56869970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.564+0000 7f0b9affd700 1 --2- 172.21.15.5:0/2823147744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865260 0x564c56869970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.564+0000 7f0b9affd700 1 -- 172.21.15.5:0/2823147744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 msgr2=0x564c56887530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.564+0000 7f0b9affd700 1 --2- 172.21.15.5:0/2823147744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 0x564c56887530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.564+0000 7f0b9affd700 1 -- 172.21.15.5:0/2823147744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c5685c140 con 0x564c56865bc0 2023-10-07T00:14:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.564+0000 7f0b9affd700 1 --2- 172.21.15.5:0/2823147744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865bc0 0x564c56869eb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c01e000 tx=0x7f0b8c09a670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c756252cb404a6e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.565+0000 7f0b9a7fc700 1 -- 172.21.15.5:0/2823147744 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0a2500 con 0x564c56865bc0 2023-10-07T00:14:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.565+0000 7f0b9a7fc700 1 -- 172.21.15.5:0/2823147744 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8c00cd40 con 0x564c56865bc0 2023-10-07T00:14:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.565+0000 7f0b9a7fc700 1 -- 172.21.15.5:0/2823147744 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0a2250 con 0x564c56865bc0 2023-10-07T00:14:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.566+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2823147744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865bc0 msgr2=0x564c56869eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.566+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2823147744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865bc0 0x564c56869eb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c01e000 tx=0x7f0b8c09a670 comp rx=0 tx=0).stop 2023-10-07T00:14:47.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.566+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2823147744 shutdown_connections 2023-10-07T00:14:47.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.566+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2823147744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56866a60 0x564c56887530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.566+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2823147744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56865260 0x564c56869970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.566+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/2823147744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865bc0 0x564c56869eb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.566+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2823147744 >> 172.21.15.5:0/2823147744 conn(0x564c567d9260 msgr2=0x564c5686ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.567+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2823147744 shutdown_connections 2023-10-07T00:14:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.567+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/2823147744 wait complete. 2023-10-07T00:14:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.567+0000 7f0bbd9efb80 1 -- start start 2023-10-07T00:14:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.568+0000 7f0bbd9efb80 1 Processor -- start 2023-10-07T00:14:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.568+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56881750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.568+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56865bc0 0x564c56881cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.568+0000 7f0bbd9efb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c568869e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.568+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c56886f20 con 0x564c56865bc0 2023-10-07T00:14:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.568+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c56887090 con 0x564c56866a60 2023-10-07T00:14:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.568+0000 7f0bbd9efb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c56887250 con 0x564c56865260 2023-10-07T00:14:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.568+0000 7f0bbd9efb80 10 client.0 _ll_register_callbacks cb 0x7f0b9400bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.569+0000 7f0ba3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c568869e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.569+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56881750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.569+0000 7f0ba3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c568869e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55766/0 (socket says 172.21.15.5:55766) 2023-10-07T00:14:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.569+0000 7f0ba3fff700 1 -- 172.21.15.5:0/3001414728 learned_addr learned my addr 172.21.15.5:0/3001414728 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.570+0000 7f0ba3fff700 1 -- 172.21.15.5:0/3001414728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 msgr2=0x564c56881750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.570+0000 7f0ba3fff700 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56881750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.570+0000 7f0ba3fff700 1 -- 172.21.15.5:0/3001414728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56865bc0 msgr2=0x564c56881cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.570+0000 7f0ba3fff700 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56865bc0 0x564c56881cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.570+0000 7f0ba3fff700 1 -- 172.21.15.5:0/3001414728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c565e2de0 con 0x564c56866a60 2023-10-07T00:14:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.571+0000 7f0ba3fff700 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c568869e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00a630 tx=0x7f0b9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e8e97590cac566f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.571+0000 7f0b82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.571+0000 7f0b82ffd700 1 -- 172.21.15.5:0/3001414728 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c010b10 con 0x564c56866a60 2023-10-07T00:14:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.571+0000 7f0b82ffd700 1 -- 172.21.15.5:0/3001414728 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0b9c010c70 con 0x564c56866a60 2023-10-07T00:14:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.571+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/3001414728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b8c09e240 con 0x564c56866a60 2023-10-07T00:14:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.571+0000 7f0b82ffd700 1 -- 172.21.15.5:0/3001414728 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b9c010e30 con 0x564c56866a60 2023-10-07T00:14:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.571+0000 7f0bbd9efb80 10 client.25961 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.571+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/3001414728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564c56609250 con 0x564c56866a60 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0b82ffd700 1 -- 172.21.15.5:0/3001414728 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8c09e240 con 0x564c56866a60 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0b82ffd700 1 -- 172.21.15.5:0/3001414728 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0b9c031430 con 0x564c56866a60 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0bbd9efb80 10 client.25961 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0bbd9efb80 10 client.25961 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0bbd9efb80 20 client.25961 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564c568f1e60 0x564c568f4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0bbd9efb80 4 client.25961 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:14:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/3001414728 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564c567b0b30 con 0x564c568f1e60 2023-10-07T00:14:47.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.573+0000 7f0ba37fe700 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564c568f1e60 0x564c568f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.574+0000 7f0ba37fe700 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564c568f1e60 0x564c568f4280 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=193a0b55fe94a463 server_cookie=344f04240df6575c in_seq=0 out_seq=0 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.574+0000 7f0b82ffd700 10 client.25961 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.574+0000 7f0b82ffd700 1 -- 172.21.15.5:0/3001414728 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564c567b0b30 con 0x564c568f1e60 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.574+0000 7f0b82ffd700 10 client.25961 handle_command_reply: tid=0 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.574+0000 7f0bbd9efb80 1 client.25961 shutdown 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/3001414728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 msgr2=0x564c568869e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c568869e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00a630 tx=0x7f0b9c004750 comp rx=0 tx=0).stop 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/3001414728 shutdown_connections 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564c568f1e60 0x564c568f4280 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564c56866a60 0x564c568869e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564c56865260 0x564c56881750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 --2- 172.21.15.5:0/3001414728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564c56865bc0 0x564c56881cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/3001414728 >> 172.21.15.5:0/3001414728 conn(0x564c567d9260 msgr2=0x564c56869970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0b82ffd700 0 client.25961 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:47.578 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:14:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/3001414728 shutdown_connections 2023-10-07T00:14:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.575+0000 7f0bbd9efb80 1 -- 172.21.15.5:0/3001414728 wait complete. 2023-10-07T00:14:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.576+0000 7f0bbd9efb80 20 client.25961 trim_cache size 0 max 16384 2023-10-07T00:14:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.576+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0b900a15d0 msgr2=0x7f0b900a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.576+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0b900a15d0 0x7f0b900a3a90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00ae00 tx=0x7f0b9c0126d0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.576+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ba41021a0 msgr2=0x7f0ba419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.576+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ba41021a0 0x7f0ba419d6a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00e9a0 tx=0x7f0b8c00ecb0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.577+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1307516499 shutdown_connections 2023-10-07T00:14:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.577+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0b900a15d0 0x7f0b900a3a90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.577+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ba4104b70 0x7f0ba41a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.577+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ba40ff830 0x7f0ba419d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.577+0000 7f0ba9fff700 1 --2- 172.21.15.5:0/1307516499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ba41021a0 0x7f0ba419d6a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.577+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1307516499 >> 172.21.15.5:0/1307516499 conn(0x7f0ba40fb450 msgr2=0x7f0ba4102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.577+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1307516499 shutdown_connections 2023-10-07T00:14:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:47.577+0000 7f0ba9fff700 1 -- 172.21.15.5:0/1307516499 wait complete. 2023-10-07T00:14:47.764 INFO:tasks.workunit.client.0.smithi005.stdout: 13 6880 417 4026 315 662 165 2023-10-07T00:14:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.394+0000 7f8c407ff700 1 -- 172.21.15.5:0/2020277070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c3810d4d0 msgr2=0x7f8c3810f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.394+0000 7f8c407ff700 1 --2- 172.21.15.5:0/2020277070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c3810d4d0 0x7f8c3810f8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8c300098f0 tx=0x7f8c30009c00 comp rx=0 tx=0).stop 2023-10-07T00:14:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.394+0000 7f8c407ff700 1 -- 172.21.15.5:0/2020277070 shutdown_connections 2023-10-07T00:14:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.394+0000 7f8c407ff700 1 --2- 172.21.15.5:0/2020277070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c3810d4d0 0x7f8c3810f8c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.394+0000 7f8c407ff700 1 --2- 172.21.15.5:0/2020277070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38074ef0 0x7f8c38073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.394+0000 7f8c407ff700 1 --2- 172.21.15.5:0/2020277070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38073910 0x7f8c38073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.394+0000 7f8c407ff700 1 -- 172.21.15.5:0/2020277070 >> 172.21.15.5:0/2020277070 conn(0x7f8c380fc470 msgr2=0x7f8c380fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.395+0000 7f8c407ff700 1 -- 172.21.15.5:0/2020277070 shutdown_connections 2023-10-07T00:14:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.395+0000 7f8c407ff700 1 -- 172.21.15.5:0/2020277070 wait complete. 2023-10-07T00:14:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.396+0000 7f8c407ff700 1 Processor -- start 2023-10-07T00:14:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.397+0000 7f8c407ff700 1 -- start start 2023-10-07T00:14:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.397+0000 7f8c407ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38073910 0x7f8c3806c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.397+0000 7f8c407ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38074ef0 0x7f8c3806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.397+0000 7f8c407ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c3810d4d0 0x7f8c38071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.397+0000 7f8c407ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38071b20 con 0x7f8c38074ef0 2023-10-07T00:14:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.397+0000 7f8c407ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38071c90 con 0x7f8c3810d4d0 2023-10-07T00:14:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.397+0000 7f8c407ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38071e50 con 0x7f8c38073910 2023-10-07T00:14:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.398+0000 7f8c3ed9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c3810d4d0 0x7f8c38071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.398+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38073910 0x7f8c3806c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.398+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38073910 0x7f8c3806c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55214/0 (socket says 172.21.15.5:55214) 2023-10-07T00:14:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.398+0000 7f8c3e59b700 1 -- 172.21.15.5:0/3961107633 learned_addr learned my addr 172.21.15.5:0/3961107633 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.399+0000 7f8c3dd9a700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38074ef0 0x7f8c3806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.399+0000 7f8c3e59b700 1 -- 172.21.15.5:0/3961107633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c3810d4d0 msgr2=0x7f8c38071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.399+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c3810d4d0 0x7f8c38071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.399+0000 7f8c3e59b700 1 -- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38074ef0 msgr2=0x7f8c3806ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.399+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38074ef0 0x7f8c3806ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.399+0000 7f8c3e59b700 1 -- 172.21.15.5:0/3961107633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30009520 con 0x7f8c38073910 2023-10-07T00:14:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.399+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38073910 0x7f8c3806c8e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c01c430 tx=0x7f8c2c01c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.399+0000 7f8c377fe700 1 -- 172.21.15.5:0/3961107633 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c00c070 con 0x7f8c38073910 2023-10-07T00:14:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.400+0000 7f8c407ff700 1 -- 172.21.15.5:0/3961107633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c380720d0 con 0x7f8c38073910 2023-10-07T00:14:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.400+0000 7f8c407ff700 1 -- 172.21.15.5:0/3961107633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c38072630 con 0x7f8c38073910 2023-10-07T00:14:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.400+0000 7f8c377fe700 1 -- 172.21.15.5:0/3961107633 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c2c004bb0 con 0x7f8c38073910 2023-10-07T00:14:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.400+0000 7f8c377fe700 1 -- 172.21.15.5:0/3961107633 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c018d60 con 0x7f8c38073910 2023-10-07T00:14:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.404+0000 7f8c377fe700 1 -- 172.21.15.5:0/3961107633 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8c2c01a0d0 con 0x7f8c38073910 2023-10-07T00:14:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.406+0000 7f8c5416cb80 1 Processor -- start 2023-10-07T00:14:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.408+0000 7f8c5416cb80 1 -- start start 2023-10-07T00:14:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.408+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce34ec0 0x55b84ce352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce36450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 0x55b84ce3d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84cd9d400 con 0x55b84ce34ec0 2023-10-07T00:14:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84cd8ebc0 con 0x55b84ce36990 2023-10-07T00:14:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84cd8c4e0 con 0x55b84ce35fd0 2023-10-07T00:14:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c377fe700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8c280a1500 0x7f8c280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c377fe700 1 -- 172.21.15.5:0/3961107633 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8c2c0cc7c0 con 0x7f8c38073910 2023-10-07T00:14:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce36450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce36450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55222/0 (socket says 172.21.15.5:55222) 2023-10-07T00:14:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.409+0000 7f8c3e59b700 1 -- 172.21.15.5:0/1665791255 learned_addr learned my addr 172.21.15.5:0/1665791255 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c3e59b700 1 -- 172.21.15.5:0/1665791255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 msgr2=0x55b84ce3d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/1665791255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 0x55b84ce3d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c3e59b700 1 -- 172.21.15.5:0/1665791255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce34ec0 msgr2=0x55b84ce352e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/1665791255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce34ec0 0x55b84ce352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c3e59b700 1 -- 172.21.15.5:0/1665791255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b84cbb2d80 con 0x55b84ce35fd0 2023-10-07T00:14:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/1665791255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce36450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c095f60 tx=0x7f8c2c099830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=306a5edaed4a3144 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8c280a1500 0x7f8c280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c34ff9700 1 -- 172.21.15.5:0/1665791255 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0993c0 con 0x55b84ce35fd0 2023-10-07T00:14:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c34ff9700 1 -- 172.21.15.5:0/1665791255 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c2c0185d0 con 0x55b84ce35fd0 2023-10-07T00:14:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.410+0000 7f8c34ff9700 1 -- 172.21.15.5:0/1665791255 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0ca350 con 0x55b84ce35fd0 2023-10-07T00:14:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.411+0000 7f8c5416cb80 1 -- 172.21.15.5:0/1665791255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 msgr2=0x55b84ce36450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.411+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/1665791255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce36450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c095f60 tx=0x7f8c2c099830 comp rx=0 tx=0).stop 2023-10-07T00:14:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.412+0000 7f8c5416cb80 1 -- 172.21.15.5:0/1665791255 shutdown_connections 2023-10-07T00:14:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.412+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/1665791255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 0x55b84ce3d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.412+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/1665791255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce34ec0 0x55b84ce352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.412+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/1665791255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce36450 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.412+0000 7f8c5416cb80 1 -- 172.21.15.5:0/1665791255 >> 172.21.15.5:0/1665791255 conn(0x55b84cda9200 msgr2=0x55b84ce2fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.412+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8c280a1500 0x7f8c280a39c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005e90 tx=0x7f8c30019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.412+0000 7f8c5416cb80 1 -- 172.21.15.5:0/1665791255 shutdown_connections 2023-10-07T00:14:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.412+0000 7f8c5416cb80 1 -- 172.21.15.5:0/1665791255 wait complete. 2023-10-07T00:14:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.413+0000 7f8c5416cb80 1 -- start start 2023-10-07T00:14:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.413+0000 7f8c5416cb80 1 Processor -- start 2023-10-07T00:14:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.414+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce34ec0 0x55b84ce3ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.414+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce3f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.414+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce36990 0x55b84ce461b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.414+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84cd87dd0 con 0x55b84ce36990 2023-10-07T00:14:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.414+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84cd246b0 con 0x55b84ce34ec0 2023-10-07T00:14:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.414+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84cd24350 con 0x55b84ce35fd0 2023-10-07T00:14:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.414+0000 7f8c5416cb80 10 client.0 _ll_register_callbacks cb 0x55b84cb817a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.414+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce34ec0 0x55b84ce3ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce34ec0 0x55b84ce3ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55810/0 (socket says 172.21.15.5:55810) 2023-10-07T00:14:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3e59b700 1 -- 172.21.15.5:0/3076770936 learned_addr learned my addr 172.21.15.5:0/3076770936 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3dd9a700 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce3f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce36990 0x55b84ce461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3e59b700 1 -- 172.21.15.5:0/3076770936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 msgr2=0x55b84ce3f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce3f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3e59b700 1 -- 172.21.15.5:0/3076770936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce36990 msgr2=0x55b84ce461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce36990 0x55b84ce461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3e59b700 1 -- 172.21.15.5:0/3076770936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c38072630 con 0x55b84ce34ec0 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce36990 0x55b84ce461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce34ec0 0x55b84ce3ec30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c018760 tx=0x7f8c2c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa89f413e3c985e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.415+0000 7f8c21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.416+0000 7f8c21ffb700 1 -- 172.21.15.5:0/3076770936 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c09a160 con 0x55b84ce34ec0 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.416+0000 7f8c21ffb700 1 -- 172.21.15.5:0/3076770936 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8c2c0b2160 con 0x55b84ce34ec0 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.416+0000 7f8c5416cb80 1 -- 172.21.15.5:0/3076770936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b84ce27d50 con 0x55b84ce34ec0 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.416+0000 7f8c21ffb700 1 -- 172.21.15.5:0/3076770936 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c2c0b2360 con 0x55b84ce34ec0 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.416+0000 7f8c5416cb80 10 client.25970 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.416+0000 7f8c5416cb80 1 -- 172.21.15.5:0/3076770936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b84cb9bc00 con 0x55b84ce34ec0 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.416+0000 7f8c21ffb700 1 -- 172.21.15.5:0/3076770936 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b84ce27d50 con 0x55b84ce34ec0 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.417+0000 7f8c21ffb700 1 -- 172.21.15.5:0/3076770936 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8c2c065640 con 0x55b84ce34ec0 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.417+0000 7f8c5416cb80 10 client.25970 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.417+0000 7f8c5416cb80 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.417+0000 7f8c5416cb80 20 client.25970 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.417+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b84ce4a7a0 0x55b84ce4cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.417+0000 7f8c5416cb80 4 client.25970 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.417+0000 7f8c5416cb80 1 -- 172.21.15.5:0/3076770936 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b84cd80db0 con 0x55b84ce4a7a0 2023-10-07T00:14:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.417+0000 7f8c3dd9a700 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b84ce4a7a0 0x55b84ce4cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.418+0000 7f8c3dd9a700 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b84ce4a7a0 0x55b84ce4cbc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cdace7b6eeba0c server_cookie=ebbcb20cb3aba10e in_seq=0 out_seq=0 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.418+0000 7f8c21ffb700 10 client.25970 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.419+0000 7f8c21ffb700 1 -- 172.21.15.5:0/3076770936 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b84cd80db0 con 0x55b84ce4a7a0 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.419+0000 7f8c21ffb700 10 client.25970 handle_command_reply: tid=0 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.419+0000 7f8c5416cb80 1 client.25970 shutdown 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.419+0000 7f8c5416cb80 1 -- 172.21.15.5:0/3076770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce34ec0 msgr2=0x55b84ce3ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.419+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce34ec0 0x55b84ce3ec30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c018760 tx=0x7f8c2c004ad0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.420+0000 7f8c5416cb80 1 -- 172.21.15.5:0/3076770936 shutdown_connections 2023-10-07T00:14:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.420+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b84ce4a7a0 0x55b84ce4cbc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.420+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce36990 0x55b84ce461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.420+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce34ec0 0x55b84ce3ec30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.420+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/3076770936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce35fd0 0x55b84ce3f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.420+0000 7f8c5416cb80 1 -- 172.21.15.5:0/3076770936 >> 172.21.15.5:0/3076770936 conn(0x55b84cda9200 msgr2=0x55b84ce2f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.420+0000 7f8c21ffb700 0 client.25970 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.421+0000 7f8c5416cb80 1 -- 172.21.15.5:0/3076770936 shutdown_connections 2023-10-07T00:14:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.421+0000 7f8c5416cb80 1 -- 172.21.15.5:0/3076770936 wait complete. 2023-10-07T00:14:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.421+0000 7f8c5416cb80 20 client.25970 trim_cache size 0 max 16384 2023-10-07T00:14:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.448+0000 7f8c5416cb80 1 Processor -- start 2023-10-07T00:14:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c5416cb80 1 -- start start 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce34ec0 0x55b84ce3d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce35fd0 0x55b84ce46170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce36990 0x55b84ce399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84cc088c0 con 0x55b84ce34ec0 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84ce3e7a0 con 0x55b84ce35fd0 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84ce3fb00 con 0x55b84ce36990 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c3ed9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce36990 0x55b84ce399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c3ed9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce36990 0x55b84ce399d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55238/0 (socket says 172.21.15.5:55238) 2023-10-07T00:14:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.449+0000 7f8c3ed9c700 1 -- 172.21.15.5:0/750180670 learned_addr learned my addr 172.21.15.5:0/750180670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.450+0000 7f8c3dd9a700 1 --2- 172.21.15.5:0/750180670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce35fd0 0x55b84ce46170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.450+0000 7f8c3ed9c700 1 -- 172.21.15.5:0/750180670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce35fd0 msgr2=0x55b84ce46170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.450+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/750180670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce35fd0 0x55b84ce46170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.450+0000 7f8c3ed9c700 1 -- 172.21.15.5:0/750180670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce34ec0 msgr2=0x55b84ce3d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.450+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/750180670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce34ec0 0x55b84ce3d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.450+0000 7f8c3ed9c700 1 -- 172.21.15.5:0/750180670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b84cbd91f0 con 0x55b84ce36990 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.450+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/750180670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce36990 0x55b84ce399d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c300092a0 tx=0x7f8c3001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71cd161b579a336d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.451+0000 7f8c357fa700 1 -- 172.21.15.5:0/750180670 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000b820 con 0x55b84ce36990 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.451+0000 7f8c357fa700 1 -- 172.21.15.5:0/750180670 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c30029050 con 0x55b84ce36990 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.451+0000 7f8c357fa700 1 -- 172.21.15.5:0/750180670 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c300038e0 con 0x55b84ce36990 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 -- 172.21.15.5:0/750180670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce36990 msgr2=0x55b84ce399d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/750180670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce36990 0x55b84ce399d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c300092a0 tx=0x7f8c3001c000 comp rx=0 tx=0).stop 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 -- 172.21.15.5:0/750180670 shutdown_connections 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/750180670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce36990 0x55b84ce399d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/750180670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce34ec0 0x55b84ce3d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/750180670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce35fd0 0x55b84ce46170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 -- 172.21.15.5:0/750180670 >> 172.21.15.5:0/750180670 conn(0x55b84cda9200 msgr2=0x55b84ce46980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 -- 172.21.15.5:0/750180670 shutdown_connections 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.452+0000 7f8c5416cb80 1 -- 172.21.15.5:0/750180670 wait complete. 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.453+0000 7f8c5416cb80 1 -- start start 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.453+0000 7f8c5416cb80 1 Processor -- start 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.454+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce34ec0 0x55b84ce436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.454+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce35fd0 0x55b84ce43c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.454+0000 7f8c5416cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 0x55b84ce44c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.454+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84ce45160 con 0x55b84ce35fd0 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.454+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84ce452d0 con 0x55b84ce36990 2023-10-07T00:14:48.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.454+0000 7f8c5416cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84ce45490 con 0x55b84ce34ec0 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.454+0000 7f8c5416cb80 10 client.0 _ll_register_callbacks cb 0x7f8c2c095da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.455+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce34ec0 0x55b84ce436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.455+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce34ec0 0x55b84ce436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55248/0 (socket says 172.21.15.5:55248) 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.455+0000 7f8c3e59b700 1 -- 172.21.15.5:0/79385416 learned_addr learned my addr 172.21.15.5:0/79385416 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.455+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 0x55b84ce44c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.455+0000 7f8c3dd9a700 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce35fd0 0x55b84ce43c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.456+0000 7f8c3ed9c700 1 -- 172.21.15.5:0/79385416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce34ec0 msgr2=0x55b84ce436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.456+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce34ec0 0x55b84ce436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.456+0000 7f8c3ed9c700 1 -- 172.21.15.5:0/79385416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce35fd0 msgr2=0x55b84ce43c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.456+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce35fd0 0x55b84ce43c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.456+0000 7f8c3ed9c700 1 -- 172.21.15.5:0/79385416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c38110270 con 0x55b84ce36990 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.457+0000 7f8c3ed9c700 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 0x55b84ce44c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009fd0 tx=0x7f8c30005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72adc86393c89523 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.457+0000 7f8c21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.457+0000 7f8c21ffb700 1 -- 172.21.15.5:0/79385416 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30003880 con 0x55b84ce36990 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.457+0000 7f8c21ffb700 1 -- 172.21.15.5:0/79385416 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8c300056b0 con 0x55b84ce36990 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.457+0000 7f8c5416cb80 1 -- 172.21.15.5:0/79385416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c2c0185d0 con 0x55b84ce36990 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.458+0000 7f8c21ffb700 1 -- 172.21.15.5:0/79385416 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c300039e0 con 0x55b84ce36990 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.458+0000 7f8c5416cb80 10 client.25973 fetch_fsmap learned FSMap version 29 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.458+0000 7f8c5416cb80 1 -- 172.21.15.5:0/79385416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b84cbb1250 con 0x55b84ce36990 2023-10-07T00:14:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.459+0000 7f8c21ffb700 1 -- 172.21.15.5:0/79385416 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c2c0185d0 con 0x55b84ce36990 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.459+0000 7f8c21ffb700 1 -- 172.21.15.5:0/79385416 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8c30041b00 con 0x55b84ce36990 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.459+0000 7f8c5416cb80 10 client.25973 fetch_fsmap finished waiting for FSMap version 29 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.459+0000 7f8c5416cb80 10 client.25973 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.459+0000 7f8c5416cb80 20 client.25973 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.459+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b84ce9e940 0x55b84cea0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.459+0000 7f8c5416cb80 4 client.25973 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.459+0000 7f8c5416cb80 1 -- 172.21.15.5:0/79385416 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b84cd80ad0 con 0x55b84ce9e940 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.460+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b84ce9e940 0x55b84cea0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.461+0000 7f8c21ffb700 10 client.25973 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.461+0000 7f8c3e59b700 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b84ce9e940 0x55b84cea0d60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38a7212be687e71 server_cookie=1794d4ebf9faaa0f in_seq=0 out_seq=0 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.478+0000 7f8c21ffb700 1 -- 172.21.15.5:0/79385416 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b84cd80ad0 con 0x55b84ce9e940 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.478+0000 7f8c21ffb700 10 client.25973 handle_command_reply: tid=0 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.478+0000 7f8c5416cb80 1 client.25973 shutdown 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 -- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 msgr2=0x55b84ce44c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 0x55b84ce44c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009fd0 tx=0x7f8c30005270 comp rx=0 tx=0).stop 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 -- 172.21.15.5:0/79385416 shutdown_connections 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55b84ce9e940 0x55b84cea0d60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b84ce36990 0x55b84ce44c20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b84ce34ec0 0x55b84ce436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 --2- 172.21.15.5:0/79385416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b84ce35fd0 0x55b84ce43c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 -- 172.21.15.5:0/79385416 >> 172.21.15.5:0/79385416 conn(0x55b84cda9200 msgr2=0x55b84ce46980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c21ffb700 0 client.25973 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 -- 172.21.15.5:0/79385416 shutdown_connections 2023-10-07T00:14:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.479+0000 7f8c5416cb80 1 -- 172.21.15.5:0/79385416 wait complete. 2023-10-07T00:14:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.480+0000 7f8c5416cb80 20 client.25973 trim_cache size 0 max 16384 2023-10-07T00:14:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:14:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:14:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:14:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:14:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.480+0000 7f8c407ff700 1 -- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8c280a1500 msgr2=0x7f8c280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.480+0000 7f8c407ff700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8c280a1500 0x7f8c280a39c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005e90 tx=0x7f8c30019040 comp rx=0 tx=0).stop 2023-10-07T00:14:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.480+0000 7f8c407ff700 1 -- 172.21.15.5:0/3961107633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38073910 msgr2=0x7f8c3806c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.480+0000 7f8c407ff700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38073910 0x7f8c3806c8e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c01c430 tx=0x7f8c2c01c740 comp rx=0 tx=0).stop 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.481+0000 7f8c407ff700 1 -- 172.21.15.5:0/3961107633 shutdown_connections 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.481+0000 7f8c407ff700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8c280a1500 0x7f8c280a39c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.481+0000 7f8c407ff700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c3810d4d0 0x7f8c38071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.481+0000 7f8c407ff700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38073910 0x7f8c3806c8e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.481+0000 7f8c407ff700 1 --2- 172.21.15.5:0/3961107633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38074ef0 0x7f8c3806ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.481+0000 7f8c407ff700 1 -- 172.21.15.5:0/3961107633 >> 172.21.15.5:0/3961107633 conn(0x7f8c380fc470 msgr2=0x7f8c380fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.481+0000 7f8c407ff700 1 -- 172.21.15.5:0/3961107633 shutdown_connections 2023-10-07T00:14:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:14:48.481+0000 7f8c407ff700 1 -- 172.21.15.5:0/3961107633 wait complete. 2023-10-07T00:14:48.606 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-07T00:14:48.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-07T00:14:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.928+0000 7f7542dff700 1 -- 172.21.15.5:0/1538830192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c107eb0 msgr2=0x7f753c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.928+0000 7f7542dff700 1 --2- 172.21.15.5:0/1538830192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c107eb0 0x7f753c10a2e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7530009990 tx=0x7f7530009ca0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.928+0000 7f7542dff700 1 -- 172.21.15.5:0/1538830192 shutdown_connections 2023-10-07T00:14:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.928+0000 7f7542dff700 1 --2- 172.21.15.5:0/1538830192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753c10aca0 0x7f753c113b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.928+0000 7f7542dff700 1 --2- 172.21.15.5:0/1538830192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c107eb0 0x7f753c10a2e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.928+0000 7f7542dff700 1 --2- 172.21.15.5:0/1538830192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c10a820 0x7f753c1115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.928+0000 7f7542dff700 1 -- 172.21.15.5:0/1538830192 >> 172.21.15.5:0/1538830192 conn(0x7f753c06e160 msgr2=0x7f753c0705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.929+0000 7f7542dff700 1 -- 172.21.15.5:0/1538830192 shutdown_connections 2023-10-07T00:14:48.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.929+0000 7f7542dff700 1 -- 172.21.15.5:0/1538830192 wait complete. 2023-10-07T00:14:48.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.930+0000 7f7542dff700 1 Processor -- start 2023-10-07T00:14:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.931+0000 7f7542dff700 1 -- start start 2023-10-07T00:14:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.931+0000 7f7542dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c107eb0 0x7f753c10eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.931+0000 7f7542dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753c10a820 0x7f753c10f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.931+0000 7f7542dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c10aca0 0x7f753c10b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.931+0000 7f7542dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c10be70 con 0x7f753c107eb0 2023-10-07T00:14:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.931+0000 7f7542dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c10bfe0 con 0x7f753c10a820 2023-10-07T00:14:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.931+0000 7f7542dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c10c1a0 con 0x7f753c10aca0 2023-10-07T00:14:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.932+0000 7f754139c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c10aca0 0x7f753c10b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.932+0000 7f754139c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c10aca0 0x7f753c10b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55258/0 (socket says 172.21.15.5:55258) 2023-10-07T00:14:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.932+0000 7f754139c700 1 -- 172.21.15.5:0/1065093719 learned_addr learned my addr 172.21.15.5:0/1065093719 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.933+0000 7f7540b9b700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c107eb0 0x7f753c10eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.933+0000 7f754139c700 1 -- 172.21.15.5:0/1065093719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753c10a820 msgr2=0x7f753c10f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.933+0000 7f754139c700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753c10a820 0x7f753c10f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.933+0000 7f754139c700 1 -- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c107eb0 msgr2=0x7f753c10eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.933+0000 7f754139c700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c107eb0 0x7f753c10eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.933+0000 7f754139c700 1 -- 172.21.15.5:0/1065093719 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300095f0 con 0x7f753c10aca0 2023-10-07T00:14:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.933+0000 7f754139c700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c10aca0 0x7f753c10b6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f753400ef30 tx=0x7f753400c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.934+0000 7f7539ffb700 1 -- 172.21.15.5:0/1065093719 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534018070 con 0x7f753c10aca0 2023-10-07T00:14:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.934+0000 7f7539ffb700 1 -- 172.21.15.5:0/1065093719 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f753400f040 con 0x7f753c10aca0 2023-10-07T00:14:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.934+0000 7f7539ffb700 1 -- 172.21.15.5:0/1065093719 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534003d00 con 0x7f753c10aca0 2023-10-07T00:14:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.934+0000 7f7542dff700 1 -- 172.21.15.5:0/1065093719 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c1a1290 con 0x7f753c10aca0 2023-10-07T00:14:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.934+0000 7f7542dff700 1 -- 172.21.15.5:0/1065093719 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c1a1750 con 0x7f753c10aca0 2023-10-07T00:14:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.940+0000 7f755668cb80 1 Processor -- start 2023-10-07T00:14:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.940+0000 7f755668cb80 1 -- start start 2023-10-07T00:14:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.940+0000 7f755668cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.940+0000 7f755668cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbba1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.940+0000 7f755668cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbba1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.940+0000 7f755668cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbb084e0 con 0x5619bbba02e0 2023-10-07T00:14:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.940+0000 7f755668cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbaf9ca0 con 0x5619bbba0c40 2023-10-07T00:14:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.940+0000 7f755668cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbaf75c0 con 0x5619bbba1ae0 2023-10-07T00:14:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.941+0000 7f7539ffb700 1 -- 172.21.15.5:0/1065093719 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f753400caa0 con 0x7f753c10aca0 2023-10-07T00:14:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.941+0000 7f7540b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbba1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.941+0000 7f7540b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbba1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55868/0 (socket says 172.21.15.5:55868) 2023-10-07T00:14:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.941+0000 7f7540b9b700 1 -- 172.21.15.5:0/3269882277 learned_addr learned my addr 172.21.15.5:0/3269882277 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.941+0000 7f753bfff700 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbba1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.941+0000 7f753bfff700 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7540b9b700 1 -- 172.21.15.5:0/3269882277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 msgr2=0x5619bbba1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7540b9b700 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbba1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7540b9b700 1 -- 172.21.15.5:0/3269882277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 msgr2=0x5619bbba0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7540b9b700 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7540b9b700 1 -- 172.21.15.5:0/3269882277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619bb91de60 con 0x5619bbba0c40 2023-10-07T00:14:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7540b9b700 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbba1500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7530009990 tx=0x7f7530005ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e31ecbf0694ef4e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7526ffd700 1 -- 172.21.15.5:0/3269882277 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530005400 con 0x5619bbba0c40 2023-10-07T00:14:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7526ffd700 1 -- 172.21.15.5:0/3269882277 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f753001e040 con 0x5619bbba0c40 2023-10-07T00:14:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.942+0000 7f7526ffd700 1 -- 172.21.15.5:0/3269882277 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000bac0 con 0x5619bbba0c40 2023-10-07T00:14:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.943+0000 7f7539ffb700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f752c0a1500 0x7f752c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.943+0000 7f7539ffb700 1 -- 172.21.15.5:0/1065093719 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f75340ccaf0 con 0x7f753c10aca0 2023-10-07T00:14:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.944+0000 7f753bfff700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f752c0a1500 0x7f752c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.944+0000 7f755668cb80 1 -- 172.21.15.5:0/3269882277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 msgr2=0x5619bbba1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.944+0000 7f755668cb80 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbba1500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7530009990 tx=0x7f7530005ee0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.945+0000 7f755668cb80 1 -- 172.21.15.5:0/3269882277 shutdown_connections 2023-10-07T00:14:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.945+0000 7f755668cb80 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbba1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.945+0000 7f755668cb80 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.945+0000 7f755668cb80 1 --2- 172.21.15.5:0/3269882277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbba1500 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.945+0000 7f755668cb80 1 -- 172.21.15.5:0/3269882277 >> 172.21.15.5:0/3269882277 conn(0x5619bbb142e0 msgr2=0x5619bbb9b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.945+0000 7f753bfff700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f752c0a1500 0x7f752c0a39c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7528005950 tx=0x7f75280058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.945+0000 7f755668cb80 1 -- 172.21.15.5:0/3269882277 shutdown_connections 2023-10-07T00:14:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.945+0000 7f755668cb80 1 -- 172.21.15.5:0/3269882277 wait complete. 2023-10-07T00:14:48.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.946+0000 7f755668cb80 1 -- start start 2023-10-07T00:14:48.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.946+0000 7f755668cb80 1 Processor -- start 2023-10-07T00:14:48.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f755668cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f755668cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba0c40 0x5619bbbaa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f755668cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba1ae0 0x5619bbbb1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f755668cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbaf2eb0 con 0x5619bbba02e0 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f755668cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bba8f790 con 0x5619bbba1ae0 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f755668cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bba8f430 con 0x5619bbba0c40 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f755668cb80 10 client.0 _ll_register_callbacks cb 0x5619bb8ec880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f7540b9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f7540b9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40760/0 (socket says 172.21.15.5:40760) 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f7540b9b700 1 -- 172.21.15.5:0/2401604108 learned_addr learned my addr 172.21.15.5:0/2401604108 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f754139c700 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba1ae0 0x5619bbbb1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f753bfff700 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba0c40 0x5619bbbaa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.947+0000 7f754139c700 1 -- 172.21.15.5:0/2401604108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba0c40 msgr2=0x5619bbbaa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f754139c700 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba0c40 0x5619bbbaa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f754139c700 1 -- 172.21.15.5:0/2401604108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 msgr2=0x5619bbba9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f754139c700 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f754139c700 1 -- 172.21.15.5:0/2401604108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c1146e0 con 0x5619bbba1ae0 2023-10-07T00:14:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f754139c700 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba1ae0 0x5619bbbb1510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f75340ca570 tx=0x7f753409a360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c4cf71c10b46904 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f751bfff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f751bfff700 1 -- 172.21.15.5:0/2401604108 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534004ad0 con 0x5619bbba1ae0 2023-10-07T00:14:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f751bfff700 1 -- 172.21.15.5:0/2401604108 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f753401b320 con 0x5619bbba1ae0 2023-10-07T00:14:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f755668cb80 1 -- 172.21.15.5:0/2401604108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619bbb92f90 con 0x5619bbba1ae0 2023-10-07T00:14:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f751bfff700 1 -- 172.21.15.5:0/2401604108 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f753409a520 con 0x5619bbba1ae0 2023-10-07T00:14:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f755668cb80 10 client.25982 fetch_fsmap learned FSMap version 30 2023-10-07T00:14:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.948+0000 7f755668cb80 1 -- 172.21.15.5:0/2401604108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5619bb906ce0 con 0x5619bbba1ae0 2023-10-07T00:14:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.949+0000 7f751bfff700 1 -- 172.21.15.5:0/2401604108 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75340b6030 con 0x5619bbba1ae0 2023-10-07T00:14:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.949+0000 7f751bfff700 1 -- 172.21.15.5:0/2401604108 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f75340a1c90 con 0x5619bbba1ae0 2023-10-07T00:14:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f755668cb80 10 client.25982 fetch_fsmap finished waiting for FSMap version 30 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f755668cb80 10 client.25982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f755668cb80 20 client.25982 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f755668cb80 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5619bbbb5da0 0x5619bbbb81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f755668cb80 4 client.25982 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f755668cb80 1 -- 172.21.15.5:0/2401604108 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5619bbaebe90 con 0x5619bbbb5da0 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f7540b9b700 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5619bbbb5da0 0x5619bbbb81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f751bfff700 10 client.25982 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.950+0000 7f7540b9b700 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5619bbbb5da0 0x5619bbbb81c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68d47bba88bde72f server_cookie=3d9de97d1e217948 in_seq=0 out_seq=0 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.951+0000 7f751bfff700 1 -- 172.21.15.5:0/2401604108 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5619bbaebe90 con 0x5619bbbb5da0 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.951+0000 7f751bfff700 10 client.25982 handle_command_reply: tid=0 2023-10-07T00:14:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 client.25982 shutdown 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 -- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba1ae0 msgr2=0x5619bbbb1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba1ae0 0x5619bbbb1510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f75340ca570 tx=0x7f753409a360 comp rx=0 tx=0).stop 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 -- 172.21.15.5:0/2401604108 shutdown_connections 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5619bbbb5da0 0x5619bbbb81c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba1ae0 0x5619bbbb1510 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbba9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f751bfff700 0 client.25982 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 --2- 172.21.15.5:0/2401604108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba0c40 0x5619bbbaa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.952+0000 7f755668cb80 1 -- 172.21.15.5:0/2401604108 >> 172.21.15.5:0/2401604108 conn(0x5619bbb142e0 msgr2=0x5619bbb9afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.953+0000 7f755668cb80 1 -- 172.21.15.5:0/2401604108 shutdown_connections 2023-10-07T00:14:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.953+0000 7f755668cb80 1 -- 172.21.15.5:0/2401604108 wait complete. 2023-10-07T00:14:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.955+0000 7f755668cb80 20 client.25982 trim_cache size 0 max 16384 2023-10-07T00:14:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.981+0000 7f755668cb80 1 Processor -- start 2023-10-07T00:14:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.981+0000 7f755668cb80 1 -- start start 2023-10-07T00:14:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.981+0000 7f755668cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbbaa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.981+0000 7f755668cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbbb14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.981+0000 7f755668cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbb9edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.981+0000 7f755668cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bb9739a0 con 0x5619bbba02e0 2023-10-07T00:14:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.981+0000 7f755668cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbaebe90 con 0x5619bbba0c40 2023-10-07T00:14:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.981+0000 7f755668cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbb9c0a0 con 0x5619bbba1ae0 2023-10-07T00:14:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.982+0000 7f753bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbbb14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.982+0000 7f7540b9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbbaa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.982+0000 7f753bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbbb14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55880/0 (socket says 172.21.15.5:55880) 2023-10-07T00:14:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.982+0000 7f753bfff700 1 -- 172.21.15.5:0/3170062844 learned_addr learned my addr 172.21.15.5:0/3170062844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.982+0000 7f754139c700 1 --2- 172.21.15.5:0/3170062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbb9edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f754139c700 1 -- 172.21.15.5:0/3170062844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 msgr2=0x5619bbbb14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f754139c700 1 --2- 172.21.15.5:0/3170062844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbbb14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f754139c700 1 -- 172.21.15.5:0/3170062844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 msgr2=0x5619bbbaa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f754139c700 1 --2- 172.21.15.5:0/3170062844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbbaa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f754139c700 1 -- 172.21.15.5:0/3170062844 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619bbbbce30 con 0x5619bbba1ae0 2023-10-07T00:14:48.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f754139c700 1 --2- 172.21.15.5:0/3170062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbb9edd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7534098170 tx=0x7f75340983d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94fea1adde592aac server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f75277fe700 1 -- 172.21.15.5:0/3170062844 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534004740 con 0x5619bbba1ae0 2023-10-07T00:14:48.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f75277fe700 1 -- 172.21.15.5:0/3170062844 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75340b6070 con 0x5619bbba1ae0 2023-10-07T00:14:48.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.983+0000 7f75277fe700 1 -- 172.21.15.5:0/3170062844 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753409a520 con 0x5619bbba1ae0 2023-10-07T00:14:48.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.984+0000 7f755668cb80 1 -- 172.21.15.5:0/3170062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 msgr2=0x5619bbb9edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:48.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.984+0000 7f755668cb80 1 --2- 172.21.15.5:0/3170062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbb9edd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7534098170 tx=0x7f75340983d0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.984+0000 7f755668cb80 1 -- 172.21.15.5:0/3170062844 shutdown_connections 2023-10-07T00:14:48.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.984+0000 7f755668cb80 1 --2- 172.21.15.5:0/3170062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbb9edd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.984+0000 7f755668cb80 1 --2- 172.21.15.5:0/3170062844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba02e0 0x5619bbbaa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.984+0000 7f755668cb80 1 --2- 172.21.15.5:0/3170062844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba0c40 0x5619bbbb14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.984+0000 7f755668cb80 1 -- 172.21.15.5:0/3170062844 >> 172.21.15.5:0/3170062844 conn(0x5619bbb142e0 msgr2=0x5619bbba9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.985+0000 7f755668cb80 1 -- 172.21.15.5:0/3170062844 shutdown_connections 2023-10-07T00:14:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.985+0000 7f755668cb80 1 -- 172.21.15.5:0/3170062844 wait complete. 2023-10-07T00:14:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.985+0000 7f755668cb80 1 -- start start 2023-10-07T00:14:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.986+0000 7f755668cb80 1 Processor -- start 2023-10-07T00:14:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.987+0000 7f755668cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba02e0 0x5619bbbadfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.987+0000 7f755668cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba0c40 0x5619bbbae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.987+0000 7f755668cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbc09c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:48.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.987+0000 7f755668cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbbb1530 con 0x5619bbba0c40 2023-10-07T00:14:48.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.987+0000 7f755668cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbbb16a0 con 0x5619bbba02e0 2023-10-07T00:14:48.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.987+0000 7f755668cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbbb1860 con 0x5619bbba1ae0 2023-10-07T00:14:48.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.987+0000 7f755668cb80 10 client.0 _ll_register_callbacks cb 0x7f7534099bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f7540b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba02e0 0x5619bbbadfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f7540b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba02e0 0x5619bbbadfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55882/0 (socket says 172.21.15.5:55882) 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f7540b9b700 1 -- 172.21.15.5:0/183591436 learned_addr learned my addr 172.21.15.5:0/183591436 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f753bfff700 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba0c40 0x5619bbbae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f754139c700 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbc09c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f7540b9b700 1 -- 172.21.15.5:0/183591436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 msgr2=0x5619bbc09c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f7540b9b700 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbc09c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f7540b9b700 1 -- 172.21.15.5:0/183591436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba0c40 msgr2=0x5619bbbae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f7540b9b700 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba0c40 0x5619bbbae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.988+0000 7f7540b9b700 1 -- 172.21.15.5:0/183591436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619bb906ce0 con 0x5619bbba02e0 2023-10-07T00:14:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.989+0000 7f7540b9b700 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba02e0 0x5619bbbadfd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7530004360 tx=0x7f7530005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f13890ffacb3d57 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.989+0000 7f751bfff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.989+0000 7f751bfff700 1 -- 172.21.15.5:0/183591436 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530003a90 con 0x5619bbba02e0 2023-10-07T00:14:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.989+0000 7f755668cb80 1 -- 172.21.15.5:0/183591436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f753001e040 con 0x5619bbba02e0 2023-10-07T00:14:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.989+0000 7f751bfff700 1 -- 172.21.15.5:0/183591436 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7530003bf0 con 0x5619bbba02e0 2023-10-07T00:14:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f751bfff700 1 -- 172.21.15.5:0/183591436 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f753000b740 con 0x5619bbba02e0 2023-10-07T00:14:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f755668cb80 10 client.25988 fetch_fsmap learned FSMap version 30 2023-10-07T00:14:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f755668cb80 1 -- 172.21.15.5:0/183591436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5619bbba8ff0 con 0x5619bbba02e0 2023-10-07T00:14:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f751bfff700 1 -- 172.21.15.5:0/183591436 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f753001e040 con 0x5619bbba02e0 2023-10-07T00:14:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f751bfff700 1 -- 172.21.15.5:0/183591436 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f75300099c0 con 0x5619bbba02e0 2023-10-07T00:14:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f755668cb80 10 client.25988 fetch_fsmap finished waiting for FSMap version 30 2023-10-07T00:14:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f755668cb80 10 client.25988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f755668cb80 20 client.25988 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f755668cb80 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5619bbc0b520 0x5619bbc0d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f755668cb80 4 client.25988 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-07T00:14:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.990+0000 7f755668cb80 1 -- 172.21.15.5:0/183591436 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5619bbaebbb0 con 0x5619bbc0b520 2023-10-07T00:14:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.991+0000 7f753bfff700 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5619bbc0b520 0x5619bbc0d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.991+0000 7f751bfff700 10 client.25988 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.991+0000 7f753bfff700 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5619bbc0b520 0x5619bbc0d940 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5015d678533bd46 server_cookie=dbb8444b4e39d231 in_seq=0 out_seq=0 2023-10-07T00:14:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.993+0000 7f751bfff700 1 -- 172.21.15.5:0/183591436 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5619bbaebbb0 con 0x5619bbc0b520 2023-10-07T00:14:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.993+0000 7f751bfff700 10 client.25988 handle_command_reply: tid=0 2023-10-07T00:14:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.993+0000 7f755668cb80 1 client.25988 shutdown 2023-10-07T00:14:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 -- 172.21.15.5:0/183591436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba02e0 msgr2=0x5619bbbadfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba02e0 0x5619bbbadfd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7530004360 tx=0x7f7530005700 comp rx=0 tx=0).stop 2023-10-07T00:14:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 -- 172.21.15.5:0/183591436 shutdown_connections 2023-10-07T00:14:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5619bbc0b520 0x5619bbc0d940 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5619bbba1ae0 0x5619bbc09c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5619bbba02e0 0x5619bbbadfd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 --2- 172.21.15.5:0/183591436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5619bbba0c40 0x5619bbbae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f751bfff700 0 client.25988 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 -- 172.21.15.5:0/183591436 >> 172.21.15.5:0/183591436 conn(0x5619bbb142e0 msgr2=0x5619bbb9a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 -- 172.21.15.5:0/183591436 shutdown_connections 2023-10-07T00:14:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.995+0000 7f755668cb80 1 -- 172.21.15.5:0/183591436 wait complete. 2023-10-07T00:14:49.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.996+0000 7f755668cb80 20 client.25988 trim_cache size 0 max 16384 2023-10-07T00:14:49.004 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:14:49.004 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2023-10-07T00:14:49.004 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "afff7b84-c672-4235-8d0d-2bf0423e0a15", 2023-10-07T00:14:49.004 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2023-10-07T00:14:49.005 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:14:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 -- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f752c0a1500 msgr2=0x7f752c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f752c0a1500 0x7f752c0a39c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7528005950 tx=0x7f75280058e0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 -- 172.21.15.5:0/1065093719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c10aca0 msgr2=0x7f753c10b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c10aca0 0x7f753c10b6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f753400ef30 tx=0x7f753400c450 comp rx=0 tx=0).stop 2023-10-07T00:14:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 -- 172.21.15.5:0/1065093719 shutdown_connections 2023-10-07T00:14:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f752c0a1500 0x7f752c0a39c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c10aca0 0x7f753c10b6d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c107eb0 0x7f753c10eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 --2- 172.21.15.5:0/1065093719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753c10a820 0x7f753c10f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.997+0000 7f7542dff700 1 -- 172.21.15.5:0/1065093719 >> 172.21.15.5:0/1065093719 conn(0x7f753c06e160 msgr2=0x7f753c06edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.998+0000 7f7542dff700 1 -- 172.21.15.5:0/1065093719 shutdown_connections 2023-10-07T00:14:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:48.999+0000 7f7542dff700 1 -- 172.21.15.5:0/1065093719 wait complete. 2023-10-07T00:14:49.014 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:48 smithi005 ceph-mon[129406]: pgmap v407: 97 pgs: 97 active+clean; 49 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.7 MiB/s wr, 153 op/s 2023-10-07T00:14:49.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:14:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:48 smithi088 ceph-mon[103111]: pgmap v407: 97 pgs: 97 active+clean; 49 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.7 MiB/s wr, 153 op/s 2023-10-07T00:14:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:48 smithi112 ceph-mon[133548]: pgmap v407: 97 pgs: 97 active+clean; 49 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.7 MiB/s wr, 153 op/s 2023-10-07T00:14:49.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 -- 172.21.15.5:0/2585926288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09010d590 msgr2=0x7ff09010f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 --2- 172.21.15.5:0/2585926288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09010d590 0x7ff09010f980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff08801a9a0 tx=0x7ff08801acb0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 -- 172.21.15.5:0/2585926288 shutdown_connections 2023-10-07T00:14:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 --2- 172.21.15.5:0/2585926288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09010d590 0x7ff09010f980 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 --2- 172.21.15.5:0/2585926288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff090074ef0 0x7ff090073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 --2- 172.21.15.5:0/2585926288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff090073910 0x7ff090073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 -- 172.21.15.5:0/2585926288 >> 172.21.15.5:0/2585926288 conn(0x7ff0900fc530 msgr2=0x7ff0900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 -- 172.21.15.5:0/2585926288 shutdown_connections 2023-10-07T00:14:49.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.356+0000 7ff096dff700 1 -- 172.21.15.5:0/2585926288 wait complete. 2023-10-07T00:14:49.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.358+0000 7ff096dff700 1 Processor -- start 2023-10-07T00:14:49.360 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:48.999+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020b [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.c auth v42 ap=1 s=2117 n(v0 rc2023-10-07T00:14:08.657513+0000 b2117 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c56c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020b:[<0x10000000208/blogbench.c v42>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x1000000020b:[<0x10000000208/blogbench.c v42>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.360 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.000+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000209 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.c auth v38 ap=1 s=729 n(v0 rc2023-10-07T00:14:08.651277+0000 b729 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c56d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000209:[<0x10000000208/mysnprintf.c v38>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000209:[<0x10000000208/mysnprintf.c v38>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.360 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.001+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000215 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/globals.h auth v62 ap=1 s=1419 n(v0 rc2023-10-07T00:14:08.688903+0000 b1419 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@10} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c56cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000215:[<0x10000000208/globals.h v62>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000215:[<0x10000000208/globals.h v62>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.360 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.001+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000211 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h auth v54 ap=1 s=4944 n(v0 rc2023-10-07T00:14:08.677348+0000 b4944 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c638000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000211:[<0x10000000208/bsd-getopt_long.h v54>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000211:[<0x10000000208/bsd-getopt_long.h v54>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.360 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.002+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020a [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.h auth v40 ap=1 s=696 n(v0 rc2023-10-07T00:14:08.654249+0000 b696 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@11} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c639080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020a:[<0x10000000208/mysnprintf.h v40>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x1000000020a:[<0x10000000208/mysnprintf.h v40>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.003+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000216 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/commenter.c auth v64 ap=1 s=939 n(v0 rc2023-10-07T00:14:08.691706+0000 b939 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c638580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000216:[<0x10000000208/commenter.c v64>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000216:[<0x10000000208/commenter.c v64>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.003+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021a [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/helpers.c auth v72 ap=1 s=4200 n(v0 rc2023-10-07T00:14:08.702356+0000 b4200 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c638b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000021a:[<0x10000000208/helpers.c v72>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x1000000021a:[<0x10000000208/helpers.c v72>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.003+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020f [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench_p.h auth v50 ap=1 s=460 n(v0 rc2023-10-07T00:14:08.670427+0000 b460 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c639600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020f:[<0x10000000208/blogbench_p.h v50>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x1000000020f:[<0x10000000208/blogbench_p.h v50>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.005+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.h auth v44 ap=1 s=3764 n(v0 rc2023-10-07T00:14:08.660390+0000 b3764 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@10} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c639b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020c:[<0x10000000208/blogbench.h v44>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x1000000020c:[<0x10000000208/blogbench.h v44>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.005+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000217 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/rewriter.c auth v66 ap=1 s=1581 n(v0 rc2023-10-07T00:14:08.694309+0000 b1581 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c63a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000217:[<0x10000000208/rewriter.c v66>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000217:[<0x10000000208/rewriter.c v66>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.007+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020d [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.c auth v46 ap=1 s=10682 n(v0 rc2023-10-07T00:14:08.663726+0000 b10682 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c63b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020d:[<0x10000000208/fakesnprintf.c v46>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x1000000020d:[<0x10000000208/fakesnprintf.c v46>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.007+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037f [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile auth v78 ap=1 s=13322 n(v0 rc2023-10-07T00:14:21.555404+0000 b13322 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c63a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037f:[<0x10000000208/Makefile v78>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x1000000037f:[<0x10000000208/Makefile v78>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.007+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000213 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.in auth v58 ap=1 s=13775 n(v0 rc2023-10-07T00:14:08.683518+0000 b13775 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c63ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000213:[<0x10000000208/Makefile.in v58>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000213:[<0x10000000208/Makefile.in v58>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.359+0000 7ff096dff700 1 -- start start 2023-10-07T00:14:49.362 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.010+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000219 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/writer.c auth v70 ap=1 s=1910 n(v0 rc2023-10-07T00:14:08.699822+0000 b1910 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c56d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000219:[<0x10000000208/writer.c v70>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000219:[<0x10000000208/writer.c v70>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.362 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.011+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000210 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c auth v52 ap=1 s=18847 n(v0 rc2023-10-07T00:14:08.674366+0000 b18847 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c644000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000210:[<0x10000000208/bsd-getopt_long.c v52>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000210:[<0x10000000208/bsd-getopt_long.c v52>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.362 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.013+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000214 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/process.c auth v60 ap=1 s=4649 n(v0 rc2023-10-07T00:14:08.686492+0000 b4649 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c644b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000214:[<0x10000000208/process.c v60>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000214:[<0x10000000208/process.c v60>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.362 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.013+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000218 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/reader.c auth v68 ap=1 s=1605 n(v0 rc2023-10-07T00:14:08.697035+0000 b1605 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c644580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000218:[<0x10000000208/reader.c v68>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000218:[<0x10000000208/reader.c v68>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.363 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.013+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000212 [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.am auth v56 ap=1 s=299 n(v0 rc2023-10-07T00:14:08.679927+0000 b299 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c63b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000212:[<0x10000000208/Makefile.am v56>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000000212:[<0x10000000208/Makefile.am v56>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.363 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:14:49.036+0000 7fc740ab0700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020e [2,head] /volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.h auth v48 ap=1 s=606 n(v0 rc2023-10-07T00:14:08.666922+0000 b606 1=1+0) (iversion lock) caps={25211=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55cc7c645080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020e:[<0x10000000208/fakesnprintf.h v48>,<0x10000000201/src v2749>,<0x10000000006/blogbench-1.0 v2563>,<0x10000000005/tmp v48>,<0x10000000003/client.0 v36>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v52>,<0x10000000001/sv_0 v67>,<0x10000000000/_nogroup v52>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x1000000020e:[<0x10000000208/fakesnprintf.h v48>,<0x10000000201/src v2815>,<0x10000000006/blogbench-1.0 v2619>,<0x10000000005/tmp v75>,<0x10000000003/client.0 v66>,<0x10000000002/511769c6-b4a3-4f32-8846-8476a986ce7c v85>,<0x10000000001/sv_0 v91>,<0x10000000000/_nogroup v24>,<0x1/volumes v71>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-07T00:14:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.359+0000 7ff096dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff090073910 0x7ff09006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.359+0000 7ff096dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff090074ef0 0x7ff09006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.359+0000 7ff096dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff09010d590 0x7ff0900713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.359+0000 7ff096dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090071b40 con 0x7ff090074ef0 2023-10-07T00:14:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.359+0000 7ff096dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090071cb0 con 0x7ff09010d590 2023-10-07T00:14:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.359+0000 7ff096dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090071e70 con 0x7ff090073910 2023-10-07T00:14:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff094b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff090073910 0x7ff09006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff094b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff090073910 0x7ff09006c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55310/0 (socket says 172.21.15.5:55310) 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff094b9b700 1 -- 172.21.15.5:0/4282995077 learned_addr learned my addr 172.21.15.5:0/4282995077 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff09539c700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff09010d590 0x7ff0900713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff08ffff700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff090074ef0 0x7ff09006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff094b9b700 1 -- 172.21.15.5:0/4282995077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff09010d590 msgr2=0x7ff0900713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff094b9b700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff09010d590 0x7ff0900713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff094b9b700 1 -- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff090074ef0 msgr2=0x7ff09006ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff094b9b700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff090074ef0 0x7ff09006ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.360+0000 7ff094b9b700 1 -- 172.21.15.5:0/4282995077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08801a600 con 0x7ff090073910 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.361+0000 7ff08ffff700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff090074ef0 0x7ff09006ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.361+0000 7ff094b9b700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff090073910 0x7ff09006c8e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b530 tx=0x7ff07800b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.362+0000 7ff08dffb700 1 -- 172.21.15.5:0/4282995077 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078011830 con 0x7ff090073910 2023-10-07T00:14:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.362+0000 7ff08dffb700 1 -- 172.21.15.5:0/4282995077 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff078011e20 con 0x7ff090073910 2023-10-07T00:14:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.362+0000 7ff08dffb700 1 -- 172.21.15.5:0/4282995077 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078010dd0 con 0x7ff090073910 2023-10-07T00:14:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.362+0000 7ff096dff700 1 -- 172.21.15.5:0/4282995077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff090072150 con 0x7ff090073910 2023-10-07T00:14:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.362+0000 7ff096dff700 1 -- 172.21.15.5:0/4282995077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff090072610 con 0x7ff090073910 2023-10-07T00:14:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.369+0000 7ff0aa75db80 1 Processor -- start 2023-10-07T00:14:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.370+0000 7ff0aa75db80 1 -- start start 2023-10-07T00:14:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.370+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.370+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9bc0 0x5616b09ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.370+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09caa60 0x5616b09caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.370+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b0931460 con 0x5616b09c9260 2023-10-07T00:14:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.370+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b0922c20 con 0x5616b09c9bc0 2023-10-07T00:14:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.370+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b0920540 con 0x5616b09caa60 2023-10-07T00:14:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.371+0000 7ff09539c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.371+0000 7ff09539c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40792/0 (socket says 172.21.15.5:40792) 2023-10-07T00:14:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.371+0000 7ff09539c700 1 -- 172.21.15.5:0/2509758987 learned_addr learned my addr 172.21.15.5:0/2509758987 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.371+0000 7ff08ffff700 1 --2- 172.21.15.5:0/2509758987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09caa60 0x5616b09caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.371+0000 7ff08dffb700 1 -- 172.21.15.5:0/4282995077 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff078011990 con 0x7ff090073910 2023-10-07T00:14:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.372+0000 7ff09539c700 1 -- 172.21.15.5:0/2509758987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09caa60 msgr2=0x5616b09caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.372+0000 7ff09539c700 1 --2- 172.21.15.5:0/2509758987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09caa60 0x5616b09caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.372+0000 7ff09539c700 1 -- 172.21.15.5:0/2509758987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9bc0 msgr2=0x5616b09ca480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T00:14:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.372+0000 7ff09539c700 1 --2- 172.21.15.5:0/2509758987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9bc0 0x5616b09ca480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.372+0000 7ff09539c700 1 -- 172.21.15.5:0/2509758987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616b0746de0 con 0x5616b09c9260 2023-10-07T00:14:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.372+0000 7ff09539c700 1 --2- 172.21.15.5:0/2509758987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c9680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff088005ca0 tx=0x7ff08801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a932ad65576388f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.373+0000 7ff086ffd700 1 -- 172.21.15.5:0/2509758987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08802d040 con 0x5616b09c9260 2023-10-07T00:14:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.373+0000 7ff086ffd700 1 -- 172.21.15.5:0/2509758987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff08801cc80 con 0x5616b09c9260 2023-10-07T00:14:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.373+0000 7ff086ffd700 1 -- 172.21.15.5:0/2509758987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088004be0 con 0x5616b09c9260 2023-10-07T00:14:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.374+0000 7ff08dffb700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff07c0a1680 0x7ff07c0a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.374+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2509758987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 msgr2=0x5616b09c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.374+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2509758987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c9680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff088005ca0 tx=0x7ff08801c9a0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.374+0000 7ff08dffb700 1 -- 172.21.15.5:0/4282995077 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff0780cc7e0 con 0x7ff090073910 2023-10-07T00:14:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.375+0000 7ff094b9b700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff07c0a1680 0x7ff07c0a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.375+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2509758987 shutdown_connections 2023-10-07T00:14:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.375+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2509758987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09caa60 0x5616b09caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.375+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2509758987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c9680 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.375+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2509758987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9bc0 0x5616b09ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.375+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2509758987 >> 172.21.15.5:0/2509758987 conn(0x5616b093d260 msgr2=0x5616b09c4140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.376+0000 7ff094b9b700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff07c0a1680 0x7ff07c0a3b40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff078095f80 tx=0x7ff078004750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.376+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2509758987 shutdown_connections 2023-10-07T00:14:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.377+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2509758987 wait complete. 2023-10-07T00:14:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.377+0000 7ff0aa75db80 1 -- start start 2023-10-07T00:14:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.377+0000 7ff0aa75db80 1 Processor -- start 2023-10-07T00:14:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.378+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.378+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.378+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 0x5616b09da4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.378+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b091be30 con 0x5616b09c9260 2023-10-07T00:14:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.378+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b08b8710 con 0x5616b09caa60 2023-10-07T00:14:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.378+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b08b83b0 con 0x5616b09c9bc0 2023-10-07T00:14:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.378+0000 7ff0aa75db80 10 client.0 _ll_register_callbacks cb 0x5616b0715800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.379+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.379+0000 7ff09539c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.379+0000 7ff09539c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09d2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40798/0 (socket says 172.21.15.5:40798) 2023-10-07T00:14:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.379+0000 7ff09539c700 1 -- 172.21.15.5:0/3205773404 learned_addr learned my addr 172.21.15.5:0/3205773404 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.379+0000 7ff09539c700 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 0x5616b09da4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.380+0000 7ff09539c700 1 -- 172.21.15.5:0/3205773404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 msgr2=0x5616b09d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.380+0000 7ff09539c700 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.380+0000 7ff09539c700 1 -- 172.21.15.5:0/3205773404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 msgr2=0x5616b09da4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.380+0000 7ff09539c700 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 0x5616b09da4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.380+0000 7ff09539c700 1 -- 172.21.15.5:0/3205773404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff090110330 con 0x5616b09c9260 2023-10-07T00:14:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.380+0000 7ff09539c700 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09d2f70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff08801acf0 tx=0x7ff088005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c50987dcd668e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.380+0000 7ff06ffff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:14:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.381+0000 7ff06ffff700 1 -- 172.21.15.5:0/3205773404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08802d040 con 0x5616b09c9260 2023-10-07T00:14:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.381+0000 7ff06ffff700 1 -- 172.21.15.5:0/3205773404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff08803ea20 con 0x5616b09c9260 2023-10-07T00:14:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.381+0000 7ff0aa75db80 1 -- 172.21.15.5:0/3205773404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616b09bbf10 con 0x5616b09c9260 2023-10-07T00:14:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.382+0000 7ff06ffff700 1 -- 172.21.15.5:0/3205773404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff08803ebe0 con 0x5616b09c9260 2023-10-07T00:14:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.386+0000 7ff0aa75db80 10 client.16188 fetch_fsmap learned FSMap version 30 2023-10-07T00:14:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.386+0000 7ff0aa75db80 1 -- 172.21.15.5:0/3205773404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5616b072fc60 con 0x5616b09c9260 2023-10-07T00:14:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.387+0000 7ff06ffff700 1 -- 172.21.15.5:0/3205773404 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5616b09bbf10 con 0x5616b09c9260 2023-10-07T00:14:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.387+0000 7ff06ffff700 1 -- 172.21.15.5:0/3205773404 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff088031c50 con 0x5616b09c9260 2023-10-07T00:14:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.387+0000 7ff0aa75db80 10 client.16188 fetch_fsmap finished waiting for FSMap version 30 2023-10-07T00:14:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.388+0000 7ff0aa75db80 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.388+0000 7ff0aa75db80 20 client.16188 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.388+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5616b09de820 0x5616b09e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.388+0000 7ff0aa75db80 4 client.16188 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:14:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.388+0000 7ff0aa75db80 1 -- 172.21.15.5:0/3205773404 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616b0914e10 con 0x5616b09de820 2023-10-07T00:14:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.388+0000 7ff08ffff700 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5616b09de820 0x5616b09e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.389+0000 7ff08ffff700 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5616b09de820 0x5616b09e0c40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c9db64d19e1d0ea server_cookie=78a8fb9c599b94c0 in_seq=0 out_seq=0 2023-10-07T00:14:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.392+0000 7ff06ffff700 10 client.16188 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.392+0000 7ff06ffff700 1 -- 172.21.15.5:0/3205773404 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5616b0914e10 con 0x5616b09de820 2023-10-07T00:14:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.392+0000 7ff06ffff700 10 client.16188 handle_command_reply: tid=0 2023-10-07T00:14:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.392+0000 7ff0aa75db80 1 client.16188 shutdown 2023-10-07T00:14:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.393+0000 7ff0aa75db80 1 -- 172.21.15.5:0/3205773404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 msgr2=0x5616b09d2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.393+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09d2f70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff08801acf0 tx=0x7ff088005e30 comp rx=0 tx=0).stop 2023-10-07T00:14:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.393+0000 7ff0aa75db80 1 -- 172.21.15.5:0/3205773404 shutdown_connections 2023-10-07T00:14:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.393+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5616b09de820 0x5616b09e0c40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.393+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 0x5616b09da4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.393+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09d2f70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.393+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/3205773404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.393+0000 7ff0aa75db80 1 -- 172.21.15.5:0/3205773404 >> 172.21.15.5:0/3205773404 conn(0x5616b093d260 msgr2=0x5616b09c3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.394+0000 7ff06ffff700 0 client.16188 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.395+0000 7ff0aa75db80 1 -- 172.21.15.5:0/3205773404 shutdown_connections 2023-10-07T00:14:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.395+0000 7ff0aa75db80 1 -- 172.21.15.5:0/3205773404 wait complete. 2023-10-07T00:14:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.395+0000 7ff0aa75db80 20 client.16188 trim_cache size 0 max 16384 2023-10-07T00:14:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.425+0000 7ff0aa75db80 1 Processor -- start 2023-10-07T00:14:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.425+0000 7ff0aa75db80 1 -- start start 2023-10-07T00:14:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.425+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.425+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.425+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 0x5616b09d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.425+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b079c920 con 0x5616b09c9260 2023-10-07T00:14:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.425+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b09d2420 con 0x5616b09caa60 2023-10-07T00:14:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.425+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b09d1ac0 con 0x5616b09c9bc0 2023-10-07T00:14:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.426+0000 7ff09539c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.426+0000 7ff09539c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40808/0 (socket says 172.21.15.5:40808) 2023-10-07T00:14:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.426+0000 7ff09539c700 1 -- 172.21.15.5:0/505118026 learned_addr learned my addr 172.21.15.5:0/505118026 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.426+0000 7ff09539c700 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 0x5616b09d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.427+0000 7ff08ffff700 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.427+0000 7ff09539c700 1 -- 172.21.15.5:0/505118026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 msgr2=0x5616b09da4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.427+0000 7ff09539c700 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09da4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.427+0000 7ff09539c700 1 -- 172.21.15.5:0/505118026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 msgr2=0x5616b09d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.427+0000 7ff09539c700 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 0x5616b09d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.427+0000 7ff09539c700 1 -- 172.21.15.5:0/505118026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616b076d250 con 0x5616b09c9260 2023-10-07T00:14:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.428+0000 7ff09539c700 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c3f50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff08801a300 tx=0x7ff08801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77368a1c5e724444 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.429+0000 7ff0877fe700 1 -- 172.21.15.5:0/505118026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088005a00 con 0x5616b09c9260 2023-10-07T00:14:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.429+0000 7ff0877fe700 1 -- 172.21.15.5:0/505118026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff088042070 con 0x5616b09c9260 2023-10-07T00:14:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.429+0000 7ff0877fe700 1 -- 172.21.15.5:0/505118026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088031420 con 0x5616b09c9260 2023-10-07T00:14:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.430+0000 7ff0aa75db80 1 -- 172.21.15.5:0/505118026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 msgr2=0x5616b09c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.430+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c3f50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff08801a300 tx=0x7ff08801c9a0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.430+0000 7ff0aa75db80 1 -- 172.21.15.5:0/505118026 shutdown_connections 2023-10-07T00:14:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.430+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09caa60 0x5616b09d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.430+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09c9260 0x5616b09c3f50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.430+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/505118026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09da4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.430+0000 7ff0aa75db80 1 -- 172.21.15.5:0/505118026 >> 172.21.15.5:0/505118026 conn(0x5616b093d260 msgr2=0x5616b09dade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.431+0000 7ff0aa75db80 1 -- 172.21.15.5:0/505118026 shutdown_connections 2023-10-07T00:14:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.431+0000 7ff0aa75db80 1 -- 172.21.15.5:0/505118026 wait complete. 2023-10-07T00:14:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.432+0000 7ff0aa75db80 1 -- start start 2023-10-07T00:14:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.432+0000 7ff0aa75db80 1 Processor -- start 2023-10-07T00:14:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.433+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9260 0x5616b09d5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.433+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.433+0000 7ff0aa75db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09caa60 0x5616b09d94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.433+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b09d9a00 con 0x5616b09caa60 2023-10-07T00:14:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.433+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b09d9b70 con 0x5616b09c9260 2023-10-07T00:14:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.433+0000 7ff0aa75db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b09d9d30 con 0x5616b09c9bc0 2023-10-07T00:14:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.433+0000 7ff0aa75db80 10 client.0 _ll_register_callbacks cb 0x7ff0800097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:14:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.434+0000 7ff09539c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9260 0x5616b09d5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff09539c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9260 0x5616b09d5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55924/0 (socket says 172.21.15.5:55924) 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff09539c700 1 -- 172.21.15.5:0/2204700887 learned_addr learned my addr 172.21.15.5:0/2204700887 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55356/0 (socket says 172.21.15.5:55356) 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff09539c700 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09caa60 0x5616b09d94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff09539c700 1 -- 172.21.15.5:0/2204700887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 msgr2=0x5616b09d64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff09539c700 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff09539c700 1 -- 172.21.15.5:0/2204700887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09caa60 msgr2=0x5616b09d94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff09539c700 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09caa60 0x5616b09d94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.435+0000 7ff09539c700 1 -- 172.21.15.5:0/2204700887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616b072fc60 con 0x5616b09c9260 2023-10-07T00:14:49.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.436+0000 7ff09539c700 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9260 0x5616b09d5f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff08803ffd0 tx=0x7ff08803c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c656c4e9bc8dfe server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:14:49.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.436+0000 7ff06ffff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:14:49.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.437+0000 7ff06ffff700 1 -- 172.21.15.5:0/2204700887 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08802d030 con 0x5616b09c9260 2023-10-07T00:14:49.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.437+0000 7ff06ffff700 1 -- 172.21.15.5:0/2204700887 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff088000e40 con 0x5616b09c9260 2023-10-07T00:14:49.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.437+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2204700887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff08801cc80 con 0x5616b09c9260 2023-10-07T00:14:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.438+0000 7ff06ffff700 1 -- 172.21.15.5:0/2204700887 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff088005c00 con 0x5616b09c9260 2023-10-07T00:14:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.438+0000 7ff0aa75db80 10 client.26003 fetch_fsmap learned FSMap version 30 2023-10-07T00:14:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.438+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2204700887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5616b07452b0 con 0x5616b09c9260 2023-10-07T00:14:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.438+0000 7ff06ffff700 1 -- 172.21.15.5:0/2204700887 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff08801cc80 con 0x5616b09c9260 2023-10-07T00:14:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.439+0000 7ff06ffff700 1 -- 172.21.15.5:0/2204700887 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff088031c50 con 0x5616b09c9260 2023-10-07T00:14:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.439+0000 7ff0aa75db80 10 client.26003 fetch_fsmap finished waiting for FSMap version 30 2023-10-07T00:14:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.439+0000 7ff0aa75db80 10 client.26003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:14:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.439+0000 7ff0aa75db80 20 client.26003 populate_metadata read hostname 'smithi005' 2023-10-07T00:14:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.440+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5616b0a32d60 0x5616b0a35150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:14:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.440+0000 7ff0aa75db80 4 client.26003 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:14:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.440+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2204700887 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5616b0914b30 con 0x5616b0a32d60 2023-10-07T00:14:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.440+0000 7ff08ffff700 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5616b0a32d60 0x5616b0a35150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:14:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.441+0000 7ff08ffff700 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5616b0a32d60 0x5616b0a35150 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b81b7202c34947e8 server_cookie=b7661311bf468284 in_seq=0 out_seq=0 2023-10-07T00:14:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.441+0000 7ff06ffff700 10 client.26003 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.441+0000 7ff06ffff700 1 -- 172.21.15.5:0/2204700887 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5616b0914b30 con 0x5616b0a32d60 2023-10-07T00:14:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.441+0000 7ff06ffff700 10 client.26003 handle_command_reply: tid=0 2023-10-07T00:14:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.441+0000 7ff0aa75db80 1 client.26003 shutdown 2023-10-07T00:14:49.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.441+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2204700887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9260 msgr2=0x5616b09d5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.441+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9260 0x5616b09d5f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff08803ffd0 tx=0x7ff08803c750 comp rx=0 tx=0).stop 2023-10-07T00:14:49.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2204700887 shutdown_connections 2023-10-07T00:14:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5616b0a32d60 0x5616b0a35150 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5616b09caa60 0x5616b09d94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5616b09c9260 0x5616b09d5f60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff0aa75db80 1 --2- 172.21.15.5:0/2204700887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5616b09c9bc0 0x5616b09d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2204700887 >> 172.21.15.5:0/2204700887 conn(0x5616b093d260 msgr2=0x5616b09c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff06ffff700 0 client.26003 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:14:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2204700887 shutdown_connections 2023-10-07T00:14:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.442+0000 7ff0aa75db80 1 -- 172.21.15.5:0/2204700887 wait complete. 2023-10-07T00:14:49.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.443+0000 7ff0aa75db80 20 client.26003 trim_cache size 0 max 16384 2023-10-07T00:14:49.445 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:14:49.445 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-07T00:14:49.445 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-07T00:14:49.445 INFO:teuthology.orchestra.run.smithi005.stdout: "afff7b84-c672-4235-8d0d-2bf0423e0a15": { 2023-10-07T00:14:49.445 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-07T00:14:49.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "afff7b84-c672-4235-8d0d-2bf0423e0a15", 2023-10-07T00:14:49.446 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-07T00:14:49.446 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:14:49.446 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:14:49.446 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 -- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff07c0a1680 msgr2=0x7ff07c0a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff07c0a1680 0x7ff07c0a3b40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff078095f80 tx=0x7ff078004750 comp rx=0 tx=0).stop 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 -- 172.21.15.5:0/4282995077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff090073910 msgr2=0x7ff09006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff090073910 0x7ff09006c8e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b530 tx=0x7ff07800b8f0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 -- 172.21.15.5:0/4282995077 shutdown_connections 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff07c0a1680 0x7ff07c0a3b40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff09010d590 0x7ff0900713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff090073910 0x7ff09006c8e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 --2- 172.21.15.5:0/4282995077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff090074ef0 0x7ff09006ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:14:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 -- 172.21.15.5:0/4282995077 >> 172.21.15.5:0/4282995077 conn(0x7ff0900fc530 msgr2=0x7ff0900fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:14:49.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.444+0000 7ff096dff700 1 -- 172.21.15.5:0/4282995077 shutdown_connections 2023-10-07T00:14:49.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:14:49.445+0000 7ff096dff700 1 -- 172.21.15.5:0/4282995077 wait complete. 2023-10-07T00:14:49.472 INFO:tasks.cephfs.filesystem:scrub status for tag:afff7b84-c672-4235-8d0d-2bf0423e0a15 - {'path': '/', 'tag': 'afff7b84-c672-4235-8d0d-2bf0423e0a15', 'options': 'recursive,force'} 2023-10-07T00:14:49.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:49.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub queued for path: / 2023-10-07T00:14:49.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:49.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:49.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:49.826 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x1000000020b (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000209 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000215 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/globals.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000211 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000216 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x1000000020f (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x1000000020c (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000217 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.827 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x1000000020d (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x1000000037f (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000213 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000219 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/writer.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000214 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/process.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000218 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/reader.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.828 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: Scrub error on inode 0x1000000020e (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:49.829 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:49.829 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:49.829 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:50.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:50.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:50.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:49 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub queued for path: / 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x1000000020b (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000209 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000215 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/globals.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000211 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:50.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000216 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x1000000020f (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x1000000020c (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000217 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x1000000020d (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x1000000037f (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000213 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000219 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/writer.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000214 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/process.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000218 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/reader.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: Scrub error on inode 0x1000000020e (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:50.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:49 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub queued for path: / 2023-10-07T00:14:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x1000000020b (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000209 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000215 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/globals.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000211 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000216 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x1000000020f (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x1000000020c (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000217 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x1000000020d (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x1000000037f (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000213 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000219 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/writer.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000214 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/process.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000218 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/reader.c) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: Scrub error on inode 0x1000000020e (/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.a log and `damage ls` output for details 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:50.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:50.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:50.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:50.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:49 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: pgmap v408: 97 pgs: 97 active+clean; 51 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.7 MiB/s wr, 145 op/s 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: active paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.117 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:50 smithi005 ceph-mon[129406]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: pgmap v408: 97 pgs: 97 active+clean; 51 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.7 MiB/s wr, 145 op/s 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.207 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.208 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.209 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.210 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: active paths [/] 2023-10-07T00:14:51.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.211 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:50 smithi088 ceph-mon[103111]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.250 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.251 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: pgmap v408: 97 pgs: 97 active+clean; 51 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.7 MiB/s wr, 145 op/s 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.252 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.253 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.254 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.255 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.256 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.256 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.256 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.256 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: active paths [/] 2023-10-07T00:14:51.256 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:51.256 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:50 smithi112 ceph-mon[133548]: scrub summary: idle+waiting paths [/] 2023-10-07T00:14:53.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:52 smithi005 ceph-mon[129406]: pgmap v409: 97 pgs: 97 active+clean; 54 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.6 MiB/s wr, 146 op/s 2023-10-07T00:14:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:52 smithi088 ceph-mon[103111]: pgmap v409: 97 pgs: 97 active+clean; 54 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.6 MiB/s wr, 146 op/s 2023-10-07T00:14:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:52 smithi112 ceph-mon[133548]: pgmap v409: 97 pgs: 97 active+clean; 54 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.6 MiB/s wr, 146 op/s 2023-10-07T00:14:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:54 smithi005 ceph-mon[129406]: pgmap v410: 97 pgs: 97 active+clean; 60 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 2.5 MiB/s wr, 148 op/s 2023-10-07T00:14:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:54 smithi088 ceph-mon[103111]: pgmap v410: 97 pgs: 97 active+clean; 60 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 2.5 MiB/s wr, 148 op/s 2023-10-07T00:14:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:54 smithi112 ceph-mon[133548]: pgmap v410: 97 pgs: 97 active+clean; 60 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 2.5 MiB/s wr, 148 op/s 2023-10-07T00:14:57.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:56 smithi005 ceph-mon[129406]: pgmap v411: 97 pgs: 97 active+clean; 66 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 168 op/s 2023-10-07T00:14:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:56 smithi088 ceph-mon[103111]: pgmap v411: 97 pgs: 97 active+clean; 66 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 168 op/s 2023-10-07T00:14:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:56 smithi112 ceph-mon[133548]: pgmap v411: 97 pgs: 97 active+clean; 66 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 168 op/s 2023-10-07T00:14:57.764 INFO:tasks.workunit.client.0.smithi005.stdout: 18 5738 381 3271 288 814 52 2023-10-07T00:14:58.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:57 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a[129381]: 2023-10-07T00:14:57.850+0000 7f38e549e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-07T00:14:58.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:57 smithi005 ceph-mon[129406]: pgmap v412: 97 pgs: 97 active+clean; 71 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.4 MiB/s wr, 164 op/s 2023-10-07T00:14:58.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:57 smithi005 ceph-mon[129406]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-07T00:14:58.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:57 smithi005 ceph-mon[129406]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:active 2023-10-07T00:14:58.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:14:57 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:58.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:57 smithi088 ceph-mon[103111]: pgmap v412: 97 pgs: 97 active+clean; 71 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.4 MiB/s wr, 164 op/s 2023-10-07T00:14:58.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:57 smithi088 ceph-mon[103111]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-07T00:14:58.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:57 smithi088 ceph-mon[103111]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:active 2023-10-07T00:14:58.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:14:57 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:14:58.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:57 smithi112 ceph-mon[133548]: pgmap v412: 97 pgs: 97 active+clean; 71 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.4 MiB/s wr, 164 op/s 2023-10-07T00:14:58.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:57 smithi112 ceph-mon[133548]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-07T00:14:58.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:57 smithi112 ceph-mon[133548]: mds.? [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] up:active 2023-10-07T00:14:58.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:14:57 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:15:01.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:00 smithi005 ceph-mon[129406]: pgmap v413: 97 pgs: 97 active+clean; 74 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 2.3 MiB/s wr, 156 op/s 2023-10-07T00:15:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:00 smithi088 ceph-mon[103111]: pgmap v413: 97 pgs: 97 active+clean; 74 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 2.3 MiB/s wr, 156 op/s 2023-10-07T00:15:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:00 smithi112 ceph-mon[133548]: pgmap v413: 97 pgs: 97 active+clean; 74 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 2.3 MiB/s wr, 156 op/s 2023-10-07T00:15:01.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.698+0000 7ff4d81ff700 1 -- 172.21.15.5:0/959570684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4d01020e0 msgr2=0x7ff4d0104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.698+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/959570684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4d01020e0 0x7ff4d0104570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009990 tx=0x7ff4c0009ca0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.699+0000 7ff4d81ff700 1 -- 172.21.15.5:0/959570684 shutdown_connections 2023-10-07T00:15:01.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.699+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/959570684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d0104ab0 0x7ff4d0104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.699+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/959570684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00ff770 0x7ff4d0101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.699+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/959570684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4d01020e0 0x7ff4d0104570 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.699+0000 7ff4d81ff700 1 -- 172.21.15.5:0/959570684 >> 172.21.15.5:0/959570684 conn(0x7ff4d00fb390 msgr2=0x7ff4d00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.699+0000 7ff4d81ff700 1 -- 172.21.15.5:0/959570684 shutdown_connections 2023-10-07T00:15:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.699+0000 7ff4d81ff700 1 -- 172.21.15.5:0/959570684 wait complete. 2023-10-07T00:15:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.700+0000 7ff4d81ff700 1 Processor -- start 2023-10-07T00:15:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.700+0000 7ff4d81ff700 1 -- start start 2023-10-07T00:15:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d81ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00ff770 0x7ff4d019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d81ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4d01020e0 0x7ff4d019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d81ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d0104ab0 0x7ff4d01a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d81ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d01a4cd0 con 0x7ff4d0104ab0 2023-10-07T00:15:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d81ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0105d90 con 0x7ff4d00ff770 2023-10-07T00:15:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d81ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0105f20 con 0x7ff4d01020e0 2023-10-07T00:15:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d5f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00ff770 0x7ff4d019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d5f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00ff770 0x7ff4d019d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55438/0 (socket says 172.21.15.5:55438) 2023-10-07T00:15:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d5f9b700 1 -- 172.21.15.5:0/3309422354 learned_addr learned my addr 172.21.15.5:0/3309422354 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.701+0000 7ff4d579a700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4d01020e0 0x7ff4d019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.702+0000 7ff4d5f9b700 1 -- 172.21.15.5:0/3309422354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4d01020e0 msgr2=0x7ff4d019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.702+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4d01020e0 0x7ff4d019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.702+0000 7ff4d5f9b700 1 -- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d0104ab0 msgr2=0x7ff4d01a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.702+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d0104ab0 0x7ff4d01a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.702+0000 7ff4d5f9b700 1 -- 172.21.15.5:0/3309422354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00095f0 con 0x7ff4d00ff770 2023-10-07T00:15:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.702+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00ff770 0x7ff4d019d150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00e9a0 tx=0x7ff4cc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.703+0000 7ff4c6ffd700 1 -- 172.21.15.5:0/3309422354 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc009790 con 0x7ff4d00ff770 2023-10-07T00:15:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.703+0000 7ff4d81ff700 1 -- 172.21.15.5:0/3309422354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d0106200 con 0x7ff4d00ff770 2023-10-07T00:15:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.703+0000 7ff4c6ffd700 1 -- 172.21.15.5:0/3309422354 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4cc00cbd0 con 0x7ff4d00ff770 2023-10-07T00:15:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.703+0000 7ff4c6ffd700 1 -- 172.21.15.5:0/3309422354 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc018680 con 0x7ff4d00ff770 2023-10-07T00:15:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.703+0000 7ff4d81ff700 1 -- 172.21.15.5:0/3309422354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d0106760 con 0x7ff4d00ff770 2023-10-07T00:15:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.709+0000 7ff4c6ffd700 1 -- 172.21.15.5:0/3309422354 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff4cc00cd40 con 0x7ff4d00ff770 2023-10-07T00:15:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.710+0000 7ff4ebbd4b80 1 Processor -- start 2023-10-07T00:15:01.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.710+0000 7ff4ebbd4b80 1 -- start start 2023-10-07T00:15:01.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a09450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a10220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba6970400 con 0x560ba6a07ec0 2023-10-07T00:15:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba6961bc0 con 0x560ba6a08fd0 2023-10-07T00:15:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba695f4e0 con 0x560ba6a09990 2023-10-07T00:15:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4d679c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4d679c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33910/0 (socket says 172.21.15.5:33910) 2023-10-07T00:15:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.711+0000 7ff4d679c700 1 -- 172.21.15.5:0/2948971491 learned_addr learned my addr 172.21.15.5:0/2948971491 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.712+0000 7ff4d579a700 1 --2- 172.21.15.5:0/2948971491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a10220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.712+0000 7ff4d579a700 1 -- 172.21.15.5:0/2948971491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 msgr2=0x560ba6a09450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:15:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.712+0000 7ff4d579a700 1 --2- 172.21.15.5:0/2948971491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a09450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.712+0000 7ff4d579a700 1 -- 172.21.15.5:0/2948971491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 msgr2=0x560ba6a082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.712+0000 7ff4d579a700 1 --2- 172.21.15.5:0/2948971491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.712+0000 7ff4d579a700 1 -- 172.21.15.5:0/2948971491 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ba6785d80 con 0x560ba6a09990 2023-10-07T00:15:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.712+0000 7ff4d579a700 1 --2- 172.21.15.5:0/2948971491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a10220 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0003f60 tx=0x7ff4c0005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1d96281068046 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.713+0000 7ff4bbfff700 1 -- 172.21.15.5:0/2948971491 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0005240 con 0x560ba6a09990 2023-10-07T00:15:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.713+0000 7ff4bbfff700 1 -- 172.21.15.5:0/2948971491 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4c001e040 con 0x560ba6a09990 2023-10-07T00:15:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.713+0000 7ff4bbfff700 1 -- 172.21.15.5:0/2948971491 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000b970 con 0x560ba6a09990 2023-10-07T00:15:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.713+0000 7ff4c6ffd700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4bc0a1580 0x7ff4bc0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.713+0000 7ff4c6ffd700 1 -- 172.21.15.5:0/3309422354 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4cc014070 con 0x7ff4d00ff770 2023-10-07T00:15:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.714+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/2948971491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 msgr2=0x560ba6a10220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.714+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/2948971491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a10220 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0003f60 tx=0x7ff4c0005c00 comp rx=0 tx=0).stop 2023-10-07T00:15:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.715+0000 7ff4d679c700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4bc0a1580 0x7ff4bc0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.715+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/2948971491 shutdown_connections 2023-10-07T00:15:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.715+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/2948971491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a10220 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.715+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/2948971491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.715+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/2948971491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a09450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.715+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/2948971491 >> 172.21.15.5:0/2948971491 conn(0x560ba697c200 msgr2=0x560ba6a02bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.716+0000 7ff4d679c700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4bc0a1580 0x7ff4bc0a3a40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009c10 tx=0x7ff4c800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.716+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/2948971491 shutdown_connections 2023-10-07T00:15:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.716+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/2948971491 wait complete. 2023-10-07T00:15:01.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.717+0000 7ff4ebbd4b80 1 -- start start 2023-10-07T00:15:01.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.717+0000 7ff4ebbd4b80 1 Processor -- start 2023-10-07T00:15:01.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.718+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a11c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.718+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a121a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.718+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.718+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba695add0 con 0x560ba6a07ec0 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.718+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba68f76b0 con 0x560ba6a08fd0 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.718+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba68f7350 con 0x560ba6a09990 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.718+0000 7ff4ebbd4b80 10 client.0 _ll_register_callbacks cb 0x560ba67547a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a121a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55442/0 (socket says 172.21.15.5:55442) 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d579a700 1 -- 172.21.15.5:0/621404438 learned_addr learned my addr 172.21.15.5:0/621404438 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d679c700 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a11c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d579a700 1 -- 172.21.15.5:0/621404438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 msgr2=0x560ba6a191e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:01.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d579a700 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a191e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d579a700 1 -- 172.21.15.5:0/621404438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 msgr2=0x560ba6a11c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:01.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d579a700 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a11c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.719+0000 7ff4d579a700 1 -- 172.21.15.5:0/621404438 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d0105a60 con 0x560ba6a08fd0 2023-10-07T00:15:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.720+0000 7ff4d579a700 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a121a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00098e0 tx=0x7ff4c0003ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe059388c81f974d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.720+0000 7ff4b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:15:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.720+0000 7ff4b97fa700 1 -- 172.21.15.5:0/621404438 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0032070 con 0x560ba6a08fd0 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.720+0000 7ff4b97fa700 1 -- 172.21.15.5:0/621404438 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4c00055c0 con 0x560ba6a08fd0 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.720+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/621404438 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ba69fad50 con 0x560ba6a08fd0 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.721+0000 7ff4b97fa700 1 -- 172.21.15.5:0/621404438 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4c000b710 con 0x560ba6a08fd0 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.721+0000 7ff4ebbd4b80 10 client.26012 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.721+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/621404438 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560ba676ec00 con 0x560ba6a08fd0 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.721+0000 7ff4b97fa700 1 -- 172.21.15.5:0/621404438 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ba69fad50 con 0x560ba6a08fd0 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.722+0000 7ff4b97fa700 1 -- 172.21.15.5:0/621404438 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff4c0035030 con 0x560ba6a08fd0 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.722+0000 7ff4ebbd4b80 10 client.26012 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.722+0000 7ff4ebbd4b80 10 client.26012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.722+0000 7ff4ebbd4b80 20 client.26012 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.722+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560ba6a1d720 0x560ba6a1fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.722+0000 7ff4ebbd4b80 4 client.26012 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.722+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/621404438 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ba6953db0 con 0x560ba6a1d720 2023-10-07T00:15:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.722+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560ba6a1d720 0x560ba6a1fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.723+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560ba6a1d720 0x560ba6a1fb40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9faf0ff9bdc9fb9b server_cookie=fa65e14a83c01204 in_seq=0 out_seq=0 2023-10-07T00:15:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.723+0000 7ff4b97fa700 10 client.26012 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4b97fa700 1 -- 172.21.15.5:0/621404438 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560ba6953db0 con 0x560ba6a1d720 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4b97fa700 10 client.26012 handle_command_reply: tid=0 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 client.26012 shutdown 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/621404438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 msgr2=0x560ba6a121a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a121a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00098e0 tx=0x7ff4c0003ab0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/621404438 shutdown_connections 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560ba6a1d720 0x560ba6a1fb40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a09990 0x560ba6a191e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a11c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/621404438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a08fd0 0x560ba6a121a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/621404438 >> 172.21.15.5:0/621404438 conn(0x560ba697c200 msgr2=0x560ba6a02250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4b97fa700 0 client.26012 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.724+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/621404438 shutdown_connections 2023-10-07T00:15:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.725+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/621404438 wait complete. 2023-10-07T00:15:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.725+0000 7ff4ebbd4b80 20 client.26012 trim_cache size 0 max 16384 2023-10-07T00:15:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.752+0000 7ff4ebbd4b80 1 Processor -- start 2023-10-07T00:15:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.753+0000 7ff4ebbd4b80 1 -- start start 2023-10-07T00:15:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.753+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a07ec0 0x560ba6a1f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.753+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a19100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.753+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a09990 0x560ba6a0fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.753+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba67db8c0 con 0x560ba6a09990 2023-10-07T00:15:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.753+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba6a19640 con 0x560ba6a07ec0 2023-10-07T00:15:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.753+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba6a042f0 con 0x560ba6a08fd0 2023-10-07T00:15:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.754+0000 7ff4d5f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a07ec0 0x560ba6a1f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.754+0000 7ff4d5f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a07ec0 0x560ba6a1f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55456/0 (socket says 172.21.15.5:55456) 2023-10-07T00:15:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.754+0000 7ff4d5f9b700 1 -- 172.21.15.5:0/3791477653 learned_addr learned my addr 172.21.15.5:0/3791477653 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.754+0000 7ff4d579a700 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a19100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4d579a700 1 -- 172.21.15.5:0/3791477653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a07ec0 msgr2=0x560ba6a1f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4d579a700 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a07ec0 0x560ba6a1f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4d679c700 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a09990 0x560ba6a0fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4d579a700 1 -- 172.21.15.5:0/3791477653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a09990 msgr2=0x560ba6a0fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4d579a700 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a09990 0x560ba6a0fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4d579a700 1 -- 172.21.15.5:0/3791477653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ba67ac1f0 con 0x560ba6a08fd0 2023-10-07T00:15:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4d679c700 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a09990 0x560ba6a0fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:15:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4d579a700 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a19100 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009990 tx=0x7ff4c0003e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6f8730786b0df8a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:01.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4c4ff9700 1 -- 172.21.15.5:0/3791477653 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0032070 con 0x560ba6a08fd0 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4c4ff9700 1 -- 172.21.15.5:0/3791477653 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4c0005bc0 con 0x560ba6a08fd0 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.755+0000 7ff4c4ff9700 1 -- 172.21.15.5:0/3791477653 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0004760 con 0x560ba6a08fd0 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.756+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/3791477653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 msgr2=0x560ba6a19100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.756+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a19100 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009990 tx=0x7ff4c0003e80 comp rx=0 tx=0).stop 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.756+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/3791477653 shutdown_connections 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.756+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a09990 0x560ba6a0fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.756+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a07ec0 0x560ba6a1f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.756+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/3791477653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a19100 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.756+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/3791477653 >> 172.21.15.5:0/3791477653 conn(0x560ba697c200 msgr2=0x560ba6a02980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.757+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/3791477653 shutdown_connections 2023-10-07T00:15:01.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.757+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/3791477653 wait complete. 2023-10-07T00:15:01.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.757+0000 7ff4ebbd4b80 1 -- start start 2023-10-07T00:15:01.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.758+0000 7ff4ebbd4b80 1 Processor -- start 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.758+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.758+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a16af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.758+0000 7ff4ebbd4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a09990 0x560ba6a17b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.758+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba6a18040 con 0x560ba6a07ec0 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.758+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba6a181b0 con 0x560ba6a09990 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.758+0000 7ff4ebbd4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ba6a18370 con 0x560ba6a08fd0 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.758+0000 7ff4ebbd4b80 10 client.0 _ll_register_callbacks cb 0x7ff4c8009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d579a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a16af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d579a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a16af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:35916/0 (socket says 172.21.15.5:35916) 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d579a700 1 -- 172.21.15.5:0/82346422 learned_addr learned my addr 172.21.15.5:0/82346422 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d579a700 1 -- 172.21.15.5:0/82346422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a09990 msgr2=0x560ba6a17b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d579a700 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a09990 0x560ba6a17b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d579a700 1 -- 172.21.15.5:0/82346422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 msgr2=0x560ba6a165b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d579a700 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a165b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.759+0000 7ff4d579a700 1 -- 172.21.15.5:0/82346422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ba676ec00 con 0x560ba6a08fd0 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.760+0000 7ff4d579a700 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a16af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0006010 tx=0x7ff4c0005810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=616a37e1834e37da server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:01.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.760+0000 7ff4b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:15:01.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.760+0000 7ff4b97fa700 1 -- 172.21.15.5:0/82346422 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0032040 con 0x560ba6a08fd0 2023-10-07T00:15:01.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.760+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/82346422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ba6953ad0 con 0x560ba6a08fd0 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.760+0000 7ff4b97fa700 1 -- 172.21.15.5:0/82346422 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4c0000e40 con 0x560ba6a08fd0 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.760+0000 7ff4b97fa700 1 -- 172.21.15.5:0/82346422 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4c00047d0 con 0x560ba6a08fd0 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.760+0000 7ff4ebbd4b80 10 client.25996 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.760+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/82346422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560ba6784250 con 0x560ba6a08fd0 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.761+0000 7ff4b97fa700 1 -- 172.21.15.5:0/82346422 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ba6953ad0 con 0x560ba6a08fd0 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.761+0000 7ff4b97fa700 1 -- 172.21.15.5:0/82346422 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff4c0035030 con 0x560ba6a08fd0 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.761+0000 7ff4ebbd4b80 10 client.25996 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.761+0000 7ff4ebbd4b80 10 client.25996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.761+0000 7ff4ebbd4b80 20 client.25996 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.761+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560ba6a717c0 0x560ba6a73bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.761+0000 7ff4ebbd4b80 4 client.25996 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:15:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.761+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/82346422 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560ba67a6f10 con 0x560ba6a717c0 2023-10-07T00:15:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.762+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560ba6a717c0 0x560ba6a73bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.762+0000 7ff4d5f9b700 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560ba6a717c0 0x560ba6a73bb0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f63710e35d183c server_cookie=1217596f2d843d0 in_seq=0 out_seq=0 2023-10-07T00:15:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.762+0000 7ff4b97fa700 10 client.25996 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.812+0000 7ff4b97fa700 1 -- 172.21.15.5:0/82346422 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560ba67a6f10 con 0x560ba6a717c0 2023-10-07T00:15:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.812+0000 7ff4b97fa700 10 client.25996 handle_command_reply: tid=0 2023-10-07T00:15:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.812+0000 7ff4ebbd4b80 1 client.25996 shutdown 2023-10-07T00:15:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.812+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/82346422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 msgr2=0x560ba6a16af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.812+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a16af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0006010 tx=0x7ff4c0005810 comp rx=0 tx=0).stop 2023-10-07T00:15:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/82346422 shutdown_connections 2023-10-07T00:15:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560ba6a717c0 0x560ba6a73bb0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560ba6a09990 0x560ba6a17b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ba6a07ec0 0x560ba6a165b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 1 --2- 172.21.15.5:0/82346422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ba6a08fd0 0x560ba6a16af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/82346422 >> 172.21.15.5:0/82346422 conn(0x560ba697c200 msgr2=0x560ba6a0fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4b97fa700 0 client.25996 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/82346422 shutdown_connections 2023-10-07T00:15:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 1 -- 172.21.15.5:0/82346422 wait complete. 2023-10-07T00:15:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.813+0000 7ff4ebbd4b80 20 client.25996 trim_cache size 0 max 16384 2023-10-07T00:15:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:15:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:15:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:15:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:15:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 -- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4bc0a1580 msgr2=0x7ff4bc0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4bc0a1580 0x7ff4bc0a3a40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009c10 tx=0x7ff4c800b040 comp rx=0 tx=0).stop 2023-10-07T00:15:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 -- 172.21.15.5:0/3309422354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00ff770 msgr2=0x7ff4d019d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00ff770 0x7ff4d019d150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00e9a0 tx=0x7ff4cc00ed60 comp rx=0 tx=0).stop 2023-10-07T00:15:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 -- 172.21.15.5:0/3309422354 shutdown_connections 2023-10-07T00:15:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7ff4bc0a1580 0x7ff4bc0a3a40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d0104ab0 0x7ff4d01a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00ff770 0x7ff4d019d150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 --2- 172.21.15.5:0/3309422354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4d01020e0 0x7ff4d019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.815+0000 7ff4d81ff700 1 -- 172.21.15.5:0/3309422354 >> 172.21.15.5:0/3309422354 conn(0x7ff4d00fb390 msgr2=0x7ff4d0100420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.816+0000 7ff4d81ff700 1 -- 172.21.15.5:0/3309422354 shutdown_connections 2023-10-07T00:15:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:01.816+0000 7ff4d81ff700 1 -- 172.21.15.5:0/3309422354 wait complete. 2023-10-07T00:15:02.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:01 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:15:02.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:01 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:15:02.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:01 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:15:02.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:01 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:15:02.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:01 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:15:02.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:01 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:15:03.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:02 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:15:03.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:02 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:15:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:02 smithi005 ceph-mon[129406]: scrub summary: idle 2023-10-07T00:15:03.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:02 smithi005 ceph-mon[129406]: pgmap v414: 97 pgs: 97 active+clean; 78 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.4 MiB/s wr, 163 op/s 2023-10-07T00:15:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:02 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:15:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:02 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:15:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:02 smithi088 ceph-mon[103111]: scrub summary: idle 2023-10-07T00:15:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:02 smithi088 ceph-mon[103111]: pgmap v414: 97 pgs: 97 active+clean; 78 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.4 MiB/s wr, 163 op/s 2023-10-07T00:15:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:02 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:15:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:02 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:15:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:02 smithi112 ceph-mon[133548]: scrub summary: idle 2023-10-07T00:15:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:02 smithi112 ceph-mon[133548]: pgmap v414: 97 pgs: 97 active+clean; 78 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.4 MiB/s wr, 163 op/s 2023-10-07T00:15:05.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:04 smithi005 ceph-mon[129406]: pgmap v415: 97 pgs: 97 active+clean; 81 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.5 MiB/s wr, 170 op/s 2023-10-07T00:15:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:04 smithi088 ceph-mon[103111]: pgmap v415: 97 pgs: 97 active+clean; 81 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.5 MiB/s wr, 170 op/s 2023-10-07T00:15:05.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:04 smithi112 ceph-mon[133548]: pgmap v415: 97 pgs: 97 active+clean; 81 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.5 MiB/s wr, 170 op/s 2023-10-07T00:15:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:06 smithi005 ceph-mon[129406]: pgmap v416: 97 pgs: 97 active+clean; 81 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 2.3 MiB/s wr, 176 op/s 2023-10-07T00:15:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:06 smithi088 ceph-mon[103111]: pgmap v416: 97 pgs: 97 active+clean; 81 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 2.3 MiB/s wr, 176 op/s 2023-10-07T00:15:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:06 smithi112 ceph-mon[133548]: pgmap v416: 97 pgs: 97 active+clean; 81 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 2.3 MiB/s wr, 176 op/s 2023-10-07T00:15:07.764 INFO:tasks.workunit.client.0.smithi005.stdout: 23 6718 247 4146 224 612 37 2023-10-07T00:15:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:08 smithi005 ceph-mon[129406]: pgmap v417: 97 pgs: 97 active+clean; 86 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.2 MiB/s wr, 166 op/s 2023-10-07T00:15:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:08 smithi088 ceph-mon[103111]: pgmap v417: 97 pgs: 97 active+clean; 86 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.2 MiB/s wr, 166 op/s 2023-10-07T00:15:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:08 smithi112 ceph-mon[133548]: pgmap v417: 97 pgs: 97 active+clean; 86 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.2 MiB/s wr, 166 op/s 2023-10-07T00:15:11.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:10 smithi005 ceph-mon[129406]: pgmap v418: 97 pgs: 97 active+clean; 88 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.9 MiB/s wr, 145 op/s 2023-10-07T00:15:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:10 smithi088 ceph-mon[103111]: pgmap v418: 97 pgs: 97 active+clean; 88 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.9 MiB/s wr, 145 op/s 2023-10-07T00:15:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:10 smithi112 ceph-mon[133548]: pgmap v418: 97 pgs: 97 active+clean; 88 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.9 MiB/s wr, 145 op/s 2023-10-07T00:15:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:12 smithi005 ceph-mon[129406]: pgmap v419: 97 pgs: 97 active+clean; 89 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2023-10-07T00:15:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:12 smithi088 ceph-mon[103111]: pgmap v419: 97 pgs: 97 active+clean; 89 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2023-10-07T00:15:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:12 smithi112 ceph-mon[133548]: pgmap v419: 97 pgs: 97 active+clean; 89 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2023-10-07T00:15:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.042+0000 7f7ce01ff700 1 -- 172.21.15.5:0/2121522234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8100f10 msgr2=0x7f7cd8101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.042+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/2121522234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8100f10 0x7f7cd8101330 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc013930 tx=0x7f7ccc013c40 comp rx=0 tx=0).stop 2023-10-07T00:15:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.042+0000 7f7ce01ff700 1 -- 172.21.15.5:0/2121522234 shutdown_connections 2023-10-07T00:15:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.042+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/2121522234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cd8102a20 0x7f7cd8109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.042+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/2121522234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8100f10 0x7f7cd8101330 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.042+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/2121522234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8102060 0x7f7cd81024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.042+0000 7f7ce01ff700 1 -- 172.21.15.5:0/2121522234 >> 172.21.15.5:0/2121522234 conn(0x7f7cd80fc480 msgr2=0x7f7cd80fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.042+0000 7f7ce01ff700 1 -- 172.21.15.5:0/2121522234 shutdown_connections 2023-10-07T00:15:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.043+0000 7f7ce01ff700 1 -- 172.21.15.5:0/2121522234 wait complete. 2023-10-07T00:15:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.044+0000 7f7ce01ff700 1 Processor -- start 2023-10-07T00:15:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7ce01ff700 1 -- start start 2023-10-07T00:15:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7ce01ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8100f10 0x7f7cd8194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7ce01ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cd8102060 0x7f7cd8194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7ce01ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8102a20 0x7f7cd819bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7ce01ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd819c590 con 0x7f7cd8102a20 2023-10-07T00:15:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7ce01ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd819c6d0 con 0x7f7cd8102060 2023-10-07T00:15:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7ce01ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd819c860 con 0x7f7cd8100f10 2023-10-07T00:15:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7cde79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8102a20 0x7f7cd819bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7cde79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8102a20 0x7f7cd819bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52618/0 (socket says 172.21.15.5:52618) 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7cde79c700 1 -- 172.21.15.5:0/1656866212 learned_addr learned my addr 172.21.15.5:0/1656866212 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.045+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cd8102060 0x7f7cd8194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.046+0000 7f7cde79c700 1 -- 172.21.15.5:0/1656866212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8100f10 msgr2=0x7f7cd8194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.046+0000 7f7cde79c700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8100f10 0x7f7cd8194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.046+0000 7f7cde79c700 1 -- 172.21.15.5:0/1656866212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cd8102060 msgr2=0x7f7cd8194f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.046+0000 7f7cde79c700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cd8102060 0x7f7cd8194f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.046+0000 7f7cde79c700 1 -- 172.21.15.5:0/1656866212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc009d00 con 0x7f7cd8102a20 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.046+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cd8102060 0x7f7cd8194f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:15:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.046+0000 7f7cde79c700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8102a20 0x7f7cd819bfc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000c970 tx=0x7f7cd000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.047+0000 7f7cd6ffd700 1 -- 172.21.15.5:0/1656866212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0007b00 con 0x7f7cd8102a20 2023-10-07T00:15:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.047+0000 7f7cd6ffd700 1 -- 172.21.15.5:0/1656866212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cd0004cc0 con 0x7f7cd8102a20 2023-10-07T00:15:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.047+0000 7f7cd6ffd700 1 -- 172.21.15.5:0/1656866212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0005410 con 0x7f7cd8102a20 2023-10-07T00:15:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.047+0000 7f7ce01ff700 1 -- 172.21.15.5:0/1656866212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd819cb40 con 0x7f7cd8102a20 2023-10-07T00:15:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.047+0000 7f7ce01ff700 1 -- 172.21.15.5:0/1656866212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd819d000 con 0x7f7cd8102a20 2023-10-07T00:15:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.053+0000 7f7cf3b3fb80 1 Processor -- start 2023-10-07T00:15:15.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.055+0000 7f7cd6ffd700 1 -- 172.21.15.5:0/1656866212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7cd0004750 con 0x7f7cd8102a20 2023-10-07T00:15:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.056+0000 7f7cf3b3fb80 1 -- start start 2023-10-07T00:15:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.056+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c915b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.056+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c915c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.056+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 0x5611c9163220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.056+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c90c3400 con 0x5611c915bfd0 2023-10-07T00:15:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.056+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c90b4bc0 con 0x5611c915c990 2023-10-07T00:15:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.056+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c90b24e0 con 0x5611c915aec0 2023-10-07T00:15:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cdd79a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c915b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cdd79a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c915b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38574/0 (socket says 172.21.15.5:38574) 2023-10-07T00:15:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cdd79a700 1 -- 172.21.15.5:0/290831818 learned_addr learned my addr 172.21.15.5:0/290831818 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 0x5611c9163220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c915c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cd6ffd700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7cc80a1550 0x7f7cc80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cddf9b700 1 -- 172.21.15.5:0/290831818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 msgr2=0x5611c915b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c915b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cd6ffd700 1 -- 172.21.15.5:0/1656866212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7cd00cca20 con 0x7f7cd8102a20 2023-10-07T00:15:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cddf9b700 1 -- 172.21.15.5:0/290831818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 msgr2=0x5611c9163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 0x5611c9163220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.057+0000 7f7cddf9b700 1 -- 172.21.15.5:0/290831818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c8ed8d80 con 0x5611c915bfd0 2023-10-07T00:15:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.058+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c915c450 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc01d000 tx=0x7f7ccc006210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86ce3c168089463 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.058+0000 7f7cde79c700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7cc80a1550 0x7f7cc80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.059+0000 7f7cc3fff700 1 -- 172.21.15.5:0/290831818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0094e0 con 0x5611c915bfd0 2023-10-07T00:15:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.059+0000 7f7cc3fff700 1 -- 172.21.15.5:0/290831818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ccc007970 con 0x5611c915bfd0 2023-10-07T00:15:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.059+0000 7f7cc3fff700 1 -- 172.21.15.5:0/290831818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc015830 con 0x5611c915bfd0 2023-10-07T00:15:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.059+0000 7f7cde79c700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7cc80a1550 0x7f7cc80a3a10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00074a0 tx=0x7f7cd0007e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.060+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/290831818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 msgr2=0x5611c915c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.060+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c915c450 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc01d000 tx=0x7f7ccc006210 comp rx=0 tx=0).stop 2023-10-07T00:15:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.060+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/290831818 shutdown_connections 2023-10-07T00:15:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.060+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 0x5611c9163220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.060+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c915b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.060+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/290831818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c915c450 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.060+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/290831818 >> 172.21.15.5:0/290831818 conn(0x5611c90cf200 msgr2=0x5611c9155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.061+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/290831818 shutdown_connections 2023-10-07T00:15:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.061+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/290831818 wait complete. 2023-10-07T00:15:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.062+0000 7f7cf3b3fb80 1 -- start start 2023-10-07T00:15:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.062+0000 7f7cf3b3fb80 1 Processor -- start 2023-10-07T00:15:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.063+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9175ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.063+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915bfd0 0x5611c91760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.063+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915c990 0x5611c917d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.063+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c90addd0 con 0x5611c915c990 2023-10-07T00:15:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.063+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c904a6b0 con 0x5611c915aec0 2023-10-07T00:15:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.063+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c904a350 con 0x5611c915bfd0 2023-10-07T00:15:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.063+0000 7f7cf3b3fb80 10 client.0 _ll_register_callbacks cb 0x5611c8ea77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.064+0000 7f7cddf9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915bfd0 0x5611c91760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.064+0000 7f7cddf9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915bfd0 0x5611c91760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38578/0 (socket says 172.21.15.5:38578) 2023-10-07T00:15:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.064+0000 7f7cddf9b700 1 -- 172.21.15.5:0/71396578 learned_addr learned my addr 172.21.15.5:0/71396578 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.064+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9175ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.065+0000 7f7cddf9b700 1 -- 172.21.15.5:0/71396578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 msgr2=0x5611c9175ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.065+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9175ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.065+0000 7f7cddf9b700 1 -- 172.21.15.5:0/71396578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915c990 msgr2=0x5611c917d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.065+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915c990 0x5611c917d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.065+0000 7f7cddf9b700 1 -- 172.21.15.5:0/71396578 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd80732a0 con 0x5611c915bfd0 2023-10-07T00:15:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.065+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915bfd0 0x5611c91760e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009a20 tx=0x7f7ccc013300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2489f819a9d76ca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.065+0000 7f7cc17fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:15:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.066+0000 7f7cc17fa700 1 -- 172.21.15.5:0/71396578 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0076a0 con 0x5611c915bfd0 2023-10-07T00:15:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.066+0000 7f7cc17fa700 1 -- 172.21.15.5:0/71396578 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7ccc00e070 con 0x5611c915bfd0 2023-10-07T00:15:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.066+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/71396578 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611c914dd50 con 0x5611c915bfd0 2023-10-07T00:15:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.067+0000 7f7cc17fa700 1 -- 172.21.15.5:0/71396578 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ccc007800 con 0x5611c915bfd0 2023-10-07T00:15:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.068+0000 7f7cf3b3fb80 10 client.26002 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.068+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/71396578 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5611c8ec1c00 con 0x5611c915bfd0 2023-10-07T00:15:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.069+0000 7f7cc17fa700 1 -- 172.21.15.5:0/71396578 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5611c914dd50 con 0x5611c915bfd0 2023-10-07T00:15:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.069+0000 7f7cc17fa700 1 -- 172.21.15.5:0/71396578 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7ccc031070 con 0x5611c915bfd0 2023-10-07T00:15:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.069+0000 7f7cf3b3fb80 10 client.26002 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.069+0000 7f7cf3b3fb80 10 client.26002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.069+0000 7f7cf3b3fb80 20 client.26002 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.069+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9181520 0x5611c9183940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.069+0000 7f7cf3b3fb80 4 client.26002 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.069+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/71396578 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611c90a6db0 con 0x5611c9181520 2023-10-07T00:15:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.070+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9181520 0x5611c9183940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.070+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9181520 0x5611c9183940 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cffd60f8c7fd917 server_cookie=a029d88835e8e0ca in_seq=0 out_seq=0 2023-10-07T00:15:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.070+0000 7f7cc17fa700 10 client.26002 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.071+0000 7f7cc17fa700 1 -- 172.21.15.5:0/71396578 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5611c90a6db0 con 0x5611c9181520 2023-10-07T00:15:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.071+0000 7f7cc17fa700 10 client.26002 handle_command_reply: tid=0 2023-10-07T00:15:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 client.26002 shutdown 2023-10-07T00:15:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/71396578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915bfd0 msgr2=0x5611c91760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915bfd0 0x5611c91760e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009a20 tx=0x7f7ccc013300 comp rx=0 tx=0).stop 2023-10-07T00:15:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/71396578 shutdown_connections 2023-10-07T00:15:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9181520 0x5611c9183940 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915c990 0x5611c917d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9175ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/71396578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915bfd0 0x5611c91760e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/71396578 >> 172.21.15.5:0/71396578 conn(0x5611c90cf200 msgr2=0x5611c9155250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.072+0000 7f7cc17fa700 0 client.26002 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.073+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/71396578 shutdown_connections 2023-10-07T00:15:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.073+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/71396578 wait complete. 2023-10-07T00:15:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.073+0000 7f7cf3b3fb80 20 client.26002 trim_cache size 0 max 16384 2023-10-07T00:15:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.100+0000 7f7cf3b3fb80 1 Processor -- start 2023-10-07T00:15:15.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.100+0000 7f7cf3b3fb80 1 -- start start 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c9162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c917d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 0x5611c9175ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c8f2e8c0 con 0x5611c915bfd0 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9175710 con 0x5611c915c990 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c915f480 con 0x5611c915aec0 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cdd79a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c9162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cdd79a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c9162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38582/0 (socket says 172.21.15.5:38582) 2023-10-07T00:15:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cdd79a700 1 -- 172.21.15.5:0/706028054 learned_addr learned my addr 172.21.15.5:0/706028054 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 0x5611c9175ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.101+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c917d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.102+0000 7f7cdd79a700 1 -- 172.21.15.5:0/706028054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 msgr2=0x5611c9175ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.102+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 0x5611c9175ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.102+0000 7f7cdd79a700 1 -- 172.21.15.5:0/706028054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 msgr2=0x5611c917d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.102+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c917d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.102+0000 7f7cdd79a700 1 -- 172.21.15.5:0/706028054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c8eff1f0 con 0x5611c915aec0 2023-10-07T00:15:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.103+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c9162da0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5611c9184210 tx=0x7f7cc4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ebb4c00da0a351e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.104+0000 7f7cd4ff9700 1 -- 172.21.15.5:0/706028054 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc40169b0 con 0x5611c915aec0 2023-10-07T00:15:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.104+0000 7f7cd4ff9700 1 -- 172.21.15.5:0/706028054 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cc4026020 con 0x5611c915aec0 2023-10-07T00:15:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.104+0000 7f7cd4ff9700 1 -- 172.21.15.5:0/706028054 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc401eea0 con 0x5611c915aec0 2023-10-07T00:15:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/706028054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 msgr2=0x5611c9162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c9162da0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5611c9184210 tx=0x7f7cc4008040 comp rx=0 tx=0).stop 2023-10-07T00:15:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/706028054 shutdown_connections 2023-10-07T00:15:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915c990 0x5611c9175ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915aec0 0x5611c9162da0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/706028054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c917d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/706028054 >> 172.21.15.5:0/706028054 conn(0x5611c90cf200 msgr2=0x5611c91748e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:15.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/706028054 shutdown_connections 2023-10-07T00:15:15.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.105+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/706028054 wait complete. 2023-10-07T00:15:15.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.106+0000 7f7cf3b3fb80 1 -- start start 2023-10-07T00:15:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:14 smithi005 ceph-mon[129406]: pgmap v420: 97 pgs: 97 active+clean; 91 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-10-07T00:15:15.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.107+0000 7f7cf3b3fb80 1 Processor -- start 2023-10-07T00:15:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.108+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9179180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.108+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c91796c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.108+0000 7f7cf3b3fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915c990 0x5611c917c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.108+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c917cc20 con 0x5611c915bfd0 2023-10-07T00:15:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.108+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c917cd90 con 0x5611c915aec0 2023-10-07T00:15:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.108+0000 7f7cf3b3fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c917cf50 con 0x5611c915c990 2023-10-07T00:15:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.108+0000 7f7cf3b3fb80 10 client.0 _ll_register_callbacks cb 0x7f7cc400ad80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.109+0000 7f7cdd79a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9179180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.109+0000 7f7cdd79a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9179180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:60520/0 (socket says 172.21.15.5:60520) 2023-10-07T00:15:15.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.109+0000 7f7cdd79a700 1 -- 172.21.15.5:0/3528160613 learned_addr learned my addr 172.21.15.5:0/3528160613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:15.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.109+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c91796c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.109+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915c990 0x5611c917c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.110+0000 7f7cdd79a700 1 -- 172.21.15.5:0/3528160613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915c990 msgr2=0x5611c917c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.110+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915c990 0x5611c917c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.110+0000 7f7cdd79a700 1 -- 172.21.15.5:0/3528160613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 msgr2=0x5611c91796c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.110+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c91796c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.110+0000 7f7cdd79a700 1 -- 172.21.15.5:0/3528160613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc400e040 con 0x5611c915aec0 2023-10-07T00:15:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.111+0000 7f7cdd79a700 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9179180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400ad50 tx=0x7f7cc4022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eacf05bfcfcc6ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.111+0000 7f7cc17fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:15:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.111+0000 7f7cc17fa700 1 -- 172.21.15.5:0/3528160613 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4016a70 con 0x5611c915aec0 2023-10-07T00:15:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.111+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/3528160613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ccc007970 con 0x5611c915aec0 2023-10-07T00:15:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.111+0000 7f7cc17fa700 1 -- 172.21.15.5:0/3528160613 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7cc4027030 con 0x5611c915aec0 2023-10-07T00:15:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cc17fa700 1 -- 172.21.15.5:0/3528160613 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cc4016bd0 con 0x5611c915aec0 2023-10-07T00:15:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cf3b3fb80 10 client.26030 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/3528160613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5611c8ed7250 con 0x5611c915aec0 2023-10-07T00:15:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cc17fa700 1 -- 172.21.15.5:0/3528160613 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ccc007970 con 0x5611c915aec0 2023-10-07T00:15:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cc17fa700 1 -- 172.21.15.5:0/3528160613 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7cc4018c50 con 0x5611c915aec0 2023-10-07T00:15:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cf3b3fb80 10 client.26030 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cf3b3fb80 10 client.26030 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cf3b3fb80 20 client.26030 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.112+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c91e7590 0x5611c91e99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.113+0000 7f7cf3b3fb80 4 client.26030 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:15:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.113+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/3528160613 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5611c90a6ad0 con 0x5611c91e7590 2023-10-07T00:15:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.113+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c91e7590 0x5611c91e99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.114+0000 7f7cddf9b700 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c91e7590 0x5611c91e99b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a1fad2aa2c6206a server_cookie=a60fd52c1aabda3f in_seq=0 out_seq=0 2023-10-07T00:15:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.114+0000 7f7cc17fa700 10 client.26030 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cc17fa700 1 -- 172.21.15.5:0/3528160613 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5611c90a6ad0 con 0x5611c91e7590 2023-10-07T00:15:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cc17fa700 10 client.26030 handle_command_reply: tid=0 2023-10-07T00:15:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 client.26030 shutdown 2023-10-07T00:15:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/3528160613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 msgr2=0x5611c9179180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9179180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400ad50 tx=0x7f7cc4022040 comp rx=0 tx=0).stop 2023-10-07T00:15:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/3528160613 shutdown_connections 2023-10-07T00:15:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c91e7590 0x5611c91e99b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c915c990 0x5611c917c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c915aec0 0x5611c9179180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 --2- 172.21.15.5:0/3528160613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c915bfd0 0x5611c91796c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.159+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/3528160613 >> 172.21.15.5:0/3528160613 conn(0x5611c90cf200 msgr2=0x5611c9162da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.160+0000 7f7cc17fa700 0 client.26030 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.160+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/3528160613 shutdown_connections 2023-10-07T00:15:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.160+0000 7f7cf3b3fb80 1 -- 172.21.15.5:0/3528160613 wait complete. 2023-10-07T00:15:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7cf3b3fb80 20 client.26030 trim_cache size 0 max 16384 2023-10-07T00:15:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:15:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:15:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:15:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:15:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 -- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7cc80a1550 msgr2=0x7f7cc80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7cc80a1550 0x7f7cc80a3a10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00074a0 tx=0x7f7cd0007e80 comp rx=0 tx=0).stop 2023-10-07T00:15:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 -- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8102a20 msgr2=0x7f7cd819bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8102a20 0x7f7cd819bfc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000c970 tx=0x7f7cd000cd30 comp rx=0 tx=0).stop 2023-10-07T00:15:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 -- 172.21.15.5:0/1656866212 shutdown_connections 2023-10-07T00:15:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f7cc80a1550 0x7f7cc80a3a10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cd8102a20 0x7f7cd819bfc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8100f10 0x7f7cd8194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 --2- 172.21.15.5:0/1656866212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cd8102060 0x7f7cd8194f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.161+0000 7f7ce01ff700 1 -- 172.21.15.5:0/1656866212 >> 172.21.15.5:0/1656866212 conn(0x7f7cd80fc480 msgr2=0x7f7cd8105690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.162+0000 7f7ce01ff700 1 -- 172.21.15.5:0/1656866212 shutdown_connections 2023-10-07T00:15:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:15.162+0000 7f7ce01ff700 1 -- 172.21.15.5:0/1656866212 wait complete. 2023-10-07T00:15:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:14 smithi088 ceph-mon[103111]: pgmap v420: 97 pgs: 97 active+clean; 91 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-10-07T00:15:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:14 smithi112 ceph-mon[133548]: pgmap v420: 97 pgs: 97 active+clean; 91 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-10-07T00:15:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:16 smithi005 ceph-mon[129406]: pgmap v421: 97 pgs: 97 active+clean; 95 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-10-07T00:15:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:16 smithi088 ceph-mon[103111]: pgmap v421: 97 pgs: 97 active+clean; 95 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-10-07T00:15:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:16 smithi112 ceph-mon[133548]: pgmap v421: 97 pgs: 97 active+clean; 95 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-10-07T00:15:17.764 INFO:tasks.workunit.client.0.smithi005.stdout: 25 7083 245 4397 64 348 83 2023-10-07T00:15:19.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:18 smithi005 ceph-mon[129406]: pgmap v422: 97 pgs: 97 active+clean; 97 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2023-10-07T00:15:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:18 smithi088 ceph-mon[103111]: pgmap v422: 97 pgs: 97 active+clean; 97 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2023-10-07T00:15:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:18 smithi112 ceph-mon[133548]: pgmap v422: 97 pgs: 97 active+clean; 97 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2023-10-07T00:15:19.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-07T00:15:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 -- 172.21.15.5:0/2317916784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 msgr2=0x7fab38104ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 --2- 172.21.15.5:0/2317916784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 0x7fab38104ff0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab3000b0a0 tx=0x7fab3000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 -- 172.21.15.5:0/2317916784 shutdown_connections 2023-10-07T00:15:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 --2- 172.21.15.5:0/2317916784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 0x7fab38104ff0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 --2- 172.21.15.5:0/2317916784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab380ff830 0x7fab38101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 --2- 172.21.15.5:0/2317916784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab381021a0 0x7fab38104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 -- 172.21.15.5:0/2317916784 >> 172.21.15.5:0/2317916784 conn(0x7fab380fb450 msgr2=0x7fab380fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 -- 172.21.15.5:0/2317916784 shutdown_connections 2023-10-07T00:15:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.781+0000 7fab401ff700 1 -- 172.21.15.5:0/2317916784 wait complete. 2023-10-07T00:15:19.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.783+0000 7fab401ff700 1 Processor -- start 2023-10-07T00:15:19.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.783+0000 7fab401ff700 1 -- start start 2023-10-07T00:15:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab401ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab380ff830 0x7fab3819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab401ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab381021a0 0x7fab3819d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab401ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 0x7fab381a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab401ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab381a4e80 con 0x7fab381021a0 2023-10-07T00:15:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab401ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab381a4fc0 con 0x7fab38104b70 2023-10-07T00:15:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab401ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab381a5150 con 0x7fab380ff830 2023-10-07T00:15:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab3e79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 0x7fab381a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab3e79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 0x7fab381a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:60542/0 (socket says 172.21.15.5:60542) 2023-10-07T00:15:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab3e79c700 1 -- 172.21.15.5:0/132103341 learned_addr learned my addr 172.21.15.5:0/132103341 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab3d79a700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab381021a0 0x7fab3819d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.784+0000 7fab3df9b700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab380ff830 0x7fab3819d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.785+0000 7fab3e79c700 1 -- 172.21.15.5:0/132103341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab380ff830 msgr2=0x7fab3819d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.785+0000 7fab3e79c700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab380ff830 0x7fab3819d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.785+0000 7fab3e79c700 1 -- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab381021a0 msgr2=0x7fab3819d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.785+0000 7fab3e79c700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab381021a0 0x7fab3819d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.785+0000 7fab3e79c700 1 -- 172.21.15.5:0/132103341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30009d00 con 0x7fab38104b70 2023-10-07T00:15:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.785+0000 7fab3d79a700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab381021a0 0x7fab3819d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:15:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.785+0000 7fab3df9b700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab380ff830 0x7fab3819d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:15:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.785+0000 7fab3e79c700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 0x7fab381a48b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab3000d010 tx=0x7fab3000bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.786+0000 7fab2effd700 1 -- 172.21.15.5:0/132103341 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3000e040 con 0x7fab38104b70 2023-10-07T00:15:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.786+0000 7fab2effd700 1 -- 172.21.15.5:0/132103341 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab30003e10 con 0x7fab38104b70 2023-10-07T00:15:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.786+0000 7fab2effd700 1 -- 172.21.15.5:0/132103341 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab300053c0 con 0x7fab38104b70 2023-10-07T00:15:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.786+0000 7fab401ff700 1 -- 172.21.15.5:0/132103341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab381a53d0 con 0x7fab38104b70 2023-10-07T00:15:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.786+0000 7fab401ff700 1 -- 172.21.15.5:0/132103341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab381a5820 con 0x7fab38104b70 2023-10-07T00:15:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.789+0000 7fab2effd700 1 -- 172.21.15.5:0/132103341 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fab3001db10 con 0x7fab38104b70 2023-10-07T00:15:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab53ac0b80 1 Processor -- start 2023-10-07T00:15:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab53ac0b80 1 -- start start 2023-10-07T00:15:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab2effd700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fab240a15d0 0x7fab240a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab2effd700 1 -- 172.21.15.5:0/132103341 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fab300cdec0 con 0x7fab38104b70 2023-10-07T00:15:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16260 0x564ce5a16680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a17480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a17ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce597e460 con 0x564ce5a16bc0 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce596fc20 con 0x564ce5a16260 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce596d540 con 0x564ce5a17a60 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.791+0000 7fab3d79a700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fab240a15d0 0x7fab240a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16260 0x564ce5a16680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16260 0x564ce5a16680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:60546/0 (socket says 172.21.15.5:60546) 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 -- 172.21.15.5:0/480380667 learned_addr learned my addr 172.21.15.5:0/480380667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3e79c700 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a17ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3d79a700 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a17480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 -- 172.21.15.5:0/480380667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 msgr2=0x564ce5a17ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:19.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a17ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 -- 172.21.15.5:0/480380667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 msgr2=0x564ce5a17480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:19.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a17480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 -- 172.21.15.5:0/480380667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ce5793de0 con 0x564ce5a16260 2023-10-07T00:15:19.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3df9b700 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16260 0x564ce5a16680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab34009de0 tx=0x7fab340116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e75b0de67bf33b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:19.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.792+0000 7fab3d79a700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fab240a15d0 0x7fab240a3a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fab28009e80 tx=0x7fab28014570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab23fff700 1 -- 172.21.15.5:0/480380667 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34011ed0 con 0x564ce5a16260 2023-10-07T00:15:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab23fff700 1 -- 172.21.15.5:0/480380667 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab340128e0 con 0x564ce5a16260 2023-10-07T00:15:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab23fff700 1 -- 172.21.15.5:0/480380667 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400f800 con 0x564ce5a16260 2023-10-07T00:15:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 -- 172.21.15.5:0/480380667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16260 msgr2=0x564ce5a16680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16260 0x564ce5a16680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab34009de0 tx=0x7fab340116c0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 -- 172.21.15.5:0/480380667 shutdown_connections 2023-10-07T00:15:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a17ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16260 0x564ce5a16680 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/480380667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a17480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 -- 172.21.15.5:0/480380667 >> 172.21.15.5:0/480380667 conn(0x564ce598a260 msgr2=0x564ce5a11140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 -- 172.21.15.5:0/480380667 shutdown_connections 2023-10-07T00:15:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.793+0000 7fab53ac0b80 1 -- 172.21.15.5:0/480380667 wait complete. 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.794+0000 7fab53ac0b80 1 -- start start 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.794+0000 7fab53ac0b80 1 Processor -- start 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 0x564ce5a1fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a20530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a17a60 0x564ce5a27570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce5968e30 con 0x564ce5a16bc0 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce5905710 con 0x564ce5a17a60 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce59053b0 con 0x564ce5a16260 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab53ac0b80 10 client.0 _ll_register_callbacks cb 0x564ce5762800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab3d79a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a20530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab3d79a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a20530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52702/0 (socket says 172.21.15.5:52702) 2023-10-07T00:15:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab3d79a700 1 -- 172.21.15.5:0/4051814937 learned_addr learned my addr 172.21.15.5:0/4051814937 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab3df9b700 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 0x564ce5a1fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab3e79c700 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a17a60 0x564ce5a27570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.795+0000 7fab3e79c700 1 -- 172.21.15.5:0/4051814937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 msgr2=0x564ce5a1fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab3e79c700 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 0x564ce5a1fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab3e79c700 1 -- 172.21.15.5:0/4051814937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 msgr2=0x564ce5a20530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab3e79c700 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a20530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab3e79c700 1 -- 172.21.15.5:0/4051814937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab34009a10 con 0x564ce5a17a60 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab3d79a700 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a20530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:15:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab3e79c700 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a17a60 0x564ce5a27570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab300cb940 tx=0x7fab3009ae00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96ebf6025f53354 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab217fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab217fa700 1 -- 172.21.15.5:0/4051814937 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3009f170 con 0x564ce5a17a60 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab217fa700 1 -- 172.21.15.5:0/4051814937 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fab3009b1f0 con 0x564ce5a17a60 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab53ac0b80 1 -- 172.21.15.5:0/4051814937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ce5a08f10 con 0x564ce5a17a60 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab217fa700 1 -- 172.21.15.5:0/4051814937 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab3009f340 con 0x564ce5a17a60 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab53ac0b80 10 client.26042 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.796+0000 7fab53ac0b80 1 -- 172.21.15.5:0/4051814937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564ce577cc60 con 0x564ce5a17a60 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab217fa700 1 -- 172.21.15.5:0/4051814937 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab300a7080 con 0x564ce5a17a60 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab217fa700 1 -- 172.21.15.5:0/4051814937 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fab3009a6e0 con 0x564ce5a17a60 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab53ac0b80 10 client.26042 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab53ac0b80 10 client.26042 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab53ac0b80 20 client.26042 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564ce5a2bc00 0x564ce5a2e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab53ac0b80 4 client.26042 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab53ac0b80 1 -- 172.21.15.5:0/4051814937 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ce5961e10 con 0x564ce5a2bc00 2023-10-07T00:15:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.797+0000 7fab3df9b700 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564ce5a2bc00 0x564ce5a2e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.798+0000 7fab3df9b700 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564ce5a2bc00 0x564ce5a2e020 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ffdfc0537620c8f server_cookie=8c187bc08669a264 in_seq=0 out_seq=0 2023-10-07T00:15:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.798+0000 7fab217fa700 10 client.26042 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab217fa700 1 -- 172.21.15.5:0/4051814937 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564ce5961e10 con 0x564ce5a2bc00 2023-10-07T00:15:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab217fa700 10 client.26042 handle_command_reply: tid=0 2023-10-07T00:15:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 client.26042 shutdown 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 -- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a17a60 msgr2=0x564ce5a27570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a17a60 0x564ce5a27570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab300cb940 tx=0x7fab3009ae00 comp rx=0 tx=0).stop 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 -- 172.21.15.5:0/4051814937 shutdown_connections 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564ce5a2bc00 0x564ce5a2e020 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a17a60 0x564ce5a27570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 0x564ce5a1fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/4051814937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16bc0 0x564ce5a20530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab217fa700 0 client.26042 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 -- 172.21.15.5:0/4051814937 >> 172.21.15.5:0/4051814937 conn(0x564ce598a260 msgr2=0x564ce5a10f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 -- 172.21.15.5:0/4051814937 shutdown_connections 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 1 -- 172.21.15.5:0/4051814937 wait complete. 2023-10-07T00:15:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.799+0000 7fab53ac0b80 20 client.26042 trim_cache size 0 max 16384 2023-10-07T00:15:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab53ac0b80 1 Processor -- start 2023-10-07T00:15:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab53ac0b80 1 -- start start 2023-10-07T00:15:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 0x564ce5a10f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a27530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a17a60 0x564ce5a1a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce57e9920 con 0x564ce5a17a60 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce5a17870 con 0x564ce5a16bc0 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce5a2b6c0 con 0x564ce5a16260 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab3e79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a17a60 0x564ce5a1a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab3df9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 0x564ce5a10f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab3e79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a17a60 0x564ce5a1a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52704/0 (socket says 172.21.15.5:52704) 2023-10-07T00:15:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab3e79c700 1 -- 172.21.15.5:0/209692395 learned_addr learned my addr 172.21.15.5:0/209692395 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab3e79c700 1 -- 172.21.15.5:0/209692395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 msgr2=0x564ce5a10f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab3e79c700 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 0x564ce5a10f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.818+0000 7fab3e79c700 1 -- 172.21.15.5:0/209692395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 msgr2=0x564ce5a27530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.817+0000 7fab3d79a700 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a27530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.818+0000 7fab3e79c700 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a27530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.818+0000 7fab3e79c700 1 -- 172.21.15.5:0/209692395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ce57ba250 con 0x564ce5a17a60 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.818+0000 7fab3d79a700 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a27530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.818+0000 7fab3e79c700 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a17a60 0x564ce5a1a930 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fab30009fd0 tx=0x7fab300997a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ffb0573d267b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.818+0000 7fab2cff9700 1 -- 172.21.15.5:0/209692395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3009f170 con 0x564ce5a17a60 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.818+0000 7fab2cff9700 1 -- 172.21.15.5:0/209692395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564ce5a08f10 con 0x564ce5a17a60 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.818+0000 7fab2cff9700 1 -- 172.21.15.5:0/209692395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab300a34f0 con 0x564ce5a17a60 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 -- 172.21.15.5:0/209692395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a17a60 msgr2=0x564ce5a1a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a17a60 0x564ce5a1a930 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fab30009fd0 tx=0x7fab300997a0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 -- 172.21.15.5:0/209692395 shutdown_connections 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a17a60 0x564ce5a1a930 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a16260 0x564ce5a10f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/209692395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a27530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 -- 172.21.15.5:0/209692395 >> 172.21.15.5:0/209692395 conn(0x564ce598a260 msgr2=0x564ce5a1ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 -- 172.21.15.5:0/209692395 shutdown_connections 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 -- 172.21.15.5:0/209692395 wait complete. 2023-10-07T00:15:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.819+0000 7fab53ac0b80 1 -- start start 2023-10-07T00:15:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab53ac0b80 1 Processor -- start 2023-10-07T00:15:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16260 0x564ce5a233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a23910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab53ac0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a26930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce5a26e70 con 0x564ce5a16260 2023-10-07T00:15:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce5a26fe0 con 0x564ce5a16bc0 2023-10-07T00:15:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab53ac0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce5a271a0 con 0x564ce5a17a60 2023-10-07T00:15:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab53ac0b80 10 client.0 _ll_register_callbacks cb 0x7fab3009afc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.820+0000 7fab3df9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16260 0x564ce5a233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3df9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16260 0x564ce5a233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52712/0 (socket says 172.21.15.5:52712) 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3df9b700 1 -- 172.21.15.5:0/2286033461 learned_addr learned my addr 172.21.15.5:0/2286033461 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3d79a700 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a23910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3e79c700 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a26930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3df9b700 1 -- 172.21.15.5:0/2286033461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 msgr2=0x564ce5a26930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3df9b700 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a26930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3df9b700 1 -- 172.21.15.5:0/2286033461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 msgr2=0x564ce5a23910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3df9b700 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a23910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3df9b700 1 -- 172.21.15.5:0/2286033461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ce577cc60 con 0x564ce5a16260 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3e79c700 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a26930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:15:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab3df9b700 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16260 0x564ce5a233d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fab340059d0 tx=0x7fab34011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73a13ce0eefe2dd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab217fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab217fa700 1 -- 172.21.15.5:0/2286033461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34012c50 con 0x564ce5a16260 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab217fa700 1 -- 172.21.15.5:0/2286033461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fab34012db0 con 0x564ce5a16260 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.821+0000 7fab53ac0b80 1 -- 172.21.15.5:0/2286033461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab340128e0 con 0x564ce5a16260 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab217fa700 1 -- 172.21.15.5:0/2286033461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab3402a1c0 con 0x564ce5a16260 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab53ac0b80 10 client.16236 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab53ac0b80 1 -- 172.21.15.5:0/2286033461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564ce57922b0 con 0x564ce5a16260 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab217fa700 1 -- 172.21.15.5:0/2286033461 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab340128e0 con 0x564ce5a16260 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab217fa700 1 -- 172.21.15.5:0/2286033461 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fab34030020 con 0x564ce5a16260 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab53ac0b80 10 client.16236 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab53ac0b80 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab53ac0b80 20 client.16236 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564ce5a80a70 0x564ce5a82e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab53ac0b80 4 client.16236 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab53ac0b80 1 -- 172.21.15.5:0/2286033461 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564ce5961b30 con 0x564ce5a80a70 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.822+0000 7fab3d79a700 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564ce5a80a70 0x564ce5a82e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab3d79a700 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564ce5a80a70 0x564ce5a82e90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=737e79989ac9ee4b server_cookie=300f617fc3576399 in_seq=0 out_seq=0 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab217fa700 10 client.16236 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab217fa700 1 -- 172.21.15.5:0/2286033461 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564ce5961b30 con 0x564ce5a80a70 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab217fa700 10 client.16236 handle_command_reply: tid=0 2023-10-07T00:15:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 client.16236 shutdown 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 -- 172.21.15.5:0/2286033461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16260 msgr2=0x564ce5a233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16260 0x564ce5a233d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fab340059d0 tx=0x7fab34011df0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 -- 172.21.15.5:0/2286033461 shutdown_connections 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564ce5a80a70 0x564ce5a82e90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ce5a17a60 0x564ce5a26930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab217fa700 0 client.16236 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ce5a16260 0x564ce5a233d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 --2- 172.21.15.5:0/2286033461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ce5a16bc0 0x564ce5a23910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.823+0000 7fab53ac0b80 1 -- 172.21.15.5:0/2286033461 >> 172.21.15.5:0/2286033461 conn(0x564ce598a260 msgr2=0x564ce5a1ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab53ac0b80 1 -- 172.21.15.5:0/2286033461 shutdown_connections 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab53ac0b80 1 -- 172.21.15.5:0/2286033461 wait complete. 2023-10-07T00:15:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab53ac0b80 20 client.16236 trim_cache size 0 max 16384 2023-10-07T00:15:19.831 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:15:19.831 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2023-10-07T00:15:19.831 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2023-10-07T00:15:19.831 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 -- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fab240a15d0 msgr2=0x7fab240a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fab240a15d0 0x7fab240a3a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fab28009e80 tx=0x7fab28014570 comp rx=0 tx=0).stop 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 -- 172.21.15.5:0/132103341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 msgr2=0x7fab381a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 0x7fab381a48b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab3000d010 tx=0x7fab3000bd70 comp rx=0 tx=0).stop 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 -- 172.21.15.5:0/132103341 shutdown_connections 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fab240a15d0 0x7fab240a3a90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab38104b70 0x7fab381a48b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab380ff830 0x7fab3819d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 --2- 172.21.15.5:0/132103341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab381021a0 0x7fab3819d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.824+0000 7fab401ff700 1 -- 172.21.15.5:0/132103341 >> 172.21.15.5:0/132103341 conn(0x7fab380fb450 msgr2=0x7fab381004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.825+0000 7fab401ff700 1 -- 172.21.15.5:0/132103341 shutdown_connections 2023-10-07T00:15:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:19.825+0000 7fab401ff700 1 -- 172.21.15.5:0/132103341 wait complete. 2023-10-07T00:15:19.843 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-07T00:15:19.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T00:15:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 -- 172.21.15.5:0/1520913805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c104370 msgr2=0x7f447c106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 --2- 172.21.15.5:0/1520913805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c104370 0x7f447c106760 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4470009990 tx=0x7f4470009ca0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 -- 172.21.15.5:0/1520913805 shutdown_connections 2023-10-07T00:15:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 --2- 172.21.15.5:0/1520913805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f447c106ca0 0x7f447c109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 --2- 172.21.15.5:0/1520913805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c101a40 0x7f447c103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 --2- 172.21.15.5:0/1520913805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c104370 0x7f447c106760 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 -- 172.21.15.5:0/1520913805 >> 172.21.15.5:0/1520913805 conn(0x7f447c0fb410 msgr2=0x7f447c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:20.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 -- 172.21.15.5:0/1520913805 shutdown_connections 2023-10-07T00:15:20.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.044+0000 7f4480bff700 1 -- 172.21.15.5:0/1520913805 wait complete. 2023-10-07T00:15:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.045+0000 7f4480bff700 1 Processor -- start 2023-10-07T00:15:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f4480bff700 1 -- start start 2023-10-07T00:15:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f4480bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f447c101a40 0x7f447c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f4480bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c104370 0x7f447c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f4480bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c106ca0 0x7f447c1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f4480bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1a0940 con 0x7f447c106ca0 2023-10-07T00:15:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f4480bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1a0a80 con 0x7f447c101a40 2023-10-07T00:15:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f4480bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1a0c10 con 0x7f447c104370 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f447ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c106ca0 0x7f447c1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f447a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f447c101a40 0x7f447c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f447ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c106ca0 0x7f447c1a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52716/0 (socket says 172.21.15.5:52716) 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f447ad9d700 1 -- 172.21.15.5:0/2414345022 learned_addr learned my addr 172.21.15.5:0/2414345022 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.046+0000 7f4479d9b700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c104370 0x7f447c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f447ad9d700 1 -- 172.21.15.5:0/2414345022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c104370 msgr2=0x7f447c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f447ad9d700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c104370 0x7f447c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f447ad9d700 1 -- 172.21.15.5:0/2414345022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f447c101a40 msgr2=0x7f447c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f447ad9d700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f447c101a40 0x7f447c198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f447ad9d700 1 -- 172.21.15.5:0/2414345022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700095f0 con 0x7f447c106ca0 2023-10-07T00:15:20.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f447ad9d700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c106ca0 0x7f447c1a0370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f447400ef30 tx=0x7f447400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:20.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f446b7fe700 1 -- 172.21.15.5:0/2414345022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474018070 con 0x7f447c106ca0 2023-10-07T00:15:20.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f446b7fe700 1 -- 172.21.15.5:0/2414345022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f447400f040 con 0x7f447c106ca0 2023-10-07T00:15:20.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c1a0e90 con 0x7f447c106ca0 2023-10-07T00:15:20.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f446b7fe700 1 -- 172.21.15.5:0/2414345022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400cc70 con 0x7f447c106ca0 2023-10-07T00:15:20.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.047+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c1a1310 con 0x7f447c106ca0 2023-10-07T00:15:20.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.048+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c108820 con 0x7f447c106ca0 2023-10-07T00:15:20.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.050+0000 7f446b7fe700 1 -- 172.21.15.5:0/2414345022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4474007500 con 0x7f447c106ca0 2023-10-07T00:15:20.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.052+0000 7f446b7fe700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44640a1500 0x7f44640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.052+0000 7f446b7fe700 1 -- 172.21.15.5:0/2414345022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f44740cc870 con 0x7f447c106ca0 2023-10-07T00:15:20.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.052+0000 7f447a59c700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44640a1500 0x7f44640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.053+0000 7f447a59c700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44640a1500 0x7f44640a39c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f446c005950 tx=0x7f446c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:20.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.056+0000 7f446b7fe700 1 -- 172.21.15.5:0/2414345022 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4474095ee0 con 0x7f447c106ca0 2023-10-07T00:15:20.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.433+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f447c10c6b0 con 0x7f447c106ca0 2023-10-07T00:15:20.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.434+0000 7f446b7fe700 1 -- 172.21.15.5:0/2414345022 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+11354 (secure 0 0 0) 0x7f4474099500 con 0x7f447c106ca0 2023-10-07T00:15:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:15:20.436 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14577,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/1806621495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1806621495},{"type":"v1","addr":"172.21.15.88:6833","nonce":1806621495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":14595,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/661622030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":661622030},{"type":"v1","addr":"172.21.15.5:6835","nonce":661622030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-07T00:11:13.365038+0000","modified":"2023-10-07T00:14:57.349591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24611,"mds_1":24574,"mds_2":24566,"mds_3":24553,"mds_4":14682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6837/3650932338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3650932338},{"type":"v1","addr":"172.21.15.5:6837","nonce":3650932338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14682":{"gid":14682,"name":"g","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6839/2286789609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2286789609},{"type":"v1","addr":"172.21.15.5:6839","nonce":2286789609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2184532481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2184532481},{"type":"v1","addr":"172.21.15.112:6833","nonce":2184532481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6835/987389810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":987389810},{"type":"v1","addr":"172.21.15.88:6835","nonce":987389810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1364284217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1364284217},{"type":"v1","addr":"172.21.15.112:6835","nonce":1364284217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/963373716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":963373716},{"type":"v1","addr":"172.21.15.112:6837","nonce":963373716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.112:6839/1437328815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1437328815},{"type":"v1","addr":"172.21.15.112:6839","nonce":1437328815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.88:6837/3467169858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":3467169858},{"type":"v1","addr":"172.21.15.88:6837","nonce":3467169858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":60,"addr":"172.21.15.5:6841/3808461894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3808461894},{"type":"v1","addr":"172.21.15.5:6841","nonce":3808461894}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6839/4013876185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":4013876185},{"type":"v1","addr":"172.21.15.88:6839","nonce":4013876185}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-07T00:15:20.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.438+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44640a1500 msgr2=0x7f44640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.438+0000 7f4480bff700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44640a1500 0x7f44640a39c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f446c005950 tx=0x7f446c00b410 comp rx=0 tx=0).stop 2023-10-07T00:15:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.438+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c106ca0 msgr2=0x7f447c1a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.438+0000 7f4480bff700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c106ca0 0x7f447c1a0370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f447400ef30 tx=0x7f447400c3a0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.439+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 shutdown_connections 2023-10-07T00:15:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.439+0000 7f4480bff700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44640a1500 0x7f44640a39c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.439+0000 7f4480bff700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c106ca0 0x7f447c1a0370 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.439+0000 7f4480bff700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f447c101a40 0x7f447c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.439+0000 7f4480bff700 1 --2- 172.21.15.5:0/2414345022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c104370 0x7f447c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.439+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 >> 172.21.15.5:0/2414345022 conn(0x7f447c0fb410 msgr2=0x7f447c1026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.439+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 shutdown_connections 2023-10-07T00:15:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.439+0000 7f4480bff700 1 -- 172.21.15.5:0/2414345022 wait complete. 2023-10-07T00:15:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2023-10-07T00:15:20.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-07T00:15:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 -- 172.21.15.5:0/645775360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9070074ef0 msgr2=0x7f9070073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 --2- 172.21.15.5:0/645775360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9070074ef0 0x7f9070073340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f906400b0a0 tx=0x7f906400b3b0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 -- 172.21.15.5:0/645775360 shutdown_connections 2023-10-07T00:15:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 --2- 172.21.15.5:0/645775360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070108e40 0x7f907010b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 --2- 172.21.15.5:0/645775360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9070074ef0 0x7f9070073340 secure :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f906400b0a0 tx=0x7f906400b3b0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 --2- 172.21.15.5:0/645775360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9070073910 0x7f9070073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 -- 172.21.15.5:0/645775360 >> 172.21.15.5:0/645775360 conn(0x7f90700fc510 msgr2=0x7f90700fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 -- 172.21.15.5:0/645775360 shutdown_connections 2023-10-07T00:15:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.806+0000 7f90777ff700 1 -- 172.21.15.5:0/645775360 wait complete. 2023-10-07T00:15:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.808+0000 7f90777ff700 1 Processor -- start 2023-10-07T00:15:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.808+0000 7f90777ff700 1 -- start start 2023-10-07T00:15:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f90777ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9070073910 0x7f90701042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f90777ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9070108e40 0x7f90701047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f90777ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070100d60 0x7f9070101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f90777ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90701019b0 con 0x7f9070073910 2023-10-07T00:15:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f90777ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9070198df0 con 0x7f9070108e40 2023-10-07T00:15:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f90777ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9070198fb0 con 0x7f9070100d60 2023-10-07T00:15:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f9074d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9070108e40 0x7f90701047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f9074d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9070108e40 0x7f90701047e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:60614/0 (socket says 172.21.15.5:60614) 2023-10-07T00:15:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.809+0000 7f9074d9a700 1 -- 172.21.15.5:0/864062280 learned_addr learned my addr 172.21.15.5:0/864062280 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.810+0000 7f9075d9c700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070100d60 0x7f9070101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.810+0000 7f9074d9a700 1 -- 172.21.15.5:0/864062280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070100d60 msgr2=0x7f9070101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.810+0000 7f9074d9a700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070100d60 0x7f9070101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.810+0000 7f9074d9a700 1 -- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9070073910 msgr2=0x7f90701042a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:15:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.810+0000 7f9074d9a700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9070073910 0x7f90701042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.810+0000 7f9074d9a700 1 -- 172.21.15.5:0/864062280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060009520 con 0x7f9070108e40 2023-10-07T00:15:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.810+0000 7f9074d9a700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9070108e40 0x7f90701047e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f906000ea50 tx=0x7f906000ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.811+0000 7f906e7fc700 1 -- 172.21.15.5:0/864062280 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906000cc90 con 0x7f9070108e40 2023-10-07T00:15:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.811+0000 7f906e7fc700 1 -- 172.21.15.5:0/864062280 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f906000cdf0 con 0x7f9070108e40 2023-10-07T00:15:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.811+0000 7f906e7fc700 1 -- 172.21.15.5:0/864062280 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060018680 con 0x7f9070108e40 2023-10-07T00:15:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.811+0000 7f90777ff700 1 -- 172.21.15.5:0/864062280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9064009d00 con 0x7f9070108e40 2023-10-07T00:15:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.811+0000 7f90777ff700 1 -- 172.21.15.5:0/864062280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90701995c0 con 0x7f9070108e40 2023-10-07T00:15:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.818+0000 7f908b21fb80 1 Processor -- start 2023-10-07T00:15:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.820+0000 7f908b21fb80 1 -- start start 2023-10-07T00:15:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.821+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 0x55784dee6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.821+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784dee7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.821+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784dee7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.821+0000 7f908b21fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784de4e460 con 0x55784dee7a60 2023-10-07T00:15:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.821+0000 7f908b21fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784de3fc20 con 0x55784dee6bc0 2023-10-07T00:15:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.821+0000 7f908b21fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784de3d540 con 0x55784dee6260 2023-10-07T00:15:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784dee7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f9075d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 0x55784dee6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784dee7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:60620/0 (socket says 172.21.15.5:60620) 2023-10-07T00:15:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 -- 172.21.15.5:0/2647013200 learned_addr learned my addr 172.21.15.5:0/2647013200 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 -- 172.21.15.5:0/2647013200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 msgr2=0x55784dee6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 --2- 172.21.15.5:0/2647013200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 0x55784dee6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 -- 172.21.15.5:0/2647013200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 msgr2=0x55784dee7ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:15:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 --2- 172.21.15.5:0/2647013200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784dee7ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 -- 172.21.15.5:0/2647013200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55784dc63de0 con 0x55784dee6bc0 2023-10-07T00:15:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.822+0000 7f907559b700 1 --2- 172.21.15.5:0/2647013200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784dee7480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f906400b070 tx=0x7f9064009be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d6f423b510ff452 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:20.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.823+0000 7f90577fe700 1 -- 172.21.15.5:0/2647013200 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400e040 con 0x55784dee6bc0 2023-10-07T00:15:20.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.823+0000 7f90577fe700 1 -- 172.21.15.5:0/2647013200 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9064009460 con 0x55784dee6bc0 2023-10-07T00:15:20.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.823+0000 7f90577fe700 1 -- 172.21.15.5:0/2647013200 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064003d70 con 0x55784dee6bc0 2023-10-07T00:15:20.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.824+0000 7f906e7fc700 1 -- 172.21.15.5:0/864062280 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9060010430 con 0x7f9070108e40 2023-10-07T00:15:20.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.824+0000 7f908b21fb80 1 -- 172.21.15.5:0/2647013200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 msgr2=0x55784dee7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.824+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2647013200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784dee7480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f906400b070 tx=0x7f9064009be0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.825+0000 7f908b21fb80 1 -- 172.21.15.5:0/2647013200 shutdown_connections 2023-10-07T00:15:20.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.825+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2647013200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784dee7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.825+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2647013200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 0x55784dee6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.825+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2647013200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784dee7480 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.825+0000 7f908b21fb80 1 -- 172.21.15.5:0/2647013200 >> 172.21.15.5:0/2647013200 conn(0x55784de5a260 msgr2=0x55784dee1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:20.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.825+0000 7f908b21fb80 1 -- 172.21.15.5:0/2647013200 shutdown_connections 2023-10-07T00:15:20.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.825+0000 7f908b21fb80 1 -- 172.21.15.5:0/2647013200 wait complete. 2023-10-07T00:15:20.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.826+0000 7f908b21fb80 1 -- start start 2023-10-07T00:15:20.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.826+0000 7f908b21fb80 1 Processor -- start 2023-10-07T00:15:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.827+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee6260 0x55784df010b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.827+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 0x55784df015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.827+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee7a60 0x55784df08630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.827+0000 7f908b21fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784de38e30 con 0x55784dee6260 2023-10-07T00:15:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.827+0000 7f908b21fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784ddd5710 con 0x55784dee7a60 2023-10-07T00:15:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.827+0000 7f908b21fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784ddd53b0 con 0x55784dee6bc0 2023-10-07T00:15:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.827+0000 7f908b21fb80 10 client.0 _ll_register_callbacks cb 0x55784dc32800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.828+0000 7f9075d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee6260 0x55784df010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.828+0000 7f9075d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee6260 0x55784df010b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52758/0 (socket says 172.21.15.5:52758) 2023-10-07T00:15:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.828+0000 7f9075d9c700 1 -- 172.21.15.5:0/1183840467 learned_addr learned my addr 172.21.15.5:0/1183840467 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.828+0000 7f9074d9a700 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee7a60 0x55784df08630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.829+0000 7f907559b700 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 0x55784df015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.829+0000 7f9075d9c700 1 -- 172.21.15.5:0/1183840467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 msgr2=0x55784df015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.829+0000 7f9075d9c700 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 0x55784df015f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.829+0000 7f9075d9c700 1 -- 172.21.15.5:0/1183840467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee7a60 msgr2=0x55784df08630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.829+0000 7f9075d9c700 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee7a60 0x55784df08630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.829+0000 7f9075d9c700 1 -- 172.21.15.5:0/1183840467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907010bef0 con 0x55784dee6260 2023-10-07T00:15:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.830+0000 7f906e7fc700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90580a1560 0x7f90580a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.830+0000 7f9075d9c700 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee6260 0x55784df010b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9068011ae0 tx=0x7f9068011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f545dce5a6583a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.830+0000 7f9054ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.830+0000 7f906e7fc700 1 -- 172.21.15.5:0/864062280 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9060014070 con 0x7f9070108e40 2023-10-07T00:15:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.830+0000 7f907559b700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90580a1560 0x7f90580a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.831+0000 7f9054ff9700 1 -- 172.21.15.5:0/1183840467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800c7f0 con 0x55784dee6260 2023-10-07T00:15:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.831+0000 7f9054ff9700 1 -- 172.21.15.5:0/1183840467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f906800fcc0 con 0x55784dee6260 2023-10-07T00:15:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.831+0000 7f908b21fb80 1 -- 172.21.15.5:0/1183840467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55784ded8f10 con 0x55784dee6260 2023-10-07T00:15:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.831+0000 7f9054ff9700 1 -- 172.21.15.5:0/1183840467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f906800ced0 con 0x55784dee6260 2023-10-07T00:15:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.831+0000 7f908b21fb80 10 client.16248 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.831+0000 7f908b21fb80 1 -- 172.21.15.5:0/1183840467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55784dc4cc60 con 0x55784dee6260 2023-10-07T00:15:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f907559b700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90580a1560 0x7f90580a3a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f906400b0a0 tx=0x7f90640095d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f9054ff9700 1 -- 172.21.15.5:0/1183840467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9068028080 con 0x55784dee6260 2023-10-07T00:15:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f9054ff9700 1 -- 172.21.15.5:0/1183840467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9068022030 con 0x55784dee6260 2023-10-07T00:15:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f908b21fb80 10 client.16248 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f908b21fb80 10 client.16248 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:15:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f908b21fb80 20 client.16248 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f908b21fb80 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55784df0cef0 0x55784df0f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f908b21fb80 4 client.16248 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f908b21fb80 1 -- 172.21.15.5:0/1183840467 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55784de31e10 con 0x55784df0cef0 2023-10-07T00:15:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.832+0000 7f9074d9a700 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55784df0cef0 0x55784df0f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.833+0000 7f9074d9a700 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55784df0cef0 0x55784df0f310 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6981da0bf21fa4f server_cookie=f8a128275625a316 in_seq=0 out_seq=0 2023-10-07T00:15:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.833+0000 7f9054ff9700 10 client.16248 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:15:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.834+0000 7f9054ff9700 1 -- 172.21.15.5:0/1183840467 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55784de31e10 con 0x55784df0cef0 2023-10-07T00:15:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.834+0000 7f9054ff9700 10 client.16248 handle_command_reply: tid=0 2023-10-07T00:15:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.834+0000 7f908b21fb80 1 client.16248 shutdown 2023-10-07T00:15:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 -- 172.21.15.5:0/1183840467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee6260 msgr2=0x55784df010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee6260 0x55784df010b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9068011ae0 tx=0x7f9068011df0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 -- 172.21.15.5:0/1183840467 shutdown_connections 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55784df0cef0 0x55784df0f310 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee7a60 0x55784df08630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee6260 0x55784df010b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 --2- 172.21.15.5:0/1183840467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 0x55784df015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 -- 172.21.15.5:0/1183840467 >> 172.21.15.5:0/1183840467 conn(0x55784de5a260 msgr2=0x55784dee0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f9054ff9700 0 client.16248 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 -- 172.21.15.5:0/1183840467 shutdown_connections 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 1 -- 172.21.15.5:0/1183840467 wait complete. 2023-10-07T00:15:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.835+0000 7f908b21fb80 20 client.16248 trim_cache size 0 max 16384 2023-10-07T00:15:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.861+0000 7f908b21fb80 1 Processor -- start 2023-10-07T00:15:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.861+0000 7f908b21fb80 1 -- start start 2023-10-07T00:15:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.861+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 0x55784deeaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.861+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784deeafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.861+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.861+0000 7f908b21fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784dcb9920 con 0x55784dee7a60 2023-10-07T00:15:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.861+0000 7f908b21fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784df02100 con 0x55784dee6bc0 2023-10-07T00:15:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.861+0000 7f908b21fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784df0a320 con 0x55784dee6260 2023-10-07T00:15:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.862+0000 7f9075d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.862+0000 7f9075d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df085f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52762/0 (socket says 172.21.15.5:52762) 2023-10-07T00:15:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.862+0000 7f9075d9c700 1 -- 172.21.15.5:0/2016487960 learned_addr learned my addr 172.21.15.5:0/2016487960 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.862+0000 7f9075d9c700 1 -- 172.21.15.5:0/2016487960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 msgr2=0x55784deeaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.862+0000 7f9075d9c700 1 --2- 172.21.15.5:0/2016487960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 0x55784deeaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.862+0000 7f9075d9c700 1 -- 172.21.15.5:0/2016487960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 msgr2=0x55784deeafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.862+0000 7f9075d9c700 1 --2- 172.21.15.5:0/2016487960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784deeafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.863+0000 7f9075d9c700 1 -- 172.21.15.5:0/2016487960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55784dc8a250 con 0x55784dee7a60 2023-10-07T00:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.863+0000 7f9075d9c700 1 --2- 172.21.15.5:0/2016487960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df085f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9068000c00 tx=0x7f906800f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ca92e47fbd32d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.864+0000 7f9057fff700 1 -- 172.21.15.5:0/2016487960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068019ac0 con 0x55784dee7a60 2023-10-07T00:15:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.864+0000 7f9057fff700 1 -- 172.21.15.5:0/2016487960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55784ded8f10 con 0x55784dee7a60 2023-10-07T00:15:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.864+0000 7f9057fff700 1 -- 172.21.15.5:0/2016487960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068004260 con 0x55784dee7a60 2023-10-07T00:15:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.865+0000 7f908b21fb80 1 -- 172.21.15.5:0/2016487960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 msgr2=0x55784df085f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.865+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2016487960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df085f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9068000c00 tx=0x7f906800f7d0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.865+0000 7f908b21fb80 1 -- 172.21.15.5:0/2016487960 shutdown_connections 2023-10-07T00:15:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.865+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2016487960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df085f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.865+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2016487960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6260 0x55784deeaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.865+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2016487960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6bc0 0x55784deeafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.865+0000 7f908b21fb80 1 -- 172.21.15.5:0/2016487960 >> 172.21.15.5:0/2016487960 conn(0x55784de5a260 msgr2=0x55784deffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.866+0000 7f908b21fb80 1 -- 172.21.15.5:0/2016487960 shutdown_connections 2023-10-07T00:15:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.866+0000 7f908b21fb80 1 -- 172.21.15.5:0/2016487960 wait complete. 2023-10-07T00:15:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.867+0000 7f908b21fb80 1 -- start start 2023-10-07T00:15:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.867+0000 7f908b21fb80 1 Processor -- start 2023-10-07T00:15:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.868+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6260 0x55784df07db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.868+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 0x55784df082f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.868+0000 7f908b21fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.868+0000 7f908b21fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784df06900 con 0x55784dee7a60 2023-10-07T00:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.868+0000 7f908b21fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784df06a70 con 0x55784dee6260 2023-10-07T00:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.868+0000 7f908b21fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784df06c30 con 0x55784dee6bc0 2023-10-07T00:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.868+0000 7f908b21fb80 10 client.0 _ll_register_callbacks cb 0x7f906800ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.869+0000 7f9075d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.869+0000 7f9075d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52770/0 (socket says 172.21.15.5:52770) 2023-10-07T00:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.869+0000 7f9075d9c700 1 -- 172.21.15.5:0/2592001242 learned_addr learned my addr 172.21.15.5:0/2592001242 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.869+0000 7f907559b700 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6260 0x55784df07db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.869+0000 7f9074d9a700 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 0x55784df082f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.870+0000 7f9075d9c700 1 -- 172.21.15.5:0/2592001242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 msgr2=0x55784df082f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.870+0000 7f9075d9c700 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 0x55784df082f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.870+0000 7f9075d9c700 1 -- 172.21.15.5:0/2592001242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6260 msgr2=0x55784df07db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.870+0000 7f9075d9c700 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6260 0x55784df07db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.870+0000 7f9075d9c700 1 -- 172.21.15.5:0/2592001242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55784dc4cc60 con 0x55784dee7a60 2023-10-07T00:15:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.870+0000 7f9075d9c700 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df063c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9068011780 tx=0x7f9068005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee3923ec1a1a645 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.870+0000 7f9054ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.871+0000 7f9054ff9700 1 -- 172.21.15.5:0/2592001242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068019b20 con 0x55784dee7a60 2023-10-07T00:15:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.871+0000 7f9054ff9700 1 -- 172.21.15.5:0/2592001242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9068000e40 con 0x55784dee7a60 2023-10-07T00:15:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.871+0000 7f908b21fb80 1 -- 172.21.15.5:0/2592001242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9064009460 con 0x55784dee7a60 2023-10-07T00:15:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.871+0000 7f9054ff9700 1 -- 172.21.15.5:0/2592001242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f906800fea0 con 0x55784dee7a60 2023-10-07T00:15:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f908b21fb80 10 client.16254 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f908b21fb80 1 -- 172.21.15.5:0/2592001242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55784dc622b0 con 0x55784dee7a60 2023-10-07T00:15:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f9054ff9700 1 -- 172.21.15.5:0/2592001242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9064009460 con 0x55784dee7a60 2023-10-07T00:15:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f9054ff9700 1 -- 172.21.15.5:0/2592001242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9068022070 con 0x55784dee7a60 2023-10-07T00:15:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f908b21fb80 10 client.16254 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f908b21fb80 10 client.16254 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.g 2023-10-07T00:15:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f908b21fb80 20 client.16254 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55784df61b80 0x55784df63fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f908b21fb80 4 client.16254 mds_command: new command op to 14682 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:15:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.872+0000 7f908b21fb80 1 -- 172.21.15.5:0/2592001242 --> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55784de31b30 con 0x55784df61b80 2023-10-07T00:15:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.873+0000 7f907559b700 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55784df61b80 0x55784df63fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.874+0000 7f907559b700 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55784df61b80 0x55784df63fa0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4a16c61991f5a277 server_cookie=5ba1ee6ad9d11085 in_seq=0 out_seq=0 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.874+0000 7f9054ff9700 10 client.16254 ms_handle_connect on v2:172.21.15.5:6838/2286789609 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.874+0000 7f9054ff9700 1 -- 172.21.15.5:0/2592001242 <== mds.4 v2:172.21.15.5:6838/2286789609 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55784de31b30 con 0x55784df61b80 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.874+0000 7f9054ff9700 10 client.16254 handle_command_reply: tid=0 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.874+0000 7f908b21fb80 1 client.16254 shutdown 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 -- 172.21.15.5:0/2592001242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 msgr2=0x55784df063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df063c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9068011780 tx=0x7f9068005aa0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 -- 172.21.15.5:0/2592001242 shutdown_connections 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55784dee7a60 0x55784df063c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.5:6838/2286789609,v1:172.21.15.5:6839/2286789609] conn(0x55784df61b80 0x55784df63fa0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55784dee6260 0x55784df07db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 --2- 172.21.15.5:0/2592001242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55784dee6bc0 0x55784df082f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 -- 172.21.15.5:0/2592001242 >> 172.21.15.5:0/2592001242 conn(0x55784de5a260 msgr2=0x55784deffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f9054ff9700 0 client.16254 ms_handle_reset on v2:172.21.15.5:6838/2286789609 2023-10-07T00:15:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 -- 172.21.15.5:0/2592001242 shutdown_connections 2023-10-07T00:15:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 1 -- 172.21.15.5:0/2592001242 wait complete. 2023-10-07T00:15:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.875+0000 7f908b21fb80 20 client.16254 trim_cache size 0 max 16384 2023-10-07T00:15:20.878 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 -- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90580a1560 msgr2=0x7f90580a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90580a1560 0x7f90580a3a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f906400b0a0 tx=0x7f90640095d0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 -- 172.21.15.5:0/864062280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9070108e40 msgr2=0x7f90701047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9070108e40 0x7f90701047e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f906000ea50 tx=0x7f906000ee10 comp rx=0 tx=0).stop 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 -- 172.21.15.5:0/864062280 shutdown_connections 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f90580a1560 0x7f90580a3a20 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f906400b0a0 tx=0x7f90640095d0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070100d60 0x7f9070101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9070073910 0x7f90701042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 --2- 172.21.15.5:0/864062280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9070108e40 0x7f90701047e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 -- 172.21.15.5:0/864062280 >> 172.21.15.5:0/864062280 conn(0x7f90700fc510 msgr2=0x7f90700fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.876+0000 7f90777ff700 1 -- 172.21.15.5:0/864062280 shutdown_connections 2023-10-07T00:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:20.877+0000 7f90777ff700 1 -- 172.21.15.5:0/864062280 wait complete. 2023-10-07T00:15:20.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-07T00:15:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:20 smithi005 ceph-mon[129406]: pgmap v423: 97 pgs: 97 active+clean; 98 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-10-07T00:15:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:20 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2414345022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:15:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:20 smithi088 ceph-mon[103111]: pgmap v423: 97 pgs: 97 active+clean; 98 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-10-07T00:15:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:20 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2414345022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:15:21.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.223+0000 7f1081bff700 1 -- 172.21.15.5:0/2163788768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c10d240 msgr2=0x7f107c10d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.223+0000 7f1081bff700 1 --2- 172.21.15.5:0/2163788768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c10d240 0x7f107c10d6c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f10640098f0 tx=0x7f1064009c00 comp rx=0 tx=0).stop 2023-10-07T00:15:21.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.224+0000 7f1081bff700 1 -- 172.21.15.5:0/2163788768 shutdown_connections 2023-10-07T00:15:21.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.224+0000 7f1081bff700 1 --2- 172.21.15.5:0/2163788768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c10d240 0x7f107c10d6c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.224+0000 7f1081bff700 1 --2- 172.21.15.5:0/2163788768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c107eb0 0x7f107c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.224+0000 7f1081bff700 1 --2- 172.21.15.5:0/2163788768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f107c10a820 0x7f107c10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.224+0000 7f1081bff700 1 -- 172.21.15.5:0/2163788768 >> 172.21.15.5:0/2163788768 conn(0x7f107c06de70 msgr2=0x7f107c0702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.229+0000 7f1081bff700 1 -- 172.21.15.5:0/2163788768 shutdown_connections 2023-10-07T00:15:21.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.230+0000 7f1081bff700 1 -- 172.21.15.5:0/2163788768 wait complete. 2023-10-07T00:15:21.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.231+0000 7f1081bff700 1 Processor -- start 2023-10-07T00:15:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.232+0000 7f1081bff700 1 -- start start 2023-10-07T00:15:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.232+0000 7f1081bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f107c107eb0 0x7f107c1a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.232+0000 7f1081bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c10a820 0x7f107c1a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.233+0000 7f1081bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c10d240 0x7f107c1acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.233+0000 7f1081bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c1ad540 con 0x7f107c10a820 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.233+0000 7f1081bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c10f5e0 con 0x7f107c107eb0 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.233+0000 7f1081bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c10f770 con 0x7f107c10d240 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.233+0000 7f107b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f107c107eb0 0x7f107c1a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.233+0000 7f107b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f107c107eb0 0x7f107c1a59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:60680/0 (socket says 172.21.15.5:60680) 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.233+0000 7f107b7fe700 1 -- 172.21.15.5:0/1397111601 learned_addr learned my addr 172.21.15.5:0/1397111601 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.233+0000 7f107bfff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c10d240 0x7f107c1acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.234+0000 7f107bfff700 1 -- 172.21.15.5:0/1397111601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f107c107eb0 msgr2=0x7f107c1a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.234+0000 7f107bfff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f107c107eb0 0x7f107c1a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.234+0000 7f107bfff700 1 -- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c10a820 msgr2=0x7f107c1a5f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.234+0000 7f107bfff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c10a820 0x7f107c1a5f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.234+0000 7f107bfff700 1 -- 172.21.15.5:0/1397111601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064009520 con 0x7f107c10d240 2023-10-07T00:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.234+0000 7f107bfff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c10d240 0x7f107c1acf70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1064009810 tx=0x7f106400bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.235+0000 7f1078ff9700 1 -- 172.21.15.5:0/1397111601 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106400b990 con 0x7f107c10d240 2023-10-07T00:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.235+0000 7f1078ff9700 1 -- 172.21.15.5:0/1397111601 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f106403e070 con 0x7f107c10d240 2023-10-07T00:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.235+0000 7f1081bff700 1 -- 172.21.15.5:0/1397111601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c10f9f0 con 0x7f107c10d240 2023-10-07T00:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.235+0000 7f1081bff700 1 -- 172.21.15.5:0/1397111601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c10fe50 con 0x7f107c10d240 2023-10-07T00:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.235+0000 7f1078ff9700 1 -- 172.21.15.5:0/1397111601 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064003ba0 con 0x7f107c10d240 2023-10-07T00:15:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.241+0000 7f1078ff9700 1 -- 172.21.15.5:0/1397111601 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1064040070 con 0x7f107c10d240 2023-10-07T00:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.241+0000 7f10955e1b80 1 Processor -- start 2023-10-07T00:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.242+0000 7f10955e1b80 1 -- start start 2023-10-07T00:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.242+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a31680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.242+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31bc0 0x559297a32480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.242+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a32a60 0x559297a32ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.242+0000 7f10955e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297999460 con 0x559297a32a60 2023-10-07T00:15:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.242+0000 7f10955e1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929798ac20 con 0x559297a31bc0 2023-10-07T00:15:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.242+0000 7f10955e1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297988540 con 0x559297a31260 2023-10-07T00:15:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.243+0000 7f107affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a31680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.243+0000 7f107affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a31680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38726/0 (socket says 172.21.15.5:38726) 2023-10-07T00:15:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.243+0000 7f107affd700 1 -- 172.21.15.5:0/936389418 learned_addr learned my addr 172.21.15.5:0/936389418 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f107b7fe700 1 --2- 172.21.15.5:0/936389418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31bc0 0x559297a32480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f1078ff9700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10680a14d0 0x7f10680a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f1078ff9700 1 -- 172.21.15.5:0/1397111601 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f10640efec0 con 0x7f107c10d240 2023-10-07T00:15:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f107bfff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10680a14d0 0x7f10680a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f107b7fe700 1 -- 172.21.15.5:0/936389418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 msgr2=0x559297a31680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f107b7fe700 1 --2- 172.21.15.5:0/936389418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a31680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f107b7fe700 1 -- 172.21.15.5:0/936389418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a32a60 msgr2=0x559297a32ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f107b7fe700 1 --2- 172.21.15.5:0/936389418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a32a60 0x559297a32ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.244+0000 7f107b7fe700 1 -- 172.21.15.5:0/936389418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592977aede0 con 0x559297a31bc0 2023-10-07T00:15:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.245+0000 7f107b7fe700 1 --2- 172.21.15.5:0/936389418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31bc0 0x559297a32480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f10740115e0 tx=0x7f1074009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7d05c05c1557c11 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.245+0000 7f1071ffb700 1 -- 172.21.15.5:0/936389418 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400e040 con 0x559297a31bc0 2023-10-07T00:15:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.245+0000 7f1071ffb700 1 -- 172.21.15.5:0/936389418 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f107400f040 con 0x559297a31bc0 2023-10-07T00:15:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.245+0000 7f1071ffb700 1 -- 172.21.15.5:0/936389418 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074007500 con 0x559297a31bc0 2023-10-07T00:15:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.246+0000 7f107bfff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10680a14d0 0x7f10680a3990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f10640ed9a0 tx=0x7f1064019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.246+0000 7f10955e1b80 1 -- 172.21.15.5:0/936389418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31bc0 msgr2=0x559297a32480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.246+0000 7f10955e1b80 1 --2- 172.21.15.5:0/936389418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31bc0 0x559297a32480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f10740115e0 tx=0x7f1074009920 comp rx=0 tx=0).stop 2023-10-07T00:15:21.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:20 smithi112 ceph-mon[133548]: pgmap v423: 97 pgs: 97 active+clean; 98 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-10-07T00:15:21.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:20 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2414345022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-07T00:15:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.247+0000 7f10955e1b80 1 -- 172.21.15.5:0/936389418 shutdown_connections 2023-10-07T00:15:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.247+0000 7f10955e1b80 1 --2- 172.21.15.5:0/936389418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a32a60 0x559297a32ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.247+0000 7f10955e1b80 1 --2- 172.21.15.5:0/936389418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a31680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.247+0000 7f10955e1b80 1 --2- 172.21.15.5:0/936389418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31bc0 0x559297a32480 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.247+0000 7f10955e1b80 1 -- 172.21.15.5:0/936389418 >> 172.21.15.5:0/936389418 conn(0x5592979a5260 msgr2=0x559297a2c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.247+0000 7f10955e1b80 1 -- 172.21.15.5:0/936389418 shutdown_connections 2023-10-07T00:15:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.248+0000 7f10955e1b80 1 -- 172.21.15.5:0/936389418 wait complete. 2023-10-07T00:15:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.249+0000 7f10955e1b80 1 -- start start 2023-10-07T00:15:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.249+0000 7f10955e1b80 1 Processor -- start 2023-10-07T00:15:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.249+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a3b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.249+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a3b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.249+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 0x559297a425a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.249+0000 7f10955e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297983e30 con 0x559297a31bc0 2023-10-07T00:15:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.249+0000 7f10955e1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297920710 con 0x559297a32a60 2023-10-07T00:15:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.249+0000 7f10955e1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592979203b0 con 0x559297a31260 2023-10-07T00:15:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.250+0000 7f10955e1b80 10 client.0 _ll_register_callbacks cb 0x55929777d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.251+0000 7f107affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a3b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.251+0000 7f107affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a3b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38738/0 (socket says 172.21.15.5:38738) 2023-10-07T00:15:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.251+0000 7f107affd700 1 -- 172.21.15.5:0/1189340473 learned_addr learned my addr 172.21.15.5:0/1189340473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.251+0000 7f107affd700 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 0x559297a425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.252+0000 7f107b7fe700 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a3b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.253+0000 7f107affd700 1 -- 172.21.15.5:0/1189340473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 msgr2=0x559297a425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.253+0000 7f107affd700 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 0x559297a425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.253+0000 7f107affd700 1 -- 172.21.15.5:0/1189340473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 msgr2=0x559297a3b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.253+0000 7f107affd700 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a3b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.253+0000 7f107affd700 1 -- 172.21.15.5:0/1189340473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1074011290 con 0x559297a31260 2023-10-07T00:15:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.253+0000 7f107affd700 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a3b020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f106c011ca0 tx=0x7f106c009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d271ed5f2283b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.253+0000 7f105affd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:15:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.254+0000 7f105affd700 1 -- 172.21.15.5:0/1189340473 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c005260 con 0x559297a31260 2023-10-07T00:15:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.254+0000 7f105affd700 1 -- 172.21.15.5:0/1189340473 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f106c0053c0 con 0x559297a31260 2023-10-07T00:15:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.255+0000 7f10955e1b80 1 -- 172.21.15.5:0/1189340473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559297a23f10 con 0x559297a31260 2023-10-07T00:15:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.255+0000 7f105affd700 1 -- 172.21.15.5:0/1189340473 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f106c005580 con 0x559297a31260 2023-10-07T00:15:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.255+0000 7f10955e1b80 10 client.26056 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.255+0000 7f10955e1b80 1 -- 172.21.15.5:0/1189340473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x559297797c60 con 0x559297a31260 2023-10-07T00:15:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.256+0000 7f105affd700 1 -- 172.21.15.5:0/1189340473 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559297a23f10 con 0x559297a31260 2023-10-07T00:15:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.256+0000 7f105affd700 1 -- 172.21.15.5:0/1189340473 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f106c00e720 con 0x559297a31260 2023-10-07T00:15:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.256+0000 7f10955e1b80 10 client.26056 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.256+0000 7f10955e1b80 10 client.26056 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:15:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.256+0000 7f10955e1b80 20 client.26056 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.256+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x559297a46e50 0x559297a49270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.256+0000 7f10955e1b80 4 client.26056 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.256+0000 7f10955e1b80 1 -- 172.21.15.5:0/1189340473 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55929797ce10 con 0x559297a46e50 2023-10-07T00:15:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.257+0000 7f107b7fe700 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x559297a46e50 0x559297a49270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.258+0000 7f107b7fe700 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x559297a46e50 0x559297a49270 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f7ca6de436c695b server_cookie=28c3e34e05f14ba9 in_seq=0 out_seq=0 2023-10-07T00:15:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.258+0000 7f105affd700 10 client.26056 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:15:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.258+0000 7f105affd700 1 -- 172.21.15.5:0/1189340473 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55929797ce10 con 0x559297a46e50 2023-10-07T00:15:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f105affd700 10 client.26056 handle_command_reply: tid=0 2023-10-07T00:15:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 client.26056 shutdown 2023-10-07T00:15:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 -- 172.21.15.5:0/1189340473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 msgr2=0x559297a3b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a3b020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f106c011ca0 tx=0x7f106c009510 comp rx=0 tx=0).stop 2023-10-07T00:15:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 -- 172.21.15.5:0/1189340473 shutdown_connections 2023-10-07T00:15:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x559297a46e50 0x559297a49270 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 0x559297a425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31260 0x559297a3b020 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1189340473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a3b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f10955e1b80 1 -- 172.21.15.5:0/1189340473 >> 172.21.15.5:0/1189340473 conn(0x5592979a5260 msgr2=0x559297a2bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.259+0000 7f105affd700 0 client.26056 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:15:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.260+0000 7f10955e1b80 1 -- 172.21.15.5:0/1189340473 shutdown_connections 2023-10-07T00:15:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.260+0000 7f10955e1b80 1 -- 172.21.15.5:0/1189340473 wait complete. 2023-10-07T00:15:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.260+0000 7f10955e1b80 20 client.26056 trim_cache size 0 max 16384 2023-10-07T00:15:21.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.281+0000 7f10955e1b80 1 Processor -- start 2023-10-07T00:15:21.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.281+0000 7f10955e1b80 1 -- start start 2023-10-07T00:15:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.281+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31260 0x559297a38e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.281+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31bc0 0x559297a42560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.281+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 0x559297a359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.281+0000 7f10955e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297804920 con 0x559297a31260 2023-10-07T00:15:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.281+0000 7f10955e1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297a26570 con 0x559297a32a60 2023-10-07T00:15:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.281+0000 7f10955e1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297a3a4d0 con 0x559297a31bc0 2023-10-07T00:15:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31260 0x559297a38e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31bc0 0x559297a42560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31bc0 0x559297a42560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38754/0 (socket says 172.21.15.5:38754) 2023-10-07T00:15:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107b7fe700 1 -- 172.21.15.5:0/1647391159 learned_addr learned my addr 172.21.15.5:0/1647391159 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107b7fe700 1 -- 172.21.15.5:0/1647391159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 msgr2=0x559297a359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107b7fe700 1 --2- 172.21.15.5:0/1647391159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 0x559297a359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107b7fe700 1 -- 172.21.15.5:0/1647391159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31260 msgr2=0x559297a38e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107b7fe700 1 --2- 172.21.15.5:0/1647391159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31260 0x559297a38e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.282+0000 7f107b7fe700 1 -- 172.21.15.5:0/1647391159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592977d5250 con 0x559297a31bc0 2023-10-07T00:15:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.283+0000 7f107b7fe700 1 --2- 172.21.15.5:0/1647391159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31bc0 0x559297a42560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10740115e0 tx=0x7f1074009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01a5d02a53a902c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.283+0000 7f10727fc700 1 -- 172.21.15.5:0/1647391159 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400e040 con 0x559297a31bc0 2023-10-07T00:15:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.283+0000 7f10727fc700 1 -- 172.21.15.5:0/1647391159 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10740098a0 con 0x559297a31bc0 2023-10-07T00:15:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.283+0000 7f10727fc700 1 -- 172.21.15.5:0/1647391159 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074003e90 con 0x559297a31bc0 2023-10-07T00:15:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.284+0000 7f10955e1b80 1 -- 172.21.15.5:0/1647391159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31bc0 msgr2=0x559297a42560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.284+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1647391159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31bc0 0x559297a42560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10740115e0 tx=0x7f1074009340 comp rx=0 tx=0).stop 2023-10-07T00:15:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.285+0000 7f10955e1b80 1 -- 172.21.15.5:0/1647391159 shutdown_connections 2023-10-07T00:15:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.285+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1647391159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a32a60 0x559297a359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.285+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1647391159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31260 0x559297a38e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.285+0000 7f10955e1b80 1 --2- 172.21.15.5:0/1647391159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a31bc0 0x559297a42560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.285+0000 7f10955e1b80 1 -- 172.21.15.5:0/1647391159 >> 172.21.15.5:0/1647391159 conn(0x5592979a5260 msgr2=0x559297a39cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.285+0000 7f10955e1b80 1 -- 172.21.15.5:0/1647391159 shutdown_connections 2023-10-07T00:15:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.285+0000 7f10955e1b80 1 -- 172.21.15.5:0/1647391159 wait complete. 2023-10-07T00:15:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.285+0000 7f10955e1b80 1 -- start start 2023-10-07T00:15:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.286+0000 7f10955e1b80 1 Processor -- start 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.286+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31260 0x559297a3fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.286+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a40210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f10955e1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a32a60 0x559297a41220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f10955e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297a41760 con 0x559297a31bc0 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f10955e1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297a418d0 con 0x559297a31260 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f10955e1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559297a41a90 con 0x559297a32a60 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f10955e1b80 10 client.0 _ll_register_callbacks cb 0x7f106c0119b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f107affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a32a60 0x559297a41220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f107affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a32a60 0x559297a41220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38770/0 (socket says 172.21.15.5:38770) 2023-10-07T00:15:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f107affd700 1 -- 172.21.15.5:0/837495516 learned_addr learned my addr 172.21.15.5:0/837495516 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.287+0000 7f107affd700 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31260 0x559297a3fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.288+0000 7f107affd700 1 -- 172.21.15.5:0/837495516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31260 msgr2=0x559297a3fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.288+0000 7f107affd700 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31260 0x559297a3fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.288+0000 7f107affd700 1 -- 172.21.15.5:0/837495516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 msgr2=0x559297a40210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:15:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.289+0000 7f107b7fe700 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a40210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.289+0000 7f107affd700 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a40210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.289+0000 7f107affd700 1 -- 172.21.15.5:0/837495516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592977aede0 con 0x559297a32a60 2023-10-07T00:15:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.290+0000 7f107b7fe700 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a40210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:15:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.290+0000 7f107affd700 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a32a60 0x559297a41220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f106c001eb0 tx=0x7f106c02d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=739c1fde4f71d0a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.290+0000 7f105affd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:15:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.290+0000 7f105affd700 1 -- 172.21.15.5:0/837495516 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c030070 con 0x559297a32a60 2023-10-07T00:15:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.290+0000 7f10955e1b80 1 -- 172.21.15.5:0/837495516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f107400f040 con 0x559297a32a60 2023-10-07T00:15:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.290+0000 7f105affd700 1 -- 172.21.15.5:0/837495516 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f106c000e40 con 0x559297a32a60 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.291+0000 7f105affd700 1 -- 172.21.15.5:0/837495516 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f106c0056a0 con 0x559297a32a60 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.291+0000 7f10955e1b80 10 client.26062 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.291+0000 7f10955e1b80 1 -- 172.21.15.5:0/837495516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5592977ad2b0 con 0x559297a32a60 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f105affd700 1 -- 172.21.15.5:0/837495516 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f106c03e020 con 0x559297a32a60 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f105affd700 1 -- 172.21.15.5:0/837495516 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f106c02a4e0 con 0x559297a32a60 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f10955e1b80 10 client.26062 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f10955e1b80 10 client.26062 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f10955e1b80 20 client.26062 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f10955e1b80 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x559297a9b420 0x559297a9d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f10955e1b80 4 client.26062 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:15:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f10955e1b80 1 -- 172.21.15.5:0/837495516 --> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55929797cb30 con 0x559297a9b420 2023-10-07T00:15:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.292+0000 7f107b7fe700 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x559297a9b420 0x559297a9d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.293+0000 7f107b7fe700 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x559297a9b420 0x559297a9d860 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ee764ed4788d4daa server_cookie=4ecdcd4c178c9366 in_seq=0 out_seq=0 2023-10-07T00:15:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.293+0000 7f105affd700 10 client.26062 ms_handle_connect on v2:172.21.15.112:6838/1437328815 2023-10-07T00:15:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.293+0000 7f105affd700 1 -- 172.21.15.5:0/837495516 <== mds.3 v2:172.21.15.112:6838/1437328815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55929797cb30 con 0x559297a9b420 2023-10-07T00:15:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.293+0000 7f105affd700 10 client.26062 handle_command_reply: tid=0 2023-10-07T00:15:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.293+0000 7f10955e1b80 1 client.26062 shutdown 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f10955e1b80 1 -- 172.21.15.5:0/837495516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a32a60 msgr2=0x559297a41220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f10955e1b80 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a32a60 0x559297a41220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f106c001eb0 tx=0x7f106c02d040 comp rx=0 tx=0).stop 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f10955e1b80 1 -- 172.21.15.5:0/837495516 shutdown_connections 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f10955e1b80 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.112:6838/1437328815,v1:172.21.15.112:6839/1437328815] conn(0x559297a9b420 0x559297a9d860 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f10955e1b80 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559297a32a60 0x559297a41220 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f10955e1b80 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559297a31260 0x559297a3fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f10955e1b80 1 --2- 172.21.15.5:0/837495516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559297a31bc0 0x559297a40210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f10955e1b80 1 -- 172.21.15.5:0/837495516 >> 172.21.15.5:0/837495516 conn(0x5592979a5260 msgr2=0x559297a38e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.294+0000 7f105affd700 0 client.26062 ms_handle_reset on v2:172.21.15.112:6838/1437328815 2023-10-07T00:15:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.295+0000 7f10955e1b80 1 -- 172.21.15.5:0/837495516 shutdown_connections 2023-10-07T00:15:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.295+0000 7f10955e1b80 1 -- 172.21.15.5:0/837495516 wait complete. 2023-10-07T00:15:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.300+0000 7f10955e1b80 20 client.26062 trim_cache size 0 max 16384 2023-10-07T00:15:21.302 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:15:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 -- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10680a14d0 msgr2=0x7f10680a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10680a14d0 0x7f10680a3990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f10640ed9a0 tx=0x7f1064019040 comp rx=0 tx=0).stop 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 -- 172.21.15.5:0/1397111601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c10d240 msgr2=0x7f107c1acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c10d240 0x7f107c1acf70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1064009810 tx=0x7f106400bf70 comp rx=0 tx=0).stop 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 -- 172.21.15.5:0/1397111601 shutdown_connections 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10680a14d0 0x7f10680a3990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c10d240 0x7f107c1acf70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f107c107eb0 0x7f107c1a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 --2- 172.21.15.5:0/1397111601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c10a820 0x7f107c1a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.302+0000 7f1081bff700 1 -- 172.21.15.5:0/1397111601 >> 172.21.15.5:0/1397111601 conn(0x7f107c06de70 msgr2=0x7f107c1097f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.303+0000 7f1081bff700 1 -- 172.21.15.5:0/1397111601 shutdown_connections 2023-10-07T00:15:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.303+0000 7f1081bff700 1 -- 172.21.15.5:0/1397111601 wait complete. 2023-10-07T00:15:21.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-07T00:15:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.653+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/1023747462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 msgr2=0x7f2bf410b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.653+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/1023747462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 0x7f2bf410b300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009990 tx=0x7f2bec009ca0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.653+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/1023747462 shutdown_connections 2023-10-07T00:15:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.653+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/1023747462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 0x7f2bf410b300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.653+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/1023747462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bf4074e90 0x7f2bf40732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.653+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/1023747462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf40738b0 0x7f2bf4073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.653+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/1023747462 >> 172.21.15.5:0/1023747462 conn(0x7f2bf40fc530 msgr2=0x7f2bf40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.654+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/1023747462 shutdown_connections 2023-10-07T00:15:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.654+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/1023747462 wait complete. 2023-10-07T00:15:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.655+0000 7f2bfb7ff700 1 Processor -- start 2023-10-07T00:15:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.656+0000 7f2bfb7ff700 1 -- start start 2023-10-07T00:15:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.656+0000 7f2bfb7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bf40738b0 0x7f2bf419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.656+0000 7f2bfb7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4074e90 0x7f2bf419d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.656+0000 7f2bfb7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 0x7f2bf41a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.656+0000 7f2bfb7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf41a4e60 con 0x7f2bf40738b0 2023-10-07T00:15:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.656+0000 7f2bfb7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf41a4fa0 con 0x7f2bf4074e90 2023-10-07T00:15:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.656+0000 7f2bfb7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf41a5130 con 0x7f2bf4108e90 2023-10-07T00:15:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.657+0000 7f2bf9d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 0x7f2bf41a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.657+0000 7f2bf9d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 0x7f2bf41a4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38786/0 (socket says 172.21.15.5:38786) 2023-10-07T00:15:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.657+0000 7f2bf9d9c700 1 -- 172.21.15.5:0/2020473442 learned_addr learned my addr 172.21.15.5:0/2020473442 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.657+0000 7f2bf959b700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bf40738b0 0x7f2bf419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.658+0000 7f2bf9d9c700 1 -- 172.21.15.5:0/2020473442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4074e90 msgr2=0x7f2bf419d820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T00:15:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.658+0000 7f2bf9d9c700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4074e90 0x7f2bf419d820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.658+0000 7f2bf9d9c700 1 -- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bf40738b0 msgr2=0x7f2bf419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.658+0000 7f2bf9d9c700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bf40738b0 0x7f2bf419d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.658+0000 7f2bf9d9c700 1 -- 172.21.15.5:0/2020473442 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec0095f0 con 0x7f2bf4108e90 2023-10-07T00:15:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.658+0000 7f2bf9d9c700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 0x7f2bf41a4890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b5c0 tx=0x7f2bec0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.659+0000 7f2bf27fc700 1 -- 172.21.15.5:0/2020473442 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec01d070 con 0x7f2bf4108e90 2023-10-07T00:15:21.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.659+0000 7f2bf27fc700 1 -- 172.21.15.5:0/2020473442 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bec004110 con 0x7f2bf4108e90 2023-10-07T00:15:21.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.659+0000 7f2bf27fc700 1 -- 172.21.15.5:0/2020473442 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00fe00 con 0x7f2bf4108e90 2023-10-07T00:15:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.659+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/2020473442 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf41a53b0 con 0x7f2bf4108e90 2023-10-07T00:15:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.659+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/2020473442 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf41a5800 con 0x7f2bf4108e90 2023-10-07T00:15:21.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.665+0000 7f2c0f0cbb80 1 Processor -- start 2023-10-07T00:15:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.666+0000 7f2bf27fc700 1 -- 172.21.15.5:0/2020473442 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2bec00f5d0 con 0x7f2bf4108e90 2023-10-07T00:15:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.666+0000 7f2c0f0cbb80 1 -- start start 2023-10-07T00:15:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.668+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x55812518d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.668+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812518e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.668+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 0x55812518eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.668+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581250f5460 con 0x55812518d260 2023-10-07T00:15:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.668+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581250e6c20 con 0x55812518ea60 2023-10-07T00:15:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.668+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581250e4540 con 0x55812518dbc0 2023-10-07T00:15:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812518e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812518e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38796/0 (socket says 172.21.15.5:38796) 2023-10-07T00:15:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf959b700 1 -- 172.21.15.5:0/2728033872 learned_addr learned my addr 172.21.15.5:0/2728033872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/2728033872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 0x55812518eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf27fc700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be40a1480 0x7f2be40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf27fc700 1 -- 172.21.15.5:0/2020473442 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2bec0cdb70 con 0x7f2bf4108e90 2023-10-07T00:15:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf959b700 1 -- 172.21.15.5:0/2728033872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 msgr2=0x55812518eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf959b700 1 --2- 172.21.15.5:0/2728033872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 0x55812518eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf959b700 1 -- 172.21.15.5:0/2728033872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 msgr2=0x55812518d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf959b700 1 --2- 172.21.15.5:0/2728033872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x55812518d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.669+0000 7f2bf959b700 1 -- 172.21.15.5:0/2728033872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558124f0ade0 con 0x55812518dbc0 2023-10-07T00:15:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.670+0000 7f2bf9d9c700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be40a1480 0x7f2be40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.670+0000 7f2bf959b700 1 --2- 172.21.15.5:0/2728033872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812518e480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009fa0 tx=0x7f2be800c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75cad766d8ddb9d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.671+0000 7f2bf9d9c700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be40a1480 0x7f2be40a3940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0a2c70 tx=0x7f2bec00ff60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.671+0000 7f2bdf7fe700 1 -- 172.21.15.5:0/2728033872 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8011070 con 0x55812518dbc0 2023-10-07T00:15:21.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.671+0000 7f2bdf7fe700 1 -- 172.21.15.5:0/2728033872 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2be8009ad0 con 0x55812518dbc0 2023-10-07T00:15:21.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.671+0000 7f2bdf7fe700 1 -- 172.21.15.5:0/2728033872 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800a400 con 0x55812518dbc0 2023-10-07T00:15:21.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2728033872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 msgr2=0x55812518e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/2728033872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812518e480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009fa0 tx=0x7f2be800c420 comp rx=0 tx=0).stop 2023-10-07T00:15:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2728033872 shutdown_connections 2023-10-07T00:15:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/2728033872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 0x55812518eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/2728033872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x55812518d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/2728033872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812518e480 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2728033872 >> 172.21.15.5:0/2728033872 conn(0x558125101260 msgr2=0x558125188140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2728033872 shutdown_connections 2023-10-07T00:15:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.672+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2728033872 wait complete. 2023-10-07T00:15:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.673+0000 7f2c0f0cbb80 1 -- start start 2023-10-07T00:15:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.673+0000 7f2c0f0cbb80 1 Processor -- start 2023-10-07T00:15:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.674+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x558125197030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.674+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x558125197570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.674+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 0x55812519e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.674+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581250dfe30 con 0x55812518d260 2023-10-07T00:15:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.674+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55812507c710 con 0x55812518ea60 2023-10-07T00:15:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.674+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55812507c3b0 con 0x55812518dbc0 2023-10-07T00:15:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.674+0000 7f2c0f0cbb80 10 client.0 _ll_register_callbacks cb 0x558124ed9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:21.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf8d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 0x55812519e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf8d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x558125197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf8d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x558125197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52846/0 (socket says 172.21.15.5:52846) 2023-10-07T00:15:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf8d9a700 1 -- 172.21.15.5:0/1598286541 learned_addr learned my addr 172.21.15.5:0/1598286541 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf959b700 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x558125197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf959b700 1 -- 172.21.15.5:0/1598286541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 msgr2=0x55812519e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf959b700 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 0x55812519e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf959b700 1 -- 172.21.15.5:0/1598286541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 msgr2=0x558125197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf959b700 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x558125197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.676+0000 7f2bf959b700 1 -- 172.21.15.5:0/1598286541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be8009c50 con 0x55812518dbc0 2023-10-07T00:15:21.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.677+0000 7f2bf959b700 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x558125197570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2be8000f80 tx=0x7f2be8015640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=722bcf5f6bc98d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.677+0000 7f2bdcff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:15:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.678+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1598286541 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8024070 con 0x55812518dbc0 2023-10-07T00:15:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.678+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1598286541 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2be8006e40 con 0x55812518dbc0 2023-10-07T00:15:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.678+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1598286541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581250d8e10 con 0x55812518dbc0 2023-10-07T00:15:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.678+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1598286541 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2be8011050 con 0x55812518dbc0 2023-10-07T00:15:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.678+0000 7f2c0f0cbb80 10 client.26074 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.678+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1598286541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x558124ef3c60 con 0x55812518dbc0 2023-10-07T00:15:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.679+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1598286541 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5581250d8e10 con 0x55812518dbc0 2023-10-07T00:15:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.679+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1598286541 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f2be8027030 con 0x55812518dbc0 2023-10-07T00:15:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.679+0000 7f2c0f0cbb80 10 client.26074 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.679+0000 7f2c0f0cbb80 10 client.26074 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:15:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.679+0000 7f2c0f0cbb80 20 client.26074 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.679+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x5581251b3d00 0x5581251b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.679+0000 7f2c0f0cbb80 4 client.26074 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.679+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1598286541 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581250d8b30 con 0x5581251b3d00 2023-10-07T00:15:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.680+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x5581251b3d00 0x5581251b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.680+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x5581251b3d00 0x5581251b6120 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87d6aad89d7c82f6 server_cookie=f283665e5761bdb6 in_seq=0 out_seq=0 2023-10-07T00:15:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.680+0000 7f2bdcff9700 10 client.26074 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:15:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.681+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1598286541 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5581250d8b30 con 0x5581251b3d00 2023-10-07T00:15:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.681+0000 7f2bdcff9700 10 client.26074 handle_command_reply: tid=0 2023-10-07T00:15:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.681+0000 7f2c0f0cbb80 1 client.26074 shutdown 2023-10-07T00:15:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1598286541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 msgr2=0x558125197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x558125197570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2be8000f80 tx=0x7f2be8015640 comp rx=0 tx=0).stop 2023-10-07T00:15:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1598286541 shutdown_connections 2023-10-07T00:15:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x5581251b3d00 0x5581251b6120 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518ea60 0x55812519e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x558125197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1598286541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x558125197570 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1598286541 >> 172.21.15.5:0/1598286541 conn(0x558125101260 msgr2=0x558125187f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2bdcff9700 0 client.26074 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:15:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1598286541 shutdown_connections 2023-10-07T00:15:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.683+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1598286541 wait complete. 2023-10-07T00:15:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.684+0000 7f2c0f0cbb80 20 client.26074 trim_cache size 0 max 16384 2023-10-07T00:15:21.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.704+0000 7f2c0f0cbb80 1 Processor -- start 2023-10-07T00:15:21.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.704+0000 7f2c0f0cbb80 1 -- start start 2023-10-07T00:15:21.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x55812518d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518dbc0 0x55812519e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518ea60 0x558125186bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558124f60920 con 0x55812518d260 2023-10-07T00:15:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581251b3ad0 con 0x55812518dbc0 2023-10-07T00:15:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558125187100 con 0x55812518ea60 2023-10-07T00:15:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2bf959b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518dbc0 0x55812519e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2bf959b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518dbc0 0x55812519e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:60754/0 (socket says 172.21.15.5:60754) 2023-10-07T00:15:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.705+0000 7f2bf959b700 1 -- 172.21.15.5:0/2096131435 learned_addr learned my addr 172.21.15.5:0/2096131435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.706+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x55812518d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.706+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518ea60 0x558125186bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.706+0000 7f2bf959b700 1 -- 172.21.15.5:0/2096131435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518ea60 msgr2=0x558125186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.706+0000 7f2bf959b700 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518ea60 0x558125186bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.706+0000 7f2bf959b700 1 -- 172.21.15.5:0/2096131435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 msgr2=0x55812518d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.706+0000 7f2bf959b700 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x55812518d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.706+0000 7f2bf959b700 1 -- 172.21.15.5:0/2096131435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558124f31250 con 0x55812518dbc0 2023-10-07T00:15:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.707+0000 7f2bf959b700 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518dbc0 0x55812519e570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2be801ee30 tx=0x7f2be8009870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1f2b1ec8140692 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.707+0000 7f2bdffff700 1 -- 172.21.15.5:0/2096131435 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8024070 con 0x55812518dbc0 2023-10-07T00:15:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.707+0000 7f2bdffff700 1 -- 172.21.15.5:0/2096131435 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2be8012040 con 0x55812518dbc0 2023-10-07T00:15:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.707+0000 7f2bdffff700 1 -- 172.21.15.5:0/2096131435 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8011070 con 0x55812518dbc0 2023-10-07T00:15:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2096131435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518dbc0 msgr2=0x55812519e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518dbc0 0x55812519e570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2be801ee30 tx=0x7f2be8009870 comp rx=0 tx=0).stop 2023-10-07T00:15:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2096131435 shutdown_connections 2023-10-07T00:15:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518ea60 0x558125186bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518d260 0x55812518d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/2096131435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518dbc0 0x55812519e570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2096131435 >> 172.21.15.5:0/2096131435 conn(0x558125101260 msgr2=0x5581251baa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2096131435 shutdown_connections 2023-10-07T00:15:21.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.708+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/2096131435 wait complete. 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.709+0000 7f2c0f0cbb80 1 -- start start 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.709+0000 7f2c0f0cbb80 1 Processor -- start 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.710+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518d260 0x55812519c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.710+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812519c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.710+0000 7f2c0f0cbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518ea60 0x55812519d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.710+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55812519db30 con 0x55812518ea60 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.710+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55812519dca0 con 0x55812518d260 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.710+0000 7f2c0f0cbb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55812519de10 con 0x55812518dbc0 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.710+0000 7f2c0f0cbb80 10 client.0 _ll_register_callbacks cb 0x7f2be8009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.710+0000 7f2bf959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812519c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812519c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38836/0 (socket says 172.21.15.5:38836) 2023-10-07T00:15:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf959b700 1 -- 172.21.15.5:0/1462763935 learned_addr learned my addr 172.21.15.5:0/1462763935 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518d260 0x55812519c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf959b700 1 -- 172.21.15.5:0/1462763935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518d260 msgr2=0x55812519c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf959b700 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518d260 0x55812519c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518ea60 0x55812519d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf959b700 1 -- 172.21.15.5:0/1462763935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518ea60 msgr2=0x55812519d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf959b700 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518ea60 0x55812519d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf959b700 1 -- 172.21.15.5:0/1462763935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558124ef3c60 con 0x55812518dbc0 2023-10-07T00:15:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518ea60 0x55812519d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:15:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bf959b700 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812519c5e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004c20 tx=0x7f2be8009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fec3ab71c564889 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.711+0000 7f2bdcff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:15:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.712+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1462763935 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8024030 con 0x55812518dbc0 2023-10-07T00:15:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.712+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1462763935 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2be8025070 con 0x55812518dbc0 2023-10-07T00:15:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.712+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1462763935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55812517ff10 con 0x55812518dbc0 2023-10-07T00:15:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.713+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1462763935 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2be8011070 con 0x55812518dbc0 2023-10-07T00:15:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.713+0000 7f2c0f0cbb80 10 client.26080 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.713+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1462763935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x558124f092b0 con 0x55812518dbc0 2023-10-07T00:15:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.713+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1462763935 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2be8039020 con 0x55812518dbc0 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.713+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1462763935 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f2be8027040 con 0x55812518dbc0 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.714+0000 7f2c0f0cbb80 10 client.26080 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.714+0000 7f2c0f0cbb80 10 client.26080 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.714+0000 7f2c0f0cbb80 20 client.26080 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.714+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x5581252193e0 0x55812521b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.714+0000 7f2c0f0cbb80 4 client.26080 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.714+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1462763935 --> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558124f2bf70 con 0x5581252193e0 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.714+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x5581252193e0 0x55812521b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.715+0000 7f2bdcff9700 10 client.26080 ms_handle_connect on v2:172.21.15.88:6836/3467169858 2023-10-07T00:15:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.715+0000 7f2bf8d9a700 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x5581252193e0 0x55812521b800 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c1b0f7978c0114a server_cookie=2e786e850f5fbb1 in_seq=0 out_seq=0 2023-10-07T00:15:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.715+0000 7f2bdcff9700 1 -- 172.21.15.5:0/1462763935 <== mds.2 v2:172.21.15.88:6836/3467169858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558124f2bf70 con 0x5581252193e0 2023-10-07T00:15:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.715+0000 7f2bdcff9700 10 client.26080 handle_command_reply: tid=0 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.715+0000 7f2c0f0cbb80 1 client.26080 shutdown 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.715+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1462763935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 msgr2=0x55812519c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.715+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812519c5e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004c20 tx=0x7f2be8009400 comp rx=0 tx=0).stop 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1462763935 shutdown_connections 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.88:6836/3467169858,v1:172.21.15.88:6837/3467169858] conn(0x5581252193e0 0x55812521b800 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55812518ea60 0x55812519d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55812518d260 0x55812519c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2bdcff9700 0 client.26080 ms_handle_reset on v2:172.21.15.88:6836/3467169858 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 1 --2- 172.21.15.5:0/1462763935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812518dbc0 0x55812519c5e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1462763935 >> 172.21.15.5:0/1462763935 conn(0x558125101260 msgr2=0x558125195d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1462763935 shutdown_connections 2023-10-07T00:15:21.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 1 -- 172.21.15.5:0/1462763935 wait complete. 2023-10-07T00:15:21.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.716+0000 7f2c0f0cbb80 20 client.26080 trim_cache size 0 max 16384 2023-10-07T00:15:21.720 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be40a1480 msgr2=0x7f2be40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be40a1480 0x7f2be40a3940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0a2c70 tx=0x7f2bec00ff60 comp rx=0 tx=0).stop 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/2020473442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 msgr2=0x7f2bf41a4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 0x7f2bf41a4890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b5c0 tx=0x7f2bec0057f0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/2020473442 shutdown_connections 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2be40a1480 0x7f2be40a3940 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bf4108e90 0x7f2bf41a4890 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bf40738b0 0x7f2bf419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 --2- 172.21.15.5:0/2020473442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4074e90 0x7f2bf419d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/2020473442 >> 172.21.15.5:0/2020473442 conn(0x7f2bf40fc530 msgr2=0x7f2bf40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/2020473442 shutdown_connections 2023-10-07T00:15:21.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:21.717+0000 7f2bfb7ff700 1 -- 172.21.15.5:0/2020473442 wait complete. 2023-10-07T00:15:21.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-07T00:15:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.080+0000 7f04125ff700 1 -- 172.21.15.5:0/1444721097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c0ff830 msgr2=0x7f040c0ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.080+0000 7f04125ff700 1 --2- 172.21.15.5:0/1444721097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c0ff830 0x7f040c0ffc50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0098f0 tx=0x7f03fc009c00 comp rx=0 tx=0).stop 2023-10-07T00:15:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.081+0000 7f04125ff700 1 -- 172.21.15.5:0/1444721097 shutdown_connections 2023-10-07T00:15:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.081+0000 7f04125ff700 1 --2- 172.21.15.5:0/1444721097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040c100b50 0x7f040c100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.081+0000 7f04125ff700 1 --2- 172.21.15.5:0/1444721097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c0ff830 0x7f040c0ffc50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.081+0000 7f04125ff700 1 --2- 172.21.15.5:0/1444721097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c100190 0x7f040c100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.081+0000 7f04125ff700 1 -- 172.21.15.5:0/1444721097 >> 172.21.15.5:0/1444721097 conn(0x7f040c0fb450 msgr2=0x7f040c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.081+0000 7f04125ff700 1 -- 172.21.15.5:0/1444721097 shutdown_connections 2023-10-07T00:15:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.081+0000 7f04125ff700 1 -- 172.21.15.5:0/1444721097 wait complete. 2023-10-07T00:15:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.082+0000 7f04125ff700 1 Processor -- start 2023-10-07T00:15:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.083+0000 7f04125ff700 1 -- start start 2023-10-07T00:15:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.083+0000 7f04125ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c0ff830 0x7f040c1041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.083+0000 7f04125ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040c100190 0x7f040c104720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.083+0000 7f04125ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c100b50 0x7f040c10b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.083+0000 7f04125ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c104e70 con 0x7f040c0ff830 2023-10-07T00:15:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.083+0000 7f04125ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c06a900 con 0x7f040c100190 2023-10-07T00:15:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.083+0000 7f04125ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c06aac0 con 0x7f040c100b50 2023-10-07T00:15:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0410b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c100b50 0x7f040c10b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0410b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c100b50 0x7f040c10b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:52016/0 (socket says 172.21.15.5:52016) 2023-10-07T00:15:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0410b9c700 1 -- 172.21.15.5:0/1484790813 learned_addr learned my addr 172.21.15.5:0/1484790813 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0403fff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040c100190 0x7f040c104720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f040bfff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c0ff830 0x7f040c1041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0410b9c700 1 -- 172.21.15.5:0/1484790813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040c100190 msgr2=0x7f040c104720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0410b9c700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040c100190 0x7f040c104720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0410b9c700 1 -- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c0ff830 msgr2=0x7f040c1041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0410b9c700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c0ff830 0x7f040c1041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f0410b9c700 1 -- 172.21.15.5:0/1484790813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc009520 con 0x7f040c100b50 2023-10-07T00:15:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.084+0000 7f040bfff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c0ff830 0x7f040c1041e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:15:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.085+0000 7f0410b9c700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c100b50 0x7f040c10b790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0404007ee0 tx=0x7f040400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.085+0000 7f0409ffb700 1 -- 172.21.15.5:0/1484790813 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404017070 con 0x7f040c100b50 2023-10-07T00:15:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.085+0000 7f0409ffb700 1 -- 172.21.15.5:0/1484790813 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f040400f040 con 0x7f040c100b50 2023-10-07T00:15:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.085+0000 7f0409ffb700 1 -- 172.21.15.5:0/1484790813 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404005710 con 0x7f040c100b50 2023-10-07T00:15:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.085+0000 7f04125ff700 1 -- 172.21.15.5:0/1484790813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c06ada0 con 0x7f040c100b50 2023-10-07T00:15:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.085+0000 7f04125ff700 1 -- 172.21.15.5:0/1484790813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c06b260 con 0x7f040c100b50 2023-10-07T00:15:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.091+0000 7f0425f91b80 1 Processor -- start 2023-10-07T00:15:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.092+0000 7f0409ffb700 1 -- 172.21.15.5:0/1484790813 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0404005870 con 0x7f040c100b50 2023-10-07T00:15:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.094+0000 7f0425f91b80 1 -- start start 2023-10-07T00:15:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.094+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03781680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.094+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d03782480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.094+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03782ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.094+0000 7f0425f91b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d036e9460 con 0x561d03782a60 2023-10-07T00:15:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.094+0000 7f0425f91b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d036dac20 con 0x561d03781260 2023-10-07T00:15:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.094+0000 7f0425f91b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d036d8540 con 0x561d03781bc0 2023-10-07T00:15:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.095+0000 7f0403fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03781680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.095+0000 7f0403fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03781680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56782/0 (socket says 172.21.15.5:56782) 2023-10-07T00:15:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.095+0000 7f0403fff700 1 -- 172.21.15.5:0/3230903544 learned_addr learned my addr 172.21.15.5:0/3230903544 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.095+0000 7f040bfff700 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d03782480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.095+0000 7f0403fff700 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03782ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.096+0000 7f0403fff700 1 -- 172.21.15.5:0/3230903544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 msgr2=0x561d03782480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.096+0000 7f0403fff700 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d03782480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.096+0000 7f0403fff700 1 -- 172.21.15.5:0/3230903544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 msgr2=0x561d03782ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.096+0000 7f0403fff700 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03782ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.096+0000 7f0403fff700 1 -- 172.21.15.5:0/3230903544 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d034fede0 con 0x561d03781260 2023-10-07T00:15:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.096+0000 7f0403fff700 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03781680 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03f400cfd0 tx=0x7f03f400c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c28080dbfbe3c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.096+0000 7f0409ffb700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f03f80a15d0 0x7f03f80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.096+0000 7f04027fc700 1 -- 172.21.15.5:0/3230903544 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4014110 con 0x561d03781260 2023-10-07T00:15:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.097+0000 7f0409ffb700 1 -- 172.21.15.5:0/1484790813 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f04040cc550 con 0x7f040c100b50 2023-10-07T00:15:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.097+0000 7f04027fc700 1 -- 172.21.15.5:0/3230903544 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03f401a020 con 0x561d03781260 2023-10-07T00:15:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.097+0000 7f04027fc700 1 -- 172.21.15.5:0/3230903544 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40126b0 con 0x561d03781260 2023-10-07T00:15:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.097+0000 7f0425f91b80 1 -- 172.21.15.5:0/3230903544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 msgr2=0x561d03781680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.097+0000 7f0425f91b80 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03781680 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03f400cfd0 tx=0x7f03f400c590 comp rx=0 tx=0).stop 2023-10-07T00:15:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.098+0000 7f0425f91b80 1 -- 172.21.15.5:0/3230903544 shutdown_connections 2023-10-07T00:15:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.098+0000 7f0425f91b80 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03782ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.098+0000 7f0425f91b80 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03781680 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.098+0000 7f0425f91b80 1 --2- 172.21.15.5:0/3230903544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d03782480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.098+0000 7f0425f91b80 1 -- 172.21.15.5:0/3230903544 >> 172.21.15.5:0/3230903544 conn(0x561d036f5260 msgr2=0x561d0377c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.098+0000 7f040bfff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f03f80a15d0 0x7f03f80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.098+0000 7f0425f91b80 1 -- 172.21.15.5:0/3230903544 shutdown_connections 2023-10-07T00:15:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.099+0000 7f0425f91b80 1 -- 172.21.15.5:0/3230903544 wait complete. 2023-10-07T00:15:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.099+0000 7f0425f91b80 1 -- start start 2023-10-07T00:15:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.099+0000 7f040bfff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f03f80a15d0 0x7f03f80a3a90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00b2e0 tx=0x7f03fc01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.100+0000 7f0425f91b80 1 Processor -- start 2023-10-07T00:15:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.100+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d0378aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.100+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d0378b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.100+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03792570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.100+0000 7f0425f91b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d036d3e30 con 0x561d03782a60 2023-10-07T00:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.100+0000 7f0425f91b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d03670710 con 0x561d03781260 2023-10-07T00:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.100+0000 7f0425f91b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d036703b0 con 0x561d03781bc0 2023-10-07T00:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.100+0000 7f0425f91b80 10 client.0 _ll_register_callbacks cb 0x561d034cd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.101+0000 7f0410b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03792570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.101+0000 7f0410b9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03792570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48014/0 (socket says 172.21.15.5:48014) 2023-10-07T00:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.101+0000 7f0410b9c700 1 -- 172.21.15.5:0/1334934490 learned_addr learned my addr 172.21.15.5:0/1334934490 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.101+0000 7f040bfff700 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d0378aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.101+0000 7f0403fff700 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d0378b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.102+0000 7f040bfff700 1 -- 172.21.15.5:0/1334934490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 msgr2=0x561d0378b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.102+0000 7f040bfff700 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d0378b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.102+0000 7f040bfff700 1 -- 172.21.15.5:0/1334934490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 msgr2=0x561d03792570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.102+0000 7f040bfff700 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03792570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.102+0000 7f040bfff700 1 -- 172.21.15.5:0/1334934490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f4014770 con 0x561d03781260 2023-10-07T00:15:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.102+0000 7f040bfff700 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d0378aff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009810 tx=0x7f03fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=429267aaa95f81ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.102+0000 7f03eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:15:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.102+0000 7f03eb7fe700 1 -- 172.21.15.5:0/1334934490 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc01d040 con 0x561d03781260 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.103+0000 7f03eb7fe700 1 -- 172.21.15.5:0/1334934490 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f03fc00f830 con 0x561d03781260 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.103+0000 7f0425f91b80 1 -- 172.21.15.5:0/1334934490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d03773f10 con 0x561d03781260 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.103+0000 7f03eb7fe700 1 -- 172.21.15.5:0/1334934490 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03fc0046d0 con 0x561d03781260 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.103+0000 7f0425f91b80 10 client.26105 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.103+0000 7f0425f91b80 1 -- 172.21.15.5:0/1334934490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561d034e7c60 con 0x561d03781260 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.104+0000 7f03eb7fe700 1 -- 172.21.15.5:0/1334934490 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561d03773f10 con 0x561d03781260 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.104+0000 7f03eb7fe700 1 -- 172.21.15.5:0/1334934490 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f03fc02fa30 con 0x561d03781260 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.104+0000 7f0425f91b80 10 client.26105 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.104+0000 7f0425f91b80 10 client.26105 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.104+0000 7f0425f91b80 20 client.26105 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.104+0000 7f0425f91b80 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561d03796ec0 0x561d037992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.104+0000 7f0425f91b80 4 client.26105 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.104+0000 7f0425f91b80 1 -- 172.21.15.5:0/1334934490 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d036cce10 con 0x561d03796ec0 2023-10-07T00:15:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.105+0000 7f0403fff700 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561d03796ec0 0x561d037992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.106+0000 7f0403fff700 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561d03796ec0 0x561d037992e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df84ba9287da9d42 server_cookie=117c3fd2a2937def in_seq=0 out_seq=0 2023-10-07T00:15:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.106+0000 7f03eb7fe700 10 client.26105 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:15:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.110+0000 7f03eb7fe700 1 -- 172.21.15.5:0/1334934490 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561d036cce10 con 0x561d03796ec0 2023-10-07T00:15:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.110+0000 7f03eb7fe700 10 client.26105 handle_command_reply: tid=0 2023-10-07T00:15:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.110+0000 7f0425f91b80 1 client.26105 shutdown 2023-10-07T00:15:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f0425f91b80 1 -- 172.21.15.5:0/1334934490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 msgr2=0x561d0378aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f0425f91b80 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d0378aff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009810 tx=0x7f03fc009c00 comp rx=0 tx=0).stop 2023-10-07T00:15:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f0425f91b80 1 -- 172.21.15.5:0/1334934490 shutdown_connections 2023-10-07T00:15:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f0425f91b80 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561d03796ec0 0x561d037992e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f0425f91b80 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03782a60 0x561d03792570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f0425f91b80 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d0378aff0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f0425f91b80 1 --2- 172.21.15.5:0/1334934490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d0378b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f03eb7fe700 0 client.26105 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:15:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.115+0000 7f0425f91b80 1 -- 172.21.15.5:0/1334934490 >> 172.21.15.5:0/1334934490 conn(0x561d036f5260 msgr2=0x561d0377bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.116+0000 7f0425f91b80 1 -- 172.21.15.5:0/1334934490 shutdown_connections 2023-10-07T00:15:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.116+0000 7f0425f91b80 1 -- 172.21.15.5:0/1334934490 wait complete. 2023-10-07T00:15:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.116+0000 7f0425f91b80 20 client.26105 trim_cache size 0 max 16384 2023-10-07T00:15:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.149+0000 7f0425f91b80 1 Processor -- start 2023-10-07T00:15:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.150+0000 7f0425f91b80 1 -- start start 2023-10-07T00:15:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.150+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03782e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.150+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781bc0 0x561d03792530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.150+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03782a60 0x561d03792e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.150+0000 7f0425f91b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d03554920 con 0x561d03781bc0 2023-10-07T00:15:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.150+0000 7f0425f91b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d03789af0 con 0x561d03781260 2023-10-07T00:15:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.150+0000 7f0425f91b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d0378ab60 con 0x561d03782a60 2023-10-07T00:15:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.151+0000 7f040bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03782e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.151+0000 7f0410b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03782a60 0x561d03792e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.151+0000 7f040bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03782e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56800/0 (socket says 172.21.15.5:56800) 2023-10-07T00:15:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.151+0000 7f0410b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03782a60 0x561d03792e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:52046/0 (socket says 172.21.15.5:52046) 2023-10-07T00:15:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.151+0000 7f040bfff700 1 -- 172.21.15.5:0/99732753 learned_addr learned my addr 172.21.15.5:0/99732753 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.151+0000 7f0403fff700 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781bc0 0x561d03792530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.152+0000 7f0410b9c700 1 -- 172.21.15.5:0/99732753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 msgr2=0x561d03782e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.152+0000 7f0410b9c700 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03782e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.152+0000 7f0410b9c700 1 -- 172.21.15.5:0/99732753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781bc0 msgr2=0x561d03792530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.152+0000 7f0410b9c700 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781bc0 0x561d03792530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.152+0000 7f0410b9c700 1 -- 172.21.15.5:0/99732753 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d03525250 con 0x561d03782a60 2023-10-07T00:15:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.152+0000 7f0403fff700 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781bc0 0x561d03792530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:15:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.153+0000 7f0410b9c700 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03782a60 0x561d03792e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0404096260 tx=0x7f04040b9040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5247b81c7bf328bc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.155+0000 7f0402ffd700 1 -- 172.21.15.5:0/99732753 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404099ef0 con 0x561d03782a60 2023-10-07T00:15:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.155+0000 7f0402ffd700 1 -- 172.21.15.5:0/99732753 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04040997f0 con 0x561d03782a60 2023-10-07T00:15:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.155+0000 7f0402ffd700 1 -- 172.21.15.5:0/99732753 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04040b90b0 con 0x561d03782a60 2023-10-07T00:15:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.158+0000 7f0425f91b80 1 -- 172.21.15.5:0/99732753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03782a60 msgr2=0x561d03792e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.158+0000 7f0425f91b80 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03782a60 0x561d03792e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0404096260 tx=0x7f04040b9040 comp rx=0 tx=0).stop 2023-10-07T00:15:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.159+0000 7f0425f91b80 1 -- 172.21.15.5:0/99732753 shutdown_connections 2023-10-07T00:15:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.159+0000 7f0425f91b80 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03782a60 0x561d03792e60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.159+0000 7f0425f91b80 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03781260 0x561d03782e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.159+0000 7f0425f91b80 1 --2- 172.21.15.5:0/99732753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781bc0 0x561d03792530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.159+0000 7f0425f91b80 1 -- 172.21.15.5:0/99732753 >> 172.21.15.5:0/99732753 conn(0x561d036f5260 msgr2=0x561d03789cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.160+0000 7f0425f91b80 1 -- 172.21.15.5:0/99732753 shutdown_connections 2023-10-07T00:15:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.160+0000 7f0425f91b80 1 -- 172.21.15.5:0/99732753 wait complete. 2023-10-07T00:15:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.160+0000 7f0425f91b80 1 -- start start 2023-10-07T00:15:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.161+0000 7f0425f91b80 1 Processor -- start 2023-10-07T00:15:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.161+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781260 0x561d0378e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.161+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d0378ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.161+0000 7f0425f91b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03782a60 0x561d03791790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.161+0000 7f0425f91b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d03791cd0 con 0x561d03781260 2023-10-07T00:15:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.161+0000 7f0425f91b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d03791e40 con 0x561d03782a60 2023-10-07T00:15:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.161+0000 7f0425f91b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d03792000 con 0x561d03781bc0 2023-10-07T00:15:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.161+0000 7f0425f91b80 10 client.0 _ll_register_callbacks cb 0x7f03fc00b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.162+0000 7f040bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781260 0x561d0378e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.162+0000 7f040bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781260 0x561d0378e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48038/0 (socket says 172.21.15.5:48038) 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.162+0000 7f040bfff700 1 -- 172.21.15.5:0/399294640 learned_addr learned my addr 172.21.15.5:0/399294640 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.162+0000 7f0403fff700 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d0378ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.162+0000 7f0410b9c700 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03782a60 0x561d03791790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.163+0000 7f040bfff700 1 -- 172.21.15.5:0/399294640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 msgr2=0x561d0378ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.163+0000 7f040bfff700 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d0378ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.163+0000 7f040bfff700 1 -- 172.21.15.5:0/399294640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03782a60 msgr2=0x561d03791790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.163+0000 7f040bfff700 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03782a60 0x561d03791790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.163+0000 7f040bfff700 1 -- 172.21.15.5:0/399294640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d034fede0 con 0x561d03781260 2023-10-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.163+0000 7f040bfff700 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781260 0x561d0378e6c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0092a0 tx=0x7f03fc009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565025d07685fee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.163+0000 7f03eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.164+0000 7f03eb7fe700 1 -- 172.21.15.5:0/399294640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc01d050 con 0x561d03781260 2023-10-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.164+0000 7f03eb7fe700 1 -- 172.21.15.5:0/399294640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f03fc03c070 con 0x561d03781260 2023-10-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.164+0000 7f0425f91b80 1 -- 172.21.15.5:0/399294640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03f401a020 con 0x561d03781260 2023-10-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.165+0000 7f03eb7fe700 1 -- 172.21.15.5:0/399294640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03fc02f440 con 0x561d03781260 2023-10-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.165+0000 7f0425f91b80 10 client.16287 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.165+0000 7f0425f91b80 1 -- 172.21.15.5:0/399294640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f040c06b260 con 0x561d03781260 2023-10-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.165+0000 7f03eb7fe700 1 -- 172.21.15.5:0/399294640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03f401a020 con 0x561d03781260 2023-10-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.166+0000 7f03eb7fe700 1 -- 172.21.15.5:0/399294640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f03fc004950 con 0x561d03781260 2023-10-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.166+0000 7f0425f91b80 10 client.16287 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.166+0000 7f0425f91b80 10 client.16287 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-10-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.166+0000 7f0425f91b80 20 client.16287 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.166+0000 7f0425f91b80 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561d037eb860 0x561d037edc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.166+0000 7f0425f91b80 4 client.16287 mds_command: new command op to 24574 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.166+0000 7f0425f91b80 1 -- 172.21.15.5:0/399294640 --> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561d036ccb30 con 0x561d037eb860 2023-10-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.167+0000 7f0403fff700 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561d037eb860 0x561d037edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.168+0000 7f0403fff700 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561d037eb860 0x561d037edc80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=241c93a80fd24ee7 server_cookie=da3f24f2662c35f4 in_seq=0 out_seq=0 2023-10-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.168+0000 7f03eb7fe700 10 client.16287 ms_handle_connect on v2:172.21.15.5:6840/3808461894 2023-10-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.168+0000 7f03eb7fe700 1 -- 172.21.15.5:0/399294640 <== mds.1 v2:172.21.15.5:6840/3808461894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+4300 (crc 0 0 0) 0x561d036ccb30 con 0x561d037eb860 2023-10-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.168+0000 7f03eb7fe700 10 client.16287 handle_command_reply: tid=0 2023-10-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 client.16287 shutdown 2023-10-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 -- 172.21.15.5:0/399294640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781260 msgr2=0x561d0378e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781260 0x561d0378e6c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0092a0 tx=0x7f03fc009830 comp rx=0 tx=0).stop 2023-10-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 -- 172.21.15.5:0/399294640 shutdown_connections 2023-10-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.5:6840/3808461894,v1:172.21.15.5:6841/3808461894] conn(0x561d037eb860 0x561d037edc80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561d03782a60 0x561d03791790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d03781260 0x561d0378e6c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 --2- 172.21.15.5:0/399294640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d03781bc0 0x561d0378ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f03eb7fe700 0 client.16287 ms_handle_reset on v2:172.21.15.5:6840/3808461894 2023-10-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 -- 172.21.15.5:0/399294640 >> 172.21.15.5:0/399294640 conn(0x561d036f5260 msgr2=0x561d03792e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 -- 172.21.15.5:0/399294640 shutdown_connections 2023-10-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.169+0000 7f0425f91b80 1 -- 172.21.15.5:0/399294640 wait complete. 2023-10-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.170+0000 7f0425f91b80 20 client.16287 trim_cache size 0 max 16384 2023-10-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 271120084, 2023-10-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628312, 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/reader.c" 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 449367071, 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628298, 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.h" 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 810886924, 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628304, 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c" 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 1178353340, 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628308, 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/process.c" 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 1615652415, 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628306, 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.am" 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 1835785273, 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628310, 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/commenter.c" 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 1991366601, 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628305, 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h" 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 2010981848, 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628313, 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/writer.c" 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 2320540173, 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628300, 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.h" 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 2369158711, 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628303, 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench_p.h" 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 2829921568, 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628307, 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.in" 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 3000923916, 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628301, 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.c" 2023-10-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 3109033173, 2023-10-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628314, 2023-10-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/helpers.c" 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 3349310809, 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628671, 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile" 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 3426034981, 2023-10-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628297, 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.c" 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 3738424502, 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628302, 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.h" 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 3790158651, 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628309, 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/globals.h" 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4007296525, 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628299, 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.c" 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2023-10-07T00:15:22.183 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4116416733, 2023-10-07T00:15:22.183 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511628311, 2023-10-07T00:15:22.183 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/rewriter.c" 2023-10-07T00:15:22.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:15:22.183 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.170+0000 7f04125ff700 1 -- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f03f80a15d0 msgr2=0x7f03f80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.170+0000 7f04125ff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f03f80a15d0 0x7f03f80a3a90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00b2e0 tx=0x7f03fc01a040 comp rx=0 tx=0).stop 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.170+0000 7f04125ff700 1 -- 172.21.15.5:0/1484790813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c100b50 msgr2=0x7f040c10b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.170+0000 7f04125ff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c100b50 0x7f040c10b790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0404007ee0 tx=0x7f040400d3b0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.171+0000 7f04125ff700 1 -- 172.21.15.5:0/1484790813 shutdown_connections 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.171+0000 7f04125ff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f03f80a15d0 0x7f03f80a3a90 secure :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00b2e0 tx=0x7f03fc01a040 comp rx=0 tx=0).stop 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.171+0000 7f04125ff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f040c100b50 0x7f040c10b790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.171+0000 7f04125ff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c0ff830 0x7f040c1041e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.171+0000 7f04125ff700 1 --2- 172.21.15.5:0/1484790813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040c100190 0x7f040c104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.171+0000 7f04125ff700 1 -- 172.21.15.5:0/1484790813 >> 172.21.15.5:0/1484790813 conn(0x7f040c0fb450 msgr2=0x7f040c0fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.171+0000 7f04125ff700 1 -- 172.21.15.5:0/1484790813 shutdown_connections 2023-10-07T00:15:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.171+0000 7f04125ff700 1 -- 172.21.15.5:0/1484790813 wait complete. 2023-10-07T00:15:22.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-07T00:15:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.535+0000 7fc19bfff700 1 -- 172.21.15.5:0/259628269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 msgr2=0x7fc1941035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.535+0000 7fc19bfff700 1 --2- 172.21.15.5:0/259628269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 0x7fc1941035e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1900099c0 tx=0x7fc190009cd0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.535+0000 7fc19bfff700 1 -- 172.21.15.5:0/259628269 shutdown_connections 2023-10-07T00:15:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.535+0000 7fc19bfff700 1 --2- 172.21.15.5:0/259628269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc194104d50 0x7fc19410b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.535+0000 7fc19bfff700 1 --2- 172.21.15.5:0/259628269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 0x7fc1941035e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.535+0000 7fc19bfff700 1 --2- 172.21.15.5:0/259628269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1941043b0 0x7fc194104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.535+0000 7fc19bfff700 1 -- 172.21.15.5:0/259628269 >> 172.21.15.5:0/259628269 conn(0x7fc1940fe730 msgr2=0x7fc194100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.536+0000 7fc19bfff700 1 -- 172.21.15.5:0/259628269 shutdown_connections 2023-10-07T00:15:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.536+0000 7fc19bfff700 1 -- 172.21.15.5:0/259628269 wait complete. 2023-10-07T00:15:22.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.537+0000 7fc19bfff700 1 Processor -- start 2023-10-07T00:15:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.538+0000 7fc19bfff700 1 -- start start 2023-10-07T00:15:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.538+0000 7fc19bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 0x7fc19406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.538+0000 7fc19bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941043b0 0x7fc19406fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.538+0000 7fc19bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194104d50 0x7fc1941ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.539+0000 7fc19bfff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc194072dc0 con 0x7fc194104d50 2023-10-07T00:15:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.539+0000 7fc19bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc194072f00 con 0x7fc1941031c0 2023-10-07T00:15:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.539+0000 7fc19bfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc194079310 con 0x7fc1941043b0 2023-10-07T00:15:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.539+0000 7fc19a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194104d50 0x7fc1941ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.539+0000 7fc19a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194104d50 0x7fc1941ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48066/0 (socket says 172.21.15.5:48066) 2023-10-07T00:15:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.539+0000 7fc19a59c700 1 -- 172.21.15.5:0/2872201652 learned_addr learned my addr 172.21.15.5:0/2872201652 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.539+0000 7fc199d9b700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 0x7fc19406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.540+0000 7fc19959a700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941043b0 0x7fc19406fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.540+0000 7fc199d9b700 1 -- 172.21.15.5:0/2872201652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941043b0 msgr2=0x7fc19406fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.540+0000 7fc199d9b700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941043b0 0x7fc19406fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.540+0000 7fc199d9b700 1 -- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194104d50 msgr2=0x7fc1941ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.540+0000 7fc199d9b700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194104d50 0x7fc1941ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.540+0000 7fc199d9b700 1 -- 172.21.15.5:0/2872201652 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184009520 con 0x7fc1941031c0 2023-10-07T00:15:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.541+0000 7fc199d9b700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 0x7fc19406f7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc19000bf10 tx=0x7fc19000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.541+0000 7fc18affd700 1 -- 172.21.15.5:0/2872201652 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19001d070 con 0x7fc1941031c0 2023-10-07T00:15:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.541+0000 7fc18affd700 1 -- 172.21.15.5:0/2872201652 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1900054e0 con 0x7fc1941031c0 2023-10-07T00:15:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.541+0000 7fc19bfff700 1 -- 172.21.15.5:0/2872201652 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1900095f0 con 0x7fc1941031c0 2023-10-07T00:15:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.541+0000 7fc18affd700 1 -- 172.21.15.5:0/2872201652 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190004a90 con 0x7fc1941031c0 2023-10-07T00:15:22.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.541+0000 7fc19bfff700 1 -- 172.21.15.5:0/2872201652 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1941a50c0 con 0x7fc1941031c0 2023-10-07T00:15:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.546+0000 7fc18affd700 1 -- 172.21.15.5:0/2872201652 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc190004bf0 con 0x7fc1941031c0 2023-10-07T00:15:22.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.547+0000 7fc18affd700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1800a1580 0x7fc1800a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.547+0000 7fc18affd700 1 -- 172.21.15.5:0/2872201652 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc1900cdae0 con 0x7fc1941031c0 2023-10-07T00:15:22.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.547+0000 7fc1af9b0b80 1 Processor -- start 2023-10-07T00:15:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.548+0000 7fc19959a700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1800a1580 0x7fc1800a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.548+0000 7fc1af9b0b80 1 -- start start 2023-10-07T00:15:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.548+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x55699913a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.548+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913abc0 0x55699913b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.548+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699913bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.548+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569990a2460 con 0x55699913a260 2023-10-07T00:15:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.548+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556999093c20 con 0x55699913abc0 2023-10-07T00:15:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.548+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556999091540 con 0x55699913ba60 2023-10-07T00:15:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699913bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699913bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:52098/0 (socket says 172.21.15.5:52098) 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19a59c700 1 -- 172.21.15.5:0/1161942449 learned_addr learned my addr 172.21.15.5:0/1161942449 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc199d9b700 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x55699913a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19959a700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1800a1580 0x7fc1800a3a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc184009d80 tx=0x7fc184009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19959a700 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913abc0 0x55699913b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19959a700 1 -- 172.21.15.5:0/1161942449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 msgr2=0x55699913bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19959a700 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699913bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19959a700 1 -- 172.21.15.5:0/1161942449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 msgr2=0x55699913a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.549+0000 7fc19959a700 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x55699913a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.550+0000 7fc19959a700 1 -- 172.21.15.5:0/1161942449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556998eb7de0 con 0x55699913abc0 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.550+0000 7fc19959a700 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913abc0 0x55699913b480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc184011a50 tx=0x7fc184014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f09488dd8d7432 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.550+0000 7fc17ffff700 1 -- 172.21.15.5:0/1161942449 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184012d40 con 0x55699913abc0 2023-10-07T00:15:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.550+0000 7fc17ffff700 1 -- 172.21.15.5:0/1161942449 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc184016070 con 0x55699913abc0 2023-10-07T00:15:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.550+0000 7fc17ffff700 1 -- 172.21.15.5:0/1161942449 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1840055c0 con 0x55699913abc0 2023-10-07T00:15:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.552+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/1161942449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913abc0 msgr2=0x55699913b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.552+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913abc0 0x55699913b480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc184011a50 tx=0x7fc184014000 comp rx=0 tx=0).stop 2023-10-07T00:15:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.552+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/1161942449 shutdown_connections 2023-10-07T00:15:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.552+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699913bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.552+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x55699913a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.552+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/1161942449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913abc0 0x55699913b480 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.552+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/1161942449 >> 172.21.15.5:0/1161942449 conn(0x5569990ae260 msgr2=0x556999135140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.553+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/1161942449 shutdown_connections 2023-10-07T00:15:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.553+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/1161942449 wait complete. 2023-10-07T00:15:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.554+0000 7fc1af9b0b80 1 -- start start 2023-10-07T00:15:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.554+0000 7fc1af9b0b80 1 Processor -- start 2023-10-07T00:15:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.555+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913a260 0x556999144090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.555+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913abc0 0x5569991445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.555+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699914b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.555+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55699908ce30 con 0x55699913abc0 2023-10-07T00:15:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.555+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556999029710 con 0x55699913a260 2023-10-07T00:15:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.555+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569990293b0 con 0x55699913ba60 2023-10-07T00:15:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.555+0000 7fc1af9b0b80 10 client.0 _ll_register_callbacks cb 0x556998e86800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.556+0000 7fc19959a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913abc0 0x5569991445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.556+0000 7fc19959a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913abc0 0x5569991445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48074/0 (socket says 172.21.15.5:48074) 2023-10-07T00:15:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.556+0000 7fc19959a700 1 -- 172.21.15.5:0/2083609880 learned_addr learned my addr 172.21.15.5:0/2083609880 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.556+0000 7fc19a59c700 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699914b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.557+0000 7fc199d9b700 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913a260 0x556999144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.557+0000 7fc19a59c700 1 -- 172.21.15.5:0/2083609880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913a260 msgr2=0x556999144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.557+0000 7fc19a59c700 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913a260 0x556999144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.557+0000 7fc19a59c700 1 -- 172.21.15.5:0/2083609880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913abc0 msgr2=0x5569991445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.558+0000 7fc19a59c700 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913abc0 0x5569991445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.558+0000 7fc19a59c700 1 -- 172.21.15.5:0/2083609880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc184011c60 con 0x55699913ba60 2023-10-07T00:15:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.558+0000 7fc19959a700 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913abc0 0x5569991445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:15:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.558+0000 7fc19a59c700 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699914b610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55699913b240 tx=0x7fc18c007b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=431a393750dcfa53 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.558+0000 7fc17d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:15:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.559+0000 7fc17d7fa700 1 -- 172.21.15.5:0/2083609880 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c004bb0 con 0x55699913ba60 2023-10-07T00:15:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.559+0000 7fc17d7fa700 1 -- 172.21.15.5:0/2083609880 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc18c004d10 con 0x55699913ba60 2023-10-07T00:15:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.559+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2083609880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55699912cf10 con 0x55699913ba60 2023-10-07T00:15:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.559+0000 7fc17d7fa700 1 -- 172.21.15.5:0/2083609880 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc18c013880 con 0x55699913ba60 2023-10-07T00:15:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.559+0000 7fc1af9b0b80 10 client.26110 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.559+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2083609880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556998ea0c60 con 0x55699913ba60 2023-10-07T00:15:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.560+0000 7fc17d7fa700 1 -- 172.21.15.5:0/2083609880 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55699912cf10 con 0x55699913ba60 2023-10-07T00:15:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.560+0000 7fc17d7fa700 1 -- 172.21.15.5:0/2083609880 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc18c01fb10 con 0x55699913ba60 2023-10-07T00:15:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.560+0000 7fc1af9b0b80 10 client.26110 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.560+0000 7fc1af9b0b80 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.560+0000 7fc1af9b0b80 20 client.26110 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.560+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55699914ff90 0x5569991523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.560+0000 7fc1af9b0b80 4 client.26110 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.560+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2083609880 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556999085e10 con 0x55699914ff90 2023-10-07T00:15:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.561+0000 7fc199d9b700 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55699914ff90 0x5569991523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.562+0000 7fc17d7fa700 10 client.26110 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.562+0000 7fc199d9b700 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55699914ff90 0x5569991523b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81e4d5942572c990 server_cookie=4a13d25b0e60b1e3 in_seq=0 out_seq=0 2023-10-07T00:15:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.563+0000 7fc17d7fa700 1 -- 172.21.15.5:0/2083609880 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556999085e10 con 0x55699914ff90 2023-10-07T00:15:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.563+0000 7fc17d7fa700 10 client.26110 handle_command_reply: tid=0 2023-10-07T00:15:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.563+0000 7fc1af9b0b80 1 client.26110 shutdown 2023-10-07T00:15:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.563+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2083609880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 msgr2=0x55699914b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.563+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699914b610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55699913b240 tx=0x7fc18c007b80 comp rx=0 tx=0).stop 2023-10-07T00:15:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2083609880 shutdown_connections 2023-10-07T00:15:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55699914ff90 0x5569991523b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913ba60 0x55699914b610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913a260 0x556999144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc17d7fa700 0 client.26110 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2083609880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913abc0 0x5569991445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2083609880 >> 172.21.15.5:0/2083609880 conn(0x5569990ae260 msgr2=0x556999134f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2083609880 shutdown_connections 2023-10-07T00:15:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.564+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2083609880 wait complete. 2023-10-07T00:15:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.565+0000 7fc1af9b0b80 20 client.26110 trim_cache size 0 max 16384 2023-10-07T00:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.586+0000 7fc1af9b0b80 1 Processor -- start 2023-10-07T00:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.586+0000 7fc1af9b0b80 1 -- start start 2023-10-07T00:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.586+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x556999142d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 0x55699914b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699913ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556998f0d920 con 0x55699913a260 2023-10-07T00:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556999143540 con 0x55699913ba60 2023-10-07T00:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55699914d300 con 0x55699913abc0 2023-10-07T00:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc19a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699913ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc19959a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 0x55699914b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc19a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699913ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56838/0 (socket says 172.21.15.5:56838) 2023-10-07T00:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.587+0000 7fc19a59c700 1 -- 172.21.15.5:0/2421674391 learned_addr learned my addr 172.21.15.5:0/2421674391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.588+0000 7fc199d9b700 1 --2- 172.21.15.5:0/2421674391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x556999142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.588+0000 7fc19959a700 1 -- 172.21.15.5:0/2421674391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 msgr2=0x55699913ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.588+0000 7fc19959a700 1 --2- 172.21.15.5:0/2421674391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699913ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.588+0000 7fc19959a700 1 -- 172.21.15.5:0/2421674391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 msgr2=0x556999142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.588+0000 7fc19959a700 1 --2- 172.21.15.5:0/2421674391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x556999142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.588+0000 7fc19959a700 1 -- 172.21.15.5:0/2421674391 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556998ede250 con 0x55699913abc0 2023-10-07T00:15:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.588+0000 7fc19959a700 1 --2- 172.21.15.5:0/2421674391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 0x55699914b5d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc184009770 tx=0x7fc184009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26343d62c683d075 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.589+0000 7fc188ff9700 1 -- 172.21.15.5:0/2421674391 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1840054d0 con 0x55699913abc0 2023-10-07T00:15:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.589+0000 7fc188ff9700 1 -- 172.21.15.5:0/2421674391 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc184005630 con 0x55699913abc0 2023-10-07T00:15:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.589+0000 7fc188ff9700 1 -- 172.21.15.5:0/2421674391 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18401f660 con 0x55699913abc0 2023-10-07T00:15:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.590+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2421674391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 msgr2=0x55699914b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.590+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2421674391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 0x55699914b5d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc184009770 tx=0x7fc184009b90 comp rx=0 tx=0).stop 2023-10-07T00:15:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2421674391 shutdown_connections 2023-10-07T00:15:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2421674391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699913ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2421674391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x556999142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/2421674391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 0x55699914b5d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2421674391 >> 172.21.15.5:0/2421674391 conn(0x5569990ae260 msgr2=0x556999156d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2421674391 shutdown_connections 2023-10-07T00:15:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/2421674391 wait complete. 2023-10-07T00:15:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 -- start start 2023-10-07T00:15:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.591+0000 7fc1af9b0b80 1 Processor -- start 2023-10-07T00:15:22.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x556999149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 0x5569991495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc1af9b0b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699914a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55699914aaf0 con 0x55699913a260 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55699914ac60 con 0x55699913ba60 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc1af9b0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55699914ae20 con 0x55699913abc0 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc1af9b0b80 10 client.0 _ll_register_callbacks cb 0x7fc18c007500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc19a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699914a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc199d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x556999149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc19a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699914a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56848/0 (socket says 172.21.15.5:56848) 2023-10-07T00:15:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.592+0000 7fc19a59c700 1 -- 172.21.15.5:0/4047021770 learned_addr learned my addr 172.21.15.5:0/4047021770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.593+0000 7fc19a59c700 1 -- 172.21.15.5:0/4047021770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 msgr2=0x5569991495a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:15:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.593+0000 7fc19a59c700 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 0x5569991495a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.593+0000 7fc19a59c700 1 -- 172.21.15.5:0/4047021770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 msgr2=0x556999149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.593+0000 7fc19a59c700 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x556999149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.593+0000 7fc19a59c700 1 -- 172.21.15.5:0/4047021770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556998eb7de0 con 0x55699913ba60 2023-10-07T00:15:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.594+0000 7fc19a59c700 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699914a5b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc18c01fef0 tx=0x7fc18c017af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e8bece7cebeb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.594+0000 7fc17d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:15:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.594+0000 7fc17d7fa700 1 -- 172.21.15.5:0/4047021770 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0092e0 con 0x55699913ba60 2023-10-07T00:15:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.594+0000 7fc17d7fa700 1 -- 172.21.15.5:0/4047021770 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc18c013880 con 0x55699913ba60 2023-10-07T00:15:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.594+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/4047021770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc184016070 con 0x55699913ba60 2023-10-07T00:15:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc17d7fa700 1 -- 172.21.15.5:0/4047021770 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc18c016430 con 0x55699913ba60 2023-10-07T00:15:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc1af9b0b80 10 client.26129 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/4047021770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556998eb62b0 con 0x55699913ba60 2023-10-07T00:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc17d7fa700 1 -- 172.21.15.5:0/4047021770 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc184016070 con 0x55699913ba60 2023-10-07T00:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc17d7fa700 1 -- 172.21.15.5:0/4047021770 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc18c01f5d0 con 0x55699913ba60 2023-10-07T00:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc1af9b0b80 10 client.26129 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc1af9b0b80 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc1af9b0b80 20 client.26129 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5569991a4a50 0x5569991a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc1af9b0b80 4 client.26129 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-07T00:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.595+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/4047021770 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556999085b30 con 0x5569991a4a50 2023-10-07T00:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.596+0000 7fc199d9b700 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5569991a4a50 0x5569991a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.596+0000 7fc199d9b700 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5569991a4a50 0x5569991a6e70 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a41ecdc1343caa6 server_cookie=d497f6f3374f6772 in_seq=0 out_seq=0 2023-10-07T00:15:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.596+0000 7fc17d7fa700 10 client.26129 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc17d7fa700 1 -- 172.21.15.5:0/4047021770 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556999085b30 con 0x5569991a4a50 2023-10-07T00:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc17d7fa700 10 client.26129 handle_command_reply: tid=0 2023-10-07T00:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 client.26129 shutdown 2023-10-07T00:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/4047021770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 msgr2=0x55699914a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699914a5b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc18c01fef0 tx=0x7fc18c017af0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/4047021770 shutdown_connections 2023-10-07T00:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5569991a4a50 0x5569991a6e70 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55699913ba60 0x55699914a5b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55699913a260 0x556999149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 --2- 172.21.15.5:0/4047021770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55699913abc0 0x5569991495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/4047021770 >> 172.21.15.5:0/4047021770 conn(0x5569990ae260 msgr2=0x556999142d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.597+0000 7fc17d7fa700 0 client.26129 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.598+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/4047021770 shutdown_connections 2023-10-07T00:15:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.598+0000 7fc1af9b0b80 1 -- 172.21.15.5:0/4047021770 wait complete. 2023-10-07T00:15:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.598+0000 7fc1af9b0b80 20 client.26129 trim_cache size 0 max 16384 2023-10-07T00:15:22.604 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-07T00:15:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.599+0000 7fc19bfff700 1 -- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1800a1580 msgr2=0x7fc1800a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.599+0000 7fc19bfff700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1800a1580 0x7fc1800a3a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc184009d80 tx=0x7fc184009260 comp rx=0 tx=0).stop 2023-10-07T00:15:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.599+0000 7fc19bfff700 1 -- 172.21.15.5:0/2872201652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 msgr2=0x7fc19406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.599+0000 7fc19bfff700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 0x7fc19406f7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc19000bf10 tx=0x7fc19000fa00 comp rx=0 tx=0).stop 2023-10-07T00:15:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.600+0000 7fc19bfff700 1 -- 172.21.15.5:0/2872201652 shutdown_connections 2023-10-07T00:15:22.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.600+0000 7fc19bfff700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fc1800a1580 0x7fc1800a3a40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.600+0000 7fc19bfff700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194104d50 0x7fc1941ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.600+0000 7fc19bfff700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1941031c0 0x7fc19406f7a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.600+0000 7fc19bfff700 1 --2- 172.21.15.5:0/2872201652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941043b0 0x7fc19406fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.600+0000 7fc19bfff700 1 -- 172.21.15.5:0/2872201652 >> 172.21.15.5:0/2872201652 conn(0x7fc1940fe730 msgr2=0x7fc194100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.600+0000 7fc19bfff700 1 -- 172.21.15.5:0/2872201652 shutdown_connections 2023-10-07T00:15:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:15:22.600+0000 7fc19bfff700 1 -- 172.21.15.5:0/2872201652 wait complete. 2023-10-07T00:15:22.629 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 271120084, 'ino': 1099511628312, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/reader.c'}, {'damage_type': 'backtrace', 'id': 449367071, 'ino': 1099511628298, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.h'}, {'damage_type': 'backtrace', 'id': 810886924, 'ino': 1099511628304, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c'}, {'damage_type': 'backtrace', 'id': 1178353340, 'ino': 1099511628308, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/process.c'}, {'damage_type': 'backtrace', 'id': 1615652415, 'ino': 1099511628306, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.am'}, {'damage_type': 'backtrace', 'id': 1835785273, 'ino': 1099511628310, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/commenter.c'}, {'damage_type': 'backtrace', 'id': 1991366601, 'ino': 1099511628305, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h'}, {'damage_type': 'backtrace', 'id': 2010981848, 'ino': 1099511628313, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/writer.c'}, {'damage_type': 'backtrace', 'id': 2320540173, 'ino': 1099511628300, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.h'}, {'damage_type': 'backtrace', 'id': 2369158711, 'ino': 1099511628303, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench_p.h'}, {'damage_type': 'backtrace', 'id': 2829921568, 'ino': 1099511628307, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile.in'}, {'damage_type': 'backtrace', 'id': 3000923916, 'ino': 1099511628301, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.c'}, {'damage_type': 'backtrace', 'id': 3109033173, 'ino': 1099511628314, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/helpers.c'}, {'damage_type': 'backtrace', 'id': 3349310809, 'ino': 1099511628671, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/Makefile'}, {'damage_type': 'backtrace', 'id': 3426034981, 'ino': 1099511628297, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/mysnprintf.c'}, {'damage_type': 'backtrace', 'id': 3738424502, 'ino': 1099511628302, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/fakesnprintf.h'}, {'damage_type': 'backtrace', 'id': 3790158651, 'ino': 1099511628309, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/globals.h'}, {'damage_type': 'backtrace', 'id': 4007296525, 'ino': 1099511628299, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/blogbench.c'}, {'damage_type': 'backtrace', 'id': 4116416733, 'ino': 1099511628311, 'path': '/volumes/_nogroup/sv_0/511769c6-b4a3-4f32-8846-8476a986ce7c/client.0/tmp/blogbench-1.0/src/rewriter.c'}] 2023-10-07T00:15:22.629 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-10-07T00:15:23.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:22 smithi005 ceph-mon[129406]: pgmap v424: 97 pgs: 97 active+clean; 102 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2023-10-07T00:15:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:22 smithi088 ceph-mon[103111]: pgmap v424: 97 pgs: 97 active+clean; 102 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2023-10-07T00:15:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:22 smithi112 ceph-mon[133548]: pgmap v424: 97 pgs: 97 active+clean; 102 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2023-10-07T00:15:25.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:24 smithi005 ceph-mon[129406]: pgmap v425: 97 pgs: 97 active+clean; 104 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2023-10-07T00:15:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:24 smithi088 ceph-mon[103111]: pgmap v425: 97 pgs: 97 active+clean; 104 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2023-10-07T00:15:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:24 smithi112 ceph-mon[133548]: pgmap v425: 97 pgs: 97 active+clean; 104 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2023-10-07T00:15:27.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:26 smithi005 ceph-mon[129406]: pgmap v426: 97 pgs: 97 active+clean; 108 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2023-10-07T00:15:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:26 smithi088 ceph-mon[103111]: pgmap v426: 97 pgs: 97 active+clean; 108 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2023-10-07T00:15:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:26 smithi112 ceph-mon[133548]: pgmap v426: 97 pgs: 97 active+clean; 108 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2023-10-07T00:15:27.764 INFO:tasks.workunit.client.0.smithi005.stdout: 27 6392 73 3629 147 559 74 2023-10-07T00:15:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.384+0000 7f39551ff700 1 -- 172.21.15.5:0/4263210503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3950104ab0 msgr2=0x7f3950104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.384+0000 7f39551ff700 1 --2- 172.21.15.5:0/4263210503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3950104ab0 0x7f3950104f30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f394000b0a0 tx=0x7f394000b3b0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.384+0000 7f39551ff700 1 -- 172.21.15.5:0/4263210503 shutdown_connections 2023-10-07T00:15:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.384+0000 7f39551ff700 1 --2- 172.21.15.5:0/4263210503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3950104ab0 0x7f3950104f30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.384+0000 7f39551ff700 1 --2- 172.21.15.5:0/4263210503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39500ff770 0x7f3950101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.385+0000 7f39551ff700 1 --2- 172.21.15.5:0/4263210503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39501020e0 0x7f3950104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.385+0000 7f39551ff700 1 -- 172.21.15.5:0/4263210503 >> 172.21.15.5:0/4263210503 conn(0x7f39500fb390 msgr2=0x7f39500fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.385+0000 7f39551ff700 1 -- 172.21.15.5:0/4263210503 shutdown_connections 2023-10-07T00:15:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.385+0000 7f39551ff700 1 -- 172.21.15.5:0/4263210503 wait complete. 2023-10-07T00:15:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.386+0000 7f39551ff700 1 Processor -- start 2023-10-07T00:15:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.387+0000 7f39551ff700 1 -- start start 2023-10-07T00:15:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.387+0000 7f39551ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39500ff770 0x7f395019d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.387+0000 7f39551ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39501020e0 0x7f395019d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.387+0000 7f39551ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3950104ab0 0x7f39501a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.387+0000 7f39551ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39501a4db0 con 0x7f39500ff770 2023-10-07T00:15:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.387+0000 7f39551ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39501a4ef0 con 0x7f39501020e0 2023-10-07T00:15:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.387+0000 7f39551ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39501a5080 con 0x7f3950104ab0 2023-10-07T00:15:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.387+0000 7f394e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39501020e0 0x7f395019d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.388+0000 7f394e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39501020e0 0x7f395019d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56862/0 (socket says 172.21.15.5:56862) 2023-10-07T00:15:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.388+0000 7f394e59c700 1 -- 172.21.15.5:0/939976303 learned_addr learned my addr 172.21.15.5:0/939976303 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.388+0000 7f394f59e700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3950104ab0 0x7f39501a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.388+0000 7f394ed9d700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39500ff770 0x7f395019d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.389+0000 7f394e59c700 1 -- 172.21.15.5:0/939976303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3950104ab0 msgr2=0x7f39501a47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.389+0000 7f394e59c700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3950104ab0 0x7f39501a47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.389+0000 7f394e59c700 1 -- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39500ff770 msgr2=0x7f395019d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.389+0000 7f394e59c700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39500ff770 0x7f395019d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.389+0000 7f394e59c700 1 -- 172.21.15.5:0/939976303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940009d00 con 0x7f39501020e0 2023-10-07T00:15:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.389+0000 7f394e59c700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39501020e0 0x7f395019d770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f393800e9a0 tx=0x7f393800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.390+0000 7f3947fff700 1 -- 172.21.15.5:0/939976303 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938009790 con 0x7f39501020e0 2023-10-07T00:15:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.390+0000 7f3947fff700 1 -- 172.21.15.5:0/939976303 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f393800cbd0 con 0x7f39501020e0 2023-10-07T00:15:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.390+0000 7f39551ff700 1 -- 172.21.15.5:0/939976303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39501a5360 con 0x7f39501020e0 2023-10-07T00:15:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.390+0000 7f3947fff700 1 -- 172.21.15.5:0/939976303 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938018680 con 0x7f39501020e0 2023-10-07T00:15:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.391+0000 7f39551ff700 1 -- 172.21.15.5:0/939976303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39501a58c0 con 0x7f39501020e0 2023-10-07T00:15:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.397+0000 7f3968b62b80 1 Processor -- start 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.400+0000 7f3947fff700 1 -- 172.21.15.5:0/939976303 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f393800cd40 con 0x7f39501020e0 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.403+0000 7f3968b62b80 1 -- start start 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.403+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd5ec0 0x55763dfd62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.403+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd6fd0 0x55763dfd7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.403+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd7990 0x55763dfde220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.403+0000 7f3968b62b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763df3e400 con 0x55763dfd5ec0 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.403+0000 7f3968b62b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763df2fbc0 con 0x55763dfd6fd0 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.403+0000 7f3968b62b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763df2d4e0 con 0x55763dfd7990 2023-10-07T00:15:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.404+0000 7f394f59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd5ec0 0x55763dfd62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.404+0000 7f394f59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd5ec0 0x55763dfd62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48128/0 (socket says 172.21.15.5:48128) 2023-10-07T00:15:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.404+0000 7f394f59e700 1 -- 172.21.15.5:0/1581489907 learned_addr learned my addr 172.21.15.5:0/1581489907 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.404+0000 7f3947fff700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f393c0a15d0 0x7f393c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.404+0000 7f394ed9d700 1 --2- 172.21.15.5:0/1581489907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd6fd0 0x55763dfd7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.404+0000 7f3947fff700 1 -- 172.21.15.5:0/939976303 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3938014070 con 0x7f39501020e0 2023-10-07T00:15:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.405+0000 7f394f59e700 1 -- 172.21.15.5:0/1581489907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd7990 msgr2=0x55763dfde220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T00:15:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.405+0000 7f394f59e700 1 --2- 172.21.15.5:0/1581489907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd7990 0x55763dfde220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.405+0000 7f394f59e700 1 -- 172.21.15.5:0/1581489907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd6fd0 msgr2=0x55763dfd7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:28.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.405+0000 7f394f59e700 1 --2- 172.21.15.5:0/1581489907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd6fd0 0x55763dfd7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.405+0000 7f394f59e700 1 -- 172.21.15.5:0/1581489907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55763dd53d80 con 0x55763dfd5ec0 2023-10-07T00:15:28.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.405+0000 7f394f59e700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f393c0a15d0 0x7f393c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.405+0000 7f394f59e700 1 --2- 172.21.15.5:0/1581489907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd5ec0 0x55763dfd62e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f394000b0a0 tx=0x7f3940009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea259eb6ef2e83e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.407+0000 7f39457fa700 1 -- 172.21.15.5:0/1581489907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000e040 con 0x55763dfd5ec0 2023-10-07T00:15:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.407+0000 7f39457fa700 1 -- 172.21.15.5:0/1581489907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3940007c10 con 0x55763dfd5ec0 2023-10-07T00:15:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.407+0000 7f39457fa700 1 -- 172.21.15.5:0/1581489907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39400406d0 con 0x55763dfd5ec0 2023-10-07T00:15:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.408+0000 7f3968b62b80 1 -- 172.21.15.5:0/1581489907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd5ec0 msgr2=0x55763dfd62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.408+0000 7f394f59e700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f393c0a15d0 0x7f393c0a3a90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3940009610 tx=0x7f3940040a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.408+0000 7f3968b62b80 1 --2- 172.21.15.5:0/1581489907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd5ec0 0x55763dfd62e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f394000b0a0 tx=0x7f3940009360 comp rx=0 tx=0).stop 2023-10-07T00:15:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.408+0000 7f3968b62b80 1 -- 172.21.15.5:0/1581489907 shutdown_connections 2023-10-07T00:15:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.408+0000 7f3968b62b80 1 --2- 172.21.15.5:0/1581489907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd7990 0x55763dfde220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.408+0000 7f3968b62b80 1 --2- 172.21.15.5:0/1581489907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd5ec0 0x55763dfd62e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.408+0000 7f3968b62b80 1 --2- 172.21.15.5:0/1581489907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd6fd0 0x55763dfd7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.408+0000 7f3968b62b80 1 -- 172.21.15.5:0/1581489907 >> 172.21.15.5:0/1581489907 conn(0x55763df4a200 msgr2=0x55763dfd0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.409+0000 7f3968b62b80 1 -- 172.21.15.5:0/1581489907 shutdown_connections 2023-10-07T00:15:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.409+0000 7f3968b62b80 1 -- 172.21.15.5:0/1581489907 wait complete. 2023-10-07T00:15:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.410+0000 7f3968b62b80 1 -- start start 2023-10-07T00:15:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.410+0000 7f3968b62b80 1 Processor -- start 2023-10-07T00:15:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.411+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.411+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 0x55763dfe0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.411+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd7990 0x55763dfe71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.411+0000 7f3968b62b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763df28dd0 con 0x55763dfd6fd0 2023-10-07T00:15:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.411+0000 7f3968b62b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763dec56b0 con 0x55763dfd7990 2023-10-07T00:15:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.411+0000 7f3968b62b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763dec5350 con 0x55763dfd5ec0 2023-10-07T00:15:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.411+0000 7f3968b62b80 10 client.0 _ll_register_callbacks cb 0x55763dd227a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.412+0000 7f394ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.413+0000 7f394ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:52128/0 (socket says 172.21.15.5:52128) 2023-10-07T00:15:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.413+0000 7f394ed9d700 1 -- 172.21.15.5:0/843635308 learned_addr learned my addr 172.21.15.5:0/843635308 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.413+0000 7f394e59c700 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 0x55763dfe0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.414+0000 7f394e59c700 1 -- 172.21.15.5:0/843635308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 msgr2=0x55763dfdfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.414+0000 7f394e59c700 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.414+0000 7f394e59c700 1 -- 172.21.15.5:0/843635308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd7990 msgr2=0x55763dfe71a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T00:15:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.414+0000 7f394e59c700 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd7990 0x55763dfe71a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.414+0000 7f394e59c700 1 -- 172.21.15.5:0/843635308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3950105a60 con 0x55763dfd6fd0 2023-10-07T00:15:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.414+0000 7f394e59c700 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 0x55763dfe0160 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f393809a1b0 tx=0x7f3938099e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a062f2abfecadb6d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.414+0000 7f39367fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.415+0000 7f39367fc700 1 -- 172.21.15.5:0/843635308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938099910 con 0x55763dfd6fd0 2023-10-07T00:15:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.415+0000 7f39367fc700 1 -- 172.21.15.5:0/843635308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f393809e150 con 0x55763dfd6fd0 2023-10-07T00:15:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.415+0000 7f3968b62b80 1 -- 172.21.15.5:0/843635308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55763dfc8d50 con 0x55763dfd6fd0 2023-10-07T00:15:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.417+0000 7f39367fc700 1 -- 172.21.15.5:0/843635308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f393809a220 con 0x55763dfd6fd0 2023-10-07T00:15:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.417+0000 7f3968b62b80 10 client.16317 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.417+0000 7f3968b62b80 1 -- 172.21.15.5:0/843635308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55763dd3cc00 con 0x55763dfd6fd0 2023-10-07T00:15:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.418+0000 7f39367fc700 1 -- 172.21.15.5:0/843635308 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55763dfc8d50 con 0x55763dfd6fd0 2023-10-07T00:15:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.418+0000 7f39367fc700 1 -- 172.21.15.5:0/843635308 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f39380a2240 con 0x55763dfd6fd0 2023-10-07T00:15:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.418+0000 7f3968b62b80 10 client.16317 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.418+0000 7f3968b62b80 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.418+0000 7f3968b62b80 20 client.16317 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.418+0000 7f3968b62b80 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55763dfeba20 0x55763dfede40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.418+0000 7f3968b62b80 4 client.16317 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.418+0000 7f3968b62b80 1 -- 172.21.15.5:0/843635308 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55763df21db0 con 0x55763dfeba20 2023-10-07T00:15:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.419+0000 7f394ed9d700 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55763dfeba20 0x55763dfede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.420+0000 7f394ed9d700 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55763dfeba20 0x55763dfede40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f523caa62d0f9538 server_cookie=eb05d8306d5512bb in_seq=0 out_seq=0 2023-10-07T00:15:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.421+0000 7f39367fc700 10 client.16317 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.421+0000 7f39367fc700 1 -- 172.21.15.5:0/843635308 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55763df21db0 con 0x55763dfeba20 2023-10-07T00:15:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.421+0000 7f39367fc700 10 client.16317 handle_command_reply: tid=0 2023-10-07T00:15:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.421+0000 7f3968b62b80 1 client.16317 shutdown 2023-10-07T00:15:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.422+0000 7f3968b62b80 1 -- 172.21.15.5:0/843635308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 msgr2=0x55763dfe0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.422+0000 7f3968b62b80 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 0x55763dfe0160 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f393809a1b0 tx=0x7f3938099e10 comp rx=0 tx=0).stop 2023-10-07T00:15:28.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.423+0000 7f3968b62b80 1 -- 172.21.15.5:0/843635308 shutdown_connections 2023-10-07T00:15:28.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.423+0000 7f3968b62b80 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55763dfeba20 0x55763dfede40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.423+0000 7f3968b62b80 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd7990 0x55763dfe71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.423+0000 7f3968b62b80 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.423+0000 7f3968b62b80 1 --2- 172.21.15.5:0/843635308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 0x55763dfe0160 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.423+0000 7f3968b62b80 1 -- 172.21.15.5:0/843635308 >> 172.21.15.5:0/843635308 conn(0x55763df4a200 msgr2=0x55763dfd0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.423+0000 7f39367fc700 0 client.16317 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.425+0000 7f3968b62b80 1 -- 172.21.15.5:0/843635308 shutdown_connections 2023-10-07T00:15:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.425+0000 7f3968b62b80 1 -- 172.21.15.5:0/843635308 wait complete. 2023-10-07T00:15:28.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.426+0000 7f3968b62b80 20 client.16317 trim_cache size 0 max 16384 2023-10-07T00:15:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.450+0000 7f3968b62b80 1 Processor -- start 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f3968b62b80 1 -- start start 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 0x55763dfe7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd7990 0x55763dfe79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f3968b62b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763dda98c0 con 0x55763dfd6fd0 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f3968b62b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763dfd22f0 con 0x55763dfd7990 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f3968b62b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763dfddc40 con 0x55763dfd5ec0 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f394ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f394ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:52134/0 (socket says 172.21.15.5:52134) 2023-10-07T00:15:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.452+0000 7f394ed9d700 1 -- 172.21.15.5:0/1637860701 learned_addr learned my addr 172.21.15.5:0/1637860701 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.453+0000 7f394ed9d700 1 -- 172.21.15.5:0/1637860701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd7990 msgr2=0x55763dfe79d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T00:15:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.453+0000 7f394ed9d700 1 --2- 172.21.15.5:0/1637860701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd7990 0x55763dfe79d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.453+0000 7f394ed9d700 1 -- 172.21.15.5:0/1637860701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 msgr2=0x55763dfe7160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:15:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.453+0000 7f394ed9d700 1 --2- 172.21.15.5:0/1637860701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 0x55763dfe7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.453+0000 7f394ed9d700 1 -- 172.21.15.5:0/1637860701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55763dd7a1f0 con 0x55763dfd5ec0 2023-10-07T00:15:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.454+0000 7f394ed9d700 1 --2- 172.21.15.5:0/1637860701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdf2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3948009e30 tx=0x7f394801dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4441c36161fe69a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.454+0000 7f3945ffb700 1 -- 172.21.15.5:0/1637860701 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948018040 con 0x55763dfd5ec0 2023-10-07T00:15:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.454+0000 7f3945ffb700 1 -- 172.21.15.5:0/1637860701 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3948014110 con 0x55763dfd5ec0 2023-10-07T00:15:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.454+0000 7f3945ffb700 1 -- 172.21.15.5:0/1637860701 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480126b0 con 0x55763dfd5ec0 2023-10-07T00:15:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.456+0000 7f3968b62b80 1 -- 172.21.15.5:0/1637860701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 msgr2=0x55763dfdf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.456+0000 7f3968b62b80 1 --2- 172.21.15.5:0/1637860701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdf2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3948009e30 tx=0x7f394801dbe0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.457+0000 7f3968b62b80 1 -- 172.21.15.5:0/1637860701 shutdown_connections 2023-10-07T00:15:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.457+0000 7f3968b62b80 1 --2- 172.21.15.5:0/1637860701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd7990 0x55763dfe79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.457+0000 7f3968b62b80 1 --2- 172.21.15.5:0/1637860701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd5ec0 0x55763dfdf2d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.457+0000 7f3968b62b80 1 --2- 172.21.15.5:0/1637860701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd6fd0 0x55763dfe7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.457+0000 7f3968b62b80 1 -- 172.21.15.5:0/1637860701 >> 172.21.15.5:0/1637860701 conn(0x55763df4a200 msgr2=0x55763dfd0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.457+0000 7f3968b62b80 1 -- 172.21.15.5:0/1637860701 shutdown_connections 2023-10-07T00:15:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.457+0000 7f3968b62b80 1 -- 172.21.15.5:0/1637860701 wait complete. 2023-10-07T00:15:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.458+0000 7f3968b62b80 1 -- start start 2023-10-07T00:15:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.458+0000 7f3968b62b80 1 Processor -- start 2023-10-07T00:15:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd5ec0 0x55763dfe2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd6fd0 0x55763dfe3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f3968b62b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd7990 0x55763dfe61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f3968b62b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763dfe66e0 con 0x55763dfd7990 2023-10-07T00:15:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f3968b62b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763dfe6850 con 0x55763dfd5ec0 2023-10-07T00:15:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f3968b62b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763dfe6a10 con 0x55763dfd6fd0 2023-10-07T00:15:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f3968b62b80 10 client.0 _ll_register_callbacks cb 0x7f3938096560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f394f59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd7990 0x55763dfe61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f394f59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd7990 0x55763dfe61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48140/0 (socket says 172.21.15.5:48140) 2023-10-07T00:15:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.459+0000 7f394f59e700 1 -- 172.21.15.5:0/3076720416 learned_addr learned my addr 172.21.15.5:0/3076720416 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394ed9d700 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd5ec0 0x55763dfe2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394e59c700 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd6fd0 0x55763dfe3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394f59e700 1 -- 172.21.15.5:0/3076720416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd6fd0 msgr2=0x55763dfe3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394f59e700 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd6fd0 0x55763dfe3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394f59e700 1 -- 172.21.15.5:0/3076720416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd5ec0 msgr2=0x55763dfe2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394f59e700 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd5ec0 0x55763dfe2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394f59e700 1 -- 172.21.15.5:0/3076720416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3948009c10 con 0x55763dfd7990 2023-10-07T00:15:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394e59c700 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd6fd0 0x55763dfe3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:15:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f394f59e700 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd7990 0x55763dfe61a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f394000d010 tx=0x7f394004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b41590151954d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.460+0000 7f39367fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.461+0000 7f39367fc700 1 -- 172.21.15.5:0/3076720416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394004f070 con 0x55763dfd7990 2023-10-07T00:15:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.461+0000 7f39367fc700 1 -- 172.21.15.5:0/3076720416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f394000bab0 con 0x55763dfd7990 2023-10-07T00:15:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.461+0000 7f3968b62b80 1 -- 172.21.15.5:0/3076720416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3940007c10 con 0x55763dfd7990 2023-10-07T00:15:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.462+0000 7f39367fc700 1 -- 172.21.15.5:0/3076720416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3940040680 con 0x55763dfd7990 2023-10-07T00:15:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.462+0000 7f3968b62b80 10 client.16320 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.462+0000 7f3968b62b80 1 -- 172.21.15.5:0/3076720416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55763dd52250 con 0x55763dfd7990 2023-10-07T00:15:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f39367fc700 1 -- 172.21.15.5:0/3076720416 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3940007c10 con 0x55763dfd7990 2023-10-07T00:15:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f39367fc700 1 -- 172.21.15.5:0/3076720416 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f394004b7a0 con 0x55763dfd7990 2023-10-07T00:15:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f3968b62b80 10 client.16320 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f3968b62b80 10 client.16320 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f3968b62b80 20 client.16320 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f3968b62b80 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55763e0512c0 0x55763e0536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f3968b62b80 4 client.16320 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:15:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f3968b62b80 1 -- 172.21.15.5:0/3076720416 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55763df21ad0 con 0x55763e0512c0 2023-10-07T00:15:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.463+0000 7f394ed9d700 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55763e0512c0 0x55763e0536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.464+0000 7f39367fc700 10 client.16320 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.464+0000 7f394ed9d700 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55763e0512c0 0x55763e0536e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f0deaf759445c9d server_cookie=65682fa62081683f in_seq=0 out_seq=0 2023-10-07T00:15:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.488+0000 7f39367fc700 1 -- 172.21.15.5:0/3076720416 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55763df21ad0 con 0x55763e0512c0 2023-10-07T00:15:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.488+0000 7f39367fc700 10 client.16320 handle_command_reply: tid=0 2023-10-07T00:15:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.488+0000 7f3968b62b80 1 client.16320 shutdown 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 -- 172.21.15.5:0/3076720416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd7990 msgr2=0x55763dfe61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd7990 0x55763dfe61a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f394000d010 tx=0x7f394004f000 comp rx=0 tx=0).stop 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 -- 172.21.15.5:0/3076720416 shutdown_connections 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55763e0512c0 0x55763e0536e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55763dfd7990 0x55763dfe61a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55763dfd5ec0 0x55763dfe2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 --2- 172.21.15.5:0/3076720416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55763dfd6fd0 0x55763dfe3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 -- 172.21.15.5:0/3076720416 >> 172.21.15.5:0/3076720416 conn(0x55763df4a200 msgr2=0x55763dfeda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f39367fc700 0 client.16320 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 -- 172.21.15.5:0/3076720416 shutdown_connections 2023-10-07T00:15:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.489+0000 7f3968b62b80 1 -- 172.21.15.5:0/3076720416 wait complete. 2023-10-07T00:15:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.490+0000 7f3968b62b80 20 client.16320 trim_cache size 0 max 16384 2023-10-07T00:15:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:15:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:15:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:15:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:15:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 -- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f393c0a15d0 msgr2=0x7f393c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f393c0a15d0 0x7f393c0a3a90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3940009610 tx=0x7f3940040a20 comp rx=0 tx=0).stop 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 -- 172.21.15.5:0/939976303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39501020e0 msgr2=0x7f395019d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39501020e0 0x7f395019d770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f393800e9a0 tx=0x7f393800ecb0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 -- 172.21.15.5:0/939976303 shutdown_connections 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f393c0a15d0 0x7f393c0a3a90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3950104ab0 0x7f39501a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39500ff770 0x7f395019d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 --2- 172.21.15.5:0/939976303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39501020e0 0x7f395019d770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.491+0000 7f39551ff700 1 -- 172.21.15.5:0/939976303 >> 172.21.15.5:0/939976303 conn(0x7f39500fb390 msgr2=0x7f39501004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.492+0000 7f39551ff700 1 -- 172.21.15.5:0/939976303 shutdown_connections 2023-10-07T00:15:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:28.492+0000 7f39551ff700 1 -- 172.21.15.5:0/939976303 wait complete. 2023-10-07T00:15:29.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:28 smithi005 ceph-mon[129406]: pgmap v427: 97 pgs: 97 active+clean; 110 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-10-07T00:15:29.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:28 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:15:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:28 smithi088 ceph-mon[103111]: pgmap v427: 97 pgs: 97 active+clean; 110 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-10-07T00:15:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:28 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:15:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:28 smithi112 ceph-mon[133548]: pgmap v427: 97 pgs: 97 active+clean; 110 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-10-07T00:15:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:28 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:15:30.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:15:30.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:15:30.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:29 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:15:30.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:15:30.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:15:30.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:29 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:15:30.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:15:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:15:30.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:29 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:15:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:30 smithi088 ceph-mon[103111]: pgmap v428: 97 pgs: 97 active+clean; 111 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-10-07T00:15:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:30 smithi112 ceph-mon[133548]: pgmap v428: 97 pgs: 97 active+clean; 111 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-10-07T00:15:31.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:30 smithi005 ceph-mon[129406]: pgmap v428: 97 pgs: 97 active+clean; 111 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-10-07T00:15:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:32 smithi088 ceph-mon[103111]: pgmap v429: 97 pgs: 97 active+clean; 114 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.4 MiB/s wr, 131 op/s 2023-10-07T00:15:33.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:32 smithi112 ceph-mon[133548]: pgmap v429: 97 pgs: 97 active+clean; 114 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.4 MiB/s wr, 131 op/s 2023-10-07T00:15:33.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:32 smithi005 ceph-mon[129406]: pgmap v429: 97 pgs: 97 active+clean; 114 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.4 MiB/s wr, 131 op/s 2023-10-07T00:15:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:34 smithi088 ceph-mon[103111]: pgmap v430: 97 pgs: 97 active+clean; 116 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-07T00:15:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:34 smithi112 ceph-mon[133548]: pgmap v430: 97 pgs: 97 active+clean; 116 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-07T00:15:35.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:34 smithi005 ceph-mon[129406]: pgmap v430: 97 pgs: 97 active+clean; 116 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-07T00:15:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:36 smithi088 ceph-mon[103111]: pgmap v431: 97 pgs: 97 active+clean; 118 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-07T00:15:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:36 smithi112 ceph-mon[133548]: pgmap v431: 97 pgs: 97 active+clean; 118 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-07T00:15:37.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:36 smithi005 ceph-mon[129406]: pgmap v431: 97 pgs: 97 active+clean; 118 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-07T00:15:37.764 INFO:tasks.workunit.client.0.smithi005.stdout: 29 7289 74 4596 94 780 56 2023-10-07T00:15:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:38 smithi088 ceph-mon[103111]: pgmap v432: 97 pgs: 97 active+clean; 120 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.1 MiB/s wr, 105 op/s 2023-10-07T00:15:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:38 smithi112 ceph-mon[133548]: pgmap v432: 97 pgs: 97 active+clean; 120 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.1 MiB/s wr, 105 op/s 2023-10-07T00:15:39.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:38 smithi005 ceph-mon[129406]: pgmap v432: 97 pgs: 97 active+clean; 120 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.1 MiB/s wr, 105 op/s 2023-10-07T00:15:40.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:40 smithi112 ceph-mon[133548]: pgmap v433: 97 pgs: 97 active+clean; 120 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.0 MiB/s wr, 96 op/s 2023-10-07T00:15:41.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:40 smithi005 ceph-mon[129406]: pgmap v433: 97 pgs: 97 active+clean; 120 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.0 MiB/s wr, 96 op/s 2023-10-07T00:15:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:40 smithi088 ceph-mon[103111]: pgmap v433: 97 pgs: 97 active+clean; 120 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.0 MiB/s wr, 96 op/s 2023-10-07T00:15:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.718+0000 7fd453bff700 1 -- 172.21.15.5:0/4125765722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0fff20 msgr2=0x7fd44c1003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.718+0000 7fd453bff700 1 --2- 172.21.15.5:0/4125765722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0fff20 0x7fd44c1003a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009990 tx=0x7fd43c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.719+0000 7fd453bff700 1 -- 172.21.15.5:0/4125765722 shutdown_connections 2023-10-07T00:15:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.719+0000 7fd453bff700 1 --2- 172.21.15.5:0/4125765722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd44c1008e0 0x7fd44c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.719+0000 7fd453bff700 1 --2- 172.21.15.5:0/4125765722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0ff1c0 0x7fd44c0ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.719+0000 7fd453bff700 1 --2- 172.21.15.5:0/4125765722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0fff20 0x7fd44c1003a0 secure :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009990 tx=0x7fd43c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.719+0000 7fd453bff700 1 -- 172.21.15.5:0/4125765722 >> 172.21.15.5:0/4125765722 conn(0x7fd44c0faaf0 msgr2=0x7fd44c0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.719+0000 7fd453bff700 1 -- 172.21.15.5:0/4125765722 shutdown_connections 2023-10-07T00:15:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.720+0000 7fd453bff700 1 -- 172.21.15.5:0/4125765722 wait complete. 2023-10-07T00:15:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.721+0000 7fd453bff700 1 Processor -- start 2023-10-07T00:15:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.721+0000 7fd453bff700 1 -- start start 2023-10-07T00:15:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd453bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0ff1c0 0x7fd44c19d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd453bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd44c1008e0 0x7fd44c19d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd453bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c1a2900 0x7fd44c1a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd453bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1a52c0 con 0x7fd44c1a2900 2023-10-07T00:15:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd453bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1a5400 con 0x7fd44c1008e0 2023-10-07T00:15:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd453bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1a5590 con 0x7fd44c0ff1c0 2023-10-07T00:15:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd45219c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c1a2900 0x7fd44c1a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd45219c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c1a2900 0x7fd44c1a4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38150/0 (socket says 172.21.15.5:38150) 2023-10-07T00:15:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.724+0000 7fd45219c700 1 -- 172.21.15.5:0/2996787571 learned_addr learned my addr 172.21.15.5:0/2996787571 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.725+0000 7fd45199b700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0ff1c0 0x7fd44c19d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.725+0000 7fd45219c700 1 -- 172.21.15.5:0/2996787571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0ff1c0 msgr2=0x7fd44c19d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.725+0000 7fd45219c700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0ff1c0 0x7fd44c19d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.725+0000 7fd45219c700 1 -- 172.21.15.5:0/2996787571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd44c1008e0 msgr2=0x7fd44c19d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.725+0000 7fd45219c700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd44c1008e0 0x7fd44c19d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.725+0000 7fd45219c700 1 -- 172.21.15.5:0/2996787571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0095f0 con 0x7fd44c1a2900 2023-10-07T00:15:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.726+0000 7fd45219c700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c1a2900 0x7fd44c1a4cf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd44400ef30 tx=0x7fd44400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.726+0000 7fd442ffd700 1 -- 172.21.15.5:0/2996787571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444018070 con 0x7fd44c1a2900 2023-10-07T00:15:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.726+0000 7fd442ffd700 1 -- 172.21.15.5:0/2996787571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd44400f040 con 0x7fd44c1a2900 2023-10-07T00:15:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.726+0000 7fd453bff700 1 -- 172.21.15.5:0/2996787571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c1a5810 con 0x7fd44c1a2900 2023-10-07T00:15:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.726+0000 7fd453bff700 1 -- 172.21.15.5:0/2996787571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c1a5cd0 con 0x7fd44c1a2900 2023-10-07T00:15:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.727+0000 7fd442ffd700 1 -- 172.21.15.5:0/2996787571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400cc70 con 0x7fd44c1a2900 2023-10-07T00:15:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.732+0000 7fd46746bb80 1 Processor -- start 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.732+0000 7fd442ffd700 1 -- 172.21.15.5:0/2996787571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd444007500 con 0x7fd44c1a2900 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.732+0000 7fd46746bb80 1 -- start start 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc594ec0 0x5621dc5952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc595fd0 0x5621dc596450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc596990 0x5621dc59d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd46746bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc4fd400 con 0x5621dc596990 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd46746bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc4eebc0 con 0x5621dc595fd0 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd46746bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc4ec4e0 con 0x5621dc594ec0 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45119a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc594ec0 0x5621dc5952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc595fd0 0x5621dc596450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc595fd0 0x5621dc596450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:60526/0 (socket says 172.21.15.5:60526) 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45199b700 1 -- 172.21.15.5:0/1941772309 learned_addr learned my addr 172.21.15.5:0/1941772309 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45199b700 1 -- 172.21.15.5:0/1941772309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc594ec0 msgr2=0x5621dc5952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45199b700 1 --2- 172.21.15.5:0/1941772309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc594ec0 0x5621dc5952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45199b700 1 -- 172.21.15.5:0/1941772309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc596990 msgr2=0x5621dc59d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45199b700 1 --2- 172.21.15.5:0/1941772309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc596990 0x5621dc59d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.733+0000 7fd45199b700 1 -- 172.21.15.5:0/1941772309 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621dc312d80 con 0x5621dc595fd0 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.734+0000 7fd45199b700 1 --2- 172.21.15.5:0/1941772309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc595fd0 0x5621dc596450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd448009d80 tx=0x7fd448011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6af70a8ed5d1f04d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.734+0000 7fd442ffd700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4380a1500 0x7fd4380a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.735+0000 7fd442ffd700 1 -- 172.21.15.5:0/2996787571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd4440cc860 con 0x7fd44c1a2900 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.735+0000 7fd437fff700 1 -- 172.21.15.5:0/1941772309 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448011e80 con 0x5621dc595fd0 2023-10-07T00:15:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.735+0000 7fd437fff700 1 -- 172.21.15.5:0/1941772309 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd4480044c0 con 0x5621dc595fd0 2023-10-07T00:15:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.735+0000 7fd437fff700 1 -- 172.21.15.5:0/1941772309 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44803b6c0 con 0x5621dc595fd0 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd46746bb80 1 -- 172.21.15.5:0/1941772309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc595fd0 msgr2=0x5621dc596450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1941772309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc595fd0 0x5621dc596450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd448009d80 tx=0x7fd448011720 comp rx=0 tx=0).stop 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd46746bb80 1 -- 172.21.15.5:0/1941772309 shutdown_connections 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1941772309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc596990 0x5621dc59d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1941772309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc594ec0 0x5621dc5952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1941772309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc595fd0 0x5621dc596450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd46746bb80 1 -- 172.21.15.5:0/1941772309 >> 172.21.15.5:0/1941772309 conn(0x5621dc509200 msgr2=0x5621dc58fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd45119a700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4380a1500 0x7fd4380a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.736+0000 7fd46746bb80 1 -- 172.21.15.5:0/1941772309 shutdown_connections 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.737+0000 7fd46746bb80 1 -- 172.21.15.5:0/1941772309 wait complete. 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.737+0000 7fd45119a700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4380a1500 0x7fd4380a39c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5621dc594c60 tx=0x7fd43c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.737+0000 7fd46746bb80 1 -- start start 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.738+0000 7fd46746bb80 1 Processor -- start 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.738+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc59eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.738+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc59f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.738+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.738+0000 7fd46746bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc4e7dd0 con 0x5621dc595fd0 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.738+0000 7fd46746bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc4846b0 con 0x5621dc594ec0 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.738+0000 7fd46746bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc484350 con 0x5621dc596990 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.738+0000 7fd46746bb80 10 client.0 _ll_register_callbacks cb 0x5621dc2e17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45119a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc59f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45119a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc59f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38172/0 (socket says 172.21.15.5:38172) 2023-10-07T00:15:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45119a700 1 -- 172.21.15.5:0/1942447604 learned_addr learned my addr 172.21.15.5:0/1942447604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45199b700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc59eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45219c700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45119a700 1 -- 172.21.15.5:0/1942447604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 msgr2=0x5621dc5a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45119a700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45119a700 1 -- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 msgr2=0x5621dc59eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45119a700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc59eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45119a700 1 -- 172.21.15.5:0/1942447604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4480099e0 con 0x5621dc595fd0 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45219c700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.739+0000 7fd45199b700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc59eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.740+0000 7fd45119a700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc59f0c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00b2e0 tx=0x7fd43c005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27ced83e5aaacf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.740+0000 7fd4357fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.740+0000 7fd4357fa700 1 -- 172.21.15.5:0/1942447604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c02c070 con 0x5621dc595fd0 2023-10-07T00:15:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.740+0000 7fd46746bb80 1 -- 172.21.15.5:0/1942447604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621dc587d50 con 0x5621dc595fd0 2023-10-07T00:15:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.740+0000 7fd4357fa700 1 -- 172.21.15.5:0/1942447604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd43c00baf0 con 0x5621dc595fd0 2023-10-07T00:15:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.741+0000 7fd4357fa700 1 -- 172.21.15.5:0/1942447604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd43c00bcb0 con 0x5621dc595fd0 2023-10-07T00:15:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.741+0000 7fd46746bb80 10 client.16329 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.741+0000 7fd46746bb80 1 -- 172.21.15.5:0/1942447604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5621dc2fbc00 con 0x5621dc595fd0 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.741+0000 7fd4357fa700 1 -- 172.21.15.5:0/1942447604 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5621dc587d50 con 0x5621dc595fd0 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.742+0000 7fd4357fa700 1 -- 172.21.15.5:0/1942447604 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fd43c039020 con 0x5621dc595fd0 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.742+0000 7fd46746bb80 10 client.16329 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.742+0000 7fd46746bb80 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.742+0000 7fd46746bb80 20 client.16329 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.742+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5621dc5aaa30 0x5621dc5ace50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.742+0000 7fd46746bb80 4 client.16329 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.742+0000 7fd46746bb80 1 -- 172.21.15.5:0/1942447604 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621dc4e0db0 con 0x5621dc5aaa30 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.742+0000 7fd45199b700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5621dc5aaa30 0x5621dc5ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.743+0000 7fd45199b700 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5621dc5aaa30 0x5621dc5ace50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d556fcdeae8ea0c9 server_cookie=5040e3a4674053f8 in_seq=0 out_seq=0 2023-10-07T00:15:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.743+0000 7fd4357fa700 10 client.16329 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.744+0000 7fd4357fa700 1 -- 172.21.15.5:0/1942447604 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5621dc4e0db0 con 0x5621dc5aaa30 2023-10-07T00:15:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.744+0000 7fd4357fa700 10 client.16329 handle_command_reply: tid=0 2023-10-07T00:15:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.744+0000 7fd46746bb80 1 client.16329 shutdown 2023-10-07T00:15:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.744+0000 7fd46746bb80 1 -- 172.21.15.5:0/1942447604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 msgr2=0x5621dc59f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.744+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc59f0c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00b2e0 tx=0x7fd43c005fb0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd46746bb80 1 -- 172.21.15.5:0/1942447604 shutdown_connections 2023-10-07T00:15:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5621dc5aaa30 0x5621dc5ace50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc59eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd46746bb80 1 --2- 172.21.15.5:0/1942447604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc59f0c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd46746bb80 1 -- 172.21.15.5:0/1942447604 >> 172.21.15.5:0/1942447604 conn(0x5621dc509200 msgr2=0x5621dc58f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd4357fa700 0 client.16329 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd46746bb80 1 -- 172.21.15.5:0/1942447604 shutdown_connections 2023-10-07T00:15:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.745+0000 7fd46746bb80 1 -- 172.21.15.5:0/1942447604 wait complete. 2023-10-07T00:15:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.746+0000 7fd46746bb80 20 client.16329 trim_cache size 0 max 16384 2023-10-07T00:15:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.766+0000 7fd46746bb80 1 Processor -- start 2023-10-07T00:15:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd46746bb80 1 -- start start 2023-10-07T00:15:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc5963b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc59cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd46746bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc3688c0 con 0x5621dc595fd0 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd46746bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc58c860 con 0x5621dc594ec0 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd46746bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc5912f0 con 0x5621dc596990 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd45219c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc59cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.767+0000 7fd45219c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc59cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53162/0 (socket says 172.21.15.5:53162) 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd45219c700 1 -- 172.21.15.5:0/2482876938 learned_addr learned my addr 172.21.15.5:0/2482876938 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd45199b700 1 --2- 172.21.15.5:0/2482876938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc5963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd45219c700 1 -- 172.21.15.5:0/2482876938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 msgr2=0x5621dc5963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd45219c700 1 --2- 172.21.15.5:0/2482876938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc5963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd45219c700 1 -- 172.21.15.5:0/2482876938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 msgr2=0x5621dc5a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd45219c700 1 --2- 172.21.15.5:0/2482876938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd45219c700 1 -- 172.21.15.5:0/2482876938 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621dc3391f0 con 0x5621dc596990 2023-10-07T00:15:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd45219c700 1 --2- 172.21.15.5:0/2482876938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc59cd80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4440a1960 tx=0x7fd444099a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58591603a005ca61 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd440bff700 1 -- 172.21.15.5:0/2482876938 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440994f0 con 0x5621dc596990 2023-10-07T00:15:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.768+0000 7fd440bff700 1 -- 172.21.15.5:0/2482876938 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd444012340 con 0x5621dc596990 2023-10-07T00:15:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.769+0000 7fd440bff700 1 -- 172.21.15.5:0/2482876938 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440ca3f0 con 0x5621dc596990 2023-10-07T00:15:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.769+0000 7fd46746bb80 1 -- 172.21.15.5:0/2482876938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 msgr2=0x5621dc59cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.769+0000 7fd46746bb80 1 --2- 172.21.15.5:0/2482876938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc59cd80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4440a1960 tx=0x7fd444099a30 comp rx=0 tx=0).stop 2023-10-07T00:15:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.769+0000 7fd46746bb80 1 -- 172.21.15.5:0/2482876938 shutdown_connections 2023-10-07T00:15:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.769+0000 7fd46746bb80 1 --2- 172.21.15.5:0/2482876938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc59cd80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.769+0000 7fd46746bb80 1 --2- 172.21.15.5:0/2482876938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc5963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.769+0000 7fd46746bb80 1 --2- 172.21.15.5:0/2482876938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.769+0000 7fd46746bb80 1 -- 172.21.15.5:0/2482876938 >> 172.21.15.5:0/2482876938 conn(0x5621dc509200 msgr2=0x5621dc59d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.770+0000 7fd46746bb80 1 -- 172.21.15.5:0/2482876938 shutdown_connections 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.770+0000 7fd46746bb80 1 -- 172.21.15.5:0/2482876938 wait complete. 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.770+0000 7fd46746bb80 1 -- start start 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.771+0000 7fd46746bb80 1 Processor -- start 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.771+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc5a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.771+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.771+0000 7fd46746bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.771+0000 7fd46746bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc5a5800 con 0x5621dc595fd0 2023-10-07T00:15:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.771+0000 7fd46746bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc5a5970 con 0x5621dc594ec0 2023-10-07T00:15:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.771+0000 7fd46746bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dc5a5b30 con 0x5621dc596990 2023-10-07T00:15:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.771+0000 7fd46746bb80 10 client.0 _ll_register_callbacks cb 0x5621dc2e17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45119a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45119a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38198/0 (socket says 172.21.15.5:38198) 2023-10-07T00:15:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45119a700 1 -- 172.21.15.5:0/3047000736 learned_addr learned my addr 172.21.15.5:0/3047000736 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45219c700 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45199b700 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc5a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45119a700 1 -- 172.21.15.5:0/3047000736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 msgr2=0x5621dc5a52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45119a700 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45119a700 1 -- 172.21.15.5:0/3047000736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 msgr2=0x5621dc5a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45119a700 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc5a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.772+0000 7fd45119a700 1 -- 172.21.15.5:0/3047000736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c1a5cd0 con 0x5621dc595fd0 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.773+0000 7fd45119a700 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a42b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd43c03beb0 tx=0x7fd43c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92adb1f348476ce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.773+0000 7fd4357fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.774+0000 7fd4357fa700 1 -- 172.21.15.5:0/3047000736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c02c030 con 0x5621dc595fd0 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.774+0000 7fd4357fa700 1 -- 172.21.15.5:0/3047000736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd43c02d070 con 0x5621dc595fd0 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.774+0000 7fd46746bb80 1 -- 172.21.15.5:0/3047000736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4480044c0 con 0x5621dc595fd0 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.774+0000 7fd4357fa700 1 -- 172.21.15.5:0/3047000736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd43c00b390 con 0x5621dc595fd0 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.774+0000 7fd46746bb80 10 client.16332 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.774+0000 7fd46746bb80 1 -- 172.21.15.5:0/3047000736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5621dc311250 con 0x5621dc595fd0 2023-10-07T00:15:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.775+0000 7fd4357fa700 1 -- 172.21.15.5:0/3047000736 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd4480044c0 con 0x5621dc595fd0 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.775+0000 7fd4357fa700 1 -- 172.21.15.5:0/3047000736 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fd43c043070 con 0x5621dc595fd0 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.775+0000 7fd46746bb80 10 client.16332 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.775+0000 7fd46746bb80 10 client.16332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.775+0000 7fd46746bb80 20 client.16332 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.775+0000 7fd46746bb80 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5621dc5ff460 0x5621dc601880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.775+0000 7fd46746bb80 4 client.16332 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.775+0000 7fd46746bb80 1 -- 172.21.15.5:0/3047000736 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5621dc4e0ad0 con 0x5621dc5ff460 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.776+0000 7fd45199b700 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5621dc5ff460 0x5621dc601880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.776+0000 7fd45199b700 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5621dc5ff460 0x5621dc601880 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8389cf7b8b047eab server_cookie=89e2a03ed387ba6 in_seq=0 out_seq=0 2023-10-07T00:15:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.776+0000 7fd4357fa700 10 client.16332 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd4357fa700 1 -- 172.21.15.5:0/3047000736 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5621dc4e0ad0 con 0x5621dc5ff460 2023-10-07T00:15:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd4357fa700 10 client.16332 handle_command_reply: tid=0 2023-10-07T00:15:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 client.16332 shutdown 2023-10-07T00:15:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 -- 172.21.15.5:0/3047000736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 msgr2=0x5621dc5a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a42b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd43c03beb0 tx=0x7fd43c0093b0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 -- 172.21.15.5:0/3047000736 shutdown_connections 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5621dc5ff460 0x5621dc601880 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621dc596990 0x5621dc5a52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5621dc594ec0 0x5621dc5a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 --2- 172.21.15.5:0/3047000736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621dc595fd0 0x5621dc5a42b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd46746bb80 1 -- 172.21.15.5:0/3047000736 >> 172.21.15.5:0/3047000736 conn(0x5621dc509200 msgr2=0x5621dc59cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.830+0000 7fd4357fa700 0 client.16332 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.831+0000 7fd46746bb80 1 -- 172.21.15.5:0/3047000736 shutdown_connections 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.831+0000 7fd46746bb80 1 -- 172.21.15.5:0/3047000736 wait complete. 2023-10-07T00:15:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.831+0000 7fd46746bb80 20 client.16332 trim_cache size 0 max 16384 2023-10-07T00:15:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:15:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:15:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:15:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:15:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 -- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4380a1500 msgr2=0x7fd4380a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4380a1500 0x7fd4380a39c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5621dc594c60 tx=0x7fd43c01a040 comp rx=0 tx=0).stop 2023-10-07T00:15:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 -- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c1a2900 msgr2=0x7fd44c1a4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c1a2900 0x7fd44c1a4cf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd44400ef30 tx=0x7fd44400c3a0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 -- 172.21.15.5:0/2996787571 shutdown_connections 2023-10-07T00:15:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd4380a1500 0x7fd4380a39c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c1a2900 0x7fd44c1a4cf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0ff1c0 0x7fd44c19d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 --2- 172.21.15.5:0/2996787571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd44c1008e0 0x7fd44c19d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 -- 172.21.15.5:0/2996787571 >> 172.21.15.5:0/2996787571 conn(0x7fd44c0faaf0 msgr2=0x7fd44c0fb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 -- 172.21.15.5:0/2996787571 shutdown_connections 2023-10-07T00:15:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:41.832+0000 7fd453bff700 1 -- 172.21.15.5:0/2996787571 wait complete. 2023-10-07T00:15:42.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:42 smithi112 ceph-mon[133548]: pgmap v434: 97 pgs: 97 active+clean; 121 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 991 KiB/s wr, 98 op/s 2023-10-07T00:15:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:42 smithi005 ceph-mon[129406]: pgmap v434: 97 pgs: 97 active+clean; 121 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 991 KiB/s wr, 98 op/s 2023-10-07T00:15:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:42 smithi088 ceph-mon[103111]: pgmap v434: 97 pgs: 97 active+clean; 121 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 991 KiB/s wr, 98 op/s 2023-10-07T00:15:44.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:44 smithi112 ceph-mon[133548]: pgmap v435: 97 pgs: 97 active+clean; 123 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 880 KiB/s wr, 94 op/s 2023-10-07T00:15:45.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:44 smithi005 ceph-mon[129406]: pgmap v435: 97 pgs: 97 active+clean; 123 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 880 KiB/s wr, 94 op/s 2023-10-07T00:15:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:44 smithi088 ceph-mon[103111]: pgmap v435: 97 pgs: 97 active+clean; 123 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 880 KiB/s wr, 94 op/s 2023-10-07T00:15:46.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:46 smithi112 ceph-mon[133548]: pgmap v436: 97 pgs: 97 active+clean; 124 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 786 KiB/s wr, 118 op/s 2023-10-07T00:15:47.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:46 smithi005 ceph-mon[129406]: pgmap v436: 97 pgs: 97 active+clean; 124 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 786 KiB/s wr, 118 op/s 2023-10-07T00:15:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:46 smithi088 ceph-mon[103111]: pgmap v436: 97 pgs: 97 active+clean; 124 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 786 KiB/s wr, 118 op/s 2023-10-07T00:15:47.765 INFO:tasks.workunit.client.0.smithi005.stdout: 30 7598 68 5032 23 768 57 2023-10-07T00:15:48.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:48 smithi112 ceph-mon[133548]: pgmap v437: 97 pgs: 97 active+clean; 125 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 717 KiB/s wr, 122 op/s 2023-10-07T00:15:49.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:48 smithi005 ceph-mon[129406]: pgmap v437: 97 pgs: 97 active+clean; 125 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 717 KiB/s wr, 122 op/s 2023-10-07T00:15:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:48 smithi088 ceph-mon[103111]: pgmap v437: 97 pgs: 97 active+clean; 125 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 717 KiB/s wr, 122 op/s 2023-10-07T00:15:50.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:50 smithi112 ceph-mon[133548]: pgmap v438: 97 pgs: 97 active+clean; 126 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 558 KiB/s wr, 105 op/s 2023-10-07T00:15:51.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:50 smithi005 ceph-mon[129406]: pgmap v438: 97 pgs: 97 active+clean; 126 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 558 KiB/s wr, 105 op/s 2023-10-07T00:15:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:50 smithi088 ceph-mon[103111]: pgmap v438: 97 pgs: 97 active+clean; 126 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 558 KiB/s wr, 105 op/s 2023-10-07T00:15:52.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:52 smithi112 ceph-mon[133548]: pgmap v439: 97 pgs: 97 active+clean; 128 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 742 KiB/s wr, 136 op/s 2023-10-07T00:15:53.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:52 smithi005 ceph-mon[129406]: pgmap v439: 97 pgs: 97 active+clean; 128 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 742 KiB/s wr, 136 op/s 2023-10-07T00:15:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:52 smithi088 ceph-mon[103111]: pgmap v439: 97 pgs: 97 active+clean; 128 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 742 KiB/s wr, 136 op/s 2023-10-07T00:15:54.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:54 smithi112 ceph-mon[133548]: pgmap v440: 97 pgs: 97 active+clean; 129 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 762 KiB/s wr, 133 op/s 2023-10-07T00:15:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.056+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/1735334777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c075870 msgr2=0x7f9e9c075c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.056+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/1735334777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c075870 0x7f9e9c075c90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009990 tx=0x7f9e90009ca0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.057+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/1735334777 shutdown_connections 2023-10-07T00:15:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.057+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/1735334777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c077470 0x7f9e9c077cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.057+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/1735334777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c075870 0x7f9e9c075c90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.057+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/1735334777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e9c076ab0 0x7f9e9c076f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.057+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/1735334777 >> 172.21.15.5:0/1735334777 conn(0x7f9e9c0fe480 msgr2=0x7f9e9c1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.057+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/1735334777 shutdown_connections 2023-10-07T00:15:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.057+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/1735334777 wait complete. 2023-10-07T00:15:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.058+0000 7f9ea1b9d700 1 Processor -- start 2023-10-07T00:15:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.059+0000 7f9ea1b9d700 1 -- start start 2023-10-07T00:15:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.059+0000 7f9ea1b9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e9c075870 0x7f9e9c19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.059+0000 7f9ea1b9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c076ab0 0x7f9e9c19d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.059+0000 7f9ea1b9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c077470 0x7f9e9c1a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.059+0000 7f9ea1b9d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c1a4aa0 con 0x7f9e9c076ab0 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.059+0000 7f9ea1b9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c06a8d0 con 0x7f9e9c075870 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.059+0000 7f9ea1b9d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c06aa60 con 0x7f9e9c077470 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c076ab0 0x7f9e9c19d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c076ab0 0x7f9e9c19d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33596/0 (socket says 172.21.15.5:33596) 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9e9bfff700 1 -- 172.21.15.5:0/3726480958 learned_addr learned my addr 172.21.15.5:0/3726480958 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9ea139c700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c077470 0x7f9e9c1a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e9c075870 0x7f9e9c19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9e9bfff700 1 -- 172.21.15.5:0/3726480958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c077470 msgr2=0x7f9e9c1a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c077470 0x7f9e9c1a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9e9bfff700 1 -- 172.21.15.5:0/3726480958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e9c075870 msgr2=0x7f9e9c19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e9c075870 0x7f9e9c19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9e9bfff700 1 -- 172.21.15.5:0/3726480958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88009520 con 0x7f9e9c076ab0 2023-10-07T00:15:55.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.060+0000 7f9ea139c700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c077470 0x7f9e9c1a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:15:55.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.061+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c076ab0 0x7f9e9c19d460 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800eb30 tx=0x7f9e8800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:55.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.061+0000 7f9e99ffb700 1 -- 172.21.15.5:0/3726480958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88009880 con 0x7f9e9c076ab0 2023-10-07T00:15:55.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.061+0000 7f9e99ffb700 1 -- 172.21.15.5:0/3726480958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e880044b0 con 0x7f9e9c076ab0 2023-10-07T00:15:55.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.061+0000 7f9e99ffb700 1 -- 172.21.15.5:0/3726480958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88003ce0 con 0x7f9e9c076ab0 2023-10-07T00:15:55.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.061+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/3726480958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e900095f0 con 0x7f9e9c076ab0 2023-10-07T00:15:55.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.061+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/3726480958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c06b070 con 0x7f9e9c076ab0 2023-10-07T00:15:55.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9eb675bb80 1 Processor -- start 2023-10-07T00:15:55.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9e99ffb700 1 -- 172.21.15.5:0/3726480958 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9e88003e40 con 0x7f9e9c076ab0 2023-10-07T00:15:55.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9eb675bb80 1 -- start start 2023-10-07T00:15:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beb3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750beb45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bebb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750be1b400 con 0x55750beb4130 2023-10-07T00:15:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750be0cbc0 con 0x55750beb4af0 2023-10-07T00:15:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.068+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750be0a4e0 con 0x55750beb3020 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bebb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bebb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:50398/0 (socket says 172.21.15.5:50398) 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9e9bfff700 1 -- 172.21.15.5:0/2228635065 learned_addr learned my addr 172.21.15.5:0/2228635065 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750beb45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9ea139c700 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beb3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2228635065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 msgr2=0x55750beb3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beb3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2228635065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 msgr2=0x55750bebb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bebb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.070+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2228635065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55750bc30d80 con 0x55750beb4130 2023-10-07T00:15:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.071+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750beb45b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9e900098e0 tx=0x7f9e90005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6085bf7ed7a8c151 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.071+0000 7f9e99ffb700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e8c0a1580 0x7f9e8c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.072+0000 7f9e99ffb700 1 -- 172.21.15.5:0/3726480958 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9e88014070 con 0x7f9e9c076ab0 2023-10-07T00:15:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.072+0000 7f9e86ffd700 1 -- 172.21.15.5:0/2228635065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9001d070 con 0x55750beb4130 2023-10-07T00:15:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.072+0000 7f9e86ffd700 1 -- 172.21.15.5:0/2228635065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e9001e040 con 0x55750beb4130 2023-10-07T00:15:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.072+0000 7f9e86ffd700 1 -- 172.21.15.5:0/2228635065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000b710 con 0x55750beb4130 2023-10-07T00:15:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.072+0000 7f9ea139c700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e8c0a1580 0x7f9e8c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.073+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2228635065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 msgr2=0x55750beb45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.073+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750beb45b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9e900098e0 tx=0x7f9e90005f00 comp rx=0 tx=0).stop 2023-10-07T00:15:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.073+0000 7f9ea139c700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e8c0a1580 0x7f9e8c0a3a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55750beb2dc0 tx=0x7f9e9400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.073+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2228635065 shutdown_connections 2023-10-07T00:15:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.073+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bebb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.073+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beb3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.073+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2228635065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750beb45b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.073+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2228635065 >> 172.21.15.5:0/2228635065 conn(0x55750be27200 msgr2=0x55750beadce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.074+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2228635065 shutdown_connections 2023-10-07T00:15:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.074+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2228635065 wait complete. 2023-10-07T00:15:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.075+0000 7f9eb675bb80 1 -- start start 2023-10-07T00:15:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.075+0000 7f9eb675bb80 1 Processor -- start 2023-10-07T00:15:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.076+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb3020 0x55750bebcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.076+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb4130 0x55750bebd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.076+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bec4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.076+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750be05dd0 con 0x55750beb3020 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.076+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750bda26b0 con 0x55750beb4af0 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.076+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750bda2350 con 0x55750beb4130 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.076+0000 7f9eb675bb80 10 client.0 _ll_register_callbacks cb 0x55750bbff7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb4130 0x55750bebd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb4130 0x55750bebd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:57840/0 (socket says 172.21.15.5:57840) 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9e9bfff700 1 -- 172.21.15.5:0/3792454646 learned_addr learned my addr 172.21.15.5:0/3792454646 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb3020 0x55750bebcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9ea139c700 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bec4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/3792454646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb4130 msgr2=0x55750bebd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb4130 0x55750bebd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 msgr2=0x55750bec4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bec4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/3792454646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c078720 con 0x55750beb3020 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.077+0000 7f9ea139c700 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bec4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.078+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb3020 0x55750bebcd00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9e90003f60 tx=0x7f9e90003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5b1e73e6ef9e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.078+0000 7f9e7bfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.078+0000 7f9e7bfff700 1 -- 172.21.15.5:0/3792454646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9001d040 con 0x55750beb3020 2023-10-07T00:15:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.078+0000 7f9e7bfff700 1 -- 172.21.15.5:0/3792454646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9e9000bc20 con 0x55750beb3020 2023-10-07T00:15:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.078+0000 7f9eb675bb80 1 -- 172.21.15.5:0/3792454646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55750bea5eb0 con 0x55750beb3020 2023-10-07T00:15:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9e7bfff700 1 -- 172.21.15.5:0/3792454646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e9000bde0 con 0x55750beb3020 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9eb675bb80 10 client.16344 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9eb675bb80 1 -- 172.21.15.5:0/3792454646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55750bc19c00 con 0x55750beb3020 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9e7bfff700 1 -- 172.21.15.5:0/3792454646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e9003a030 con 0x55750beb3020 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9e7bfff700 1 -- 172.21.15.5:0/3792454646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9e90022400 con 0x55750beb3020 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9eb675bb80 10 client.16344 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9eb675bb80 10 client.16344 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9eb675bb80 20 client.16344 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55750bec8650 0x55750becaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9eb675bb80 4 client.16344 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:15:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.079+0000 7f9eb675bb80 1 -- 172.21.15.5:0/3792454646 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55750bdfedb0 con 0x55750bec8650 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.080+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55750bec8650 0x55750becaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.081+0000 7f9e7bfff700 10 client.16344 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.081+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55750bec8650 0x55750becaa70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b82bdef9b01508 server_cookie=920721125bfe682e in_seq=0 out_seq=0 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.081+0000 7f9e7bfff700 1 -- 172.21.15.5:0/3792454646 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55750bdfedb0 con 0x55750bec8650 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.081+0000 7f9e7bfff700 10 client.16344 handle_command_reply: tid=0 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.081+0000 7f9eb675bb80 1 client.16344 shutdown 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 -- 172.21.15.5:0/3792454646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb3020 msgr2=0x55750bebcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb3020 0x55750bebcd00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9e90003f60 tx=0x7f9e90003e00 comp rx=0 tx=0).stop 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 -- 172.21.15.5:0/3792454646 shutdown_connections 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55750bec8650 0x55750becaa70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750bec4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb3020 0x55750bebcd00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/3792454646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb4130 0x55750bebd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 -- 172.21.15.5:0/3792454646 >> 172.21.15.5:0/3792454646 conn(0x55750be27200 msgr2=0x55750bead3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9e7bfff700 0 client.16344 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 -- 172.21.15.5:0/3792454646 shutdown_connections 2023-10-07T00:15:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.082+0000 7f9eb675bb80 1 -- 172.21.15.5:0/3792454646 wait complete. 2023-10-07T00:15:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.083+0000 7f9eb675bb80 20 client.16344 trim_cache size 0 max 16384 2023-10-07T00:15:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9eb675bb80 1 Processor -- start 2023-10-07T00:15:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9eb675bb80 1 -- start start 2023-10-07T00:15:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750bec4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750beb7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750bc868c0 con 0x55750beb4130 2023-10-07T00:15:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750bebc040 con 0x55750beb4af0 2023-10-07T00:15:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750beaf0f0 con 0x55750beb3020 2023-10-07T00:15:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.106+0000 7f9ea0b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea0b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:57854/0 (socket says 172.21.15.5:57854) 2023-10-07T00:15:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2983331823 learned_addr learned my addr 172.21.15.5:0/2983331823 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea139c700 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750beb7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:54 smithi005 ceph-mon[129406]: pgmap v440: 97 pgs: 97 active+clean; 129 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 762 KiB/s wr, 133 op/s 2023-10-07T00:15:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2983331823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 msgr2=0x55750beb7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750bec4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750beb7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2983331823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 msgr2=0x55750bec4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750bec4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2983331823 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55750bc571f0 con 0x55750beb3020 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750bec4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.107+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beca660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e900098e0 tx=0x7f9e90009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91aa95e3e60560de server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.108+0000 7f9e877fe700 1 -- 172.21.15.5:0/2983331823 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90022400 con 0x55750beb3020 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.108+0000 7f9e877fe700 1 -- 172.21.15.5:0/2983331823 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e9003a040 con 0x55750beb3020 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.108+0000 7f9e877fe700 1 -- 172.21.15.5:0/2983331823 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000f6c0 con 0x55750beb3020 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2983331823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 msgr2=0x55750beca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beca660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e900098e0 tx=0x7f9e90009ca0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2983331823 shutdown_connections 2023-10-07T00:15:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4af0 0x55750beb7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750beb3020 0x55750beca660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2983331823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4130 0x55750bec4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2983331823 >> 172.21.15.5:0/2983331823 conn(0x55750be27200 msgr2=0x55750bebafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2983331823 shutdown_connections 2023-10-07T00:15:55.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.109+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2983331823 wait complete. 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.110+0000 7f9eb675bb80 1 -- start start 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.110+0000 7f9eb675bb80 1 Processor -- start 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.110+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4130 0x55750bec1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4af0 0x55750bec2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9eb675bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750bec3270 0x55750bec36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750bec3c30 con 0x55750beb4af0 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750bec3da0 con 0x55750beb4130 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9eb675bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55750bec3f60 con 0x55750bec3270 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9eb675bb80 10 client.0 _ll_register_callbacks cb 0x7f9e880d0880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4af0 0x55750bec2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9ea0b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4130 0x55750bec1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4af0 0x55750bec2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33628/0 (socket says 172.21.15.5:33628) 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9e9bfff700 1 -- 172.21.15.5:0/2288777071 learned_addr learned my addr 172.21.15.5:0/2288777071 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9ea0b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4130 0x55750bec1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:50424/0 (socket says 172.21.15.5:50424) 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9ea139c700 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750bec3270 0x55750bec36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2288777071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750bec3270 msgr2=0x55750bec36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750bec3270 0x55750bec36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2288777071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4af0 msgr2=0x55750bec2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4af0 0x55750bec2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.111+0000 7f9ea0b9b700 1 -- 172.21.15.5:0/2288777071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55750bc19c00 con 0x55750beb4130 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.112+0000 7f9ea0b9b700 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4130 0x55750bec1d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55750bebc180 tx=0x7f9e90005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c63e5d99b7eff6b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:15:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.112+0000 7f9e7bfff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:15:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.112+0000 7f9e7bfff700 1 -- 172.21.15.5:0/2288777071 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000bc20 con 0x55750beb4130 2023-10-07T00:15:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.112+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2288777071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e9001e040 con 0x55750beb4130 2023-10-07T00:15:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.112+0000 7f9e7bfff700 1 -- 172.21.15.5:0/2288777071 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9e90000e40 con 0x55750beb4130 2023-10-07T00:15:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.113+0000 7f9e7bfff700 1 -- 172.21.15.5:0/2288777071 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e9000bd80 con 0x55750beb4130 2023-10-07T00:15:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.113+0000 7f9eb675bb80 10 client.26174 fetch_fsmap learned FSMap version 31 2023-10-07T00:15:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.113+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2288777071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55750bc2f250 con 0x55750beb4130 2023-10-07T00:15:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.113+0000 7f9e7bfff700 1 -- 172.21.15.5:0/2288777071 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e9001e040 con 0x55750beb4130 2023-10-07T00:15:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.114+0000 7f9e7bfff700 1 -- 172.21.15.5:0/2288777071 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9e9000f460 con 0x55750beb4130 2023-10-07T00:15:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.114+0000 7f9eb675bb80 10 client.26174 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:15:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.114+0000 7f9eb675bb80 10 client.26174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:15:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.114+0000 7f9eb675bb80 20 client.26174 populate_metadata read hostname 'smithi005' 2023-10-07T00:15:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.114+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55750bf1cff0 0x55750bf1f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:15:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.114+0000 7f9eb675bb80 4 client.26174 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:15:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.114+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2288777071 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55750bdfead0 con 0x55750bf1cff0 2023-10-07T00:15:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.115+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55750bf1cff0 0x55750bf1f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:15:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.116+0000 7f9e9bfff700 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55750bf1cff0 0x55750bf1f3e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=982c4d03a839b6cb server_cookie=e756b7d2bf2599c7 in_seq=0 out_seq=0 2023-10-07T00:15:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.116+0000 7f9e7bfff700 10 client.26174 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9e7bfff700 1 -- 172.21.15.5:0/2288777071 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55750bdfead0 con 0x55750bf1cff0 2023-10-07T00:15:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9e7bfff700 10 client.26174 handle_command_reply: tid=0 2023-10-07T00:15:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 client.26174 shutdown 2023-10-07T00:15:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2288777071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4130 msgr2=0x55750bec1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4130 0x55750bec1d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55750bebc180 tx=0x7f9e90005e80 comp rx=0 tx=0).stop 2023-10-07T00:15:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2288777071 shutdown_connections 2023-10-07T00:15:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55750bf1cff0 0x55750bf1f3e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55750bec3270 0x55750bec36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55750beb4130 0x55750bec1d20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 --2- 172.21.15.5:0/2288777071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55750beb4af0 0x55750bec2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9e7bfff700 0 client.26174 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:15:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.161+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2288777071 >> 172.21.15.5:0/2288777071 conn(0x55750be27200 msgr2=0x55750beca660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.162+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2288777071 shutdown_connections 2023-10-07T00:15:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.162+0000 7f9eb675bb80 1 -- 172.21.15.5:0/2288777071 wait complete. 2023-10-07T00:15:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:15:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:15:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:15:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:15:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.162+0000 7f9eb675bb80 20 client.26174 trim_cache size 0 max 16384 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e8c0a1580 msgr2=0x7f9e8c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e8c0a1580 0x7f9e8c0a3a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55750beb2dc0 tx=0x7f9e9400b040 comp rx=0 tx=0).stop 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c076ab0 msgr2=0x7f9e9c19d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c076ab0 0x7f9e9c19d460 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800eb30 tx=0x7f9e8800ee40 comp rx=0 tx=0).stop 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/3726480958 shutdown_connections 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e8c0a1580 0x7f9e8c0a3a40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c077470 0x7f9e9c1a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e9c075870 0x7f9e9c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 --2- 172.21.15.5:0/3726480958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e9c076ab0 0x7f9e9c19d460 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800eb30 tx=0x7f9e8800ee40 comp rx=0 tx=0).stop 2023-10-07T00:15:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.163+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/3726480958 >> 172.21.15.5:0/3726480958 conn(0x7f9e9c0fe480 msgr2=0x7f9e9c1001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:15:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.164+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/3726480958 shutdown_connections 2023-10-07T00:15:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:15:55.164+0000 7f9ea1b9d700 1 -- 172.21.15.5:0/3726480958 wait complete. 2023-10-07T00:15:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:54 smithi088 ceph-mon[103111]: pgmap v440: 97 pgs: 97 active+clean; 129 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 762 KiB/s wr, 133 op/s 2023-10-07T00:15:57.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:56 smithi005 ceph-mon[129406]: pgmap v441: 97 pgs: 97 active+clean; 133 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 982 KiB/s wr, 151 op/s 2023-10-07T00:15:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:56 smithi088 ceph-mon[103111]: pgmap v441: 97 pgs: 97 active+clean; 133 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 982 KiB/s wr, 151 op/s 2023-10-07T00:15:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:56 smithi112 ceph-mon[133548]: pgmap v441: 97 pgs: 97 active+clean; 133 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 982 KiB/s wr, 151 op/s 2023-10-07T00:15:57.765 INFO:tasks.workunit.client.0.smithi005.stdout: 30 7260 104 3976 61 686 67 2023-10-07T00:15:59.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:15:58 smithi005 ceph-mon[129406]: pgmap v442: 97 pgs: 97 active+clean; 134 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 982 KiB/s wr, 131 op/s 2023-10-07T00:15:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:15:58 smithi088 ceph-mon[103111]: pgmap v442: 97 pgs: 97 active+clean; 134 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 982 KiB/s wr, 131 op/s 2023-10-07T00:15:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:15:58 smithi112 ceph-mon[133548]: pgmap v442: 97 pgs: 97 active+clean; 134 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 982 KiB/s wr, 131 op/s 2023-10-07T00:16:01.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:00 smithi005 ceph-mon[129406]: pgmap v443: 97 pgs: 97 active+clean; 135 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 926 KiB/s wr, 124 op/s 2023-10-07T00:16:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:00 smithi088 ceph-mon[103111]: pgmap v443: 97 pgs: 97 active+clean; 135 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 926 KiB/s wr, 124 op/s 2023-10-07T00:16:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:00 smithi112 ceph-mon[133548]: pgmap v443: 97 pgs: 97 active+clean; 135 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 926 KiB/s wr, 124 op/s 2023-10-07T00:16:03.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:02 smithi005 ceph-mon[129406]: pgmap v444: 97 pgs: 97 active+clean; 137 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:16:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:02 smithi088 ceph-mon[103111]: pgmap v444: 97 pgs: 97 active+clean; 137 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:16:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:02 smithi112 ceph-mon[133548]: pgmap v444: 97 pgs: 97 active+clean; 137 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:16:05.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:04 smithi005 ceph-mon[129406]: pgmap v445: 97 pgs: 97 active+clean; 138 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 936 KiB/s wr, 128 op/s 2023-10-07T00:16:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:04 smithi088 ceph-mon[103111]: pgmap v445: 97 pgs: 97 active+clean; 138 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 936 KiB/s wr, 128 op/s 2023-10-07T00:16:05.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:04 smithi112 ceph-mon[133548]: pgmap v445: 97 pgs: 97 active+clean; 138 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 936 KiB/s wr, 128 op/s 2023-10-07T00:16:07.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:06 smithi005 ceph-mon[129406]: pgmap v446: 97 pgs: 97 active+clean; 141 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2023-10-07T00:16:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:06 smithi088 ceph-mon[103111]: pgmap v446: 97 pgs: 97 active+clean; 141 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2023-10-07T00:16:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:06 smithi112 ceph-mon[133548]: pgmap v446: 97 pgs: 97 active+clean; 141 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2023-10-07T00:16:07.765 INFO:tasks.workunit.client.0.smithi005.stdout: 30 7076 13 4683 85 432 49 2023-10-07T00:16:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 -- 172.21.15.5:0/3538147552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0840073910 msgr2=0x7f0840073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 --2- 172.21.15.5:0/3538147552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0840073910 0x7f0840073d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0834009990 tx=0x7f0834009ca0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 -- 172.21.15.5:0/3538147552 shutdown_connections 2023-10-07T00:16:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 --2- 172.21.15.5:0/3538147552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840108dc0 0x7f084010b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 --2- 172.21.15.5:0/3538147552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0840074ef0 0x7f0840073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 --2- 172.21.15.5:0/3538147552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0840073910 0x7f0840073d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 -- 172.21.15.5:0/3538147552 >> 172.21.15.5:0/3538147552 conn(0x7f08400fc470 msgr2=0x7f08400fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 -- 172.21.15.5:0/3538147552 shutdown_connections 2023-10-07T00:16:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.351+0000 7f08469ff700 1 -- 172.21.15.5:0/3538147552 wait complete. 2023-10-07T00:16:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.352+0000 7f08469ff700 1 Processor -- start 2023-10-07T00:16:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.352+0000 7f08469ff700 1 -- start start 2023-10-07T00:16:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.352+0000 7f08469ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840073910 0x7f0840198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.352+0000 7f08469ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0840074ef0 0x7f08401992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.352+0000 7f08469ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0840108dc0 0x7f08401a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.352+0000 7f08469ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401a08f0 con 0x7f0840073910 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.352+0000 7f08469ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401a0a30 con 0x7f0840074ef0 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.352+0000 7f08469ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401a0bc0 con 0x7f0840108dc0 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840073910 0x7f0840198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840073910 0x7f0840198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46332/0 (socket says 172.21.15.5:46332) 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 -- 172.21.15.5:0/2104763319 learned_addr learned my addr 172.21.15.5:0/2104763319 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083f7fe700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0840074ef0 0x7f08401992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0840108dc0 0x7f08401a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 -- 172.21.15.5:0/2104763319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0840108dc0 msgr2=0x7f08401a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0840108dc0 0x7f08401a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 -- 172.21.15.5:0/2104763319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0840074ef0 msgr2=0x7f08401992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0840074ef0 0x7f08401992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 -- 172.21.15.5:0/2104763319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08340095f0 con 0x7f0840073910 2023-10-07T00:16:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083ffff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840073910 0x7f0840198d70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f083000e9a0 tx=0x7f083000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.353+0000 7f083d7fa700 1 -- 172.21.15.5:0/2104763319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830009790 con 0x7f0840073910 2023-10-07T00:16:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.354+0000 7f083d7fa700 1 -- 172.21.15.5:0/2104763319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0830010430 con 0x7f0840073910 2023-10-07T00:16:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.354+0000 7f08469ff700 1 -- 172.21.15.5:0/2104763319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08401a0ea0 con 0x7f0840073910 2023-10-07T00:16:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.354+0000 7f083d7fa700 1 -- 172.21.15.5:0/2104763319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083000cea0 con 0x7f0840073910 2023-10-07T00:16:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.354+0000 7f08469ff700 1 -- 172.21.15.5:0/2104763319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08401a12c0 con 0x7f0840073910 2023-10-07T00:16:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.357+0000 7f083d7fa700 1 -- 172.21.15.5:0/2104763319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f08300105a0 con 0x7f0840073910 2023-10-07T00:16:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.358+0000 7f085a309b80 1 Processor -- start 2023-10-07T00:16:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.358+0000 7f085a309b80 1 -- start start 2023-10-07T00:16:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.358+0000 7f083d7fa700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08280a1480 0x7f08280a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.358+0000 7f083d7fa700 1 -- 172.21.15.5:0/2104763319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0830014070 con 0x7f0840073910 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.358+0000 7f085a309b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.358+0000 7f085a309b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7d8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f085a309b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f085a309b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd73f400 con 0x55e8fd7d8990 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f085a309b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd730bc0 con 0x55e8fd7d7fd0 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f085a309b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd72e4e0 con 0x55e8fd7d6ec0 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08280a1480 0x7f08280a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:41490/0 (socket says 172.21.15.5:41490) 2023-10-07T00:16:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 -- 172.21.15.5:0/1150217607 learned_addr learned my addr 172.21.15.5:0/1150217607 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f0844f9c700 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083f7fe700 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7d8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 -- 172.21.15.5:0/1150217607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d7fd0 msgr2=0x55e8fd7d8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7d8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 -- 172.21.15.5:0/1150217607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 msgr2=0x55e8fd7df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 -- 172.21.15.5:0/1150217607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8fd554d80 con 0x55e8fd7d6ec0 2023-10-07T00:16:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083f7fe700 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7d8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:16:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f0844f9c700 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:16:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.359+0000 7f083ffff700 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d72e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f08300a2010 tx=0x7f0830099be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e20a23fc890e3c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08280a1480 0x7f08280a3940 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0838009ec0 tx=0x7f0838009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f08267fc700 1 -- 172.21.15.5:0/1150217607 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083009e120 con 0x55e8fd7d6ec0 2023-10-07T00:16:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f08267fc700 1 -- 172.21.15.5:0/1150217607 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f083009a1b0 con 0x55e8fd7d6ec0 2023-10-07T00:16:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f08267fc700 1 -- 172.21.15.5:0/1150217607 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08300a20b0 con 0x55e8fd7d6ec0 2023-10-07T00:16:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f085a309b80 1 -- 172.21.15.5:0/1150217607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d6ec0 msgr2=0x55e8fd7d72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f085a309b80 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d72e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f08300a2010 tx=0x7f0830099be0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f085a309b80 1 -- 172.21.15.5:0/1150217607 shutdown_connections 2023-10-07T00:16:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f085a309b80 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f085a309b80 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d72e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f085a309b80 1 --2- 172.21.15.5:0/1150217607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7d8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.360+0000 7f085a309b80 1 -- 172.21.15.5:0/1150217607 >> 172.21.15.5:0/1150217607 conn(0x55e8fd74b200 msgr2=0x55e8fd7d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.361+0000 7f085a309b80 1 -- 172.21.15.5:0/1150217607 shutdown_connections 2023-10-07T00:16:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.361+0000 7f085a309b80 1 -- 172.21.15.5:0/1150217607 wait complete. 2023-10-07T00:16:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.361+0000 7f085a309b80 1 -- start start 2023-10-07T00:16:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.361+0000 7f085a309b80 1 Processor -- start 2023-10-07T00:16:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f085a309b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f085a309b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f085a309b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f085a309b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd729dd0 con 0x55e8fd7d8990 2023-10-07T00:16:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f085a309b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd6c66b0 con 0x55e8fd7d6ec0 2023-10-07T00:16:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f085a309b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd6c6350 con 0x55e8fd7d7fd0 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f085a309b80 10 client.0 _ll_register_callbacks cb 0x55e8fd5237a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f0844f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f0844f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46356/0 (socket says 172.21.15.5:46356) 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f0844f9c700 1 -- 172.21.15.5:0/2571730380 learned_addr learned my addr 172.21.15.5:0/2571730380 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f083f7fe700 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f083ffff700 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f0844f9c700 1 -- 172.21.15.5:0/2571730380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 msgr2=0x55e8fd7e10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.362+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f0844f9c700 1 -- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 msgr2=0x55e8fd7e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f0844f9c700 1 -- 172.21.15.5:0/2571730380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08401a12c0 con 0x55e8fd7d8990 2023-10-07T00:16:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f083ffff700 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:16:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e8120 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0838018a40 tx=0x7f0838004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b41b43900729c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f081f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:16:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f081f7fe700 1 -- 172.21.15.5:0/2571730380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838021070 con 0x55e8fd7d8990 2023-10-07T00:16:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f085a309b80 1 -- 172.21.15.5:0/2571730380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8fd7c9d50 con 0x55e8fd7d8990 2023-10-07T00:16:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f081f7fe700 1 -- 172.21.15.5:0/2571730380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f083801c510 con 0x55e8fd7d8990 2023-10-07T00:16:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f081f7fe700 1 -- 172.21.15.5:0/2571730380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f083800e070 con 0x55e8fd7d8990 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f085a309b80 10 client.16359 fetch_fsmap learned FSMap version 31 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.363+0000 7f085a309b80 1 -- 172.21.15.5:0/2571730380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e8fd53dc00 con 0x55e8fd7d8990 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f081f7fe700 1 -- 172.21.15.5:0/2571730380 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0838034080 con 0x55e8fd7d8990 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f081f7fe700 1 -- 172.21.15.5:0/2571730380 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f083802e030 con 0x55e8fd7d8990 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f085a309b80 10 client.16359 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f085a309b80 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f085a309b80 20 client.16359 populate_metadata read hostname 'smithi005' 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f085a309b80 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8fd7ecad0 0x55e8fd7eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f085a309b80 4 client.16359 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f085a309b80 1 -- 172.21.15.5:0/2571730380 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8fd722db0 con 0x55e8fd7ecad0 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.364+0000 7f083ffff700 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8fd7ecad0 0x55e8fd7eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.365+0000 7f083ffff700 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8fd7ecad0 0x55e8fd7eeef0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c583227532914a5 server_cookie=830cb032dfd71810 in_seq=0 out_seq=0 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.365+0000 7f081f7fe700 10 client.16359 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f081f7fe700 1 -- 172.21.15.5:0/2571730380 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e8fd722db0 con 0x55e8fd7ecad0 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f081f7fe700 10 client.16359 handle_command_reply: tid=0 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 client.16359 shutdown 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 -- 172.21.15.5:0/2571730380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 msgr2=0x55e8fd7e8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e8120 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0838018a40 tx=0x7f0838004b40 comp rx=0 tx=0).stop 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 -- 172.21.15.5:0/2571730380 shutdown_connections 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8fd7ecad0 0x55e8fd7eeef0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e8120 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f081f7fe700 0 client.16359 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 --2- 172.21.15.5:0/2571730380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 -- 172.21.15.5:0/2571730380 >> 172.21.15.5:0/2571730380 conn(0x55e8fd74b200 msgr2=0x55e8fd7d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 -- 172.21.15.5:0/2571730380 shutdown_connections 2023-10-07T00:16:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 1 -- 172.21.15.5:0/2571730380 wait complete. 2023-10-07T00:16:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.366+0000 7f085a309b80 20 client.16359 trim_cache size 0 max 16384 2023-10-07T00:16:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.381+0000 7f085a309b80 1 Processor -- start 2023-10-07T00:16:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.381+0000 7f085a309b80 1 -- start start 2023-10-07T00:16:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f085a309b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f085a309b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f085a309b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f085a309b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd5aa8c0 con 0x55e8fd7d7fd0 2023-10-07T00:16:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f085a309b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd7d36c0 con 0x55e8fd7d6ec0 2023-10-07T00:16:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f085a309b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd7e0710 con 0x55e8fd7d8990 2023-10-07T00:16:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f083f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f083f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46358/0 (socket says 172.21.15.5:46358) 2023-10-07T00:16:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f083f7fe700 1 -- 172.21.15.5:0/2243208602 learned_addr learned my addr 172.21.15.5:0/2243208602 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f083ffff700 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f0844f9c700 1 -- 172.21.15.5:0/2243208602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 msgr2=0x55e8fd7d83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f0844f9c700 1 -- 172.21.15.5:0/2243208602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d7fd0 msgr2=0x55e8fd7e8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f0844f9c700 1 -- 172.21.15.5:0/2243208602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8fd57b1f0 con 0x55e8fd7d8990 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f083ffff700 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.382+0000 7f083f7fe700 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.383+0000 7f0844f9c700 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df860 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f083801a7a0 tx=0x7f08380087d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e5abeb4f5d3cae server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.383+0000 7f0826ffd700 1 -- 172.21.15.5:0/2243208602 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838021070 con 0x55e8fd7d8990 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.383+0000 7f0826ffd700 1 -- 172.21.15.5:0/2243208602 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e8fd7c9d50 con 0x55e8fd7d8990 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.383+0000 7f0826ffd700 1 -- 172.21.15.5:0/2243208602 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083801ab00 con 0x55e8fd7d8990 2023-10-07T00:16:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.383+0000 7f085a309b80 1 -- 172.21.15.5:0/2243208602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d8990 msgr2=0x55e8fd7df860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.383+0000 7f085a309b80 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df860 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f083801a7a0 tx=0x7f08380087d0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 -- 172.21.15.5:0/2243208602 shutdown_connections 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d8990 0x55e8fd7df860 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7d83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 --2- 172.21.15.5:0/2243208602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 -- 172.21.15.5:0/2243208602 >> 172.21.15.5:0/2243208602 conn(0x55e8fd74b200 msgr2=0x55e8fd7d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 -- 172.21.15.5:0/2243208602 shutdown_connections 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 -- 172.21.15.5:0/2243208602 wait complete. 2023-10-07T00:16:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 -- start start 2023-10-07T00:16:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.384+0000 7f085a309b80 1 Processor -- start 2023-10-07T00:16:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f085a309b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f085a309b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f085a309b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f085a309b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd7e72c0 con 0x55e8fd7d8990 2023-10-07T00:16:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f085a309b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd7e7430 con 0x55e8fd7d6ec0 2023-10-07T00:16:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f085a309b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8fd7e75f0 con 0x55e8fd7d7fd0 2023-10-07T00:16:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f085a309b80 10 client.0 _ll_register_callbacks cb 0x7f0838008dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f0844f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f083f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f083ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f083f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:41522/0 (socket says 172.21.15.5:41522) 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f083f7fe700 1 -- 172.21.15.5:0/377190057 learned_addr learned my addr 172.21.15.5:0/377190057 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f0844f9c700 1 -- 172.21.15.5:0/377190057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 msgr2=0x55e8fd7e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.385+0000 7f0844f9c700 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f0844f9c700 1 -- 172.21.15.5:0/377190057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 msgr2=0x55e8fd7e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f0844f9c700 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f0844f9c700 1 -- 172.21.15.5:0/377190057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084010be70 con 0x55e8fd7d8990 2023-10-07T00:16:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f083f7fe700 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f083ffff700 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f0844f9c700 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e6d80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0838000f80 tx=0x7f0838003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1484d4b3ea83b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f081f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f081f7fe700 1 -- 172.21.15.5:0/377190057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838021070 con 0x55e8fd7d8990 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f085a309b80 1 -- 172.21.15.5:0/377190057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f083009a1b0 con 0x55e8fd7d8990 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f081f7fe700 1 -- 172.21.15.5:0/377190057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0838004ca0 con 0x55e8fd7d8990 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f081f7fe700 1 -- 172.21.15.5:0/377190057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f083800e040 con 0x55e8fd7d8990 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f085a309b80 10 client.16365 fetch_fsmap learned FSMap version 31 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.386+0000 7f085a309b80 1 -- 172.21.15.5:0/377190057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e8fd53dc00 con 0x55e8fd7d8990 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f081f7fe700 1 -- 172.21.15.5:0/377190057 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f083804a080 con 0x55e8fd7d8990 2023-10-07T00:16:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f081f7fe700 1 -- 172.21.15.5:0/377190057 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0838044030 con 0x55e8fd7d8990 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f085a309b80 10 client.16365 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f085a309b80 10 client.16365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f085a309b80 20 client.16365 populate_metadata read hostname 'smithi005' 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f085a309b80 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8fd840fb0 0x55e8fd8433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f085a309b80 4 client.16365 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f085a309b80 1 -- 172.21.15.5:0/377190057 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e8fd722ad0 con 0x55e8fd840fb0 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.387+0000 7f083ffff700 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8fd840fb0 0x55e8fd8433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.388+0000 7f083ffff700 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8fd840fb0 0x55e8fd8433a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a4b25628dda9298 server_cookie=f68fb9be519bfb9d in_seq=0 out_seq=0 2023-10-07T00:16:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.388+0000 7f081f7fe700 10 client.16365 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.552+0000 7f081f7fe700 1 -- 172.21.15.5:0/377190057 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e8fd722ad0 con 0x55e8fd840fb0 2023-10-07T00:16:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.552+0000 7f081f7fe700 10 client.16365 handle_command_reply: tid=0 2023-10-07T00:16:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.552+0000 7f085a309b80 1 client.16365 shutdown 2023-10-07T00:16:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.552+0000 7f085a309b80 1 -- 172.21.15.5:0/377190057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 msgr2=0x55e8fd7e6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.552+0000 7f085a309b80 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e6d80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0838000f80 tx=0x7f0838003e60 comp rx=0 tx=0).stop 2023-10-07T00:16:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f085a309b80 1 -- 172.21.15.5:0/377190057 shutdown_connections 2023-10-07T00:16:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f085a309b80 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8fd840fb0 0x55e8fd8433a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f085a309b80 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8fd7d8990 0x55e8fd7e6d80 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f085a309b80 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8fd7d6ec0 0x55e8fd7e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f085a309b80 1 --2- 172.21.15.5:0/377190057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8fd7d7fd0 0x55e8fd7e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f085a309b80 1 -- 172.21.15.5:0/377190057 >> 172.21.15.5:0/377190057 conn(0x55e8fd74b200 msgr2=0x55e8fd7dee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f081f7fe700 0 client.16365 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f085a309b80 1 -- 172.21.15.5:0/377190057 shutdown_connections 2023-10-07T00:16:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.553+0000 7f085a309b80 1 -- 172.21.15.5:0/377190057 wait complete. 2023-10-07T00:16:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.554+0000 7f085a309b80 20 client.16365 trim_cache size 0 max 16384 2023-10-07T00:16:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:16:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:16:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:16:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:16:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 -- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08280a1480 msgr2=0x7f08280a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08280a1480 0x7f08280a3940 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0838009ec0 tx=0x7f0838009920 comp rx=0 tx=0).stop 2023-10-07T00:16:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 -- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840073910 msgr2=0x7f0840198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840073910 0x7f0840198d70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f083000e9a0 tx=0x7f083000ecb0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 -- 172.21.15.5:0/2104763319 shutdown_connections 2023-10-07T00:16:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08280a1480 0x7f08280a3940 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0840108dc0 0x7f08401a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840073910 0x7f0840198d70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 --2- 172.21.15.5:0/2104763319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0840074ef0 0x7f08401992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 -- 172.21.15.5:0/2104763319 >> 172.21.15.5:0/2104763319 conn(0x7f08400fc470 msgr2=0x7f08400fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 -- 172.21.15.5:0/2104763319 shutdown_connections 2023-10-07T00:16:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:08.555+0000 7f08469ff700 1 -- 172.21.15.5:0/2104763319 wait complete. 2023-10-07T00:16:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:08 smithi005 ceph-mon[129406]: pgmap v447: 97 pgs: 97 active+clean; 142 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 872 KiB/s wr, 113 op/s 2023-10-07T00:16:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:08 smithi088 ceph-mon[103111]: pgmap v447: 97 pgs: 97 active+clean; 142 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 872 KiB/s wr, 113 op/s 2023-10-07T00:16:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:08 smithi112 ceph-mon[133548]: pgmap v447: 97 pgs: 97 active+clean; 142 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 872 KiB/s wr, 113 op/s 2023-10-07T00:16:11.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:10 smithi005 ceph-mon[129406]: pgmap v448: 97 pgs: 97 active+clean; 144 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 909 KiB/s wr, 112 op/s 2023-10-07T00:16:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:10 smithi088 ceph-mon[103111]: pgmap v448: 97 pgs: 97 active+clean; 144 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 909 KiB/s wr, 112 op/s 2023-10-07T00:16:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:10 smithi112 ceph-mon[133548]: pgmap v448: 97 pgs: 97 active+clean; 144 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 909 KiB/s wr, 112 op/s 2023-10-07T00:16:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:12 smithi005 ceph-mon[129406]: pgmap v449: 97 pgs: 97 active+clean; 145 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 939 KiB/s wr, 121 op/s 2023-10-07T00:16:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:12 smithi088 ceph-mon[103111]: pgmap v449: 97 pgs: 97 active+clean; 145 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 939 KiB/s wr, 121 op/s 2023-10-07T00:16:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:12 smithi112 ceph-mon[133548]: pgmap v449: 97 pgs: 97 active+clean; 145 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 939 KiB/s wr, 121 op/s 2023-10-07T00:16:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:14 smithi005 ceph-mon[129406]: pgmap v450: 97 pgs: 97 active+clean; 146 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 785 KiB/s wr, 97 op/s 2023-10-07T00:16:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:14 smithi088 ceph-mon[103111]: pgmap v450: 97 pgs: 97 active+clean; 146 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 785 KiB/s wr, 97 op/s 2023-10-07T00:16:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:14 smithi112 ceph-mon[133548]: pgmap v450: 97 pgs: 97 active+clean; 146 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 785 KiB/s wr, 97 op/s 2023-10-07T00:16:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:16 smithi005 ceph-mon[129406]: pgmap v451: 97 pgs: 97 active+clean; 149 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 992 KiB/s wr, 130 op/s 2023-10-07T00:16:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:16 smithi088 ceph-mon[103111]: pgmap v451: 97 pgs: 97 active+clean; 149 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 992 KiB/s wr, 130 op/s 2023-10-07T00:16:17.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:16 smithi112 ceph-mon[133548]: pgmap v451: 97 pgs: 97 active+clean; 149 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 992 KiB/s wr, 130 op/s 2023-10-07T00:16:17.765 INFO:tasks.workunit.client.0.smithi005.stdout: 32 7034 40 4489 50 1035 51 2023-10-07T00:16:19.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:18 smithi005 ceph-mon[129406]: pgmap v452: 97 pgs: 97 active+clean; 149 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 753 KiB/s wr, 103 op/s 2023-10-07T00:16:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:18 smithi088 ceph-mon[103111]: pgmap v452: 97 pgs: 97 active+clean; 149 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 753 KiB/s wr, 103 op/s 2023-10-07T00:16:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:18 smithi112 ceph-mon[133548]: pgmap v452: 97 pgs: 97 active+clean; 149 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 753 KiB/s wr, 103 op/s 2023-10-07T00:16:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:20 smithi005 ceph-mon[129406]: pgmap v453: 97 pgs: 97 active+clean; 151 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 791 KiB/s wr, 117 op/s 2023-10-07T00:16:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:20 smithi088 ceph-mon[103111]: pgmap v453: 97 pgs: 97 active+clean; 151 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 791 KiB/s wr, 117 op/s 2023-10-07T00:16:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:20 smithi112 ceph-mon[133548]: pgmap v453: 97 pgs: 97 active+clean; 151 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 791 KiB/s wr, 117 op/s 2023-10-07T00:16:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 -- 172.21.15.5:0/1848807552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c103110 msgr2=0x7f012c103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 --2- 172.21.15.5:0/1848807552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c103110 0x7f012c103530 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0128009990 tx=0x7f0128009ca0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 -- 172.21.15.5:0/1848807552 shutdown_connections 2023-10-07T00:16:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 --2- 172.21.15.5:0/1848807552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c104ca0 0x7f012c10b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 --2- 172.21.15.5:0/1848807552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c103110 0x7f012c103530 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 --2- 172.21.15.5:0/1848807552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f012c104300 0x7f012c104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 -- 172.21.15.5:0/1848807552 >> 172.21.15.5:0/1848807552 conn(0x7f012c0fe660 msgr2=0x7f012c100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 -- 172.21.15.5:0/1848807552 shutdown_connections 2023-10-07T00:16:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.783+0000 7f0133dff700 1 -- 172.21.15.5:0/1848807552 wait complete. 2023-10-07T00:16:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.785+0000 7f0133dff700 1 Processor -- start 2023-10-07T00:16:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.785+0000 7f0133dff700 1 -- start start 2023-10-07T00:16:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f0133dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f012c103110 0x7f012c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f0133dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c104300 0x7f012c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f0133dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c104ca0 0x7f012c1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f0133dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c1a08d0 con 0x7f012c104300 2023-10-07T00:16:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f0133dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c1a0a10 con 0x7f012c103110 2023-10-07T00:16:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f0133dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c1a0ba0 con 0x7f012c104ca0 2023-10-07T00:16:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f013139a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c104300 0x7f012c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f013239c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c104ca0 0x7f012c1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f013239c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c104ca0 0x7f012c1a0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:51458/0 (socket says 172.21.15.5:51458) 2023-10-07T00:16:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f013239c700 1 -- 172.21.15.5:0/3733947247 learned_addr learned my addr 172.21.15.5:0/3733947247 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.786+0000 7f0131b9b700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f012c103110 0x7f012c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.787+0000 7f013239c700 1 -- 172.21.15.5:0/3733947247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f012c103110 msgr2=0x7f012c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.787+0000 7f013239c700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f012c103110 0x7f012c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.787+0000 7f013239c700 1 -- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c104300 msgr2=0x7f012c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.787+0000 7f013239c700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c104300 0x7f012c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.787+0000 7f013239c700 1 -- 172.21.15.5:0/3733947247 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01280095f0 con 0x7f012c104ca0 2023-10-07T00:16:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.787+0000 7f013239c700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c104ca0 0x7f012c1a0300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f012400ef30 tx=0x7f012400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.787+0000 7f0122ffd700 1 -- 172.21.15.5:0/3733947247 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124018070 con 0x7f012c104ca0 2023-10-07T00:16:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.788+0000 7f0122ffd700 1 -- 172.21.15.5:0/3733947247 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f012400f040 con 0x7f012c104ca0 2023-10-07T00:16:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.788+0000 7f0122ffd700 1 -- 172.21.15.5:0/3733947247 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012400cbc0 con 0x7f012c104ca0 2023-10-07T00:16:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.788+0000 7f0133dff700 1 -- 172.21.15.5:0/3733947247 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c075430 con 0x7f012c104ca0 2023-10-07T00:16:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.788+0000 7f0133dff700 1 -- 172.21.15.5:0/3733947247 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c0758f0 con 0x7f012c104ca0 2023-10-07T00:16:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.794+0000 7f014769db80 1 Processor -- start 2023-10-07T00:16:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.794+0000 7f0122ffd700 1 -- 172.21.15.5:0/3733947247 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0124007500 con 0x7f012c104ca0 2023-10-07T00:16:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.795+0000 7f014769db80 1 -- start start 2023-10-07T00:16:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.795+0000 7f014769db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.795+0000 7f014769db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.795+0000 7f014769db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.795+0000 7f014769db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee613400 con 0x5567ee6abfd0 2023-10-07T00:16:21.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.795+0000 7f014769db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee604bc0 con 0x5567ee6aaec0 2023-10-07T00:16:21.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.795+0000 7f014769db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee6024e0 con 0x5567ee6ac990 2023-10-07T00:16:21.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.796+0000 7f013139a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.796+0000 7f013139a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:41862/0 (socket says 172.21.15.5:41862) 2023-10-07T00:16:21.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.796+0000 7f013139a700 1 -- 172.21.15.5:0/3306357469 learned_addr learned my addr 172.21.15.5:0/3306357469 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:21.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.796+0000 7f013139a700 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f013139a700 1 -- 172.21.15.5:0/3306357469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 msgr2=0x5567ee6b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f013139a700 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f013139a700 1 -- 172.21.15.5:0/3306357469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 msgr2=0x5567ee6ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f0131b9b700 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f013139a700 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f013139a700 1 -- 172.21.15.5:0/3306357469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567ee428d80 con 0x5567ee6aaec0 2023-10-07T00:16:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f0131b9b700 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:16:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f0122ffd700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01180a1500 0x7f01180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.797+0000 7f013139a700 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6ab2e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f011c012840 tx=0x7f011c007840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a8710a368a7855 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.798+0000 7f0122ffd700 1 -- 172.21.15.5:0/3733947247 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f01240cc740 con 0x7f012c104ca0 2023-10-07T00:16:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.798+0000 7f0117fff700 1 -- 172.21.15.5:0/3306357469 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c012e60 con 0x5567ee6aaec0 2023-10-07T00:16:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.798+0000 7f0131b9b700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01180a1500 0x7f01180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.798+0000 7f0117fff700 1 -- 172.21.15.5:0/3306357469 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f011c0044c0 con 0x5567ee6aaec0 2023-10-07T00:16:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.798+0000 7f0117fff700 1 -- 172.21.15.5:0/3306357469 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c005280 con 0x5567ee6aaec0 2023-10-07T00:16:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 -- 172.21.15.5:0/3306357469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 msgr2=0x5567ee6ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6ab2e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f011c012840 tx=0x7f011c007840 comp rx=0 tx=0).stop 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f0131b9b700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01180a1500 0x7f01180a39c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f012800b2e0 tx=0x7f0128005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 -- 172.21.15.5:0/3306357469 shutdown_connections 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6ab2e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 --2- 172.21.15.5:0/3306357469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 -- 172.21.15.5:0/3306357469 >> 172.21.15.5:0/3306357469 conn(0x5567ee61f200 msgr2=0x5567ee6a5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 -- 172.21.15.5:0/3306357469 shutdown_connections 2023-10-07T00:16:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.800+0000 7f014769db80 1 -- 172.21.15.5:0/3306357469 wait complete. 2023-10-07T00:16:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.801+0000 7f014769db80 1 -- start start 2023-10-07T00:16:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.801+0000 7f014769db80 1 Processor -- start 2023-10-07T00:16:21.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.803+0000 7f014769db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.803+0000 7f014769db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6abfd0 0x5567ee6b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.803+0000 7f014769db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6ac990 0x5567ee6bc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.803+0000 7f014769db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee5fddd0 con 0x5567ee6aaec0 2023-10-07T00:16:21.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.803+0000 7f014769db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee59a6b0 con 0x5567ee6ac990 2023-10-07T00:16:21.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.803+0000 7f014769db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee59a350 con 0x5567ee6abfd0 2023-10-07T00:16:21.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.803+0000 7f014769db80 10 client.0 _ll_register_callbacks cb 0x5567ee3f77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:16:21.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013239c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6ac990 0x5567ee6bc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013239c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6ac990 0x5567ee6bc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:41870/0 (socket says 172.21.15.5:41870) 2023-10-07T00:16:21.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013139a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6abfd0 0x5567ee6b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013239c700 1 -- 172.21.15.5:0/1311805437 learned_addr learned my addr 172.21.15.5:0/1311805437 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f0131b9b700 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013239c700 1 -- 172.21.15.5:0/1311805437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6abfd0 msgr2=0x5567ee6b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013239c700 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6abfd0 0x5567ee6b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013239c700 1 -- 172.21.15.5:0/1311805437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 msgr2=0x5567ee6b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013239c700 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013239c700 1 -- 172.21.15.5:0/1311805437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011c01a040 con 0x5567ee6ac990 2023-10-07T00:16:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.804+0000 7f013139a700 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6abfd0 0x5567ee6b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:16:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f013239c700 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6ac990 0x5567ee6bc0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f01240964e0 tx=0x7f0124099fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26bf10ce78d5323c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f01157fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f01157fa700 1 -- 172.21.15.5:0/1311805437 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012409a170 con 0x5567ee6ac990 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f01157fa700 1 -- 172.21.15.5:0/1311805437 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0124099a70 con 0x5567ee6ac990 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f014769db80 1 -- 172.21.15.5:0/1311805437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567ee69dd50 con 0x5567ee6ac990 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f01157fa700 1 -- 172.21.15.5:0/1311805437 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f012409dbc0 con 0x5567ee6ac990 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f014769db80 10 client.26204 fetch_fsmap learned FSMap version 31 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f014769db80 1 -- 172.21.15.5:0/1311805437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5567ee411c00 con 0x5567ee6ac990 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.805+0000 7f01157fa700 1 -- 172.21.15.5:0/1311805437 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5567ee69dd50 con 0x5567ee6ac990 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.806+0000 7f01157fa700 1 -- 172.21.15.5:0/1311805437 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f01240a18e0 con 0x5567ee6ac990 2023-10-07T00:16:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.806+0000 7f014769db80 10 client.26204 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:16:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.806+0000 7f014769db80 10 client.26204 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:16:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.806+0000 7f014769db80 20 client.26204 populate_metadata read hostname 'smithi005' 2023-10-07T00:16:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.806+0000 7f014769db80 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5567ee6c08a0 0x5567ee6c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.806+0000 7f014769db80 4 client.26204 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:16:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.806+0000 7f014769db80 1 -- 172.21.15.5:0/1311805437 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567ee5f6db0 con 0x5567ee6c08a0 2023-10-07T00:16:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.806+0000 7f0131b9b700 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5567ee6c08a0 0x5567ee6c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.807+0000 7f0131b9b700 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5567ee6c08a0 0x5567ee6c2cc0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f12d4f04668bee53 server_cookie=560dc0e469b00e6b in_seq=0 out_seq=0 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.807+0000 7f01157fa700 10 client.26204 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f01157fa700 1 -- 172.21.15.5:0/1311805437 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5567ee5f6db0 con 0x5567ee6c08a0 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f01157fa700 10 client.26204 handle_command_reply: tid=0 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 client.26204 shutdown 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 -- 172.21.15.5:0/1311805437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6ac990 msgr2=0x5567ee6bc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6ac990 0x5567ee6bc0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f01240964e0 tx=0x7f0124099fb0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 -- 172.21.15.5:0/1311805437 shutdown_connections 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5567ee6c08a0 0x5567ee6c2cc0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6ac990 0x5567ee6bc0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 --2- 172.21.15.5:0/1311805437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6abfd0 0x5567ee6b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.808+0000 7f014769db80 1 -- 172.21.15.5:0/1311805437 >> 172.21.15.5:0/1311805437 conn(0x5567ee61f200 msgr2=0x5567ee6a5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.809+0000 7f01157fa700 0 client.26204 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.809+0000 7f014769db80 1 -- 172.21.15.5:0/1311805437 shutdown_connections 2023-10-07T00:16:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.809+0000 7f014769db80 1 -- 172.21.15.5:0/1311805437 wait complete. 2023-10-07T00:16:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.809+0000 7f014769db80 20 client.26204 trim_cache size 0 max 16384 2023-10-07T00:16:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.834+0000 7f014769db80 1 Processor -- start 2023-10-07T00:16:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.834+0000 7f014769db80 1 -- start start 2023-10-07T00:16:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f014769db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f014769db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6abfd0 0x5567ee6bc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f014769db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f014769db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee47e8c0 con 0x5567ee6aaec0 2023-10-07T00:16:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f014769db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee6b3580 con 0x5567ee6abfd0 2023-10-07T00:16:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f014769db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee6ace60 con 0x5567ee6ac990 2023-10-07T00:16:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f0131b9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f0131b9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6c28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58812/0 (socket says 172.21.15.5:58812) 2023-10-07T00:16:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f0131b9b700 1 -- 172.21.15.5:0/1346942377 learned_addr learned my addr 172.21.15.5:0/1346942377 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f013139a700 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6abfd0 0x5567ee6bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.835+0000 7f013239c700 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.836+0000 7f0131b9b700 1 -- 172.21.15.5:0/1346942377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 msgr2=0x5567ee6af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.836+0000 7f0131b9b700 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.836+0000 7f0131b9b700 1 -- 172.21.15.5:0/1346942377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6abfd0 msgr2=0x5567ee6bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.836+0000 7f0131b9b700 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6abfd0 0x5567ee6bc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.836+0000 7f0131b9b700 1 -- 172.21.15.5:0/1346942377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567ee44f1f0 con 0x5567ee6aaec0 2023-10-07T00:16:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.837+0000 7f0131b9b700 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6c28b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f012c104160 tx=0x7f0128024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bf176f463d4c57 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.837+0000 7f0120bff700 1 -- 172.21.15.5:0/1346942377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128033ea0 con 0x5567ee6aaec0 2023-10-07T00:16:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.837+0000 7f0120bff700 1 -- 172.21.15.5:0/1346942377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f012802d040 con 0x5567ee6aaec0 2023-10-07T00:16:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.837+0000 7f0120bff700 1 -- 172.21.15.5:0/1346942377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128003b10 con 0x5567ee6aaec0 2023-10-07T00:16:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 -- 172.21.15.5:0/1346942377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 msgr2=0x5567ee6c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6c28b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f012c104160 tx=0x7f0128024000 comp rx=0 tx=0).stop 2023-10-07T00:16:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 -- 172.21.15.5:0/1346942377 shutdown_connections 2023-10-07T00:16:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6aaec0 0x5567ee6c28b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 --2- 172.21.15.5:0/1346942377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6abfd0 0x5567ee6bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 -- 172.21.15.5:0/1346942377 >> 172.21.15.5:0/1346942377 conn(0x5567ee61f200 msgr2=0x5567ee6b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 -- 172.21.15.5:0/1346942377 shutdown_connections 2023-10-07T00:16:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.838+0000 7f014769db80 1 -- 172.21.15.5:0/1346942377 wait complete. 2023-10-07T00:16:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.839+0000 7f014769db80 1 -- start start 2023-10-07T00:16:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.839+0000 7f014769db80 1 Processor -- start 2023-10-07T00:16:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f014769db80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f014769db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6b9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f014769db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6bae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f014769db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee6bb340 con 0x5567ee6abfd0 2023-10-07T00:16:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f014769db80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee6bb4b0 con 0x5567ee6aaec0 2023-10-07T00:16:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f014769db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ee6bb620 con 0x5567ee6ac990 2023-10-07T00:16:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f014769db80 10 client.0 _ll_register_callbacks cb 0x7f01240998d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:16:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f013139a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6b9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f013139a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6b9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58828/0 (socket says 172.21.15.5:58828) 2023-10-07T00:16:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f013139a700 1 -- 172.21.15.5:0/467285962 learned_addr learned my addr 172.21.15.5:0/467285962 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.840+0000 7f013239c700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6bae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.841+0000 7f0131b9b700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.841+0000 7f0131b9b700 1 -- 172.21.15.5:0/467285962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 msgr2=0x5567ee6bae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.841+0000 7f0131b9b700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6bae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.841+0000 7f0131b9b700 1 -- 172.21.15.5:0/467285962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 msgr2=0x5567ee6b9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.841+0000 7f0131b9b700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6b9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.841+0000 7f0131b9b700 1 -- 172.21.15.5:0/467285962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c10bea0 con 0x5567ee6aaec0 2023-10-07T00:16:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.841+0000 7f013239c700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6bae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:16:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.841+0000 7f013139a700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6b9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:16:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.842+0000 7f0131b9b700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6b98b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f01280098e0 tx=0x7f012800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccaf089fbc057f0c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.842+0000 7f01157fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:16:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.842+0000 7f01157fa700 1 -- 172.21.15.5:0/467285962 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128033ea0 con 0x5567ee6aaec0 2023-10-07T00:16:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.842+0000 7f014769db80 1 -- 172.21.15.5:0/467285962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f011c0044c0 con 0x5567ee6aaec0 2023-10-07T00:16:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.842+0000 7f01157fa700 1 -- 172.21.15.5:0/467285962 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0128003a90 con 0x5567ee6aaec0 2023-10-07T00:16:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.842+0000 7f01157fa700 1 -- 172.21.15.5:0/467285962 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01280053a0 con 0x5567ee6aaec0 2023-10-07T00:16:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.842+0000 7f014769db80 10 client.26210 fetch_fsmap learned FSMap version 31 2023-10-07T00:16:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.842+0000 7f014769db80 1 -- 172.21.15.5:0/467285962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5567ee427250 con 0x5567ee6aaec0 2023-10-07T00:16:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.843+0000 7f01157fa700 1 -- 172.21.15.5:0/467285962 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f011c0044c0 con 0x5567ee6aaec0 2023-10-07T00:16:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.843+0000 7f01157fa700 1 -- 172.21.15.5:0/467285962 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0128045020 con 0x5567ee6aaec0 2023-10-07T00:16:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.843+0000 7f014769db80 10 client.26210 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:16:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.843+0000 7f014769db80 10 client.26210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:16:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.843+0000 7f014769db80 20 client.26210 populate_metadata read hostname 'smithi005' 2023-10-07T00:16:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.843+0000 7f014769db80 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5567ee725d50 0x5567ee728170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.843+0000 7f014769db80 4 client.26210 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:16:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.843+0000 7f014769db80 1 -- 172.21.15.5:0/467285962 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5567ee5f6ad0 con 0x5567ee725d50 2023-10-07T00:16:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.844+0000 7f013139a700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5567ee725d50 0x5567ee728170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.844+0000 7f013139a700 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5567ee725d50 0x5567ee728170 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83b8fdea3d6a764c server_cookie=450eadeb793f1602 in_seq=0 out_seq=0 2023-10-07T00:16:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.844+0000 7f01157fa700 10 client.26210 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.879+0000 7f01157fa700 1 -- 172.21.15.5:0/467285962 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5567ee5f6ad0 con 0x5567ee725d50 2023-10-07T00:16:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.879+0000 7f01157fa700 10 client.26210 handle_command_reply: tid=0 2023-10-07T00:16:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.879+0000 7f014769db80 1 client.26210 shutdown 2023-10-07T00:16:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.879+0000 7f014769db80 1 -- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 msgr2=0x5567ee6b98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.879+0000 7f014769db80 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6b98b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f01280098e0 tx=0x7f012800b330 comp rx=0 tx=0).stop 2023-10-07T00:16:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 1 -- 172.21.15.5:0/467285962 shutdown_connections 2023-10-07T00:16:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5567ee725d50 0x5567ee728170 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567ee6ac990 0x5567ee6bae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5567ee6aaec0 0x5567ee6b98b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f01157fa700 0 client.26210 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 1 --2- 172.21.15.5:0/467285962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567ee6abfd0 0x5567ee6b9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 1 -- 172.21.15.5:0/467285962 >> 172.21.15.5:0/467285962 conn(0x5567ee61f200 msgr2=0x5567ee6c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 1 -- 172.21.15.5:0/467285962 shutdown_connections 2023-10-07T00:16:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 1 -- 172.21.15.5:0/467285962 wait complete. 2023-10-07T00:16:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.880+0000 7f014769db80 20 client.26210 trim_cache size 0 max 16384 2023-10-07T00:16:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:16:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:16:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:16:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:16:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.881+0000 7f0133dff700 1 -- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01180a1500 msgr2=0x7f01180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.881+0000 7f0133dff700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01180a1500 0x7f01180a39c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f012800b2e0 tx=0x7f0128005fd0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.881+0000 7f0133dff700 1 -- 172.21.15.5:0/3733947247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c104ca0 msgr2=0x7f012c1a0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.881+0000 7f0133dff700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c104ca0 0x7f012c1a0300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f012400ef30 tx=0x7f012400c3a0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.882+0000 7f0133dff700 1 -- 172.21.15.5:0/3733947247 shutdown_connections 2023-10-07T00:16:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.882+0000 7f0133dff700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01180a1500 0x7f01180a39c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.882+0000 7f0133dff700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f012c104ca0 0x7f012c1a0300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.882+0000 7f0133dff700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f012c103110 0x7f012c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.882+0000 7f0133dff700 1 --2- 172.21.15.5:0/3733947247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c104300 0x7f012c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:21.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.882+0000 7f0133dff700 1 -- 172.21.15.5:0/3733947247 >> 172.21.15.5:0/3733947247 conn(0x7f012c0fe660 msgr2=0x7f012c100950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:21.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.882+0000 7f0133dff700 1 -- 172.21.15.5:0/3733947247 shutdown_connections 2023-10-07T00:16:21.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:21.882+0000 7f0133dff700 1 -- 172.21.15.5:0/3733947247 wait complete. 2023-10-07T00:16:23.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:22 smithi005 ceph-mon[129406]: pgmap v454: 97 pgs: 97 active+clean; 152 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 739 KiB/s wr, 111 op/s 2023-10-07T00:16:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:22 smithi088 ceph-mon[103111]: pgmap v454: 97 pgs: 97 active+clean; 152 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 739 KiB/s wr, 111 op/s 2023-10-07T00:16:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:22 smithi112 ceph-mon[133548]: pgmap v454: 97 pgs: 97 active+clean; 152 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 739 KiB/s wr, 111 op/s 2023-10-07T00:16:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:24 smithi005 ceph-mon[129406]: pgmap v455: 97 pgs: 97 active+clean; 153 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 714 KiB/s wr, 98 op/s 2023-10-07T00:16:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:24 smithi088 ceph-mon[103111]: pgmap v455: 97 pgs: 97 active+clean; 153 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 714 KiB/s wr, 98 op/s 2023-10-07T00:16:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:24 smithi112 ceph-mon[133548]: pgmap v455: 97 pgs: 97 active+clean; 153 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 714 KiB/s wr, 98 op/s 2023-10-07T00:16:27.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:26 smithi005 ceph-mon[129406]: pgmap v456: 97 pgs: 97 active+clean; 155 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 915 KiB/s wr, 124 op/s 2023-10-07T00:16:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:26 smithi088 ceph-mon[103111]: pgmap v456: 97 pgs: 97 active+clean; 155 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 915 KiB/s wr, 124 op/s 2023-10-07T00:16:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:26 smithi112 ceph-mon[133548]: pgmap v456: 97 pgs: 97 active+clean; 155 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 915 KiB/s wr, 124 op/s 2023-10-07T00:16:27.765 INFO:tasks.workunit.client.0.smithi005.stdout: 32 7767 20 5024 86 1145 52 2023-10-07T00:16:29.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:28 smithi005 ceph-mon[129406]: pgmap v457: 97 pgs: 97 active+clean; 157 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 776 KiB/s wr, 99 op/s 2023-10-07T00:16:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:28 smithi088 ceph-mon[103111]: pgmap v457: 97 pgs: 97 active+clean; 157 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 776 KiB/s wr, 99 op/s 2023-10-07T00:16:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:28 smithi112 ceph-mon[133548]: pgmap v457: 97 pgs: 97 active+clean; 157 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 776 KiB/s wr, 99 op/s 2023-10-07T00:16:31.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:30 smithi005 ceph-mon[129406]: pgmap v458: 97 pgs: 97 active+clean; 159 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 852 KiB/s wr, 101 op/s 2023-10-07T00:16:31.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:30 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:16:31.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:30 smithi088 ceph-mon[103111]: pgmap v458: 97 pgs: 97 active+clean; 159 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 852 KiB/s wr, 101 op/s 2023-10-07T00:16:31.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:30 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:16:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:30 smithi112 ceph-mon[133548]: pgmap v458: 97 pgs: 97 active+clean; 159 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 852 KiB/s wr, 101 op/s 2023-10-07T00:16:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:30 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:16:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:16:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:16:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:16:32.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:16:32.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:16:32.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:16:32.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:16:32.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:16:32.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:16:33.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:32 smithi005 ceph-mon[129406]: pgmap v459: 97 pgs: 97 active+clean; 160 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 808 KiB/s wr, 96 op/s 2023-10-07T00:16:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:32 smithi088 ceph-mon[103111]: pgmap v459: 97 pgs: 97 active+clean; 160 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 808 KiB/s wr, 96 op/s 2023-10-07T00:16:33.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:32 smithi112 ceph-mon[133548]: pgmap v459: 97 pgs: 97 active+clean; 160 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 808 KiB/s wr, 96 op/s 2023-10-07T00:16:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:34 smithi005 ceph-mon[129406]: pgmap v460: 97 pgs: 97 active+clean; 161 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 864 KiB/s wr, 100 op/s 2023-10-07T00:16:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.107+0000 7f1015bff700 1 -- 172.21.15.5:0/2418098214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 msgr2=0x7f1010104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.107+0000 7f1015bff700 1 --2- 172.21.15.5:0/2418098214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 0x7f1010104570 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80098f0 tx=0x7f0ff8009c00 comp rx=0 tx=0).stop 2023-10-07T00:16:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.108+0000 7f1015bff700 1 -- 172.21.15.5:0/2418098214 shutdown_connections 2023-10-07T00:16:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.108+0000 7f1015bff700 1 --2- 172.21.15.5:0/2418098214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1010104ab0 0x7f1010104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.108+0000 7f1015bff700 1 --2- 172.21.15.5:0/2418098214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100ff770 0x7f1010101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.108+0000 7f1015bff700 1 --2- 172.21.15.5:0/2418098214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 0x7f1010104570 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.108+0000 7f1015bff700 1 -- 172.21.15.5:0/2418098214 >> 172.21.15.5:0/2418098214 conn(0x7f10100fb390 msgr2=0x7f10100fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.108+0000 7f1015bff700 1 -- 172.21.15.5:0/2418098214 shutdown_connections 2023-10-07T00:16:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.108+0000 7f1015bff700 1 -- 172.21.15.5:0/2418098214 wait complete. 2023-10-07T00:16:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.109+0000 7f1015bff700 1 Processor -- start 2023-10-07T00:16:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.109+0000 7f1015bff700 1 -- start start 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.109+0000 7f1015bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100ff770 0x7f1010194950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.109+0000 7f1015bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 0x7f1010194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.110+0000 7f1015bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1010104ab0 0x7f101019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.110+0000 7f1015bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101019c4d0 con 0x7f10101020e0 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.110+0000 7f1015bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101019c610 con 0x7f10100ff770 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.110+0000 7f1015bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101019c7a0 con 0x7f1010104ab0 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.110+0000 7f100effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 0x7f1010194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.110+0000 7f100effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 0x7f1010194e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35246/0 (socket says 172.21.15.5:35246) 2023-10-07T00:16:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.110+0000 7f100effd700 1 -- 172.21.15.5:0/1668693284 learned_addr learned my addr 172.21.15.5:0/1668693284 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.110+0000 7f100ffff700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1010104ab0 0x7f101019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.111+0000 7f100f7fe700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100ff770 0x7f1010194950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.111+0000 7f100f7fe700 1 -- 172.21.15.5:0/1668693284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1010104ab0 msgr2=0x7f101019bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.111+0000 7f100f7fe700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1010104ab0 0x7f101019bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.111+0000 7f100f7fe700 1 -- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 msgr2=0x7f1010194e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.111+0000 7f100f7fe700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 0x7f1010194e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.111+0000 7f100f7fe700 1 -- 172.21.15.5:0/1668693284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100001a600 con 0x7f10100ff770 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.111+0000 7f100effd700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 0x7f1010194e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.112+0000 7f100f7fe700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100ff770 0x7f1010194950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f100001afd0 tx=0x7f100001d5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.112+0000 7f100cff9700 1 -- 172.21.15.5:0/1668693284 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100001fed0 con 0x7f10100ff770 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.112+0000 7f1015bff700 1 -- 172.21.15.5:0/1668693284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff8009520 con 0x7f10100ff770 2023-10-07T00:16:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.112+0000 7f100cff9700 1 -- 172.21.15.5:0/1668693284 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10000044b0 con 0x7f10100ff770 2023-10-07T00:16:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.112+0000 7f100cff9700 1 -- 172.21.15.5:0/1668693284 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000003e00 con 0x7f10100ff770 2023-10-07T00:16:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.112+0000 7f1015bff700 1 -- 172.21.15.5:0/1668693284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101019ce50 con 0x7f10100ff770 2023-10-07T00:16:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.118+0000 7f100cff9700 1 -- 172.21.15.5:0/1668693284 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f100001dd30 con 0x7f10100ff770 2023-10-07T00:16:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.118+0000 7f1029450b80 1 Processor -- start 2023-10-07T00:16:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.119+0000 7f1029450b80 1 -- start start 2023-10-07T00:16:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.119+0000 7f1029450b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c51c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.119+0000 7f1029450b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51cfd0 0x555c6c51d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.119+0000 7f1029450b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51d990 0x555c6c524220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.119+0000 7f1029450b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c484400 con 0x555c6c51cfd0 2023-10-07T00:16:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.119+0000 7f1029450b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c475bc0 con 0x555c6c51bec0 2023-10-07T00:16:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.119+0000 7f1029450b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c4734e0 con 0x555c6c51d990 2023-10-07T00:16:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.120+0000 7f100ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c51c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.120+0000 7f100ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c51c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:51578/0 (socket says 172.21.15.5:51578) 2023-10-07T00:16:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.120+0000 7f100ffff700 1 -- 172.21.15.5:0/4139972352 learned_addr learned my addr 172.21.15.5:0/4139972352 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.120+0000 7f100f7fe700 1 --2- 172.21.15.5:0/4139972352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51cfd0 0x555c6c51d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100ffff700 1 -- 172.21.15.5:0/4139972352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51d990 msgr2=0x555c6c524220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100ffff700 1 --2- 172.21.15.5:0/4139972352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51d990 0x555c6c524220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100ffff700 1 -- 172.21.15.5:0/4139972352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51cfd0 msgr2=0x555c6c51d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100ffff700 1 --2- 172.21.15.5:0/4139972352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51cfd0 0x555c6c51d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100ffff700 1 -- 172.21.15.5:0/4139972352 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c6c299d80 con 0x555c6c51bec0 2023-10-07T00:16:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100cff9700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0ffc0a1580 0x7f0ffc0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100cff9700 1 -- 172.21.15.5:0/1668693284 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1000025070 con 0x7f10100ff770 2023-10-07T00:16:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100ffff700 1 --2- 172.21.15.5:0/4139972352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c51c2e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f10080098f0 tx=0x7f1008009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae856ae8b848a0e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.121+0000 7f100f7fe700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0ffc0a1580 0x7f0ffc0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.122+0000 7f1005ffb700 1 -- 172.21.15.5:0/4139972352 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008019070 con 0x555c6c51bec0 2023-10-07T00:16:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.122+0000 7f1005ffb700 1 -- 172.21.15.5:0/4139972352 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f100800f040 con 0x555c6c51bec0 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.122+0000 7f1005ffb700 1 -- 172.21.15.5:0/4139972352 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008007a50 con 0x555c6c51bec0 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 -- 172.21.15.5:0/4139972352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 msgr2=0x555c6c51c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 --2- 172.21.15.5:0/4139972352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c51c2e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f10080098f0 tx=0x7f1008009c00 comp rx=0 tx=0).stop 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 -- 172.21.15.5:0/4139972352 shutdown_connections 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f100f7fe700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0ffc0a1580 0x7f0ffc0a3a40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10000a7820 tx=0x7f10000e1840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 --2- 172.21.15.5:0/4139972352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51d990 0x555c6c524220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 --2- 172.21.15.5:0/4139972352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c51c2e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 --2- 172.21.15.5:0/4139972352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51cfd0 0x555c6c51d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 -- 172.21.15.5:0/4139972352 >> 172.21.15.5:0/4139972352 conn(0x555c6c490200 msgr2=0x555c6c516bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 -- 172.21.15.5:0/4139972352 shutdown_connections 2023-10-07T00:16:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.123+0000 7f1029450b80 1 -- 172.21.15.5:0/4139972352 wait complete. 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.124+0000 7f1029450b80 1 -- start start 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.124+0000 7f1029450b80 1 Processor -- start 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.125+0000 7f1029450b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51bec0 0x555c6c525b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.125+0000 7f1029450b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c526050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.125+0000 7f1029450b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 0x555c6c52d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.125+0000 7f1029450b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c46edd0 con 0x555c6c51d990 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.125+0000 7f1029450b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c40b6b0 con 0x555c6c51cfd0 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.125+0000 7f1029450b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c40b350 con 0x555c6c51bec0 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.125+0000 7f1029450b80 10 client.0 _ll_register_callbacks cb 0x555c6c2687a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.125+0000 7f100ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51bec0 0x555c6c525b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51bec0 0x555c6c525b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55226/0 (socket says 172.21.15.5:55226) 2023-10-07T00:16:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100ffff700 1 -- 172.21.15.5:0/1239977851 learned_addr learned my addr 172.21.15.5:0/1239977851 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100effd700 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c526050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100ffff700 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 0x555c6c52d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100effd700 1 -- 172.21.15.5:0/1239977851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51bec0 msgr2=0x555c6c525b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100effd700 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51bec0 0x555c6c525b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100effd700 1 -- 172.21.15.5:0/1239977851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 msgr2=0x555c6c52d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100effd700 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 0x555c6c52d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100effd700 1 -- 172.21.15.5:0/1239977851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1008003c50 con 0x555c6c51cfd0 2023-10-07T00:16:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f100effd700 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c526050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800f9d0 tx=0x7f0ff800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b6cd6589f26e51b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.126+0000 7f0feeffd700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:16:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.127+0000 7f0feeffd700 1 -- 172.21.15.5:0/1239977851 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff801c050 con 0x555c6c51cfd0 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.127+0000 7f1029450b80 1 -- 172.21.15.5:0/1239977851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c6c50ed50 con 0x555c6c51cfd0 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.127+0000 7f0feeffd700 1 -- 172.21.15.5:0/1239977851 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0ff8005040 con 0x555c6c51cfd0 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.127+0000 7f0feeffd700 1 -- 172.21.15.5:0/1239977851 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff800bec0 con 0x555c6c51cfd0 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.127+0000 7f1029450b80 10 client.26222 fetch_fsmap learned FSMap version 31 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.127+0000 7f1029450b80 1 -- 172.21.15.5:0/1239977851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x555c6c282c00 con 0x555c6c51cfd0 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.127+0000 7f0feeffd700 1 -- 172.21.15.5:0/1239977851 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ff8031020 con 0x555c6c51cfd0 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.128+0000 7f0feeffd700 1 -- 172.21.15.5:0/1239977851 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0ff8015020 con 0x555c6c51cfd0 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.128+0000 7f1029450b80 10 client.26222 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.128+0000 7f1029450b80 10 client.26222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.128+0000 7f1029450b80 20 client.26222 populate_metadata read hostname 'smithi005' 2023-10-07T00:16:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.128+0000 7f1029450b80 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x555c6c531a60 0x555c6c533e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.128+0000 7f1029450b80 4 client.26222 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:16:35.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.128+0000 7f1029450b80 1 -- 172.21.15.5:0/1239977851 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c6c467db0 con 0x555c6c531a60 2023-10-07T00:16:35.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.128+0000 7f100ffff700 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x555c6c531a60 0x555c6c533e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.129+0000 7f100ffff700 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x555c6c531a60 0x555c6c533e80 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3971ceffd8096e7 server_cookie=bf419afbdb489237 in_seq=0 out_seq=0 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.129+0000 7f0feeffd700 10 client.26222 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.129+0000 7f0feeffd700 1 -- 172.21.15.5:0/1239977851 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555c6c467db0 con 0x555c6c531a60 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.129+0000 7f0feeffd700 10 client.26222 handle_command_reply: tid=0 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.130+0000 7f1029450b80 1 client.26222 shutdown 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.130+0000 7f1029450b80 1 -- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 msgr2=0x555c6c526050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.130+0000 7f1029450b80 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c526050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800f9d0 tx=0x7f0ff800b790 comp rx=0 tx=0).stop 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 1 -- 172.21.15.5:0/1239977851 shutdown_connections 2023-10-07T00:16:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x555c6c531a60 0x555c6c533e80 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 0x555c6c52d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51bec0 0x555c6c525b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 1 --2- 172.21.15.5:0/1239977851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c526050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f0feeffd700 0 client.26222 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 1 -- 172.21.15.5:0/1239977851 >> 172.21.15.5:0/1239977851 conn(0x555c6c490200 msgr2=0x555c6c516250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 1 -- 172.21.15.5:0/1239977851 shutdown_connections 2023-10-07T00:16:35.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 1 -- 172.21.15.5:0/1239977851 wait complete. 2023-10-07T00:16:35.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.131+0000 7f1029450b80 20 client.26222 trim_cache size 0 max 16384 2023-10-07T00:16:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.159+0000 7f1029450b80 1 Processor -- start 2023-10-07T00:16:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.159+0000 7f1029450b80 1 -- start start 2023-10-07T00:16:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f1029450b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51bec0 0x555c6c523d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f1029450b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c52d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f1029450b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51d990 0x555c6c525b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f1029450b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c2ef8c0 con 0x555c6c51bec0 2023-10-07T00:16:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f1029450b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c524f70 con 0x555c6c51cfd0 2023-10-07T00:16:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f1029450b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c50e890 con 0x555c6c51d990 2023-10-07T00:16:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f100effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c52d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f100effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c52d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:51594/0 (socket says 172.21.15.5:51594) 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.160+0000 7f100effd700 1 -- 172.21.15.5:0/1686732335 learned_addr learned my addr 172.21.15.5:0/1686732335 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.161+0000 7f100ffff700 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51bec0 0x555c6c523d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.161+0000 7f100effd700 1 -- 172.21.15.5:0/1686732335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51d990 msgr2=0x555c6c525b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.161+0000 7f100effd700 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51d990 0x555c6c525b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.161+0000 7f100effd700 1 -- 172.21.15.5:0/1686732335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51bec0 msgr2=0x555c6c523d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.161+0000 7f100effd700 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51bec0 0x555c6c523d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.161+0000 7f100effd700 1 -- 172.21.15.5:0/1686732335 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c6c2c01f0 con 0x555c6c51cfd0 2023-10-07T00:16:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.161+0000 7f100ffff700 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51bec0 0x555c6c523d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:16:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.161+0000 7f100effd700 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c52d050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8003bd0 tx=0x7f0ff8009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9b7a9550ac02cd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.162+0000 7f10067fc700 1 -- 172.21.15.5:0/1686732335 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff801c040 con 0x555c6c51cfd0 2023-10-07T00:16:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.162+0000 7f10067fc700 1 -- 172.21.15.5:0/1686732335 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ff8031020 con 0x555c6c51cfd0 2023-10-07T00:16:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.162+0000 7f10067fc700 1 -- 172.21.15.5:0/1686732335 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80226c0 con 0x555c6c51cfd0 2023-10-07T00:16:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 -- 172.21.15.5:0/1686732335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 msgr2=0x555c6c52d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c52d050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8003bd0 tx=0x7f0ff8009fd0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 -- 172.21.15.5:0/1686732335 shutdown_connections 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51d990 0x555c6c525b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51bec0 0x555c6c523d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 --2- 172.21.15.5:0/1686732335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51cfd0 0x555c6c52d050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 -- 172.21.15.5:0/1686732335 >> 172.21.15.5:0/1686732335 conn(0x555c6c490200 msgr2=0x555c6c524860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 -- 172.21.15.5:0/1686732335 shutdown_connections 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.163+0000 7f1029450b80 1 -- 172.21.15.5:0/1686732335 wait complete. 2023-10-07T00:16:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.164+0000 7f1029450b80 1 -- start start 2023-10-07T00:16:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.164+0000 7f1029450b80 1 Processor -- start 2023-10-07T00:16:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.165+0000 7f1029450b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c52a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.165+0000 7f1029450b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51cfd0 0x555c6c52ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.165+0000 7f1029450b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 0x555c6c52bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.165+0000 7f1029450b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c52c080 con 0x555c6c51d990 2023-10-07T00:16:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.165+0000 7f1029450b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c52c1f0 con 0x555c6c51bec0 2023-10-07T00:16:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.165+0000 7f1029450b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c6c52c3b0 con 0x555c6c51cfd0 2023-10-07T00:16:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.166+0000 7f1029450b80 10 client.0 _ll_register_callbacks cb 0x7f0ff800f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:16:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.166+0000 7f100effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51cfd0 0x555c6c52ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.166+0000 7f100ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c52a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.166+0000 7f100effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51cfd0 0x555c6c52ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:55246/0 (socket says 172.21.15.5:55246) 2023-10-07T00:16:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.166+0000 7f100effd700 1 -- 172.21.15.5:0/4103462843 learned_addr learned my addr 172.21.15.5:0/4103462843 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.166+0000 7f100ffff700 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 0x555c6c52bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.167+0000 7f100effd700 1 -- 172.21.15.5:0/4103462843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 msgr2=0x555c6c52a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.167+0000 7f100effd700 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c52a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.167+0000 7f100effd700 1 -- 172.21.15.5:0/4103462843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 msgr2=0x555c6c52bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.167+0000 7f100effd700 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 0x555c6c52bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.167+0000 7f100effd700 1 -- 172.21.15.5:0/4103462843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c6c282c00 con 0x555c6c51cfd0 2023-10-07T00:16:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.167+0000 7f100effd700 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51cfd0 0x555c6c52ab30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8003cf0 tx=0x7f0ff8003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96f15b4123790a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.167+0000 7f0feeffd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:16:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.168+0000 7f0feeffd700 1 -- 172.21.15.5:0/4103462843 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff801c070 con 0x555c6c51cfd0 2023-10-07T00:16:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.168+0000 7f0feeffd700 1 -- 172.21.15.5:0/4103462843 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0ff8032080 con 0x555c6c51cfd0 2023-10-07T00:16:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.168+0000 7f1029450b80 1 -- 172.21.15.5:0/4103462843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f100800f040 con 0x555c6c51cfd0 2023-10-07T00:16:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.168+0000 7f0feeffd700 1 -- 172.21.15.5:0/4103462843 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff803f460 con 0x555c6c51cfd0 2023-10-07T00:16:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.168+0000 7f1029450b80 10 client.26206 fetch_fsmap learned FSMap version 31 2023-10-07T00:16:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.168+0000 7f1029450b80 1 -- 172.21.15.5:0/4103462843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x555c6c298250 con 0x555c6c51cfd0 2023-10-07T00:16:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.169+0000 7f0feeffd700 1 -- 172.21.15.5:0/4103462843 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f100800f040 con 0x555c6c51cfd0 2023-10-07T00:16:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.169+0000 7f0feeffd700 1 -- 172.21.15.5:0/4103462843 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0ff8015070 con 0x555c6c51cfd0 2023-10-07T00:16:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.169+0000 7f1029450b80 10 client.26206 fetch_fsmap finished waiting for FSMap version 31 2023-10-07T00:16:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.169+0000 7f1029450b80 10 client.26206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:16:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.169+0000 7f1029450b80 20 client.26206 populate_metadata read hostname 'smithi005' 2023-10-07T00:16:35.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.169+0000 7f1029450b80 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x555c6c585b60 0x555c6c587f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:35.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.169+0000 7f1029450b80 4 client.26206 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:16:35.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.169+0000 7f1029450b80 1 -- 172.21.15.5:0/4103462843 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555c6c467ad0 con 0x555c6c585b60 2023-10-07T00:16:35.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.170+0000 7f100ffff700 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x555c6c585b60 0x555c6c587f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:35.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.171+0000 7f0feeffd700 10 client.26206 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:35.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.171+0000 7f100ffff700 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x555c6c585b60 0x555c6c587f50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24c9a47a5174a24c server_cookie=5044094e846f351f in_seq=0 out_seq=0 2023-10-07T00:16:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:34 smithi088 ceph-mon[103111]: pgmap v460: 97 pgs: 97 active+clean; 161 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 864 KiB/s wr, 100 op/s 2023-10-07T00:16:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:34 smithi112 ceph-mon[133548]: pgmap v460: 97 pgs: 97 active+clean; 161 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 864 KiB/s wr, 100 op/s 2023-10-07T00:16:35.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f0feeffd700 1 -- 172.21.15.5:0/4103462843 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555c6c467ad0 con 0x555c6c585b60 2023-10-07T00:16:35.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f0feeffd700 10 client.26206 handle_command_reply: tid=0 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 client.26206 shutdown 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 -- 172.21.15.5:0/4103462843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51cfd0 msgr2=0x555c6c52ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51cfd0 0x555c6c52ab30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8003cf0 tx=0x7f0ff8003680 comp rx=0 tx=0).stop 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 -- 172.21.15.5:0/4103462843 shutdown_connections 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x555c6c585b60 0x555c6c587f50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c6c51d990 0x555c6c52bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555c6c51bec0 0x555c6c52a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 --2- 172.21.15.5:0/4103462843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c6c51cfd0 0x555c6c52ab30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f1029450b80 1 -- 172.21.15.5:0/4103462843 >> 172.21.15.5:0/4103462843 conn(0x555c6c490200 msgr2=0x555c6c523d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.431+0000 7f0feeffd700 0 client.26206 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.432+0000 7f1029450b80 1 -- 172.21.15.5:0/4103462843 shutdown_connections 2023-10-07T00:16:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.432+0000 7f1029450b80 1 -- 172.21.15.5:0/4103462843 wait complete. 2023-10-07T00:16:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.432+0000 7f1029450b80 20 client.26206 trim_cache size 0 max 16384 2023-10-07T00:16:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:16:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:16:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:16:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:16:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.433+0000 7f1015bff700 1 -- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0ffc0a1580 msgr2=0x7f0ffc0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.433+0000 7f1015bff700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0ffc0a1580 0x7f0ffc0a3a40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10000a7820 tx=0x7f10000e1840 comp rx=0 tx=0).stop 2023-10-07T00:16:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.433+0000 7f1015bff700 1 -- 172.21.15.5:0/1668693284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100ff770 msgr2=0x7f1010194950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.433+0000 7f1015bff700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100ff770 0x7f1010194950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f100001afd0 tx=0x7f100001d5c0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.434+0000 7f1015bff700 1 -- 172.21.15.5:0/1668693284 shutdown_connections 2023-10-07T00:16:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.434+0000 7f1015bff700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0ffc0a1580 0x7f0ffc0a3a40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.434+0000 7f1015bff700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1010104ab0 0x7f101019bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.434+0000 7f1015bff700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10100ff770 0x7f1010194950 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.434+0000 7f1015bff700 1 --2- 172.21.15.5:0/1668693284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10101020e0 0x7f1010194e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.434+0000 7f1015bff700 1 -- 172.21.15.5:0/1668693284 >> 172.21.15.5:0/1668693284 conn(0x7f10100fb390 msgr2=0x7f10100fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.434+0000 7f1015bff700 1 -- 172.21.15.5:0/1668693284 shutdown_connections 2023-10-07T00:16:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:35.434+0000 7f1015bff700 1 -- 172.21.15.5:0/1668693284 wait complete. 2023-10-07T00:16:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:36 smithi005 ceph-mon[129406]: pgmap v461: 97 pgs: 97 active+clean; 163 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 952 KiB/s wr, 116 op/s 2023-10-07T00:16:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:36 smithi088 ceph-mon[103111]: pgmap v461: 97 pgs: 97 active+clean; 163 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 952 KiB/s wr, 116 op/s 2023-10-07T00:16:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:36 smithi112 ceph-mon[133548]: pgmap v461: 97 pgs: 97 active+clean; 163 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 952 KiB/s wr, 116 op/s 2023-10-07T00:16:37.765 INFO:tasks.workunit.client.0.smithi005.stdout: 34 7482 46 5147 42 692 59 2023-10-07T00:16:39.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:38 smithi005 ceph-mon[129406]: pgmap v462: 97 pgs: 97 active+clean; 164 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 817 KiB/s wr, 102 op/s 2023-10-07T00:16:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:38 smithi088 ceph-mon[103111]: pgmap v462: 97 pgs: 97 active+clean; 164 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 817 KiB/s wr, 102 op/s 2023-10-07T00:16:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:38 smithi112 ceph-mon[133548]: pgmap v462: 97 pgs: 97 active+clean; 164 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 817 KiB/s wr, 102 op/s 2023-10-07T00:16:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:40 smithi005 ceph-mon[129406]: pgmap v463: 97 pgs: 97 active+clean; 165 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 759 KiB/s wr, 103 op/s 2023-10-07T00:16:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:40 smithi088 ceph-mon[103111]: pgmap v463: 97 pgs: 97 active+clean; 165 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 759 KiB/s wr, 103 op/s 2023-10-07T00:16:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:40 smithi112 ceph-mon[133548]: pgmap v463: 97 pgs: 97 active+clean; 165 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 759 KiB/s wr, 103 op/s 2023-10-07T00:16:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:42 smithi005 ceph-mon[129406]: pgmap v464: 97 pgs: 97 active+clean; 167 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 759 KiB/s wr, 113 op/s 2023-10-07T00:16:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:42 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:16:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:42 smithi088 ceph-mon[103111]: pgmap v464: 97 pgs: 97 active+clean; 167 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 759 KiB/s wr, 113 op/s 2023-10-07T00:16:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:42 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:16:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:42 smithi112 ceph-mon[133548]: pgmap v464: 97 pgs: 97 active+clean; 167 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 759 KiB/s wr, 113 op/s 2023-10-07T00:16:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:42 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:16:45.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:44 smithi005 ceph-mon[129406]: pgmap v465: 97 pgs: 97 active+clean; 168 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 751 KiB/s wr, 111 op/s 2023-10-07T00:16:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:44 smithi088 ceph-mon[103111]: pgmap v465: 97 pgs: 97 active+clean; 168 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 751 KiB/s wr, 111 op/s 2023-10-07T00:16:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:44 smithi112 ceph-mon[133548]: pgmap v465: 97 pgs: 97 active+clean; 168 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 751 KiB/s wr, 111 op/s 2023-10-07T00:16:47.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:46 smithi005 ceph-mon[129406]: pgmap v466: 97 pgs: 97 active+clean; 171 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 869 KiB/s wr, 120 op/s 2023-10-07T00:16:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:46 smithi088 ceph-mon[103111]: pgmap v466: 97 pgs: 97 active+clean; 171 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 869 KiB/s wr, 120 op/s 2023-10-07T00:16:47.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:46 smithi112 ceph-mon[133548]: pgmap v466: 97 pgs: 97 active+clean; 171 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 869 KiB/s wr, 120 op/s 2023-10-07T00:16:47.766 INFO:tasks.workunit.client.0.smithi005.stdout: 35 7708 49 5192 33 1401 71 2023-10-07T00:16:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.667+0000 7f32b91ff700 1 -- 172.21.15.5:0/1522225804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b410a820 msgr2=0x7f32b410ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.667+0000 7f32b91ff700 1 --2- 172.21.15.5:0/1522225804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b410a820 0x7f32b410ccb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f32a40098f0 tx=0x7f32a4009c00 comp rx=0 tx=0).stop 2023-10-07T00:16:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.667+0000 7f32b91ff700 1 -- 172.21.15.5:0/1522225804 shutdown_connections 2023-10-07T00:16:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.667+0000 7f32b91ff700 1 --2- 172.21.15.5:0/1522225804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b410d1f0 0x7f32b410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.667+0000 7f32b91ff700 1 --2- 172.21.15.5:0/1522225804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b4107eb0 0x7f32b410a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.667+0000 7f32b91ff700 1 --2- 172.21.15.5:0/1522225804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b410a820 0x7f32b410ccb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.667+0000 7f32b91ff700 1 -- 172.21.15.5:0/1522225804 >> 172.21.15.5:0/1522225804 conn(0x7f32b406dcf0 msgr2=0x7f32b4070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.668+0000 7f32b91ff700 1 -- 172.21.15.5:0/1522225804 shutdown_connections 2023-10-07T00:16:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.668+0000 7f32b91ff700 1 -- 172.21.15.5:0/1522225804 wait complete. 2023-10-07T00:16:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.669+0000 7f32b91ff700 1 Processor -- start 2023-10-07T00:16:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.669+0000 7f32b91ff700 1 -- start start 2023-10-07T00:16:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.670+0000 7f32b91ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b4107eb0 0x7f32b41a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.670+0000 7f32b91ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b410a820 0x7f32b41a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.670+0000 7f32b91ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b410d1f0 0x7f32b41acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.670+0000 7f32b91ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41ad590 con 0x7f32b4107eb0 2023-10-07T00:16:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.670+0000 7f32b91ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41ad6d0 con 0x7f32b410d1f0 2023-10-07T00:16:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.670+0000 7f32b91ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41ad860 con 0x7f32b410a820 2023-10-07T00:16:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.670+0000 7f32b2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b4107eb0 0x7f32b41a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b4107eb0 0x7f32b41a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33636/0 (socket says 172.21.15.5:33636) 2023-10-07T00:16:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b2d9d700 1 -- 172.21.15.5:0/2758583621 learned_addr learned my addr 172.21.15.5:0/2758583621 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b359e700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b410d1f0 0x7f32b41acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b259c700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b410a820 0x7f32b41a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b359e700 1 -- 172.21.15.5:0/2758583621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b410a820 msgr2=0x7f32b41a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b359e700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b410a820 0x7f32b41a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b359e700 1 -- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b4107eb0 msgr2=0x7f32b41a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b359e700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b4107eb0 0x7f32b41a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b359e700 1 -- 172.21.15.5:0/2758583621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4009520 con 0x7f32b410d1f0 2023-10-07T00:16:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.671+0000 7f32b359e700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b410d1f0 0x7f32b41acfc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00efc0 tx=0x7f32ac00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.672+0000 7f329bfff700 1 -- 172.21.15.5:0/2758583621 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac018070 con 0x7f32b410d1f0 2023-10-07T00:16:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.672+0000 7f32b91ff700 1 -- 172.21.15.5:0/2758583621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b41adae0 con 0x7f32b410d1f0 2023-10-07T00:16:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.672+0000 7f329bfff700 1 -- 172.21.15.5:0/2758583621 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32ac00f040 con 0x7f32b410d1f0 2023-10-07T00:16:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.672+0000 7f329bfff700 1 -- 172.21.15.5:0/2758583621 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00cba0 con 0x7f32b410d1f0 2023-10-07T00:16:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.672+0000 7f32b91ff700 1 -- 172.21.15.5:0/2758583621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b41adff0 con 0x7f32b410d1f0 2023-10-07T00:16:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.677+0000 7f329bfff700 1 -- 172.21.15.5:0/2758583621 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f32ac003a00 con 0x7f32b410d1f0 2023-10-07T00:16:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.678+0000 7f32ccbbab80 1 Processor -- start 2023-10-07T00:16:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32ccbbab80 1 -- start start 2023-10-07T00:16:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79222e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7922fd0 0x556dd7923450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd792a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd788a400 con 0x556dd7922fd0 2023-10-07T00:16:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd787bbc0 con 0x556dd7923990 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd78794e0 con 0x556dd7921ec0 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32b259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32b259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79222e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:39584/0 (socket says 172.21.15.5:39584) 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32b259c700 1 -- 172.21.15.5:0/2031585103 learned_addr learned my addr 172.21.15.5:0/2031585103 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.679+0000 7f32b259c700 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd792a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.680+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7922fd0 0x556dd7923450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.680+0000 7f32b259c700 1 -- 172.21.15.5:0/2031585103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 msgr2=0x556dd792a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.680+0000 7f32b259c700 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd792a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.680+0000 7f32b259c700 1 -- 172.21.15.5:0/2031585103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7922fd0 msgr2=0x556dd7923450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.680+0000 7f32b259c700 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7922fd0 0x556dd7923450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.680+0000 7f32b259c700 1 -- 172.21.15.5:0/2031585103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dd769fd80 con 0x556dd7921ec0 2023-10-07T00:16:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.680+0000 7f329bfff700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f329c0a1500 0x7f329c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.681+0000 7f32b259c700 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79222e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f32a40098f0 tx=0x7f32a4019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4647cad88d8ebac5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.681+0000 7f329bfff700 1 -- 172.21.15.5:0/2758583621 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f32ac0cc740 con 0x7f32b410d1f0 2023-10-07T00:16:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.681+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f329c0a1500 0x7f329c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.681+0000 7f32997fa700 1 -- 172.21.15.5:0/2031585103 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400f530 con 0x556dd7921ec0 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.681+0000 7f32997fa700 1 -- 172.21.15.5:0/2031585103 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32a400f690 con 0x556dd7921ec0 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.681+0000 7f32997fa700 1 -- 172.21.15.5:0/2031585103 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40053b0 con 0x556dd7921ec0 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.682+0000 7f32ccbbab80 1 -- 172.21.15.5:0/2031585103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 msgr2=0x556dd79222e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.682+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f329c0a1500 0x7f329c0a39c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009c10 tx=0x7f32a8009240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.682+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79222e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f32a40098f0 tx=0x7f32a4019040 comp rx=0 tx=0).stop 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.683+0000 7f32ccbbab80 1 -- 172.21.15.5:0/2031585103 shutdown_connections 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.683+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd792a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.683+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79222e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.683+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/2031585103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7922fd0 0x556dd7923450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.683+0000 7f32ccbbab80 1 -- 172.21.15.5:0/2031585103 >> 172.21.15.5:0/2031585103 conn(0x556dd7896200 msgr2=0x556dd791cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.683+0000 7f32ccbbab80 1 -- 172.21.15.5:0/2031585103 shutdown_connections 2023-10-07T00:16:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.683+0000 7f32ccbbab80 1 -- 172.21.15.5:0/2031585103 wait complete. 2023-10-07T00:16:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.683+0000 7f32ccbbab80 1 -- start start 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.684+0000 7f32ccbbab80 1 Processor -- start 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7921ec0 0x556dd792bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd792c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd79331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd7874dd0 con 0x556dd7923990 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd78116b0 con 0x556dd7921ec0 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd7811350 con 0x556dd7922fd0 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32ccbbab80 10 client.0 _ll_register_callbacks cb 0x556dd766e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32b359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd79331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32b359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd79331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33660/0 (socket says 172.21.15.5:33660) 2023-10-07T00:16:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32b359e700 1 -- 172.21.15.5:0/3882079474 learned_addr learned my addr 172.21.15.5:0/3882079474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.685+0000 7f32b259c700 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd792c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.686+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7921ec0 0x556dd792bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.686+0000 7f32b259c700 1 -- 172.21.15.5:0/3882079474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7921ec0 msgr2=0x556dd792bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.686+0000 7f32b259c700 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7921ec0 0x556dd792bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.686+0000 7f32b259c700 1 -- 172.21.15.5:0/3882079474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 msgr2=0x556dd79331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.686+0000 7f32b259c700 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd79331d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.686+0000 7f32b259c700 1 -- 172.21.15.5:0/3882079474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a401f040 con 0x556dd7922fd0 2023-10-07T00:16:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.686+0000 7f32b359e700 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd79331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:16:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.686+0000 7f32b259c700 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd792c190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009fd0 tx=0x7f32a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=157039169fa7df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.687+0000 7f3296ff5700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:16:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.687+0000 7f3296ff5700 1 -- 172.21.15.5:0/3882079474 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400f530 con 0x556dd7922fd0 2023-10-07T00:16:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.687+0000 7f3296ff5700 1 -- 172.21.15.5:0/3882079474 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f32a4005130 con 0x556dd7922fd0 2023-10-07T00:16:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.687+0000 7f32ccbbab80 1 -- 172.21.15.5:0/3882079474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556dd7914d50 con 0x556dd7922fd0 2023-10-07T00:16:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.687+0000 7f3296ff5700 1 -- 172.21.15.5:0/3882079474 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32a40052f0 con 0x556dd7922fd0 2023-10-07T00:16:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.688+0000 7f32ccbbab80 10 client.26218 fetch_fsmap learned FSMap version 32 2023-10-07T00:16:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.688+0000 7f32ccbbab80 1 -- 172.21.15.5:0/3882079474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x556dd7688c00 con 0x556dd7922fd0 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.688+0000 7f3296ff5700 1 -- 172.21.15.5:0/3882079474 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556dd7914d50 con 0x556dd7922fd0 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.688+0000 7f3296ff5700 1 -- 172.21.15.5:0/3882079474 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f32a4015020 con 0x556dd7922fd0 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.689+0000 7f32ccbbab80 10 client.26218 fetch_fsmap finished waiting for FSMap version 32 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.689+0000 7f32ccbbab80 10 client.26218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.689+0000 7f32ccbbab80 20 client.26218 populate_metadata read hostname 'smithi005' 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.689+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x556dd7937500 0x556dd7939920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.689+0000 7f32ccbbab80 4 client.26218 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.689+0000 7f32ccbbab80 1 -- 172.21.15.5:0/3882079474 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556dd786ddb0 con 0x556dd7937500 2023-10-07T00:16:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.689+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x556dd7937500 0x556dd7939920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.690+0000 7f3296ff5700 10 client.26218 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.690+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x556dd7937500 0x556dd7939920 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20e63df6d443b1cc server_cookie=551fafdf52299305 in_seq=0 out_seq=0 2023-10-07T00:16:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f3296ff5700 1 -- 172.21.15.5:0/3882079474 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556dd786ddb0 con 0x556dd7937500 2023-10-07T00:16:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f3296ff5700 10 client.26218 handle_command_reply: tid=0 2023-10-07T00:16:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 client.26218 shutdown 2023-10-07T00:16:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 -- 172.21.15.5:0/3882079474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 msgr2=0x556dd792c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd792c190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009fd0 tx=0x7f32a4009c00 comp rx=0 tx=0).stop 2023-10-07T00:16:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 -- 172.21.15.5:0/3882079474 shutdown_connections 2023-10-07T00:16:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x556dd7937500 0x556dd7939920 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd79331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7921ec0 0x556dd792bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/3882079474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd792c190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f32ccbbab80 1 -- 172.21.15.5:0/3882079474 >> 172.21.15.5:0/3882079474 conn(0x556dd7896200 msgr2=0x556dd791c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.691+0000 7f3296ff5700 0 client.26218 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.692+0000 7f32ccbbab80 1 -- 172.21.15.5:0/3882079474 shutdown_connections 2023-10-07T00:16:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.692+0000 7f32ccbbab80 1 -- 172.21.15.5:0/3882079474 wait complete. 2023-10-07T00:16:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.692+0000 7f32ccbbab80 20 client.26218 trim_cache size 0 max 16384 2023-10-07T00:16:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.718+0000 7f32ccbbab80 1 Processor -- start 2023-10-07T00:16:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.718+0000 7f32ccbbab80 1 -- start start 2023-10-07T00:16:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79233b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7922fd0 0x556dd7933190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd792a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd76f58c0 con 0x556dd7923990 2023-10-07T00:16:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd791da00 con 0x556dd7922fd0 2023-10-07T00:16:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd7919860 con 0x556dd7921ec0 2023-10-07T00:16:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32b359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd792a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32b359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd792a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33670/0 (socket says 172.21.15.5:33670) 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32b359e700 1 -- 172.21.15.5:0/1441458135 learned_addr learned my addr 172.21.15.5:0/1441458135 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.719+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.720+0000 7f32b259c700 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7922fd0 0x556dd7933190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.720+0000 7f32b2d9d700 1 -- 172.21.15.5:0/1441458135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7922fd0 msgr2=0x556dd7933190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.720+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7922fd0 0x556dd7933190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.720+0000 7f32b2d9d700 1 -- 172.21.15.5:0/1441458135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 msgr2=0x556dd792a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.720+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd792a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.720+0000 7f32b2d9d700 1 -- 172.21.15.5:0/1441458135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dd76c61f0 con 0x556dd7921ec0 2023-10-07T00:16:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.720+0000 7f32b259c700 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7922fd0 0x556dd7933190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:16:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.720+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79233b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x556dd7939f00 tx=0x7f32a8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc06b72189aa865d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.721+0000 7f3299ffb700 1 -- 172.21.15.5:0/1441458135 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8023830 con 0x556dd7921ec0 2023-10-07T00:16:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.721+0000 7f3299ffb700 1 -- 172.21.15.5:0/1441458135 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32a8023e20 con 0x556dd7921ec0 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.721+0000 7f3299ffb700 1 -- 172.21.15.5:0/1441458135 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8014cf0 con 0x556dd7921ec0 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 -- 172.21.15.5:0/1441458135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 msgr2=0x556dd79233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79233b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x556dd7939f00 tx=0x7f32a8014000 comp rx=0 tx=0).stop 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 -- 172.21.15.5:0/1441458135 shutdown_connections 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7923990 0x556dd792a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7921ec0 0x556dd79233b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/1441458135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7922fd0 0x556dd7933190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 -- 172.21.15.5:0/1441458135 >> 172.21.15.5:0/1441458135 conn(0x556dd7896200 msgr2=0x556dd791c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 -- 172.21.15.5:0/1441458135 shutdown_connections 2023-10-07T00:16:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.722+0000 7f32ccbbab80 1 -- 172.21.15.5:0/1441458135 wait complete. 2023-10-07T00:16:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.723+0000 7f32ccbbab80 1 -- start start 2023-10-07T00:16:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.723+0000 7f32ccbbab80 1 Processor -- start 2023-10-07T00:16:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7921ec0 0x556dd7930c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd7931140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32ccbbab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd7932150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd7932690 con 0x556dd7921ec0 2023-10-07T00:16:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd7932800 con 0x556dd7923990 2023-10-07T00:16:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32ccbbab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd79329c0 con 0x556dd7922fd0 2023-10-07T00:16:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32ccbbab80 10 client.0 _ll_register_callbacks cb 0x7f32a80094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:16:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32b359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd7932150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32b259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd7931140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32b359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd7932150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:34632/0 (socket says 172.21.15.5:34632) 2023-10-07T00:16:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32b359e700 1 -- 172.21.15.5:0/559442546 learned_addr learned my addr 172.21.15.5:0/559442546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:16:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.724+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7921ec0 0x556dd7930c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.725+0000 7f32b259c700 1 -- 172.21.15.5:0/559442546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 msgr2=0x556dd7932150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.725+0000 7f32b259c700 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd7932150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.725+0000 7f32b259c700 1 -- 172.21.15.5:0/559442546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7921ec0 msgr2=0x556dd7930c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.725+0000 7f32b259c700 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7921ec0 0x556dd7930c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.725+0000 7f32b259c700 1 -- 172.21.15.5:0/559442546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a8011890 con 0x556dd7922fd0 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.725+0000 7f32b259c700 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd7931140 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x556dd7811350 tx=0x7f32a4010bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b686040456ce3f37 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.725+0000 7f3296ff5700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.725+0000 7f3296ff5700 1 -- 172.21.15.5:0/559442546 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400f530 con 0x556dd7922fd0 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.726+0000 7f32ccbbab80 1 -- 172.21.15.5:0/559442546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32a400f690 con 0x556dd7922fd0 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.726+0000 7f3296ff5700 1 -- 172.21.15.5:0/559442546 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f32a40052c0 con 0x556dd7922fd0 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.726+0000 7f3296ff5700 1 -- 172.21.15.5:0/559442546 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32a400bbd0 con 0x556dd7922fd0 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.726+0000 7f32ccbbab80 10 client.26224 fetch_fsmap learned FSMap version 32 2023-10-07T00:16:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.726+0000 7f32ccbbab80 1 -- 172.21.15.5:0/559442546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x556dd769e250 con 0x556dd7922fd0 2023-10-07T00:16:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.726+0000 7f3296ff5700 1 -- 172.21.15.5:0/559442546 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32a4044020 con 0x556dd7922fd0 2023-10-07T00:16:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.727+0000 7f3296ff5700 1 -- 172.21.15.5:0/559442546 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f32a4015030 con 0x556dd7922fd0 2023-10-07T00:16:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.727+0000 7f32ccbbab80 10 client.26224 fetch_fsmap finished waiting for FSMap version 32 2023-10-07T00:16:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.727+0000 7f32ccbbab80 10 client.26224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:16:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.727+0000 7f32ccbbab80 20 client.26224 populate_metadata read hostname 'smithi005' 2023-10-07T00:16:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.727+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x556dd798bbc0 0x556dd798dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:16:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.727+0000 7f32ccbbab80 4 client.26224 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:16:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.727+0000 7f32ccbbab80 1 -- 172.21.15.5:0/559442546 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556dd786dad0 con 0x556dd798bbc0 2023-10-07T00:16:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.727+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x556dd798bbc0 0x556dd798dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:16:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.728+0000 7f32b2d9d700 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x556dd798bbc0 0x556dd798dfe0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4a1f880f90059f server_cookie=1e54e89d379436cb in_seq=0 out_seq=0 2023-10-07T00:16:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.728+0000 7f3296ff5700 10 client.26224 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f3296ff5700 1 -- 172.21.15.5:0/559442546 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556dd786dad0 con 0x556dd798bbc0 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f3296ff5700 10 client.26224 handle_command_reply: tid=0 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 client.26224 shutdown 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 -- 172.21.15.5:0/559442546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 msgr2=0x556dd7931140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd7931140 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x556dd7811350 tx=0x7f32a4010bb0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 -- 172.21.15.5:0/559442546 shutdown_connections 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x556dd798bbc0 0x556dd798dfe0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556dd7923990 0x556dd7932150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556dd7921ec0 0x556dd7930c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 --2- 172.21.15.5:0/559442546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556dd7922fd0 0x556dd7931140 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f32ccbbab80 1 -- 172.21.15.5:0/559442546 >> 172.21.15.5:0/559442546 conn(0x556dd7896200 msgr2=0x556dd792a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.758+0000 7f3296ff5700 0 client.26224 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:16:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.759+0000 7f32ccbbab80 1 -- 172.21.15.5:0/559442546 shutdown_connections 2023-10-07T00:16:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.759+0000 7f32ccbbab80 1 -- 172.21.15.5:0/559442546 wait complete. 2023-10-07T00:16:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.760+0000 7f32ccbbab80 20 client.26224 trim_cache size 0 max 16384 2023-10-07T00:16:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:16:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:16:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:16:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.760+0000 7f32b91ff700 1 -- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f329c0a1500 msgr2=0x7f329c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.760+0000 7f32b91ff700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f329c0a1500 0x7f329c0a39c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009c10 tx=0x7f32a8009240 comp rx=0 tx=0).stop 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.760+0000 7f32b91ff700 1 -- 172.21.15.5:0/2758583621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b410d1f0 msgr2=0x7f32b41acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.760+0000 7f32b91ff700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b410d1f0 0x7f32b41acfc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00efc0 tx=0x7f32ac00c3a0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.761+0000 7f32b91ff700 1 -- 172.21.15.5:0/2758583621 shutdown_connections 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.761+0000 7f32b91ff700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f329c0a1500 0x7f329c0a39c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.761+0000 7f32b91ff700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b410d1f0 0x7f32b41acfc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.761+0000 7f32b91ff700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b4107eb0 0x7f32b41a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.761+0000 7f32b91ff700 1 --2- 172.21.15.5:0/2758583621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b410a820 0x7f32b41a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:16:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.761+0000 7f32b91ff700 1 -- 172.21.15.5:0/2758583621 >> 172.21.15.5:0/2758583621 conn(0x7f32b406dcf0 msgr2=0x7f32b4109340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:16:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.761+0000 7f32b91ff700 1 -- 172.21.15.5:0/2758583621 shutdown_connections 2023-10-07T00:16:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:16:48.761+0000 7f32b91ff700 1 -- 172.21.15.5:0/2758583621 wait complete. 2023-10-07T00:16:49.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:48 smithi005 ceph-mon[129406]: pgmap v467: 97 pgs: 97 active+clean; 172 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 868 KiB/s wr, 116 op/s 2023-10-07T00:16:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:48 smithi088 ceph-mon[103111]: pgmap v467: 97 pgs: 97 active+clean; 172 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 868 KiB/s wr, 116 op/s 2023-10-07T00:16:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:48 smithi112 ceph-mon[133548]: pgmap v467: 97 pgs: 97 active+clean; 172 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 868 KiB/s wr, 116 op/s 2023-10-07T00:16:51.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:50 smithi005 ceph-mon[129406]: pgmap v468: 97 pgs: 97 active+clean; 173 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 841 KiB/s wr, 109 op/s 2023-10-07T00:16:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:50 smithi088 ceph-mon[103111]: pgmap v468: 97 pgs: 97 active+clean; 173 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 841 KiB/s wr, 109 op/s 2023-10-07T00:16:51.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:50 smithi112 ceph-mon[133548]: pgmap v468: 97 pgs: 97 active+clean; 173 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 841 KiB/s wr, 109 op/s 2023-10-07T00:16:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:52 smithi088 ceph-mon[103111]: pgmap v469: 97 pgs: 97 active+clean; 171 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 875 KiB/s wr, 110 op/s 2023-10-07T00:16:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:52 smithi112 ceph-mon[133548]: pgmap v469: 97 pgs: 97 active+clean; 171 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 875 KiB/s wr, 110 op/s 2023-10-07T00:16:53.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:52 smithi005 ceph-mon[129406]: pgmap v469: 97 pgs: 97 active+clean; 171 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 875 KiB/s wr, 110 op/s 2023-10-07T00:16:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:54 smithi088 ceph-mon[103111]: pgmap v470: 97 pgs: 97 active+clean; 171 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 823 KiB/s wr, 113 op/s 2023-10-07T00:16:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:54 smithi112 ceph-mon[133548]: pgmap v470: 97 pgs: 97 active+clean; 171 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 823 KiB/s wr, 113 op/s 2023-10-07T00:16:55.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:54 smithi005 ceph-mon[129406]: pgmap v470: 97 pgs: 97 active+clean; 171 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 823 KiB/s wr, 113 op/s 2023-10-07T00:16:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:56 smithi088 ceph-mon[103111]: pgmap v471: 97 pgs: 97 active+clean; 175 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1020 KiB/s wr, 127 op/s 2023-10-07T00:16:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:56 smithi112 ceph-mon[133548]: pgmap v471: 97 pgs: 97 active+clean; 175 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1020 KiB/s wr, 127 op/s 2023-10-07T00:16:57.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:56 smithi005 ceph-mon[129406]: pgmap v471: 97 pgs: 97 active+clean; 175 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1020 KiB/s wr, 127 op/s 2023-10-07T00:16:57.766 INFO:tasks.workunit.client.0.smithi005.stdout: 37 6779 79 4819 33 1532 100 2023-10-07T00:16:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:16:58 smithi088 ceph-mon[103111]: pgmap v472: 97 pgs: 97 active+clean; 176 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 846 KiB/s wr, 114 op/s 2023-10-07T00:16:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:16:58 smithi112 ceph-mon[133548]: pgmap v472: 97 pgs: 97 active+clean; 176 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 846 KiB/s wr, 114 op/s 2023-10-07T00:16:59.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:16:58 smithi005 ceph-mon[129406]: pgmap v472: 97 pgs: 97 active+clean; 176 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 846 KiB/s wr, 114 op/s 2023-10-07T00:17:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:00 smithi088 ceph-mon[103111]: pgmap v473: 97 pgs: 97 active+clean; 177 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 826 KiB/s wr, 108 op/s 2023-10-07T00:17:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:00 smithi112 ceph-mon[133548]: pgmap v473: 97 pgs: 97 active+clean; 177 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 826 KiB/s wr, 108 op/s 2023-10-07T00:17:01.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:00 smithi005 ceph-mon[129406]: pgmap v473: 97 pgs: 97 active+clean; 177 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 826 KiB/s wr, 108 op/s 2023-10-07T00:17:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.989+0000 7f8a19bff700 1 -- 172.21.15.5:0/2577470248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a14100eb0 msgr2=0x7f8a141012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.989+0000 7f8a19bff700 1 --2- 172.21.15.5:0/2577470248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a14100eb0 0x7f8a141012d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009990 tx=0x7f8a04009ca0 comp rx=0 tx=0).stop 2023-10-07T00:17:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.989+0000 7f8a19bff700 1 -- 172.21.15.5:0/2577470248 shutdown_connections 2023-10-07T00:17:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.989+0000 7f8a19bff700 1 --2- 172.21.15.5:0/2577470248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a14102a50 0x7f8a14109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.989+0000 7f8a19bff700 1 --2- 172.21.15.5:0/2577470248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a14100eb0 0x7f8a141012d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.989+0000 7f8a19bff700 1 --2- 172.21.15.5:0/2577470248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a14102090 0x7f8a14102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.989+0000 7f8a19bff700 1 -- 172.21.15.5:0/2577470248 >> 172.21.15.5:0/2577470248 conn(0x7f8a140fc470 msgr2=0x7f8a140fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.990+0000 7f8a19bff700 1 -- 172.21.15.5:0/2577470248 shutdown_connections 2023-10-07T00:17:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.990+0000 7f8a19bff700 1 -- 172.21.15.5:0/2577470248 wait complete. 2023-10-07T00:17:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.991+0000 7f8a19bff700 1 Processor -- start 2023-10-07T00:17:01.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.991+0000 7f8a19bff700 1 -- start start 2023-10-07T00:17:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a19bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a14100eb0 0x7f8a14194920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a19bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a14102090 0x7f8a14194e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a19bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a14102a50 0x7f8a1419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a19bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419c4a0 con 0x7f8a14102090 2023-10-07T00:17:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a19bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419c5e0 con 0x7f8a14100eb0 2023-10-07T00:17:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a19bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419c770 con 0x7f8a14102a50 2023-10-07T00:17:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a14100eb0 0x7f8a14194920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a14100eb0 0x7f8a14194920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:42324/0 (socket says 172.21.15.5:42324) 2023-10-07T00:17:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a137fe700 1 -- 172.21.15.5:0/1453720927 learned_addr learned my addr 172.21.15.5:0/1453720927 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a13fff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a14102a50 0x7f8a1419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.992+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a14102090 0x7f8a14194e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a137fe700 1 -- 172.21.15.5:0/1453720927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a14102a50 msgr2=0x7f8a1419bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a137fe700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a14102a50 0x7f8a1419bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a137fe700 1 -- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a14102090 msgr2=0x7f8a14194e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a137fe700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a14102090 0x7f8a14194e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a137fe700 1 -- 172.21.15.5:0/1453720927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a040095f0 con 0x7f8a14100eb0 2023-10-07T00:17:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a137fe700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a14100eb0 0x7f8a14194920 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a04000c00 tx=0x7f8a04004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a10ff9700 1 -- 172.21.15.5:0/1453720927 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0401d070 con 0x7f8a14100eb0 2023-10-07T00:17:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a10ff9700 1 -- 172.21.15.5:0/1453720927 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a0400bdb0 con 0x7f8a14100eb0 2023-10-07T00:17:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.993+0000 7f8a10ff9700 1 -- 172.21.15.5:0/1453720927 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400fda0 con 0x7f8a14100eb0 2023-10-07T00:17:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.994+0000 7f8a19bff700 1 -- 172.21.15.5:0/1453720927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1419c9f0 con 0x7f8a14100eb0 2023-10-07T00:17:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.994+0000 7f8a19bff700 1 -- 172.21.15.5:0/1453720927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1419cdc0 con 0x7f8a14100eb0 2023-10-07T00:17:02.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:01.999+0000 7f8a10ff9700 1 -- 172.21.15.5:0/1453720927 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8a0400f560 con 0x7f8a14100eb0 2023-10-07T00:17:02.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.000+0000 7f8a2d4e2b80 1 Processor -- start 2023-10-07T00:17:02.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.000+0000 7f8a2d4e2b80 1 -- start start 2023-10-07T00:17:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.001+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89aec0 0x56392d89b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.001+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d89c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.001+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89c990 0x56392d8a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.001+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d803400 con 0x56392d89c990 2023-10-07T00:17:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.001+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d7f4bc0 con 0x56392d89aec0 2023-10-07T00:17:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.001+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d7f24e0 con 0x56392d89bfd0 2023-10-07T00:17:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.002+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89c990 0x56392d8a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.002+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89c990 0x56392d8a3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48070/0 (socket says 172.21.15.5:48070) 2023-10-07T00:17:02.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.002+0000 7f8a12ffd700 1 -- 172.21.15.5:0/3098782434 learned_addr learned my addr 172.21.15.5:0/3098782434 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:02.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.002+0000 7f8a137fe700 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d89c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.002+0000 7f8a13fff700 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89aec0 0x56392d89b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.002+0000 7f8a12ffd700 1 -- 172.21.15.5:0/3098782434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 msgr2=0x56392d89c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.003+0000 7f8a10ff9700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f89fc0a14d0 0x7f89fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.003+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d89c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.003+0000 7f8a12ffd700 1 -- 172.21.15.5:0/3098782434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89aec0 msgr2=0x56392d89b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.003+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89aec0 0x56392d89b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.003+0000 7f8a12ffd700 1 -- 172.21.15.5:0/3098782434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56392d618d80 con 0x56392d89c990 2023-10-07T00:17:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.003+0000 7f8a13fff700 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89aec0 0x56392d89b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:17:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.003+0000 7f8a137fe700 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d89c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:17:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.003+0000 7f8a10ff9700 1 -- 172.21.15.5:0/1453720927 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8a040cdfb0 con 0x7f8a14100eb0 2023-10-07T00:17:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.004+0000 7f8a13fff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f89fc0a14d0 0x7f89fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.004+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89c990 0x56392d8a3220 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009cb0 tx=0x7f8a080113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1eaa73f21858ae server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.004+0000 7f89f9ffb700 1 -- 172.21.15.5:0/3098782434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080097b0 con 0x56392d89c990 2023-10-07T00:17:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.004+0000 7f89f9ffb700 1 -- 172.21.15.5:0/3098782434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a08011c00 con 0x56392d89c990 2023-10-07T00:17:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.004+0000 7f89f9ffb700 1 -- 172.21.15.5:0/3098782434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800f6a0 con 0x56392d89c990 2023-10-07T00:17:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.005+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/3098782434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89c990 msgr2=0x56392d8a3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.005+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89c990 0x56392d8a3220 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009cb0 tx=0x7f8a080113e0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.005+0000 7f8a13fff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f89fc0a14d0 0x7f89fc0a3990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x56392d89ac60 tx=0x7f8a0c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.006+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/3098782434 shutdown_connections 2023-10-07T00:17:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.006+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89c990 0x56392d8a3220 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.006+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89aec0 0x56392d89b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.006+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/3098782434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d89c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.006+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/3098782434 >> 172.21.15.5:0/3098782434 conn(0x56392d80f200 msgr2=0x56392d895bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.006+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/3098782434 shutdown_connections 2023-10-07T00:17:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.006+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/3098782434 wait complete. 2023-10-07T00:17:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.007+0000 7f8a2d4e2b80 1 -- start start 2023-10-07T00:17:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.007+0000 7f8a2d4e2b80 1 Processor -- start 2023-10-07T00:17:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d8a5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d8aa370 0x56392d8ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d7eddd0 con 0x56392d89aec0 2023-10-07T00:17:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d78a6b0 con 0x56392d8aa370 2023-10-07T00:17:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d78a350 con 0x56392d89bfd0 2023-10-07T00:17:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a2d4e2b80 10 client.0 _ll_register_callbacks cb 0x56392d5e77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d8a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8a4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48086/0 (socket says 172.21.15.5:48086) 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a137fe700 1 -- 172.21.15.5:0/2092007577 learned_addr learned my addr 172.21.15.5:0/2092007577 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.008+0000 7f8a13fff700 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d8aa370 0x56392d8ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.009+0000 7f8a137fe700 1 -- 172.21.15.5:0/2092007577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 msgr2=0x56392d8a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.009+0000 7f8a137fe700 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d8a5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.009+0000 7f8a137fe700 1 -- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d8aa370 msgr2=0x56392d8ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.009+0000 7f8a137fe700 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d8aa370 0x56392d8ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.009+0000 7f8a137fe700 1 -- 172.21.15.5:0/2092007577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c003cc0 con 0x56392d89aec0 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.009+0000 7f8a13fff700 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d8aa370 0x56392d8ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:17:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.009+0000 7f8a137fe700 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8a4e00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8a0409b270 tx=0x7f8a0400bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bed8c1da15e38f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.009+0000 7f89f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:17:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.011+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2092007577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0409b0b0 con 0x56392d89aec0 2023-10-07T00:17:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.011+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2092007577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8a0409b9e0 con 0x56392d89aec0 2023-10-07T00:17:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.011+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2092007577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56392d88dd50 con 0x56392d89aec0 2023-10-07T00:17:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2092007577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a0409ae20 con 0x56392d89aec0 2023-10-07T00:17:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f8a2d4e2b80 10 client.16425 fetch_fsmap learned FSMap version 32 2023-10-07T00:17:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2092007577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f8a08009910 con 0x56392d89aec0 2023-10-07T00:17:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2092007577 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56392d88dd50 con 0x56392d89aec0 2023-10-07T00:17:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2092007577 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8a0409a7d0 con 0x56392d89aec0 2023-10-07T00:17:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f8a2d4e2b80 10 client.16425 fetch_fsmap finished waiting for FSMap version 32 2023-10-07T00:17:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f8a2d4e2b80 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f8a2d4e2b80 20 client.16425 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56392d8b0bb0 0x56392d8b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f8a2d4e2b80 4 client.16425 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:17:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.012+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2092007577 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56392d7e6db0 con 0x56392d8b0bb0 2023-10-07T00:17:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.013+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56392d8b0bb0 0x56392d8b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.014+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56392d8b0bb0 0x56392d8b2fa0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e191951433620d4b server_cookie=a2208ab98467b99d in_seq=0 out_seq=0 2023-10-07T00:17:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.014+0000 7f89f2ffd700 10 client.16425 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.016+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2092007577 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56392d7e6db0 con 0x56392d8b0bb0 2023-10-07T00:17:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.016+0000 7f89f2ffd700 10 client.16425 handle_command_reply: tid=0 2023-10-07T00:17:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.016+0000 7f8a2d4e2b80 1 client.16425 shutdown 2023-10-07T00:17:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.016+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2092007577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 msgr2=0x56392d8a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:02.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.016+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8a4e00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8a0409b270 tx=0x7f8a0400bfa0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2092007577 shutdown_connections 2023-10-07T00:17:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56392d8b0bb0 0x56392d8b2fa0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d8aa370 0x56392d8ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8a4e00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2092007577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89bfd0 0x56392d8a5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2092007577 >> 172.21.15.5:0/2092007577 conn(0x56392d80f200 msgr2=0x56392d895250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f89f2ffd700 0 client.16425 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2092007577 shutdown_connections 2023-10-07T00:17:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2092007577 wait complete. 2023-10-07T00:17:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.017+0000 7f8a2d4e2b80 20 client.16425 trim_cache size 0 max 16384 2023-10-07T00:17:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a2d4e2b80 1 Processor -- start 2023-10-07T00:17:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a2d4e2b80 1 -- start start 2023-10-07T00:17:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d8aa370 0x56392d895b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d66e8c0 con 0x56392d89aec0 2023-10-07T00:17:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d88d8f0 con 0x56392d89bfd0 2023-10-07T00:17:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d8c0d10 con 0x56392d8aa370 2023-10-07T00:17:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.044+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.045+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:42348/0 (socket says 172.21.15.5:42348) 2023-10-07T00:17:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.045+0000 7f8a12ffd700 1 -- 172.21.15.5:0/1252361509 learned_addr learned my addr 172.21.15.5:0/1252361509 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.045+0000 7f8a137fe700 1 --2- 172.21.15.5:0/1252361509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.045+0000 7f8a12ffd700 1 -- 172.21.15.5:0/1252361509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d8aa370 msgr2=0x56392d895b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.045+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/1252361509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d8aa370 0x56392d895b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.045+0000 7f8a12ffd700 1 -- 172.21.15.5:0/1252361509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 msgr2=0x56392d8ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.045+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/1252361509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.045+0000 7f8a12ffd700 1 -- 172.21.15.5:0/1252361509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56392d601c00 con 0x56392d89bfd0 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.046+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/1252361509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c07a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009c00 tx=0x7f8a08005ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb11fe40e87a23c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.046+0000 7f89fa7fc700 1 -- 172.21.15.5:0/1252361509 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08011e70 con 0x56392d89bfd0 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.046+0000 7f89fa7fc700 1 -- 172.21.15.5:0/1252361509 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a08029150 con 0x56392d89bfd0 2023-10-07T00:17:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.046+0000 7f89fa7fc700 1 -- 172.21.15.5:0/1252361509 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080127d0 con 0x56392d89bfd0 2023-10-07T00:17:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.047+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/1252361509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 msgr2=0x56392d8c07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.047+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/1252361509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c07a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009c00 tx=0x7f8a08005ce0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.047+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/1252361509 shutdown_connections 2023-10-07T00:17:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.047+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/1252361509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d8aa370 0x56392d895b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.047+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/1252361509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d89aec0 0x56392d8ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.047+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/1252361509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c07a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.047+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/1252361509 >> 172.21.15.5:0/1252361509 conn(0x56392d80f200 msgr2=0x56392d895250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.048+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/1252361509 shutdown_connections 2023-10-07T00:17:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.048+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/1252361509 wait complete. 2023-10-07T00:17:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.048+0000 7f8a2d4e2b80 1 -- start start 2023-10-07T00:17:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.049+0000 7f8a2d4e2b80 1 Processor -- start 2023-10-07T00:17:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.049+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89aec0 0x56392d8bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.049+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.049+0000 7f8a2d4e2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d8aa370 0x56392d903670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.049+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d903bb0 con 0x56392d8aa370 2023-10-07T00:17:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.049+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d903cf0 con 0x56392d89bfd0 2023-10-07T00:17:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.049+0000 7f8a2d4e2b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392d903e80 con 0x56392d89aec0 2023-10-07T00:17:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.049+0000 7f8a2d4e2b80 10 client.0 _ll_register_callbacks cb 0x56392d5e77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.050+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d8aa370 0x56392d903670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.050+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.050+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d8aa370 0x56392d903670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48106/0 (socket says 172.21.15.5:48106) 2023-10-07T00:17:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.050+0000 7f8a13fff700 1 -- 172.21.15.5:0/2102324374 learned_addr learned my addr 172.21.15.5:0/2102324374 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.050+0000 7f8a137fe700 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89aec0 0x56392d8bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.050+0000 7f8a12ffd700 1 -- 172.21.15.5:0/2102324374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89aec0 msgr2=0x56392d8bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.050+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89aec0 0x56392d8bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.050+0000 7f8a12ffd700 1 -- 172.21.15.5:0/2102324374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d8aa370 msgr2=0x56392d903670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.051+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d8aa370 0x56392d903670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.051+0000 7f8a12ffd700 1 -- 172.21.15.5:0/2102324374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56392d618d80 con 0x56392d89bfd0 2023-10-07T00:17:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.051+0000 7f8a12ffd700 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c0280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a0802c040 tx=0x7f8a08011f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41a0d3fcc4f8c667 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.051+0000 7f89f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:17:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.052+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2102324374 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08029d00 con 0x56392d89bfd0 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.052+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2102324374 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8a08012550 con 0x56392d89bfd0 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.052+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2102324374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a08011c00 con 0x56392d89bfd0 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.052+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2102324374 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a08029e60 con 0x56392d89bfd0 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.052+0000 7f8a2d4e2b80 10 client.26258 fetch_fsmap learned FSMap version 32 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.052+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2102324374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56392d63f1f0 con 0x56392d89bfd0 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2102324374 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a08044020 con 0x56392d89bfd0 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2102324374 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8a08022070 con 0x56392d89bfd0 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f8a2d4e2b80 10 client.26258 fetch_fsmap finished waiting for FSMap version 32 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f8a2d4e2b80 10 client.26258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f8a2d4e2b80 20 client.26258 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56392d9054f0 0x56392d907910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f8a2d4e2b80 4 client.26258 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:17:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2102324374 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56392d7e6ad0 con 0x56392d9054f0 2023-10-07T00:17:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.053+0000 7f8a137fe700 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56392d9054f0 0x56392d907910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.054+0000 7f8a137fe700 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56392d9054f0 0x56392d907910 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38dc2c111a322d89 server_cookie=c2c47a1f574c823b in_seq=0 out_seq=0 2023-10-07T00:17:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.054+0000 7f89f2ffd700 10 client.26258 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:02.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f89f2ffd700 1 -- 172.21.15.5:0/2102324374 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56392d7e6ad0 con 0x56392d9054f0 2023-10-07T00:17:02.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f89f2ffd700 10 client.26258 handle_command_reply: tid=0 2023-10-07T00:17:02.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 client.26258 shutdown 2023-10-07T00:17:02.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2102324374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 msgr2=0x56392d8c0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:02.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c0280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a0802c040 tx=0x7f8a08011f00 comp rx=0 tx=0).stop 2023-10-07T00:17:02.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2102324374 shutdown_connections 2023-10-07T00:17:02.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56392d9054f0 0x56392d907910 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56392d8aa370 0x56392d903670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56392d89aec0 0x56392d8bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 --2- 172.21.15.5:0/2102324374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56392d89bfd0 0x56392d8c0280 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2102324374 >> 172.21.15.5:0/2102324374 conn(0x56392d80f200 msgr2=0x56392d8968b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.111+0000 7f89f2ffd700 0 client.26258 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.112+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2102324374 shutdown_connections 2023-10-07T00:17:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.112+0000 7f8a2d4e2b80 1 -- 172.21.15.5:0/2102324374 wait complete. 2023-10-07T00:17:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.112+0000 7f8a2d4e2b80 20 client.26258 trim_cache size 0 max 16384 2023-10-07T00:17:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:17:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:17:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:17:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:17:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 -- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f89fc0a14d0 msgr2=0x7f89fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f89fc0a14d0 0x7f89fc0a3990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x56392d89ac60 tx=0x7f8a0c019040 comp rx=0 tx=0).stop 2023-10-07T00:17:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 -- 172.21.15.5:0/1453720927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a14100eb0 msgr2=0x7f8a14194920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a14100eb0 0x7f8a14194920 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a04000c00 tx=0x7f8a04004730 comp rx=0 tx=0).stop 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 -- 172.21.15.5:0/1453720927 shutdown_connections 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f89fc0a14d0 0x7f89fc0a3990 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a14102a50 0x7f8a1419bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a14100eb0 0x7f8a14194920 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a04000c00 tx=0x7f8a04004730 comp rx=0 tx=0).stop 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 --2- 172.21.15.5:0/1453720927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a14102090 0x7f8a14194e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 -- 172.21.15.5:0/1453720927 >> 172.21.15.5:0/1453720927 conn(0x7f8a140fc470 msgr2=0x7f8a140fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 -- 172.21.15.5:0/1453720927 shutdown_connections 2023-10-07T00:17:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:02.113+0000 7f8a19bff700 1 -- 172.21.15.5:0/1453720927 wait complete. 2023-10-07T00:17:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:02 smithi088 ceph-mon[103111]: pgmap v474: 97 pgs: 97 active+clean; 179 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 890 KiB/s wr, 113 op/s 2023-10-07T00:17:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:02 smithi112 ceph-mon[133548]: pgmap v474: 97 pgs: 97 active+clean; 179 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 890 KiB/s wr, 113 op/s 2023-10-07T00:17:03.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:02 smithi005 ceph-mon[129406]: pgmap v474: 97 pgs: 97 active+clean; 179 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 890 KiB/s wr, 113 op/s 2023-10-07T00:17:05.205 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:04 smithi088 ceph-mon[103111]: pgmap v475: 97 pgs: 97 active+clean; 180 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 853 KiB/s wr, 114 op/s 2023-10-07T00:17:05.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:04 smithi112 ceph-mon[133548]: pgmap v475: 97 pgs: 97 active+clean; 180 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 853 KiB/s wr, 114 op/s 2023-10-07T00:17:05.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:04 smithi005 ceph-mon[129406]: pgmap v475: 97 pgs: 97 active+clean; 180 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 853 KiB/s wr, 114 op/s 2023-10-07T00:17:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:06 smithi088 ceph-mon[103111]: pgmap v476: 97 pgs: 97 active+clean; 183 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 136 op/s 2023-10-07T00:17:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:06 smithi112 ceph-mon[133548]: pgmap v476: 97 pgs: 97 active+clean; 183 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 136 op/s 2023-10-07T00:17:07.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:06 smithi005 ceph-mon[129406]: pgmap v476: 97 pgs: 97 active+clean; 183 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 136 op/s 2023-10-07T00:17:07.766 INFO:tasks.workunit.client.0.smithi005.stdout: 37 7378 108 4828 48 1045 78 2023-10-07T00:17:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:08 smithi088 ceph-mon[103111]: pgmap v477: 97 pgs: 97 active+clean; 184 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 868 KiB/s wr, 118 op/s 2023-10-07T00:17:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:08 smithi112 ceph-mon[133548]: pgmap v477: 97 pgs: 97 active+clean; 184 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 868 KiB/s wr, 118 op/s 2023-10-07T00:17:09.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:08 smithi005 ceph-mon[129406]: pgmap v477: 97 pgs: 97 active+clean; 184 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 868 KiB/s wr, 118 op/s 2023-10-07T00:17:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:10 smithi088 ceph-mon[103111]: pgmap v478: 97 pgs: 97 active+clean; 187 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 1.0 MiB/s wr, 125 op/s 2023-10-07T00:17:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:10 smithi112 ceph-mon[133548]: pgmap v478: 97 pgs: 97 active+clean; 187 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 1.0 MiB/s wr, 125 op/s 2023-10-07T00:17:11.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:10 smithi005 ceph-mon[129406]: pgmap v478: 97 pgs: 97 active+clean; 187 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 1.0 MiB/s wr, 125 op/s 2023-10-07T00:17:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:12 smithi088 ceph-mon[103111]: pgmap v479: 97 pgs: 97 active+clean; 187 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 977 KiB/s wr, 126 op/s 2023-10-07T00:17:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:12 smithi112 ceph-mon[133548]: pgmap v479: 97 pgs: 97 active+clean; 187 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 977 KiB/s wr, 126 op/s 2023-10-07T00:17:13.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:12 smithi005 ceph-mon[129406]: pgmap v479: 97 pgs: 97 active+clean; 187 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 977 KiB/s wr, 126 op/s 2023-10-07T00:17:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:14 smithi088 ceph-mon[103111]: pgmap v480: 97 pgs: 97 active+clean; 189 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 936 KiB/s wr, 118 op/s 2023-10-07T00:17:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:14 smithi112 ceph-mon[133548]: pgmap v480: 97 pgs: 97 active+clean; 189 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 936 KiB/s wr, 118 op/s 2023-10-07T00:17:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 -- 172.21.15.5:0/1963317404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c4102090 msgr2=0x7f10c4102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/1963317404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c4102090 0x7f10c4102510 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009990 tx=0x7f10b4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 -- 172.21.15.5:0/1963317404 shutdown_connections 2023-10-07T00:17:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/1963317404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c4102a50 0x7f10c4109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/1963317404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4100eb0 0x7f10c41012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/1963317404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c4102090 0x7f10c4102510 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 -- 172.21.15.5:0/1963317404 >> 172.21.15.5:0/1963317404 conn(0x7f10c40fc470 msgr2=0x7f10c40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 -- 172.21.15.5:0/1963317404 shutdown_connections 2023-10-07T00:17:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.332+0000 7f10cc1ff700 1 -- 172.21.15.5:0/1963317404 wait complete. 2023-10-07T00:17:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.334+0000 7f10cc1ff700 1 Processor -- start 2023-10-07T00:17:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.334+0000 7f10cc1ff700 1 -- start start 2023-10-07T00:17:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.334+0000 7f10cc1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4100eb0 0x7f10c419d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.334+0000 7f10cc1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c4102090 0x7f10c419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10cc1ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c4102a50 0x7f10c41a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10cc1ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41a4cc0 con 0x7f10c4102a50 2023-10-07T00:17:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10cc1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41a4e00 con 0x7f10c4100eb0 2023-10-07T00:17:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10cc1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41a4f90 con 0x7f10c4102090 2023-10-07T00:17:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c9f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4100eb0 0x7f10c419d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c9f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4100eb0 0x7f10c419d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55416/0 (socket says 172.21.15.5:55416) 2023-10-07T00:17:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c9f9b700 1 -- 172.21.15.5:0/186625538 learned_addr learned my addr 172.21.15.5:0/186625538 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10ca79c700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c4102a50 0x7f10c41a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c979a700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c4102090 0x7f10c419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c9f9b700 1 -- 172.21.15.5:0/186625538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c4102090 msgr2=0x7f10c419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c4102090 0x7f10c419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c9f9b700 1 -- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c4102a50 msgr2=0x7f10c41a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c4102a50 0x7f10c41a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.335+0000 7f10c9f9b700 1 -- 172.21.15.5:0/186625538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40095f0 con 0x7f10c4100eb0 2023-10-07T00:17:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.336+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4100eb0 0x7f10c419d140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f10c000d980 tx=0x7f10c000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.336+0000 7f10baffd700 1 -- 172.21.15.5:0/186625538 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0004020 con 0x7f10c4100eb0 2023-10-07T00:17:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.336+0000 7f10cc1ff700 1 -- 172.21.15.5:0/186625538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c41a5270 con 0x7f10c4100eb0 2023-10-07T00:17:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.336+0000 7f10baffd700 1 -- 172.21.15.5:0/186625538 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10c000f690 con 0x7f10c4100eb0 2023-10-07T00:17:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.336+0000 7f10baffd700 1 -- 172.21.15.5:0/186625538 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00039e0 con 0x7f10c4100eb0 2023-10-07T00:17:15.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.336+0000 7f10cc1ff700 1 -- 172.21.15.5:0/186625538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c41a57d0 con 0x7f10c4100eb0 2023-10-07T00:17:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.343+0000 7f10baffd700 1 -- 172.21.15.5:0/186625538 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f10c000f800 con 0x7f10c4100eb0 2023-10-07T00:17:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.343+0000 7f10dfaa9b80 1 Processor -- start 2023-10-07T00:17:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.343+0000 7f10dfaa9b80 1 -- start start 2023-10-07T00:17:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dcfd0 0x56154f6dd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6e4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f644400 con 0x56154f6dcfd0 2023-10-07T00:17:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f635bc0 con 0x56154f6dbec0 2023-10-07T00:17:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f6334e0 con 0x56154f6dd990 2023-10-07T00:17:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10c979a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10c979a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6e4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:39892/0 (socket says 172.21.15.5:39892) 2023-10-07T00:17:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.344+0000 7f10c979a700 1 -- 172.21.15.5:0/4204462305 learned_addr learned my addr 172.21.15.5:0/4204462305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.345+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/4204462305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dcfd0 0x56154f6dd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.345+0000 7f10c979a700 1 -- 172.21.15.5:0/4204462305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 msgr2=0x56154f6dc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.345+0000 7f10c979a700 1 --2- 172.21.15.5:0/4204462305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.345+0000 7f10c979a700 1 -- 172.21.15.5:0/4204462305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dcfd0 msgr2=0x56154f6dd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.345+0000 7f10c979a700 1 --2- 172.21.15.5:0/4204462305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dcfd0 0x56154f6dd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.345+0000 7f10c979a700 1 -- 172.21.15.5:0/4204462305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56154f459d80 con 0x56154f6dd990 2023-10-07T00:17:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.346+0000 7f10baffd700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10b00a1480 0x7f10b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.346+0000 7f10c979a700 1 --2- 172.21.15.5:0/4204462305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6e4220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009990 tx=0x7f10b4005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce591ce83f907736 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.346+0000 7f10baffd700 1 -- 172.21.15.5:0/186625538 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f10c00cc940 con 0x7f10c4100eb0 2023-10-07T00:17:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.346+0000 7f10ca79c700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10b00a1480 0x7f10b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.346+0000 7f10affff700 1 -- 172.21.15.5:0/4204462305 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b401d070 con 0x56154f6dd990 2023-10-07T00:17:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.346+0000 7f10affff700 1 -- 172.21.15.5:0/4204462305 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10b401e040 con 0x56154f6dd990 2023-10-07T00:17:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.346+0000 7f10affff700 1 -- 172.21.15.5:0/4204462305 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400b710 con 0x56154f6dd990 2023-10-07T00:17:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.347+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/4204462305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 msgr2=0x56154f6e4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.347+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/4204462305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6e4220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009990 tx=0x7f10b4005f00 comp rx=0 tx=0).stop 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.348+0000 7f10ca79c700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10b00a1480 0x7f10b00a3940 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x56154f6dbc60 tx=0x7f10bc009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.348+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/4204462305 shutdown_connections 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.348+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/4204462305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6e4220 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.348+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/4204462305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.348+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/4204462305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dcfd0 0x56154f6dd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.348+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/4204462305 >> 172.21.15.5:0/4204462305 conn(0x56154f650200 msgr2=0x56154f6d6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.348+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/4204462305 shutdown_connections 2023-10-07T00:17:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.348+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/4204462305 wait complete. 2023-10-07T00:17:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.349+0000 7f10dfaa9b80 1 -- start start 2023-10-07T00:17:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.349+0000 7f10dfaa9b80 1 Processor -- start 2023-10-07T00:17:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dbec0 0x56154f6e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f62edd0 con 0x56154f6dbec0 2023-10-07T00:17:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f5cb6b0 con 0x56154f6dcfd0 2023-10-07T00:17:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f5cb350 con 0x56154f6dd990 2023-10-07T00:17:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10dfaa9b80 10 client.0 _ll_register_callbacks cb 0x56154f4287a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10c979a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10c9f9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dbec0 0x56154f6e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10c979a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55430/0 (socket says 172.21.15.5:55430) 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10c979a700 1 -- 172.21.15.5:0/3396362404 learned_addr learned my addr 172.21.15.5:0/3396362404 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.350+0000 7f10ca79c700 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.351+0000 7f10c979a700 1 -- 172.21.15.5:0/3396362404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 msgr2=0x56154f6ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.351+0000 7f10c979a700 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.351+0000 7f10c979a700 1 -- 172.21.15.5:0/3396362404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dbec0 msgr2=0x56154f6e5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.351+0000 7f10c979a700 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dbec0 0x56154f6e5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.351+0000 7f10c979a700 1 -- 172.21.15.5:0/3396362404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c4109ca0 con 0x56154f6dcfd0 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.351+0000 7f10c979a700 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e60a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10b4003f60 tx=0x7f10b4003e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=defcf654e73028ca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.351+0000 7f10ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:17:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.352+0000 7f10ad7fa700 1 -- 172.21.15.5:0/3396362404 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b401d030 con 0x56154f6dcfd0 2023-10-07T00:17:15.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.352+0000 7f10ad7fa700 1 -- 172.21.15.5:0/3396362404 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f10b400b710 con 0x56154f6dcfd0 2023-10-07T00:17:15.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.352+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3396362404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56154f6ced50 con 0x56154f6dcfd0 2023-10-07T00:17:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.352+0000 7f10ad7fa700 1 -- 172.21.15.5:0/3396362404 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10b400b8d0 con 0x56154f6dcfd0 2023-10-07T00:17:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.352+0000 7f10dfaa9b80 10 client.26267 fetch_fsmap learned FSMap version 32 2023-10-07T00:17:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.352+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3396362404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56154f442c00 con 0x56154f6dcfd0 2023-10-07T00:17:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.353+0000 7f10ad7fa700 1 -- 172.21.15.5:0/3396362404 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56154f6ced50 con 0x56154f6dcfd0 2023-10-07T00:17:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.353+0000 7f10ad7fa700 1 -- 172.21.15.5:0/3396362404 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f10b4004bf0 con 0x56154f6dcfd0 2023-10-07T00:17:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.353+0000 7f10dfaa9b80 10 client.26267 fetch_fsmap finished waiting for FSMap version 32 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.353+0000 7f10dfaa9b80 10 client.26267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.353+0000 7f10dfaa9b80 20 client.26267 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.353+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56154f6f1500 0x56154f6f3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.353+0000 7f10dfaa9b80 4 client.26267 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.353+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3396362404 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56154f627db0 con 0x56154f6f1500 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.354+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56154f6f1500 0x56154f6f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.354+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56154f6f1500 0x56154f6f3920 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff77250bd069b1a6 server_cookie=7d82900517723b14 in_seq=0 out_seq=0 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.354+0000 7f10ad7fa700 10 client.26267 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10ad7fa700 1 -- 172.21.15.5:0/3396362404 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56154f627db0 con 0x56154f6f1500 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10ad7fa700 10 client.26267 handle_command_reply: tid=0 2023-10-07T00:17:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 client.26267 shutdown 2023-10-07T00:17:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3396362404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 msgr2=0x56154f6e60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e60a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10b4003f60 tx=0x7f10b4003e70 comp rx=0 tx=0).stop 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3396362404 shutdown_connections 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56154f6f1500 0x56154f6f3920 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dd990 0x56154f6ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dbec0 0x56154f6e5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3396362404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e60a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3396362404 >> 172.21.15.5:0/3396362404 conn(0x56154f650200 msgr2=0x56154f6d6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.355+0000 7f10ad7fa700 0 client.26267 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.356+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3396362404 shutdown_connections 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.356+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3396362404 wait complete. 2023-10-07T00:17:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.356+0000 7f10dfaa9b80 20 client.26267 trim_cache size 0 max 16384 2023-10-07T00:17:15.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:14 smithi005 ceph-mon[129406]: pgmap v480: 97 pgs: 97 active+clean; 189 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 936 KiB/s wr, 118 op/s 2023-10-07T00:17:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.380+0000 7f10dfaa9b80 1 Processor -- start 2023-10-07T00:17:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.380+0000 7f10dfaa9b80 1 -- start start 2023-10-07T00:17:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.380+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.380+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dcfd0 0x56154f6ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.380+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 0x56154f6d7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.380+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f4af8c0 con 0x56154f6dd990 2023-10-07T00:17:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.380+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f6e3b80 con 0x56154f6dbec0 2023-10-07T00:17:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.380+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f6e1490 con 0x56154f6dcfd0 2023-10-07T00:17:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.381+0000 7f10c9f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.381+0000 7f10c9f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:55440/0 (socket says 172.21.15.5:55440) 2023-10-07T00:17:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.381+0000 7f10c9f9b700 1 -- 172.21.15.5:0/3217475424 learned_addr learned my addr 172.21.15.5:0/3217475424 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.381+0000 7f10c9f9b700 1 -- 172.21.15.5:0/3217475424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dcfd0 msgr2=0x56154f6ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.382+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/3217475424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dcfd0 0x56154f6ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.382+0000 7f10c9f9b700 1 -- 172.21.15.5:0/3217475424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 msgr2=0x56154f6d7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.382+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/3217475424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 0x56154f6d7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.382+0000 7f10c9f9b700 1 -- 172.21.15.5:0/3217475424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56154f4801f0 con 0x56154f6dbec0 2023-10-07T00:17:15.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.382+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/3217475424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dd3b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f10c00046a0 tx=0x7f10c0096040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f9910dcf5e15f8a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:15.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.382+0000 7f10b8ff9700 1 -- 172.21.15.5:0/3217475424 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0099540 con 0x56154f6dbec0 2023-10-07T00:17:15.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.382+0000 7f10b8ff9700 1 -- 172.21.15.5:0/3217475424 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10c000fb00 con 0x56154f6dbec0 2023-10-07T00:17:15.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.382+0000 7f10b8ff9700 1 -- 172.21.15.5:0/3217475424 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00a2000 con 0x56154f6dbec0 2023-10-07T00:17:15.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3217475424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 msgr2=0x56154f6dd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3217475424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dd3b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f10c00046a0 tx=0x7f10c0096040 comp rx=0 tx=0).stop 2023-10-07T00:17:15.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3217475424 shutdown_connections 2023-10-07T00:17:15.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3217475424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 0x56154f6d7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3217475424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dbec0 0x56154f6dd3b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/3217475424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dcfd0 0x56154f6ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3217475424 >> 172.21.15.5:0/3217475424 conn(0x56154f650200 msgr2=0x56154f6f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3217475424 shutdown_connections 2023-10-07T00:17:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/3217475424 wait complete. 2023-10-07T00:17:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.384+0000 7f10dfaa9b80 1 -- start start 2023-10-07T00:17:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.385+0000 7f10dfaa9b80 1 Processor -- start 2023-10-07T00:17:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dbec0 0x56154f6e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10dfaa9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 0x56154f6ec420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f6ec960 con 0x56154f6dd990 2023-10-07T00:17:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f6ecad0 con 0x56154f6dcfd0 2023-10-07T00:17:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10dfaa9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154f6ecc90 con 0x56154f6dbec0 2023-10-07T00:17:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10dfaa9b80 10 client.0 _ll_register_callbacks cb 0x7f10c00d2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10c9f9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dbec0 0x56154f6e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10c9f9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dbec0 0x56154f6e8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:39918/0 (socket says 172.21.15.5:39918) 2023-10-07T00:17:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10c9f9b700 1 -- 172.21.15.5:0/1777357620 learned_addr learned my addr 172.21.15.5:0/1777357620 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:15.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.386+0000 7f10ca79c700 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 0x56154f6ec420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10c9f9b700 1 -- 172.21.15.5:0/1777357620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 msgr2=0x56154f6e9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:15.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10c9f9b700 1 -- 172.21.15.5:0/1777357620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 msgr2=0x56154f6ec420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:15.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 0x56154f6ec420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10c9f9b700 1 -- 172.21.15.5:0/1777357620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c00cfe70 con 0x56154f6dbec0 2023-10-07T00:17:15.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10c9f9b700 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dbec0 0x56154f6e8ec0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f10c000d950 tx=0x7f10c00995f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a61bae76ae49c954 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:15.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:17:15.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10ad7fa700 1 -- 172.21.15.5:0/1777357620 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c009a2e0 con 0x56154f6dbec0 2023-10-07T00:17:15.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10ad7fa700 1 -- 172.21.15.5:0/1777357620 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f10c0099e40 con 0x56154f6dbec0 2023-10-07T00:17:15.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.387+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/1777357620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10b401e040 con 0x56154f6dbec0 2023-10-07T00:17:15.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.388+0000 7f10ad7fa700 1 -- 172.21.15.5:0/1777357620 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10c009a000 con 0x56154f6dbec0 2023-10-07T00:17:15.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.388+0000 7f10dfaa9b80 10 client.26254 fetch_fsmap learned FSMap version 32 2023-10-07T00:17:15.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.388+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/1777357620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56154f458250 con 0x56154f6dbec0 2023-10-07T00:17:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.388+0000 7f10ad7fa700 1 -- 172.21.15.5:0/1777357620 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10b401e040 con 0x56154f6dbec0 2023-10-07T00:17:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.388+0000 7f10ad7fa700 1 -- 172.21.15.5:0/1777357620 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f10c00a1b70 con 0x56154f6dbec0 2023-10-07T00:17:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.389+0000 7f10dfaa9b80 10 client.26254 fetch_fsmap finished waiting for FSMap version 32 2023-10-07T00:17:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.389+0000 7f10dfaa9b80 10 client.26254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.389+0000 7f10dfaa9b80 20 client.26254 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.389+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56154f757110 0x56154f759530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.389+0000 7f10dfaa9b80 4 client.26254 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:17:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.389+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/1777357620 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56154f627ad0 con 0x56154f757110 2023-10-07T00:17:15.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.389+0000 7f10c979a700 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56154f757110 0x56154f759530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:15.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.392+0000 7f10c979a700 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56154f757110 0x56154f759530 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcc4fdcd5ed55b51 server_cookie=45a8f87d9a015ad4 in_seq=0 out_seq=0 2023-10-07T00:17:15.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.392+0000 7f10ad7fa700 10 client.26254 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10ad7fa700 1 -- 172.21.15.5:0/1777357620 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56154f627ad0 con 0x56154f757110 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10ad7fa700 10 client.26254 handle_command_reply: tid=0 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 client.26254 shutdown 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/1777357620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dbec0 msgr2=0x56154f6e8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dbec0 0x56154f6e8ec0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f10c000d950 tx=0x7f10c00995f0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/1777357620 shutdown_connections 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56154f757110 0x56154f759530 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56154f6dd990 0x56154f6ec420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56154f6dbec0 0x56154f6e8ec0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 --2- 172.21.15.5:0/1777357620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56154f6dcfd0 0x56154f6e9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/1777357620 >> 172.21.15.5:0/1777357620 conn(0x56154f650200 msgr2=0x56154f6d6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.687+0000 7f10ad7fa700 0 client.26254 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.688+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/1777357620 shutdown_connections 2023-10-07T00:17:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.688+0000 7f10dfaa9b80 1 -- 172.21.15.5:0/1777357620 wait complete. 2023-10-07T00:17:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.688+0000 7f10dfaa9b80 20 client.26254 trim_cache size 0 max 16384 2023-10-07T00:17:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:17:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:17:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:17:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:17:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 -- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10b00a1480 msgr2=0x7f10b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10b00a1480 0x7f10b00a3940 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x56154f6dbc60 tx=0x7f10bc009920 comp rx=0 tx=0).stop 2023-10-07T00:17:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 -- 172.21.15.5:0/186625538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4100eb0 msgr2=0x7f10c419d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4100eb0 0x7f10c419d140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f10c000d980 tx=0x7f10c000dc90 comp rx=0 tx=0).stop 2023-10-07T00:17:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 -- 172.21.15.5:0/186625538 shutdown_connections 2023-10-07T00:17:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f10b00a1480 0x7f10b00a3940 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c4102a50 0x7f10c41a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4100eb0 0x7f10c419d140 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 --2- 172.21.15.5:0/186625538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c4102090 0x7f10c419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.690+0000 7f10cc1ff700 1 -- 172.21.15.5:0/186625538 >> 172.21.15.5:0/186625538 conn(0x7f10c40fc470 msgr2=0x7f10c40fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.691+0000 7f10cc1ff700 1 -- 172.21.15.5:0/186625538 shutdown_connections 2023-10-07T00:17:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:15.691+0000 7f10cc1ff700 1 -- 172.21.15.5:0/186625538 wait complete. 2023-10-07T00:17:16.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:15 smithi112 ceph-mon[133548]: pgmap v481: 97 pgs: 97 active+clean; 192 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.1 MiB/s wr, 137 op/s 2023-10-07T00:17:16.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:15 smithi005 ceph-mon[129406]: pgmap v481: 97 pgs: 97 active+clean; 192 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.1 MiB/s wr, 137 op/s 2023-10-07T00:17:16.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:15 smithi088 ceph-mon[103111]: pgmap v481: 97 pgs: 97 active+clean; 192 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.1 MiB/s wr, 137 op/s 2023-10-07T00:17:17.766 INFO:tasks.workunit.client.0.smithi005.stdout: 38 6275 60 4128 90 1634 74 2023-10-07T00:17:19.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:18 smithi005 ceph-mon[129406]: pgmap v482: 97 pgs: 97 active+clean; 193 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 960 KiB/s wr, 119 op/s 2023-10-07T00:17:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:18 smithi088 ceph-mon[103111]: pgmap v482: 97 pgs: 97 active+clean; 193 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 960 KiB/s wr, 119 op/s 2023-10-07T00:17:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:18 smithi112 ceph-mon[133548]: pgmap v482: 97 pgs: 97 active+clean; 193 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 960 KiB/s wr, 119 op/s 2023-10-07T00:17:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:20 smithi005 ceph-mon[129406]: pgmap v483: 97 pgs: 97 active+clean; 196 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.1 MiB/s wr, 142 op/s 2023-10-07T00:17:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:20 smithi088 ceph-mon[103111]: pgmap v483: 97 pgs: 97 active+clean; 196 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.1 MiB/s wr, 142 op/s 2023-10-07T00:17:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:20 smithi112 ceph-mon[133548]: pgmap v483: 97 pgs: 97 active+clean; 196 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.1 MiB/s wr, 142 op/s 2023-10-07T00:17:23.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:22 smithi005 ceph-mon[129406]: pgmap v484: 97 pgs: 97 active+clean; 197 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 984 KiB/s wr, 137 op/s 2023-10-07T00:17:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:22 smithi088 ceph-mon[103111]: pgmap v484: 97 pgs: 97 active+clean; 197 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 984 KiB/s wr, 137 op/s 2023-10-07T00:17:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:22 smithi112 ceph-mon[133548]: pgmap v484: 97 pgs: 97 active+clean; 197 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 984 KiB/s wr, 137 op/s 2023-10-07T00:17:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:24 smithi005 ceph-mon[129406]: pgmap v485: 97 pgs: 97 active+clean; 198 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 1015 KiB/s wr, 138 op/s 2023-10-07T00:17:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:24 smithi088 ceph-mon[103111]: pgmap v485: 97 pgs: 97 active+clean; 198 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 1015 KiB/s wr, 138 op/s 2023-10-07T00:17:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:24 smithi112 ceph-mon[133548]: pgmap v485: 97 pgs: 97 active+clean; 198 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 1015 KiB/s wr, 138 op/s 2023-10-07T00:17:27.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:26 smithi005 ceph-mon[129406]: pgmap v486: 97 pgs: 97 active+clean; 200 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:17:27.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:26 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:26 smithi088 ceph-mon[103111]: pgmap v486: 97 pgs: 97 active+clean; 200 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:17:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:26 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:26 smithi112 ceph-mon[133548]: pgmap v486: 97 pgs: 97 active+clean; 200 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:17:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:26 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:27.766 INFO:tasks.workunit.client.0.smithi005.stdout: 40 6949 101 5049 27 1350 61 2023-10-07T00:17:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.924+0000 7f0c109ff700 1 -- 172.21.15.5:0/895408970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c0c103110 msgr2=0x7f0c0c103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.924+0000 7f0c109ff700 1 --2- 172.21.15.5:0/895408970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c0c103110 0x7f0c0c103530 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009fc0 tx=0x7f0bfc00b330 comp rx=0 tx=0).stop 2023-10-07T00:17:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.924+0000 7f0c109ff700 1 -- 172.21.15.5:0/895408970 shutdown_connections 2023-10-07T00:17:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.924+0000 7f0c109ff700 1 --2- 172.21.15.5:0/895408970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c104ca0 0x7f0c0c10b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.924+0000 7f0c109ff700 1 --2- 172.21.15.5:0/895408970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c0c103110 0x7f0c0c103530 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.924+0000 7f0c109ff700 1 --2- 172.21.15.5:0/895408970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c0c104300 0x7f0c0c104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.924+0000 7f0c109ff700 1 -- 172.21.15.5:0/895408970 >> 172.21.15.5:0/895408970 conn(0x7f0c0c0fe6a0 msgr2=0x7f0c0c100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.925+0000 7f0c109ff700 1 -- 172.21.15.5:0/895408970 shutdown_connections 2023-10-07T00:17:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.925+0000 7f0c109ff700 1 -- 172.21.15.5:0/895408970 wait complete. 2023-10-07T00:17:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.926+0000 7f0c109ff700 1 Processor -- start 2023-10-07T00:17:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.926+0000 7f0c109ff700 1 -- start start 2023-10-07T00:17:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c109ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c0c103110 0x7f0c0c19d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c109ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c0c104300 0x7f0c0c19d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c109ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c104ca0 0x7f0c0c1a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c109ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c1a4e60 con 0x7f0c0c103110 2023-10-07T00:17:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c109ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c1a4fa0 con 0x7f0c0c104300 2023-10-07T00:17:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c109ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c1a5130 con 0x7f0c0c104ca0 2023-10-07T00:17:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c0ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c104ca0 0x7f0c0c1a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c09d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c0c104300 0x7f0c0c19d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c0ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c104ca0 0x7f0c0c1a4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53906/0 (socket says 172.21.15.5:53906) 2023-10-07T00:17:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.927+0000 7f0c0ad9d700 1 -- 172.21.15.5:0/3687486317 learned_addr learned my addr 172.21.15.5:0/3687486317 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.928+0000 7f0c0a59c700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c0c103110 0x7f0c0c19d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.928+0000 7f0c0ad9d700 1 -- 172.21.15.5:0/3687486317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c0c104300 msgr2=0x7f0c0c19d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.928+0000 7f0c0ad9d700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c0c104300 0x7f0c0c19d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.928+0000 7f0c0ad9d700 1 -- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c0c103110 msgr2=0x7f0c0c19d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.928+0000 7f0c0ad9d700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c0c103110 0x7f0c0c19d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.928+0000 7f0c0ad9d700 1 -- 172.21.15.5:0/3687486317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40095f0 con 0x7f0c0c104ca0 2023-10-07T00:17:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.928+0000 7f0c0ad9d700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c104ca0 0x7f0c0c1a4890 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400eb80 tx=0x7f0bf400ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.929+0000 7f0c037fe700 1 -- 172.21.15.5:0/3687486317 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40099f0 con 0x7f0c0c104ca0 2023-10-07T00:17:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.929+0000 7f0c037fe700 1 -- 172.21.15.5:0/3687486317 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bf40044c0 con 0x7f0c0c104ca0 2023-10-07T00:17:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.929+0000 7f0c037fe700 1 -- 172.21.15.5:0/3687486317 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4010430 con 0x7f0c0c104ca0 2023-10-07T00:17:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.929+0000 7f0c109ff700 1 -- 172.21.15.5:0/3687486317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc009c40 con 0x7f0c0c104ca0 2023-10-07T00:17:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.929+0000 7f0c109ff700 1 -- 172.21.15.5:0/3687486317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c1a5740 con 0x7f0c0c104ca0 2023-10-07T00:17:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.935+0000 7f0c037fe700 1 -- 172.21.15.5:0/3687486317 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0bf4003f10 con 0x7f0c0c104ca0 2023-10-07T00:17:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.937+0000 7f0c24418b80 1 Processor -- start 2023-10-07T00:17:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.937+0000 7f0c24418b80 1 -- start start 2023-10-07T00:17:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 0x55fca0ac0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0ac0990 0x55fca0ac7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c24418b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0a27400 con 0x55fca0abeec0 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c24418b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0a18bc0 con 0x55fca0ac0990 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c24418b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0a164e0 con 0x55fca0abffd0 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c037fe700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0bf80a1650 0x7f0bf80a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c037fe700 1 -- 172.21.15.5:0/3687486317 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0bf4014070 con 0x7f0c0c104ca0 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c09d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c09d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52010/0 (socket says 172.21.15.5:52010) 2023-10-07T00:17:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c09d9b700 1 -- 172.21.15.5:0/1809107664 learned_addr learned my addr 172.21.15.5:0/1809107664 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.938+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0ac0990 0x55fca0ac7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.939+0000 7f0c0ad9d700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0bf80a1650 0x7f0bf80a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.939+0000 7f0c0a59c700 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 0x55fca0ac0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.939+0000 7f0c09d9b700 1 -- 172.21.15.5:0/1809107664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 msgr2=0x55fca0ac0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.939+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 0x55fca0ac0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.939+0000 7f0c09d9b700 1 -- 172.21.15.5:0/1809107664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0ac0990 msgr2=0x55fca0ac7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.939+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0ac0990 0x55fca0ac7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.939+0000 7f0c09d9b700 1 -- 172.21.15.5:0/1809107664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca083cd80 con 0x55fca0abeec0 2023-10-07T00:17:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.940+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abf2e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0c04013910 tx=0x7f0c04009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b121bce7776dd44d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.940+0000 7f0c00ff9700 1 -- 172.21.15.5:0/1809107664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04013170 con 0x55fca0abeec0 2023-10-07T00:17:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.940+0000 7f0c00ff9700 1 -- 172.21.15.5:0/1809107664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c040132d0 con 0x55fca0abeec0 2023-10-07T00:17:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.940+0000 7f0c00ff9700 1 -- 172.21.15.5:0/1809107664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04005690 con 0x55fca0abeec0 2023-10-07T00:17:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.940+0000 7f0c0ad9d700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0bf80a1650 0x7f0bf80a3b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400f010 tx=0x7f0bf40cd200 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.941+0000 7f0c24418b80 1 -- 172.21.15.5:0/1809107664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 msgr2=0x55fca0abf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.941+0000 7f0c24418b80 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abf2e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0c04013910 tx=0x7f0c04009830 comp rx=0 tx=0).stop 2023-10-07T00:17:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.942+0000 7f0c24418b80 1 -- 172.21.15.5:0/1809107664 shutdown_connections 2023-10-07T00:17:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.942+0000 7f0c24418b80 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0ac0990 0x55fca0ac7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.942+0000 7f0c24418b80 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abf2e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.942+0000 7f0c24418b80 1 --2- 172.21.15.5:0/1809107664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 0x55fca0ac0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.942+0000 7f0c24418b80 1 -- 172.21.15.5:0/1809107664 >> 172.21.15.5:0/1809107664 conn(0x55fca0a33200 msgr2=0x55fca0ab9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.942+0000 7f0c24418b80 1 -- 172.21.15.5:0/1809107664 shutdown_connections 2023-10-07T00:17:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.942+0000 7f0c24418b80 1 -- 172.21.15.5:0/1809107664 wait complete. 2023-10-07T00:17:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.943+0000 7f0c24418b80 1 -- start start 2023-10-07T00:17:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.943+0000 7f0c24418b80 1 Processor -- start 2023-10-07T00:17:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abeec0 0x55fca0ac8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 0x55fca0ac90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0ac0990 0x55fca0ad0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c24418b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0a11dd0 con 0x55fca0ac0990 2023-10-07T00:17:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c24418b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca09ae6b0 con 0x55fca0abeec0 2023-10-07T00:17:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c24418b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca09ae350 con 0x55fca0abffd0 2023-10-07T00:17:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c24418b80 10 client.0 _ll_register_callbacks cb 0x55fca080b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c09d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abeec0 0x55fca0ac8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c09d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abeec0 0x55fca0ac8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:50536/0 (socket says 172.21.15.5:50536) 2023-10-07T00:17:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c09d9b700 1 -- 172.21.15.5:0/3138113178 learned_addr learned my addr 172.21.15.5:0/3138113178 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.944+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0ac0990 0x55fca0ad0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.945+0000 7f0c0a59c700 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 0x55fca0ac90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.945+0000 7f0c09d9b700 1 -- 172.21.15.5:0/3138113178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 msgr2=0x55fca0ac90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.945+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 0x55fca0ac90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.945+0000 7f0c09d9b700 1 -- 172.21.15.5:0/3138113178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0ac0990 msgr2=0x55fca0ad0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.945+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0ac0990 0x55fca0ad0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.945+0000 7f0c09d9b700 1 -- 172.21.15.5:0/3138113178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0401b040 con 0x55fca0abeec0 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.946+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abeec0 0x55fca0ac8bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c04004a10 tx=0x7f0c04015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366160840c8a2d3c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.946+0000 7f0bf1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.946+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/3138113178 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04004d40 con 0x55fca0abeec0 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.946+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/3138113178 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0c04004050 con 0x55fca0abeec0 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.946+0000 7f0c24418b80 1 -- 172.21.15.5:0/3138113178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fca0ab1d50 con 0x55fca0abeec0 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/3138113178 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c04004210 con 0x55fca0abeec0 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0c24418b80 10 client.26282 fetch_fsmap learned FSMap version 33 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0c24418b80 1 -- 172.21.15.5:0/3138113178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fca0825c00 con 0x55fca0abeec0 2023-10-07T00:17:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/3138113178 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c04034080 con 0x55fca0abeec0 2023-10-07T00:17:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/3138113178 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 33) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0c0402d030 con 0x55fca0abeec0 2023-10-07T00:17:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0c24418b80 10 client.26282 fetch_fsmap finished waiting for FSMap version 33 2023-10-07T00:17:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0c24418b80 10 client.26282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0c24418b80 20 client.26282 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0c24418b80 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fca0ad4850 0x55fca0ad6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0c24418b80 4 client.26282 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:17:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.947+0000 7f0c24418b80 1 -- 172.21.15.5:0/3138113178 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fca0a0adb0 con 0x55fca0ad4850 2023-10-07T00:17:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.948+0000 7f0c0a59c700 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fca0ad4850 0x55fca0ad6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.948+0000 7f0c0a59c700 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fca0ad4850 0x55fca0ad6c70 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1069a86acfed4dd server_cookie=7af77e143110b5ce in_seq=0 out_seq=0 2023-10-07T00:17:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.948+0000 7f0bf1ffb700 10 client.26282 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.949+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/3138113178 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fca0a0adb0 con 0x55fca0ad4850 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.949+0000 7f0bf1ffb700 10 client.26282 handle_command_reply: tid=0 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.949+0000 7f0c24418b80 1 client.26282 shutdown 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 -- 172.21.15.5:0/3138113178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abeec0 msgr2=0x55fca0ac8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abeec0 0x55fca0ac8bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c04004a10 tx=0x7f0c04015040 comp rx=0 tx=0).stop 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 -- 172.21.15.5:0/3138113178 shutdown_connections 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fca0ad4850 0x55fca0ad6c70 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0ac0990 0x55fca0ad0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abeec0 0x55fca0ac8bb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 --2- 172.21.15.5:0/3138113178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0abffd0 0x55fca0ac90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0bf1ffb700 0 client.26282 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 -- 172.21.15.5:0/3138113178 >> 172.21.15.5:0/3138113178 conn(0x55fca0a33200 msgr2=0x55fca0ab9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 -- 172.21.15.5:0/3138113178 shutdown_connections 2023-10-07T00:17:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.950+0000 7f0c24418b80 1 -- 172.21.15.5:0/3138113178 wait complete. 2023-10-07T00:17:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.951+0000 7f0c24418b80 20 client.26282 trim_cache size 0 max 16384 2023-10-07T00:17:28.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.973+0000 7f0c24418b80 1 Processor -- start 2023-10-07T00:17:28.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.973+0000 7f0c24418b80 1 -- start start 2023-10-07T00:17:28.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.973+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.973+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ad00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.973+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 0x55fca0ab9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.973+0000 7f0c24418b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca08928c0 con 0x55fca0abeec0 2023-10-07T00:17:28.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.973+0000 7f0c24418b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0aba0c0 con 0x55fca0abffd0 2023-10-07T00:17:28.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.973+0000 7f0c24418b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0ac6be0 con 0x55fca0ac0990 2023-10-07T00:17:28.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c09d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c0a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ad00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c0a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ad00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:50548/0 (socket says 172.21.15.5:50548) 2023-10-07T00:17:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c0a59c700 1 -- 172.21.15.5:0/1985881999 learned_addr learned my addr 172.21.15.5:0/1985881999 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/1985881999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 0x55fca0ab9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c09d9b700 1 -- 172.21.15.5:0/1985881999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 msgr2=0x55fca0ab9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/1985881999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 0x55fca0ab9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c09d9b700 1 -- 172.21.15.5:0/1985881999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 msgr2=0x55fca0ad00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/1985881999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ad00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.974+0000 7f0c09d9b700 1 -- 172.21.15.5:0/1985881999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca08631f0 con 0x55fca0abeec0 2023-10-07T00:17:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.975+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/1985881999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abaaa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400f700 tx=0x7f0c04009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d646b99c216f642 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.975+0000 7f0c017fa700 1 -- 172.21.15.5:0/1985881999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04009910 con 0x55fca0abeec0 2023-10-07T00:17:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.975+0000 7f0c017fa700 1 -- 172.21.15.5:0/1985881999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fca0ab1d50 con 0x55fca0abeec0 2023-10-07T00:17:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.975+0000 7f0c017fa700 1 -- 172.21.15.5:0/1985881999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04003b10 con 0x55fca0abeec0 2023-10-07T00:17:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 -- 172.21.15.5:0/1985881999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 msgr2=0x55fca0abaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 --2- 172.21.15.5:0/1985881999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abaaa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400f700 tx=0x7f0c04009830 comp rx=0 tx=0).stop 2023-10-07T00:17:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 -- 172.21.15.5:0/1985881999 shutdown_connections 2023-10-07T00:17:28.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 --2- 172.21.15.5:0/1985881999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 0x55fca0ab9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 --2- 172.21.15.5:0/1985881999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0abaaa0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 --2- 172.21.15.5:0/1985881999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ad00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 -- 172.21.15.5:0/1985881999 >> 172.21.15.5:0/1985881999 conn(0x55fca0a33200 msgr2=0x55fca0ab9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:28.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 -- 172.21.15.5:0/1985881999 shutdown_connections 2023-10-07T00:17:28.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.976+0000 7f0c24418b80 1 -- 172.21.15.5:0/1985881999 wait complete. 2023-10-07T00:17:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.977+0000 7f0c24418b80 1 -- start start 2023-10-07T00:17:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.977+0000 7f0c24418b80 1 Processor -- start 2023-10-07T00:17:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0acdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ace050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c24418b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 0x55fca0acf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c24418b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0acf5a0 con 0x55fca0abeec0 2023-10-07T00:17:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c24418b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0acf710 con 0x55fca0abffd0 2023-10-07T00:17:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c24418b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0acf8d0 con 0x55fca0ac0990 2023-10-07T00:17:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c24418b80 10 client.0 _ll_register_callbacks cb 0x7f0c040050e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c09d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0acdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c09d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0acdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52040/0 (socket says 172.21.15.5:52040) 2023-10-07T00:17:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.978+0000 7f0c09d9b700 1 -- 172.21.15.5:0/790814564 learned_addr learned my addr 172.21.15.5:0/790814564 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.979+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 0x55fca0acf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.979+0000 7f0c0a59c700 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ace050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.979+0000 7f0c09d9b700 1 -- 172.21.15.5:0/790814564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 msgr2=0x55fca0acf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.979+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 0x55fca0acf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.979+0000 7f0c09d9b700 1 -- 172.21.15.5:0/790814564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 msgr2=0x55fca0ace050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.979+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ace050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.979+0000 7f0c09d9b700 1 -- 172.21.15.5:0/790814564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fca0825c00 con 0x55fca0abeec0 2023-10-07T00:17:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.980+0000 7f0c09d9b700 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0acdb10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0c04013270 tx=0x7f0c040058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5950592ceedd3038 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.980+0000 7f0bf1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:17:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.980+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/790814564 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04005190 con 0x55fca0abeec0 2023-10-07T00:17:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.980+0000 7f0c24418b80 1 -- 172.21.15.5:0/790814564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c040132d0 con 0x55fca0abeec0 2023-10-07T00:17:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.980+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/790814564 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0c04000e40 con 0x55fca0abeec0 2023-10-07T00:17:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.981+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/790814564 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c04005c20 con 0x55fca0abeec0 2023-10-07T00:17:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.981+0000 7f0c24418b80 10 client.16464 fetch_fsmap learned FSMap version 33 2023-10-07T00:17:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.981+0000 7f0c24418b80 1 -- 172.21.15.5:0/790814564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fca083b250 con 0x55fca0abeec0 2023-10-07T00:17:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/790814564 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c040132d0 con 0x55fca0abeec0 2023-10-07T00:17:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/790814564 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0c0402d050 con 0x55fca0abeec0 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0c24418b80 10 client.16464 fetch_fsmap finished waiting for FSMap version 33 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0c24418b80 10 client.16464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0c24418b80 20 client.16464 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0c24418b80 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fca0b28b20 0x55fca0b2af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0c24418b80 4 client.16464 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0c24418b80 1 -- 172.21.15.5:0/790814564 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fca0a0aad0 con 0x55fca0b28b20 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.982+0000 7f0c0a59c700 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fca0b28b20 0x55fca0b2af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.983+0000 7f0c0a59c700 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fca0b28b20 0x55fca0b2af40 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e8da606b0e9af25 server_cookie=9cbab6aed976c7e5 in_seq=0 out_seq=0 2023-10-07T00:17:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:28.983+0000 7f0bf1ffb700 10 client.16464 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.020+0000 7f0bf1ffb700 1 -- 172.21.15.5:0/790814564 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fca0a0aad0 con 0x55fca0b28b20 2023-10-07T00:17:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.020+0000 7f0bf1ffb700 10 client.16464 handle_command_reply: tid=0 2023-10-07T00:17:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.020+0000 7f0c24418b80 1 client.16464 shutdown 2023-10-07T00:17:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.020+0000 7f0c24418b80 1 -- 172.21.15.5:0/790814564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 msgr2=0x55fca0acdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.020+0000 7f0c24418b80 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0acdb10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0c04013270 tx=0x7f0c040058e0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.020+0000 7f0c24418b80 1 -- 172.21.15.5:0/790814564 shutdown_connections 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.020+0000 7f0c24418b80 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fca0b28b20 0x55fca0b2af40 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.021+0000 7f0c24418b80 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fca0ac0990 0x55fca0acf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.021+0000 7f0c24418b80 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fca0abeec0 0x55fca0acdb10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.021+0000 7f0c24418b80 1 --2- 172.21.15.5:0/790814564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fca0abffd0 0x55fca0ace050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.021+0000 7f0c24418b80 1 -- 172.21.15.5:0/790814564 >> 172.21.15.5:0/790814564 conn(0x55fca0a33200 msgr2=0x55fca0ab9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.021+0000 7f0bf1ffb700 0 client.16464 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.021+0000 7f0c24418b80 1 -- 172.21.15.5:0/790814564 shutdown_connections 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.021+0000 7f0c24418b80 1 -- 172.21.15.5:0/790814564 wait complete. 2023-10-07T00:17:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.021+0000 7f0c24418b80 20 client.16464 trim_cache size 0 max 16384 2023-10-07T00:17:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:17:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:17:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:17:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 -- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0bf80a1650 msgr2=0x7f0bf80a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0bf80a1650 0x7f0bf80a3b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400f010 tx=0x7f0bf40cd200 comp rx=0 tx=0).stop 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 -- 172.21.15.5:0/3687486317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c104ca0 msgr2=0x7f0c0c1a4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c104ca0 0x7f0c0c1a4890 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400eb80 tx=0x7f0bf400ee90 comp rx=0 tx=0).stop 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 -- 172.21.15.5:0/3687486317 shutdown_connections 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0bf80a1650 0x7f0bf80a3b10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c104ca0 0x7f0c0c1a4890 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c0c103110 0x7f0c0c19d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 --2- 172.21.15.5:0/3687486317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c0c104300 0x7f0c0c19d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 -- 172.21.15.5:0/3687486317 >> 172.21.15.5:0/3687486317 conn(0x7f0c0c0fe6a0 msgr2=0x7f0c0c100950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.022+0000 7f0c109ff700 1 -- 172.21.15.5:0/3687486317 shutdown_connections 2023-10-07T00:17:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:29.023+0000 7f0c109ff700 1 -- 172.21.15.5:0/3687486317 wait complete. 2023-10-07T00:17:29.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:28 smithi005 ceph-mon[129406]: pgmap v487: 97 pgs: 97 active+clean; 202 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 901 KiB/s wr, 130 op/s 2023-10-07T00:17:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:28 smithi088 ceph-mon[103111]: pgmap v487: 97 pgs: 97 active+clean; 202 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 901 KiB/s wr, 130 op/s 2023-10-07T00:17:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:28 smithi112 ceph-mon[133548]: pgmap v487: 97 pgs: 97 active+clean; 202 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 901 KiB/s wr, 130 op/s 2023-10-07T00:17:31.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:30 smithi005 ceph-mon[129406]: pgmap v488: 97 pgs: 97 active+clean; 204 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1023 KiB/s wr, 133 op/s 2023-10-07T00:17:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:30 smithi088 ceph-mon[103111]: pgmap v488: 97 pgs: 97 active+clean; 204 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1023 KiB/s wr, 133 op/s 2023-10-07T00:17:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:30 smithi112 ceph-mon[133548]: pgmap v488: 97 pgs: 97 active+clean; 204 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1023 KiB/s wr, 133 op/s 2023-10-07T00:17:32.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:31 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:32.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:31 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:17:32.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:31 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:32.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:31 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:17:32.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:31 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:32.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:31 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:17:33.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:32 smithi005 ceph-mon[129406]: pgmap v489: 97 pgs: 97 active+clean; 206 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 902 KiB/s wr, 134 op/s 2023-10-07T00:17:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:32 smithi088 ceph-mon[103111]: pgmap v489: 97 pgs: 97 active+clean; 206 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 902 KiB/s wr, 134 op/s 2023-10-07T00:17:33.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:32 smithi112 ceph-mon[133548]: pgmap v489: 97 pgs: 97 active+clean; 206 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 902 KiB/s wr, 134 op/s 2023-10-07T00:17:34.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:33 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:17:34.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:33 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:17:34.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:33 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:17:34.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:33 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:17:34.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:33 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:17:34.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:33 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:17:34.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:33 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:17:34.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:33 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:17:34.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:33 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:17:35.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:34 smithi005 ceph-mon[129406]: pgmap v490: 97 pgs: 97 active+clean; 207 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 1007 KiB/s wr, 145 op/s 2023-10-07T00:17:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:34 smithi088 ceph-mon[103111]: pgmap v490: 97 pgs: 97 active+clean; 207 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 1007 KiB/s wr, 145 op/s 2023-10-07T00:17:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:34 smithi112 ceph-mon[133548]: pgmap v490: 97 pgs: 97 active+clean; 207 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 1007 KiB/s wr, 145 op/s 2023-10-07T00:17:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:36 smithi005 ceph-mon[129406]: pgmap v491: 97 pgs: 97 active+clean; 210 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 1.2 MiB/s wr, 168 op/s 2023-10-07T00:17:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:36 smithi088 ceph-mon[103111]: pgmap v491: 97 pgs: 97 active+clean; 210 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 1.2 MiB/s wr, 168 op/s 2023-10-07T00:17:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:36 smithi112 ceph-mon[133548]: pgmap v491: 97 pgs: 97 active+clean; 210 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 1.2 MiB/s wr, 168 op/s 2023-10-07T00:17:37.766 INFO:tasks.workunit.client.0.smithi005.stdout: 40 5971 84 3941 41 1058 83 2023-10-07T00:17:39.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:38 smithi005 ceph-mon[129406]: pgmap v492: 97 pgs: 97 active+clean; 212 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-10-07T00:17:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:38 smithi088 ceph-mon[103111]: pgmap v492: 97 pgs: 97 active+clean; 212 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-10-07T00:17:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:38 smithi112 ceph-mon[133548]: pgmap v492: 97 pgs: 97 active+clean; 212 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-10-07T00:17:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:40 smithi005 ceph-mon[129406]: pgmap v493: 97 pgs: 97 active+clean; 213 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 1.1 MiB/s wr, 151 op/s 2023-10-07T00:17:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:40 smithi088 ceph-mon[103111]: pgmap v493: 97 pgs: 97 active+clean; 213 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 1.1 MiB/s wr, 151 op/s 2023-10-07T00:17:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:40 smithi112 ceph-mon[133548]: pgmap v493: 97 pgs: 97 active+clean; 213 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 1.1 MiB/s wr, 151 op/s 2023-10-07T00:17:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.244+0000 7f18bdbff700 1 -- 172.21.15.5:0/3349795737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18b8073910 msgr2=0x7f18b8073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.244+0000 7f18bdbff700 1 --2- 172.21.15.5:0/3349795737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18b8073910 0x7f18b8073d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009990 tx=0x7f18a0009ca0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.244+0000 7f18bdbff700 1 -- 172.21.15.5:0/3349795737 shutdown_connections 2023-10-07T00:17:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.244+0000 7f18bdbff700 1 --2- 172.21.15.5:0/3349795737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18b810d4d0 0x7f18b810f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.244+0000 7f18bdbff700 1 --2- 172.21.15.5:0/3349795737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b8074ef0 0x7f18b8073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.244+0000 7f18bdbff700 1 --2- 172.21.15.5:0/3349795737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18b8073910 0x7f18b8073d90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.244+0000 7f18bdbff700 1 -- 172.21.15.5:0/3349795737 >> 172.21.15.5:0/3349795737 conn(0x7f18b80fc470 msgr2=0x7f18b80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.245+0000 7f18bdbff700 1 -- 172.21.15.5:0/3349795737 shutdown_connections 2023-10-07T00:17:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.245+0000 7f18bdbff700 1 -- 172.21.15.5:0/3349795737 wait complete. 2023-10-07T00:17:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.246+0000 7f18bdbff700 1 Processor -- start 2023-10-07T00:17:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.247+0000 7f18bdbff700 1 -- start start 2023-10-07T00:17:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.247+0000 7f18bdbff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b8073910 0x7f18b819d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.247+0000 7f18bdbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18b8074ef0 0x7f18b819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.247+0000 7f18bdbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18b810d4d0 0x7f18b81a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.247+0000 7f18bdbff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81a4ce0 con 0x7f18b8073910 2023-10-07T00:17:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.247+0000 7f18bdbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8104cc0 con 0x7f18b8074ef0 2023-10-07T00:17:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.247+0000 7f18bdbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8104e50 con 0x7f18b810d4d0 2023-10-07T00:17:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18b810d4d0 0x7f18b81a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18b810d4d0 0x7f18b81a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:47306/0 (socket says 172.21.15.5:47306) 2023-10-07T00:17:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18b7fff700 1 -- 172.21.15.5:0/1261390171 learned_addr learned my addr 172.21.15.5:0/1261390171 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18affff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18b8074ef0 0x7f18b819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18b7fff700 1 -- 172.21.15.5:0/1261390171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18b8074ef0 msgr2=0x7f18b819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18b7fff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18b8074ef0 0x7f18b819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18b7fff700 1 -- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b8073910 msgr2=0x7f18b819d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18b7fff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b8073910 0x7f18b819d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.248+0000 7f18b7fff700 1 -- 172.21.15.5:0/1261390171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00095f0 con 0x7f18b810d4d0 2023-10-07T00:17:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.249+0000 7f18b7fff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18b810d4d0 0x7f18b81a4710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f18b0007ee0 tx=0x7f18b000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.249+0000 7f18b57fa700 1 -- 172.21.15.5:0/1261390171 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000ddd0 con 0x7f18b810d4d0 2023-10-07T00:17:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.249+0000 7f18b57fa700 1 -- 172.21.15.5:0/1261390171 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18b000f040 con 0x7f18b810d4d0 2023-10-07T00:17:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.249+0000 7f18b57fa700 1 -- 172.21.15.5:0/1261390171 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00047d0 con 0x7f18b810d4d0 2023-10-07T00:17:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.250+0000 7f18bdbff700 1 -- 172.21.15.5:0/1261390171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b8105130 con 0x7f18b810d4d0 2023-10-07T00:17:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.250+0000 7f18bdbff700 1 -- 172.21.15.5:0/1261390171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b81055f0 con 0x7f18b810d4d0 2023-10-07T00:17:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.254+0000 7f18b57fa700 1 -- 172.21.15.5:0/1261390171 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f18b0003a00 con 0x7f18b810d4d0 2023-10-07T00:17:42.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.255+0000 7f18d15beb80 1 Processor -- start 2023-10-07T00:17:42.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18d15beb80 1 -- start start 2023-10-07T00:17:42.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18b57fa700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18980a15d0 0x7f18980a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38911ec0 0x561c389122e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c38913450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38913990 0x561c3891a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18d15beb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3887a400 con 0x561c38911ec0 2023-10-07T00:17:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18d15beb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3886bbc0 con 0x561c38913990 2023-10-07T00:17:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18d15beb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c388694e0 con 0x561c38912fd0 2023-10-07T00:17:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.256+0000 7f18b57fa700 1 -- 172.21.15.5:0/1261390171 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f18b00cc5c0 con 0x7f18b810d4d0 2023-10-07T00:17:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38911ec0 0x561c389122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38911ec0 0x561c389122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57000/0 (socket says 172.21.15.5:57000) 2023-10-07T00:17:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b77fe700 1 -- 172.21.15.5:0/2461482999 learned_addr learned my addr 172.21.15.5:0/2461482999 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b7fff700 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38913990 0x561c3891a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18affff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18980a15d0 0x7f18980a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18affff700 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c38913450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b77fe700 1 -- 172.21.15.5:0/2461482999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 msgr2=0x561c38913450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b77fe700 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c38913450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b77fe700 1 -- 172.21.15.5:0/2461482999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38913990 msgr2=0x561c3891a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b77fe700 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38913990 0x561c3891a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18b77fe700 1 -- 172.21.15.5:0/2461482999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c3868fd80 con 0x561c38911ec0 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.257+0000 7f18affff700 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c38913450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.258+0000 7f18b77fe700 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38911ec0 0x561c389122e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f18a800bb90 tx=0x7f18a800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7ccc0c027fde9d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.258+0000 7f18affff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18980a15d0 0x7f18980a3a90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f18a000b5c0 tx=0x7f18a001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.259+0000 7f18adffb700 1 -- 172.21.15.5:0/2461482999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8004830 con 0x561c38911ec0 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.259+0000 7f18adffb700 1 -- 172.21.15.5:0/2461482999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18a8004e20 con 0x561c38911ec0 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.259+0000 7f18adffb700 1 -- 172.21.15.5:0/2461482999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8005350 con 0x561c38911ec0 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 -- 172.21.15.5:0/2461482999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38911ec0 msgr2=0x561c389122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38911ec0 0x561c389122e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f18a800bb90 tx=0x7f18a800bea0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 -- 172.21.15.5:0/2461482999 shutdown_connections 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38913990 0x561c3891a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38911ec0 0x561c389122e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2461482999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c38913450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 -- 172.21.15.5:0/2461482999 >> 172.21.15.5:0/2461482999 conn(0x561c38886200 msgr2=0x561c3890cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 -- 172.21.15.5:0/2461482999 shutdown_connections 2023-10-07T00:17:42.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.260+0000 7f18d15beb80 1 -- 172.21.15.5:0/2461482999 wait complete. 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.261+0000 7f18d15beb80 1 -- start start 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.261+0000 7f18d15beb80 1 Processor -- start 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.261+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c3891bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.261+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c3891c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.261+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c389230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.261+0000 7f18d15beb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c38864dd0 con 0x561c38913990 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.261+0000 7f18d15beb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c388016b0 con 0x561c38911ec0 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.261+0000 7f18d15beb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c38801350 con 0x561c38912fd0 2023-10-07T00:17:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.262+0000 7f18d15beb80 10 client.0 _ll_register_callbacks cb 0x561c3865e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.262+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c389230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.262+0000 7f18b77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c3891bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.262+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c389230f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57004/0 (socket says 172.21.15.5:57004) 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.262+0000 7f18b7fff700 1 -- 172.21.15.5:0/435749821 learned_addr learned my addr 172.21.15.5:0/435749821 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.262+0000 7f18affff700 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c3891c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18b7fff700 1 -- 172.21.15.5:0/435749821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 msgr2=0x561c3891c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18b7fff700 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c3891c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18b7fff700 1 -- 172.21.15.5:0/435749821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 msgr2=0x561c3891bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18b7fff700 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c3891bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18b7fff700 1 -- 172.21.15.5:0/435749821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a800b7c0 con 0x561c38913990 2023-10-07T00:17:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18affff700 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c3891c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:17:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18b7fff700 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c389230f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f18b00ca040 tx=0x7f18b0099f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91775f12222b5a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:17:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18a6ffd700 1 -- 172.21.15.5:0/435749821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0099860 con 0x561c38913990 2023-10-07T00:17:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18a6ffd700 1 -- 172.21.15.5:0/435749821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f18b009d9b0 con 0x561c38913990 2023-10-07T00:17:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.263+0000 7f18d15beb80 1 -- 172.21.15.5:0/435749821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c38904d50 con 0x561c38913990 2023-10-07T00:17:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18a6ffd700 1 -- 172.21.15.5:0/435749821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18b00a1bf0 con 0x561c38913990 2023-10-07T00:17:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18d15beb80 10 client.16473 fetch_fsmap learned FSMap version 34 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18d15beb80 1 -- 172.21.15.5:0/435749821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x561c38678c00 con 0x561c38913990 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18a6ffd700 1 -- 172.21.15.5:0/435749821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561c38904d50 con 0x561c38913990 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18a6ffd700 1 -- 172.21.15.5:0/435749821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f18b0004bd0 con 0x561c38913990 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18d15beb80 10 client.16473 fetch_fsmap finished waiting for FSMap version 34 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18d15beb80 10 client.16473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18d15beb80 20 client.16473 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.264+0000 7f18d15beb80 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561c38927910 0x561c38929d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.265+0000 7f18d15beb80 4 client.16473 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.265+0000 7f18d15beb80 1 -- 172.21.15.5:0/435749821 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c3885ddb0 con 0x561c38927910 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.265+0000 7f18b77fe700 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561c38927910 0x561c38929d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.266+0000 7f18b77fe700 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561c38927910 0x561c38929d30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a454de42f3ee2 server_cookie=4d0b3ae884655655 in_seq=0 out_seq=0 2023-10-07T00:17:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.266+0000 7f18a6ffd700 10 client.16473 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.266+0000 7f18a6ffd700 1 -- 172.21.15.5:0/435749821 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c3885ddb0 con 0x561c38927910 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.266+0000 7f18a6ffd700 10 client.16473 handle_command_reply: tid=0 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.266+0000 7f18d15beb80 1 client.16473 shutdown 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 -- 172.21.15.5:0/435749821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 msgr2=0x561c389230f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c389230f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f18b00ca040 tx=0x7f18b0099f60 comp rx=0 tx=0).stop 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 -- 172.21.15.5:0/435749821 shutdown_connections 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561c38927910 0x561c38929d30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c389230f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c3891bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 --2- 172.21.15.5:0/435749821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c3891c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 -- 172.21.15.5:0/435749821 >> 172.21.15.5:0/435749821 conn(0x561c38886200 msgr2=0x561c3890c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18a6ffd700 0 client.16473 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 -- 172.21.15.5:0/435749821 shutdown_connections 2023-10-07T00:17:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 1 -- 172.21.15.5:0/435749821 wait complete. 2023-10-07T00:17:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.267+0000 7f18d15beb80 20 client.16473 trim_cache size 0 max 16384 2023-10-07T00:17:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.288+0000 7f18d15beb80 1 Processor -- start 2023-10-07T00:17:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18d15beb80 1 -- start start 2023-10-07T00:17:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c389133b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c389230b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c3891a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18d15beb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c386e58c0 con 0x561c38913990 2023-10-07T00:17:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18d15beb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c38912740 con 0x561c38911ec0 2023-10-07T00:17:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18d15beb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3891b6e0 con 0x561c38912fd0 2023-10-07T00:17:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18b77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c389133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18b77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c389133b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:48148/0 (socket says 172.21.15.5:48148) 2023-10-07T00:17:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.289+0000 7f18b77fe700 1 -- 172.21.15.5:0/723873441 learned_addr learned my addr 172.21.15.5:0/723873441 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18b7fff700 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c3891a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18affff700 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c389230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18b77fe700 1 -- 172.21.15.5:0/723873441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 msgr2=0x561c389230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18b77fe700 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c389230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18b77fe700 1 -- 172.21.15.5:0/723873441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 msgr2=0x561c3891a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18b77fe700 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c3891a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18b77fe700 1 -- 172.21.15.5:0/723873441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c386b61f0 con 0x561c38911ec0 2023-10-07T00:17:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18b7fff700 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c3891a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:17:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.290+0000 7f18affff700 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c389230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:17:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.291+0000 7f18b77fe700 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c389133b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18a800bb90 tx=0x7f18a8004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89237862cb1b17d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.291+0000 7f18ae7fc700 1 -- 172.21.15.5:0/723873441 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800da10 con 0x561c38911ec0 2023-10-07T00:17:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.291+0000 7f18ae7fc700 1 -- 172.21.15.5:0/723873441 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18a801f040 con 0x561c38911ec0 2023-10-07T00:17:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.291+0000 7f18ae7fc700 1 -- 172.21.15.5:0/723873441 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8025be0 con 0x561c38911ec0 2023-10-07T00:17:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.292+0000 7f18d15beb80 1 -- 172.21.15.5:0/723873441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 msgr2=0x561c389133b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.292+0000 7f18d15beb80 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c389133b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18a800bb90 tx=0x7f18a8004f90 comp rx=0 tx=0).stop 2023-10-07T00:17:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 -- 172.21.15.5:0/723873441 shutdown_connections 2023-10-07T00:17:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38913990 0x561c3891a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c389133b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 --2- 172.21.15.5:0/723873441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38912fd0 0x561c389230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 -- 172.21.15.5:0/723873441 >> 172.21.15.5:0/723873441 conn(0x561c38886200 msgr2=0x561c3890c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 -- 172.21.15.5:0/723873441 shutdown_connections 2023-10-07T00:17:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 -- 172.21.15.5:0/723873441 wait complete. 2023-10-07T00:17:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 -- start start 2023-10-07T00:17:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.293+0000 7f18d15beb80 1 Processor -- start 2023-10-07T00:17:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.294+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c38920b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.294+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38912fd0 0x561c38921050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.294+0000 7f18d15beb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38913990 0x561c38922060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.294+0000 7f18d15beb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c389225a0 con 0x561c38912fd0 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.294+0000 7f18d15beb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c38922710 con 0x561c38911ec0 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.294+0000 7f18d15beb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c389228d0 con 0x561c38913990 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.294+0000 7f18d15beb80 10 client.0 _ll_register_callbacks cb 0x561c3865e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38913990 0x561c38922060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18affff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38912fd0 0x561c38921050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38913990 0x561c38922060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:47354/0 (socket says 172.21.15.5:47354) 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b7fff700 1 -- 172.21.15.5:0/2297675435 learned_addr learned my addr 172.21.15.5:0/2297675435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b77fe700 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c38920b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b7fff700 1 -- 172.21.15.5:0/2297675435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 msgr2=0x561c38920b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b7fff700 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c38920b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b7fff700 1 -- 172.21.15.5:0/2297675435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38912fd0 msgr2=0x561c38921050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b7fff700 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38912fd0 0x561c38921050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.295+0000 7f18b7fff700 1 -- 172.21.15.5:0/2297675435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c3868fd80 con 0x561c38913990 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.296+0000 7f18b7fff700 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38913990 0x561c38922060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f18b00a16c0 tx=0x7f18b0095c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=846a6a183b0f464e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.296+0000 7f18a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.296+0000 7f18a6ffd700 1 -- 172.21.15.5:0/2297675435 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00a19b0 con 0x561c38913990 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.296+0000 7f18a6ffd700 1 -- 172.21.15.5:0/2297675435 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f18b00a1e40 con 0x561c38913990 2023-10-07T00:17:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.296+0000 7f18d15beb80 1 -- 172.21.15.5:0/2297675435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18a8004e20 con 0x561c38913990 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18a6ffd700 1 -- 172.21.15.5:0/2297675435 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18b009d9b0 con 0x561c38913990 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18d15beb80 10 client.26284 fetch_fsmap learned FSMap version 34 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18d15beb80 1 -- 172.21.15.5:0/2297675435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x561c3868e250 con 0x561c38913990 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18a6ffd700 1 -- 172.21.15.5:0/2297675435 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18a8004e20 con 0x561c38913990 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18a6ffd700 1 -- 172.21.15.5:0/2297675435 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 34) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f18b0099be0 con 0x561c38913990 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18d15beb80 10 client.26284 fetch_fsmap finished waiting for FSMap version 34 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18d15beb80 10 client.26284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18d15beb80 20 client.26284 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561c3897c0b0 0x561c3897e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18d15beb80 4 client.26284 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.297+0000 7f18d15beb80 1 -- 172.21.15.5:0/2297675435 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561c3885dad0 con 0x561c3897c0b0 2023-10-07T00:17:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.298+0000 7f18b77fe700 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561c3897c0b0 0x561c3897e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.298+0000 7f18b77fe700 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561c3897c0b0 0x561c3897e4a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=493de93cda40b2b6 server_cookie=21f2f90da5ae8c86 in_seq=0 out_seq=0 2023-10-07T00:17:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.298+0000 7f18a6ffd700 10 client.26284 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.353+0000 7f18a6ffd700 1 -- 172.21.15.5:0/2297675435 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561c3885dad0 con 0x561c3897c0b0 2023-10-07T00:17:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.353+0000 7f18a6ffd700 10 client.26284 handle_command_reply: tid=0 2023-10-07T00:17:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.353+0000 7f18d15beb80 1 client.26284 shutdown 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 -- 172.21.15.5:0/2297675435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38913990 msgr2=0x561c38922060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38913990 0x561c38922060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f18b00a16c0 tx=0x7f18b0095c10 comp rx=0 tx=0).stop 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 -- 172.21.15.5:0/2297675435 shutdown_connections 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561c3897c0b0 0x561c3897e4a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561c38913990 0x561c38922060 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c38911ec0 0x561c38920b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 --2- 172.21.15.5:0/2297675435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c38912fd0 0x561c38921050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 -- 172.21.15.5:0/2297675435 >> 172.21.15.5:0/2297675435 conn(0x561c38886200 msgr2=0x561c38919dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18a6ffd700 0 client.26284 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 -- 172.21.15.5:0/2297675435 shutdown_connections 2023-10-07T00:17:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.354+0000 7f18d15beb80 1 -- 172.21.15.5:0/2297675435 wait complete. 2023-10-07T00:17:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.355+0000 7f18d15beb80 20 client.26284 trim_cache size 0 max 16384 2023-10-07T00:17:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:17:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:17:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:17:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:17:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 -- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18980a15d0 msgr2=0x7f18980a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18980a15d0 0x7f18980a3a90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f18a000b5c0 tx=0x7f18a001a040 comp rx=0 tx=0).stop 2023-10-07T00:17:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 -- 172.21.15.5:0/1261390171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18b810d4d0 msgr2=0x7f18b81a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18b810d4d0 0x7f18b81a4710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f18b0007ee0 tx=0x7f18b000d3b0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 -- 172.21.15.5:0/1261390171 shutdown_connections 2023-10-07T00:17:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f18980a15d0 0x7f18980a3a90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18b810d4d0 0x7f18b81a4710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b8073910 0x7f18b819d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 --2- 172.21.15.5:0/1261390171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18b8074ef0 0x7f18b819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 -- 172.21.15.5:0/1261390171 >> 172.21.15.5:0/1261390171 conn(0x7f18b80fc470 msgr2=0x7f18b80fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 -- 172.21.15.5:0/1261390171 shutdown_connections 2023-10-07T00:17:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:42.356+0000 7f18bdbff700 1 -- 172.21.15.5:0/1261390171 wait complete. 2023-10-07T00:17:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:42 smithi088 ceph-mon[103111]: pgmap v494: 97 pgs: 97 active+clean; 215 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:17:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:42 smithi112 ceph-mon[133548]: pgmap v494: 97 pgs: 97 active+clean; 215 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:17:43.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:42 smithi005 ceph-mon[129406]: pgmap v494: 97 pgs: 97 active+clean; 215 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-07T00:17:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:44 smithi088 ceph-mon[103111]: pgmap v495: 97 pgs: 97 active+clean; 217 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-07T00:17:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:44 smithi112 ceph-mon[133548]: pgmap v495: 97 pgs: 97 active+clean; 217 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-07T00:17:45.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:44 smithi005 ceph-mon[129406]: pgmap v495: 97 pgs: 97 active+clean; 217 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-07T00:17:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:46 smithi088 ceph-mon[103111]: pgmap v496: 97 pgs: 97 active+clean; 220 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2023-10-07T00:17:47.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:46 smithi112 ceph-mon[133548]: pgmap v496: 97 pgs: 97 active+clean; 220 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2023-10-07T00:17:47.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:46 smithi005 ceph-mon[129406]: pgmap v496: 97 pgs: 97 active+clean; 220 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2023-10-07T00:17:47.767 INFO:tasks.workunit.client.0.smithi005.stdout: 40 7005 33 4669 64 1201 96 2023-10-07T00:17:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:48 smithi088 ceph-mon[103111]: pgmap v497: 97 pgs: 97 active+clean; 221 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 989 KiB/s wr, 153 op/s 2023-10-07T00:17:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:48 smithi112 ceph-mon[133548]: pgmap v497: 97 pgs: 97 active+clean; 221 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 989 KiB/s wr, 153 op/s 2023-10-07T00:17:49.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:48 smithi005 ceph-mon[129406]: pgmap v497: 97 pgs: 97 active+clean; 221 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 989 KiB/s wr, 153 op/s 2023-10-07T00:17:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:50 smithi088 ceph-mon[103111]: pgmap v498: 97 pgs: 97 active+clean; 223 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1019 KiB/s wr, 169 op/s 2023-10-07T00:17:51.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:50 smithi112 ceph-mon[133548]: pgmap v498: 97 pgs: 97 active+clean; 223 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1019 KiB/s wr, 169 op/s 2023-10-07T00:17:51.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:50 smithi005 ceph-mon[129406]: pgmap v498: 97 pgs: 97 active+clean; 223 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1019 KiB/s wr, 169 op/s 2023-10-07T00:17:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:52 smithi088 ceph-mon[103111]: pgmap v499: 97 pgs: 97 active+clean; 224 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.0 MiB/s wr, 183 op/s 2023-10-07T00:17:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:52 smithi112 ceph-mon[133548]: pgmap v499: 97 pgs: 97 active+clean; 224 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.0 MiB/s wr, 183 op/s 2023-10-07T00:17:53.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:52 smithi005 ceph-mon[129406]: pgmap v499: 97 pgs: 97 active+clean; 224 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.0 MiB/s wr, 183 op/s 2023-10-07T00:17:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:54 smithi088 ceph-mon[103111]: pgmap v500: 97 pgs: 97 active+clean; 225 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 920 KiB/s wr, 161 op/s 2023-10-07T00:17:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:54 smithi112 ceph-mon[133548]: pgmap v500: 97 pgs: 97 active+clean; 225 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 920 KiB/s wr, 161 op/s 2023-10-07T00:17:55.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:54 smithi005 ceph-mon[129406]: pgmap v500: 97 pgs: 97 active+clean; 225 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 920 KiB/s wr, 161 op/s 2023-10-07T00:17:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.575+0000 7f99067ff700 1 -- 172.21.15.5:0/1018212911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 msgr2=0x7f9900100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.575+0000 7f99067ff700 1 --2- 172.21.15.5:0/1018212911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 0x7f9900100220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98f00099c0 tx=0x7f98f0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.575+0000 7f99067ff700 1 -- 172.21.15.5:0/1018212911 shutdown_connections 2023-10-07T00:17:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.575+0000 7f99067ff700 1 --2- 172.21.15.5:0/1018212911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9900101990 0x7f9900108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.575+0000 7f99067ff700 1 --2- 172.21.15.5:0/1018212911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 0x7f9900100220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.575+0000 7f99067ff700 1 --2- 172.21.15.5:0/1018212911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9900100ff0 0x7f9900101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.575+0000 7f99067ff700 1 -- 172.21.15.5:0/1018212911 >> 172.21.15.5:0/1018212911 conn(0x7f99000fb390 msgr2=0x7f99000fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.576+0000 7f99067ff700 1 -- 172.21.15.5:0/1018212911 shutdown_connections 2023-10-07T00:17:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.576+0000 7f99067ff700 1 -- 172.21.15.5:0/1018212911 wait complete. 2023-10-07T00:17:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.577+0000 7f99067ff700 1 Processor -- start 2023-10-07T00:17:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.577+0000 7f99067ff700 1 -- start start 2023-10-07T00:17:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.577+0000 7f99067ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 0x7f990010a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.577+0000 7f99067ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9900100ff0 0x7f9900108d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f99067ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9900101990 0x7f9900109290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f99067ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990019a970 con 0x7f9900101990 2023-10-07T00:17:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f99067ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99001097d0 con 0x7f99000ffe00 2023-10-07T00:17:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f99067ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9900109990 con 0x7f9900100ff0 2023-10-07T00:17:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f9904d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9900101990 0x7f9900109290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f9904d9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9900101990 0x7f9900109290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56584/0 (socket says 172.21.15.5:56584) 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f9904d9c700 1 -- 172.21.15.5:0/1887315568 learned_addr learned my addr 172.21.15.5:0/1887315568 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f98fffff700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 0x7f990010a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.578+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9900100ff0 0x7f9900108d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.579+0000 7f9904d9c700 1 -- 172.21.15.5:0/1887315568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9900100ff0 msgr2=0x7f9900108d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.579+0000 7f9904d9c700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9900100ff0 0x7f9900108d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.579+0000 7f9904d9c700 1 -- 172.21.15.5:0/1887315568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 msgr2=0x7f990010a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.579+0000 7f9904d9c700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 0x7f990010a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.579+0000 7f9904d9c700 1 -- 172.21.15.5:0/1887315568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00095f0 con 0x7f9900101990 2023-10-07T00:17:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.579+0000 7f98fffff700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 0x7f990010a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:17:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.579+0000 7f9904d9c700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9900101990 0x7f9900109290 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f98f8007d70 tx=0x7f98f800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.579+0000 7f98fd7fa700 1 -- 172.21.15.5:0/1887315568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f800ad40 con 0x7f9900101990 2023-10-07T00:17:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.580+0000 7f98fd7fa700 1 -- 172.21.15.5:0/1887315568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98f80128b0 con 0x7f9900101990 2023-10-07T00:17:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.580+0000 7f98fd7fa700 1 -- 172.21.15.5:0/1887315568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f80115a0 con 0x7f9900101990 2023-10-07T00:17:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.580+0000 7f99067ff700 1 -- 172.21.15.5:0/1887315568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99001a5320 con 0x7f9900101990 2023-10-07T00:17:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.580+0000 7f99067ff700 1 -- 172.21.15.5:0/1887315568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99001a56f0 con 0x7f9900101990 2023-10-07T00:17:55.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.584+0000 7f98fd7fa700 1 -- 172.21.15.5:0/1887315568 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f98f8012a20 con 0x7f9900101990 2023-10-07T00:17:55.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.585+0000 7f991a115b80 1 Processor -- start 2023-10-07T00:17:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.586+0000 7f991a115b80 1 -- start start 2023-10-07T00:17:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.586+0000 7f991a115b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b082fb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.586+0000 7f991a115b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b082fc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.586+0000 7f991a115b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08303220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.586+0000 7f991a115b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b08263400 con 0x560b082faec0 2023-10-07T00:17:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.586+0000 7f991a115b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b08254bc0 con 0x560b082fbfd0 2023-10-07T00:17:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.586+0000 7f991a115b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b082524e0 con 0x560b082fc990 2023-10-07T00:17:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b082fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b082fc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:58936/0 (socket says 172.21.15.5:58936) 2023-10-07T00:17:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98fffff700 1 -- 172.21.15.5:0/928848959 learned_addr learned my addr 172.21.15.5:0/928848959 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08303220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b082fb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98fffff700 1 -- 172.21.15.5:0/928848959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 msgr2=0x560b08303220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98fffff700 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08303220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98fffff700 1 -- 172.21.15.5:0/928848959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 msgr2=0x560b082fb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98fffff700 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b082fb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.587+0000 7f98fffff700 1 -- 172.21.15.5:0/928848959 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b08078d80 con 0x560b082fbfd0 2023-10-07T00:17:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.588+0000 7f98fffff700 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b082fc450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f98f000b580 tx=0x7f98f0005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce7e9ed27be96de server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.588+0000 7f98fd7fa700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f98e80a1500 0x7f98e80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.588+0000 7f98e67fc700 1 -- 172.21.15.5:0/928848959 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f001d050 con 0x560b082fbfd0 2023-10-07T00:17:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.588+0000 7f98e67fc700 1 -- 172.21.15.5:0/928848959 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98f001e040 con 0x560b082fbfd0 2023-10-07T00:17:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.588+0000 7f98e67fc700 1 -- 172.21.15.5:0/928848959 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0004ad0 con 0x560b082fbfd0 2023-10-07T00:17:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.588+0000 7f98fd7fa700 1 -- 172.21.15.5:0/1887315568 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f98f80ccf70 con 0x7f9900101990 2023-10-07T00:17:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.589+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f98e80a1500 0x7f98e80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.589+0000 7f991a115b80 1 -- 172.21.15.5:0/928848959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 msgr2=0x560b082fc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.589+0000 7f991a115b80 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b082fc450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f98f000b580 tx=0x7f98f0005c90 comp rx=0 tx=0).stop 2023-10-07T00:17:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.590+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f98e80a1500 0x7f98e80a39c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x560b082fac60 tx=0x7f98f40058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.590+0000 7f991a115b80 1 -- 172.21.15.5:0/928848959 shutdown_connections 2023-10-07T00:17:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.590+0000 7f991a115b80 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08303220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.590+0000 7f991a115b80 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b082fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.590+0000 7f991a115b80 1 --2- 172.21.15.5:0/928848959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b082fc450 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.590+0000 7f991a115b80 1 -- 172.21.15.5:0/928848959 >> 172.21.15.5:0/928848959 conn(0x560b0826f200 msgr2=0x560b082f5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.590+0000 7f991a115b80 1 -- 172.21.15.5:0/928848959 shutdown_connections 2023-10-07T00:17:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.590+0000 7f991a115b80 1 -- 172.21.15.5:0/928848959 wait complete. 2023-10-07T00:17:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.591+0000 7f991a115b80 1 -- start start 2023-10-07T00:17:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.591+0000 7f991a115b80 1 Processor -- start 2023-10-07T00:17:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.592+0000 7f991a115b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08304ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.592+0000 7f991a115b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fbfd0 0x560b08304ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.592+0000 7f991a115b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fc990 0x560b0830c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.592+0000 7f991a115b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b0824ddd0 con 0x560b082faec0 2023-10-07T00:17:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.592+0000 7f991a115b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b081ea6b0 con 0x560b082fc990 2023-10-07T00:17:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.592+0000 7f991a115b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b081ea350 con 0x560b082fbfd0 2023-10-07T00:17:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.592+0000 7f991a115b80 10 client.0 _ll_register_callbacks cb 0x560b080477a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.592+0000 7f98ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fbfd0 0x560b08304ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fbfd0 0x560b08304ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:58280/0 (socket says 172.21.15.5:58280) 2023-10-07T00:17:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98ff7fe700 1 -- 172.21.15.5:0/2914654357 learned_addr learned my addr 172.21.15.5:0/2914654357 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f9904d9c700 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fc990 0x560b0830c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98fffff700 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08304ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98ff7fe700 1 -- 172.21.15.5:0/2914654357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fc990 msgr2=0x560b0830c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fc990 0x560b0830c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98ff7fe700 1 -- 172.21.15.5:0/2914654357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 msgr2=0x560b08304ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08304ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98ff7fe700 1 -- 172.21.15.5:0/2914654357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9900068440 con 0x560b082fbfd0 2023-10-07T00:17:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.593+0000 7f98fffff700 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08304ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:17:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.594+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fbfd0 0x560b08304ff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f98f4011c60 tx=0x7f98f40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af17bc8942595b64 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.594+0000 7f98df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:17:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.594+0000 7f98df7fe700 1 -- 172.21.15.5:0/2914654357 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4012ea0 con 0x560b082fbfd0 2023-10-07T00:17:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.594+0000 7f991a115b80 1 -- 172.21.15.5:0/2914654357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b082edd50 con 0x560b082fbfd0 2023-10-07T00:17:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.594+0000 7f98df7fe700 1 -- 172.21.15.5:0/2914654357 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f98f400fc60 con 0x560b082fbfd0 2023-10-07T00:17:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.594+0000 7f98df7fe700 1 -- 172.21.15.5:0/2914654357 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98f400fe60 con 0x560b082fbfd0 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.595+0000 7f991a115b80 10 client.26296 fetch_fsmap learned FSMap version 35 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.595+0000 7f991a115b80 1 -- 172.21.15.5:0/2914654357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x560b08061c00 con 0x560b082fbfd0 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.595+0000 7f98df7fe700 1 -- 172.21.15.5:0/2914654357 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560b082edd50 con 0x560b082fbfd0 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.595+0000 7f98df7fe700 1 -- 172.21.15.5:0/2914654357 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 35) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f98f4026030 con 0x560b082fbfd0 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.596+0000 7f991a115b80 10 client.26296 fetch_fsmap finished waiting for FSMap version 35 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.596+0000 7f991a115b80 10 client.26296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.596+0000 7f991a115b80 20 client.26296 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.596+0000 7f991a115b80 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560b083109e0 0x560b08312e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.596+0000 7f991a115b80 4 client.26296 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:17:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.596+0000 7f991a115b80 1 -- 172.21.15.5:0/2914654357 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b08246db0 con 0x560b083109e0 2023-10-07T00:17:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.596+0000 7f98fffff700 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560b083109e0 0x560b08312e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.598+0000 7f98fffff700 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560b083109e0 0x560b08312e20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cd19263527dfcf2 server_cookie=994f4d48e57b1ae7 in_seq=0 out_seq=0 2023-10-07T00:17:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.598+0000 7f98df7fe700 10 client.26296 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.599+0000 7f98df7fe700 1 -- 172.21.15.5:0/2914654357 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560b08246db0 con 0x560b083109e0 2023-10-07T00:17:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.599+0000 7f98df7fe700 10 client.26296 handle_command_reply: tid=0 2023-10-07T00:17:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.599+0000 7f991a115b80 1 client.26296 shutdown 2023-10-07T00:17:55.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 -- 172.21.15.5:0/2914654357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fbfd0 msgr2=0x560b08304ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fbfd0 0x560b08304ff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f98f4011c60 tx=0x7f98f40047c0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 -- 172.21.15.5:0/2914654357 shutdown_connections 2023-10-07T00:17:55.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560b083109e0 0x560b08312e20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fc990 0x560b0830c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08304ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 --2- 172.21.15.5:0/2914654357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fbfd0 0x560b08304ff0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f98df7fe700 0 client.26296 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 -- 172.21.15.5:0/2914654357 >> 172.21.15.5:0/2914654357 conn(0x560b0826f200 msgr2=0x560b082f5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.600+0000 7f991a115b80 1 -- 172.21.15.5:0/2914654357 shutdown_connections 2023-10-07T00:17:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.601+0000 7f991a115b80 1 -- 172.21.15.5:0/2914654357 wait complete. 2023-10-07T00:17:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.601+0000 7f991a115b80 20 client.26296 trim_cache size 0 max 16384 2023-10-07T00:17:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.632+0000 7f991a115b80 1 Processor -- start 2023-10-07T00:17:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.633+0000 7f991a115b80 1 -- start start 2023-10-07T00:17:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.633+0000 7f991a115b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b082f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.633+0000 7f991a115b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b0830bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.633+0000 7f991a115b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08302d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.633+0000 7f991a115b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b080ce8c0 con 0x560b082faec0 2023-10-07T00:17:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.633+0000 7f991a115b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b08305730 con 0x560b082fbfd0 2023-10-07T00:17:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.633+0000 7f991a115b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b08302ad0 con 0x560b082fc990 2023-10-07T00:17:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.634+0000 7f9904d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08302d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.634+0000 7f98ff7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b0830bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.634+0000 7f98fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b082f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.634+0000 7f98ff7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b0830bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:58950/0 (socket says 172.21.15.5:58950) 2023-10-07T00:17:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.634+0000 7f9904d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08302d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:58292/0 (socket says 172.21.15.5:58292) 2023-10-07T00:17:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.634+0000 7f98ff7fe700 1 -- 172.21.15.5:0/470095219 learned_addr learned my addr 172.21.15.5:0/470095219 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.635+0000 7f98ff7fe700 1 -- 172.21.15.5:0/470095219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 msgr2=0x560b08302d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.635+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/470095219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08302d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.635+0000 7f98ff7fe700 1 -- 172.21.15.5:0/470095219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 msgr2=0x560b082f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.635+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/470095219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b082f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.635+0000 7f98ff7fe700 1 -- 172.21.15.5:0/470095219 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b0809f1f0 con 0x560b082fbfd0 2023-10-07T00:17:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.635+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/470095219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b0830bff0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f98f4011c30 tx=0x7f98f400f720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2c49b1c28685c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.636+0000 7f98e6ffd700 1 -- 172.21.15.5:0/470095219 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f400fc60 con 0x560b082fbfd0 2023-10-07T00:17:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.636+0000 7f98e6ffd700 1 -- 172.21.15.5:0/470095219 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98f4003b10 con 0x560b082fbfd0 2023-10-07T00:17:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.636+0000 7f98e6ffd700 1 -- 172.21.15.5:0/470095219 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40044d0 con 0x560b082fbfd0 2023-10-07T00:17:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.637+0000 7f991a115b80 1 -- 172.21.15.5:0/470095219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 msgr2=0x560b0830bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.637+0000 7f991a115b80 1 --2- 172.21.15.5:0/470095219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b0830bff0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f98f4011c30 tx=0x7f98f400f720 comp rx=0 tx=0).stop 2023-10-07T00:17:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.637+0000 7f991a115b80 1 -- 172.21.15.5:0/470095219 shutdown_connections 2023-10-07T00:17:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.638+0000 7f991a115b80 1 --2- 172.21.15.5:0/470095219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b08302d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.638+0000 7f991a115b80 1 --2- 172.21.15.5:0/470095219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b082f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.638+0000 7f991a115b80 1 --2- 172.21.15.5:0/470095219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b0830bff0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.638+0000 7f991a115b80 1 -- 172.21.15.5:0/470095219 >> 172.21.15.5:0/470095219 conn(0x560b0826f200 msgr2=0x560b083177c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.638+0000 7f991a115b80 1 -- 172.21.15.5:0/470095219 shutdown_connections 2023-10-07T00:17:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.638+0000 7f991a115b80 1 -- 172.21.15.5:0/470095219 wait complete. 2023-10-07T00:17:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.639+0000 7f991a115b80 1 -- start start 2023-10-07T00:17:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.639+0000 7f991a115b80 1 Processor -- start 2023-10-07T00:17:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.640+0000 7f991a115b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08307e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.640+0000 7f991a115b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b08308360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.640+0000 7f991a115b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b0830b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.640+0000 7f991a115b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b0830b8c0 con 0x560b082faec0 2023-10-07T00:17:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.640+0000 7f991a115b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b0830ba30 con 0x560b082fbfd0 2023-10-07T00:17:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.640+0000 7f991a115b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b0830bbf0 con 0x560b082fc990 2023-10-07T00:17:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.640+0000 7f991a115b80 10 client.0 _ll_register_callbacks cb 0x7f98f4011810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:17:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f9904d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b0830b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f9904d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b0830b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:58308/0 (socket says 172.21.15.5:58308) 2023-10-07T00:17:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f9904d9c700 1 -- 172.21.15.5:0/4088012290 learned_addr learned my addr 172.21.15.5:0/4088012290 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:17:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b08308360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f98fffff700 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08307e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f98ff7fe700 1 -- 172.21.15.5:0/4088012290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 msgr2=0x560b0830b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b0830b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f98ff7fe700 1 -- 172.21.15.5:0/4088012290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 msgr2=0x560b08307e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:17:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08307e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.641+0000 7f98ff7fe700 1 -- 172.21.15.5:0/4088012290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b08061c00 con 0x560b082fbfd0 2023-10-07T00:17:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.642+0000 7f98ff7fe700 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b08308360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005950 tx=0x7f98f40039b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6caba27f3deffd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:17:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.642+0000 7f98df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:17:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.643+0000 7f98df7fe700 1 -- 172.21.15.5:0/4088012290 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f400fc60 con 0x560b082fbfd0 2023-10-07T00:17:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.643+0000 7f98df7fe700 1 -- 172.21.15.5:0/4088012290 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f98f400fdc0 con 0x560b082fbfd0 2023-10-07T00:17:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.643+0000 7f991a115b80 1 -- 172.21.15.5:0/4088012290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98f001e040 con 0x560b082fbfd0 2023-10-07T00:17:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.643+0000 7f98df7fe700 1 -- 172.21.15.5:0/4088012290 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98f4004580 con 0x560b082fbfd0 2023-10-07T00:17:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f991a115b80 10 client.26324 fetch_fsmap learned FSMap version 35 2023-10-07T00:17:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f991a115b80 1 -- 172.21.15.5:0/4088012290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x560b08077250 con 0x560b082fbfd0 2023-10-07T00:17:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f98df7fe700 1 -- 172.21.15.5:0/4088012290 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98f001e040 con 0x560b082fbfd0 2023-10-07T00:17:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f98df7fe700 1 -- 172.21.15.5:0/4088012290 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 35) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f98f4026070 con 0x560b082fbfd0 2023-10-07T00:17:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f991a115b80 10 client.26324 fetch_fsmap finished waiting for FSMap version 35 2023-10-07T00:17:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f991a115b80 10 client.26324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:17:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f991a115b80 20 client.26324 populate_metadata read hostname 'smithi005' 2023-10-07T00:17:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f991a115b80 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560b08376360 0x560b08378750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:17:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f991a115b80 4 client.26324 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:17:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.644+0000 7f991a115b80 1 -- 172.21.15.5:0/4088012290 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560b08246ad0 con 0x560b08376360 2023-10-07T00:17:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.645+0000 7f98fffff700 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560b08376360 0x560b08378750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:17:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.646+0000 7f98fffff700 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560b08376360 0x560b08378750 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=466f9e777a5c43e4 server_cookie=21aee438bb5787ae in_seq=0 out_seq=0 2023-10-07T00:17:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.646+0000 7f98df7fe700 10 client.26324 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.706+0000 7f98df7fe700 1 -- 172.21.15.5:0/4088012290 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560b08246ad0 con 0x560b08376360 2023-10-07T00:17:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.706+0000 7f98df7fe700 10 client.26324 handle_command_reply: tid=0 2023-10-07T00:17:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.706+0000 7f991a115b80 1 client.26324 shutdown 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 -- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 msgr2=0x560b08308360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b08308360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005950 tx=0x7f98f40039b0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 -- 172.21.15.5:0/4088012290 shutdown_connections 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x560b08376360 0x560b08378750 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560b082fc990 0x560b0830b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b082faec0 0x560b08307e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 --2- 172.21.15.5:0/4088012290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b082fbfd0 0x560b08308360 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 -- 172.21.15.5:0/4088012290 >> 172.21.15.5:0/4088012290 conn(0x560b0826f200 msgr2=0x560b08303860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f98df7fe700 0 client.26324 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 -- 172.21.15.5:0/4088012290 shutdown_connections 2023-10-07T00:17:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.707+0000 7f991a115b80 1 -- 172.21.15.5:0/4088012290 wait complete. 2023-10-07T00:17:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.708+0000 7f991a115b80 20 client.26324 trim_cache size 0 max 16384 2023-10-07T00:17:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:17:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:17:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:17:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:17:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.708+0000 7f99067ff700 1 -- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f98e80a1500 msgr2=0x7f98e80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.708+0000 7f99067ff700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f98e80a1500 0x7f98e80a39c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x560b082fac60 tx=0x7f98f40058e0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.708+0000 7f99067ff700 1 -- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9900101990 msgr2=0x7f9900109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:17:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.708+0000 7f99067ff700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9900101990 0x7f9900109290 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f98f8007d70 tx=0x7f98f800a340 comp rx=0 tx=0).stop 2023-10-07T00:17:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.709+0000 7f99067ff700 1 -- 172.21.15.5:0/1887315568 shutdown_connections 2023-10-07T00:17:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.709+0000 7f99067ff700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f98e80a1500 0x7f98e80a39c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.709+0000 7f99067ff700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9900101990 0x7f9900109290 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.709+0000 7f99067ff700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99000ffe00 0x7f990010a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.709+0000 7f99067ff700 1 --2- 172.21.15.5:0/1887315568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9900100ff0 0x7f9900108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:17:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.709+0000 7f99067ff700 1 -- 172.21.15.5:0/1887315568 >> 172.21.15.5:0/1887315568 conn(0x7f99000fb390 msgr2=0x7f9900104580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:17:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.709+0000 7f99067ff700 1 -- 172.21.15.5:0/1887315568 shutdown_connections 2023-10-07T00:17:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:17:55.709+0000 7f99067ff700 1 -- 172.21.15.5:0/1887315568 wait complete. 2023-10-07T00:17:56.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:55 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:56.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:55 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:56.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:55 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:17:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:56 smithi088 ceph-mon[103111]: pgmap v501: 97 pgs: 97 active+clean; 228 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-10-07T00:17:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:56 smithi112 ceph-mon[133548]: pgmap v501: 97 pgs: 97 active+clean; 228 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-10-07T00:17:57.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:56 smithi005 ceph-mon[129406]: pgmap v501: 97 pgs: 97 active+clean; 228 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-10-07T00:17:57.766 INFO:tasks.workunit.client.0.smithi005.stdout: 43 6689 90 4327 50 1264 92 2023-10-07T00:17:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:17:58 smithi088 ceph-mon[103111]: pgmap v502: 97 pgs: 97 active+clean; 230 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.0 MiB/s wr, 175 op/s 2023-10-07T00:17:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:17:58 smithi112 ceph-mon[133548]: pgmap v502: 97 pgs: 97 active+clean; 230 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.0 MiB/s wr, 175 op/s 2023-10-07T00:17:59.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:17:58 smithi005 ceph-mon[129406]: pgmap v502: 97 pgs: 97 active+clean; 230 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.0 MiB/s wr, 175 op/s 2023-10-07T00:18:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:00 smithi088 ceph-mon[103111]: pgmap v503: 97 pgs: 97 active+clean; 229 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 1.2 MiB/s wr, 193 op/s 2023-10-07T00:18:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:00 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:18:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:00 smithi112 ceph-mon[133548]: pgmap v503: 97 pgs: 97 active+clean; 229 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 1.2 MiB/s wr, 193 op/s 2023-10-07T00:18:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:00 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:18:01.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:00 smithi005 ceph-mon[129406]: pgmap v503: 97 pgs: 97 active+clean; 229 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 1.2 MiB/s wr, 193 op/s 2023-10-07T00:18:01.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:00 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:18:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:02 smithi088 ceph-mon[103111]: pgmap v504: 97 pgs: 97 active+clean; 231 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.2 MiB/s wr, 188 op/s 2023-10-07T00:18:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:02 smithi112 ceph-mon[133548]: pgmap v504: 97 pgs: 97 active+clean; 231 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.2 MiB/s wr, 188 op/s 2023-10-07T00:18:03.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:02 smithi005 ceph-mon[129406]: pgmap v504: 97 pgs: 97 active+clean; 231 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.2 MiB/s wr, 188 op/s 2023-10-07T00:18:04.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:03 smithi112 ceph-mon[133548]: pgmap v505: 97 pgs: 97 active+clean; 232 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 1.1 MiB/s wr, 170 op/s 2023-10-07T00:18:04.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:03 smithi005 ceph-mon[129406]: pgmap v505: 97 pgs: 97 active+clean; 232 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 1.1 MiB/s wr, 170 op/s 2023-10-07T00:18:04.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:03 smithi088 ceph-mon[103111]: pgmap v505: 97 pgs: 97 active+clean; 232 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 1.1 MiB/s wr, 170 op/s 2023-10-07T00:18:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:06 smithi005 ceph-mon[129406]: pgmap v506: 97 pgs: 97 active+clean; 234 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.2 MiB/s wr, 184 op/s 2023-10-07T00:18:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:06 smithi088 ceph-mon[103111]: pgmap v506: 97 pgs: 97 active+clean; 234 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.2 MiB/s wr, 184 op/s 2023-10-07T00:18:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:06 smithi112 ceph-mon[133548]: pgmap v506: 97 pgs: 97 active+clean; 234 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.2 MiB/s wr, 184 op/s 2023-10-07T00:18:07.766 INFO:tasks.workunit.client.0.smithi005.stdout: 44 6988 81 4698 56 1769 74 2023-10-07T00:18:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.931+0000 7f9ce15ff700 1 -- 172.21.15.5:0/3356751623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 msgr2=0x7f9cdc1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.931+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/3356751623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 0x7f9cdc1012c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009990 tx=0x7f9ccc009ca0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.932+0000 7f9ce15ff700 1 -- 172.21.15.5:0/3356751623 shutdown_connections 2023-10-07T00:18:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.932+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/3356751623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cdc102a40 0x7f9cdc109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.932+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/3356751623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 0x7f9cdc1012c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.932+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/3356751623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cdc102080 0x7f9cdc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.932+0000 7f9ce15ff700 1 -- 172.21.15.5:0/3356751623 >> 172.21.15.5:0/3356751623 conn(0x7f9cdc0fc460 msgr2=0x7f9cdc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.932+0000 7f9ce15ff700 1 -- 172.21.15.5:0/3356751623 shutdown_connections 2023-10-07T00:18:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.932+0000 7f9ce15ff700 1 -- 172.21.15.5:0/3356751623 wait complete. 2023-10-07T00:18:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.933+0000 7f9ce15ff700 1 Processor -- start 2023-10-07T00:18:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.934+0000 7f9ce15ff700 1 -- start start 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.934+0000 7f9ce15ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 0x7f9cdc1949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.934+0000 7f9ce15ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cdc102080 0x7f9cdc194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.934+0000 7f9ce15ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cdc102a40 0x7f9cdc19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.934+0000 7f9ce15ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc19c530 con 0x7f9cdc102a40 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.934+0000 7f9ce15ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc19c670 con 0x7f9cdc100ea0 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.934+0000 7f9ce15ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc19c800 con 0x7f9cdc102080 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cdaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 0x7f9cdc1949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cdaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 0x7f9cdc1949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:44046/0 (socket says 172.21.15.5:44046) 2023-10-07T00:18:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cdaffd700 1 -- 172.21.15.5:0/2869850880 learned_addr learned my addr 172.21.15.5:0/2869850880 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cdc102080 0x7f9cdc194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cdaffd700 1 -- 172.21.15.5:0/2869850880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cdc102080 msgr2=0x7f9cdc194ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cdaffd700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cdc102080 0x7f9cdc194ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cdaffd700 1 -- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cdc102a40 msgr2=0x7f9cdc19bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cdaffd700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cdc102a40 0x7f9cdc19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.935+0000 7f9cdaffd700 1 -- 172.21.15.5:0/2869850880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc0095f0 con 0x7f9cdc100ea0 2023-10-07T00:18:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.936+0000 7f9cdaffd700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 0x7f9cdc1949b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0098e0 tx=0x7f9ccc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.936+0000 7f9cd3fff700 1 -- 172.21.15.5:0/2869850880 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc01d070 con 0x7f9cdc100ea0 2023-10-07T00:18:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.936+0000 7f9cd3fff700 1 -- 172.21.15.5:0/2869850880 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ccc00be30 con 0x7f9cdc100ea0 2023-10-07T00:18:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.936+0000 7f9cd3fff700 1 -- 172.21.15.5:0/2869850880 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc022dd0 con 0x7f9cdc100ea0 2023-10-07T00:18:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.937+0000 7f9ce15ff700 1 -- 172.21.15.5:0/2869850880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc19ca80 con 0x7f9cdc100ea0 2023-10-07T00:18:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.937+0000 7f9ce15ff700 1 -- 172.21.15.5:0/2869850880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc19ce50 con 0x7f9cdc100ea0 2023-10-07T00:18:08.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.942+0000 7f9cd3fff700 1 -- 172.21.15.5:0/2869850880 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9ccc022570 con 0x7f9cdc100ea0 2023-10-07T00:18:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.944+0000 7f9cf4f23b80 1 Processor -- start 2023-10-07T00:18:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.945+0000 7f9cf4f23b80 1 -- start start 2023-10-07T00:18:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.945+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.945+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026c1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.945+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.946+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d02628400 con 0x557d026c0fd0 2023-10-07T00:18:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.946+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d02619bc0 con 0x557d026c1990 2023-10-07T00:18:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.946+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d026174e0 con 0x557d026bfec0 2023-10-07T00:18:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.946+0000 7f9cda7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.946+0000 7f9cda7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:44056/0 (socket says 172.21.15.5:44056) 2023-10-07T00:18:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.946+0000 7f9cda7fc700 1 -- 172.21.15.5:0/3543343270 learned_addr learned my addr 172.21.15.5:0/3543343270 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.946+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.947+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/3543343270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 msgr2=0x557d026c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.947+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.947+0000 7f9cdaffd700 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.947+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/3543343270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 msgr2=0x557d026c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.947+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026c1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.947+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/3543343270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d0243dd80 con 0x557d026bfec0 2023-10-07T00:18:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.947+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c02e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400be30 tx=0x7f9cd400b3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd4b11156177366 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.948+0000 7f9cd3fff700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9cc80a1500 0x7f9cc80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.948+0000 7f9cd17fa700 1 -- 172.21.15.5:0/3543343270 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd400d4d0 con 0x557d026bfec0 2023-10-07T00:18:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.948+0000 7f9cd17fa700 1 -- 172.21.15.5:0/3543343270 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cd400d630 con 0x557d026bfec0 2023-10-07T00:18:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.948+0000 7f9cd17fa700 1 -- 172.21.15.5:0/3543343270 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd40156b0 con 0x557d026bfec0 2023-10-07T00:18:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.948+0000 7f9cdaffd700 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026c1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:18:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.948+0000 7f9cd3fff700 1 -- 172.21.15.5:0/2869850880 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9ccc0ce2c0 con 0x7f9cdc100ea0 2023-10-07T00:18:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.949+0000 7f9cdaffd700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9cc80a1500 0x7f9cc80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.949+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3543343270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 msgr2=0x557d026c02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.949+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c02e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400be30 tx=0x7f9cd400b3a0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.949+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3543343270 shutdown_connections 2023-10-07T00:18:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.949+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.949+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c02e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.949+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3543343270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026c1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.949+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3543343270 >> 172.21.15.5:0/3543343270 conn(0x557d02634200 msgr2=0x557d026babb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.950+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3543343270 shutdown_connections 2023-10-07T00:18:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.950+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3543343270 wait complete. 2023-10-07T00:18:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.951+0000 7f9cdaffd700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9cc80a1500 0x7f9cc80a39c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0ce520 tx=0x7f9ccc009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.951+0000 7f9cf4f23b80 1 -- start start 2023-10-07T00:18:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.951+0000 7f9cf4f23b80 1 Processor -- start 2023-10-07T00:18:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.952+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.952+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c0fd0 0x557d026ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.952+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c1990 0x557d026d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.952+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d02612dd0 con 0x557d026c1990 2023-10-07T00:18:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.952+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d025af6b0 con 0x557d026c0fd0 2023-10-07T00:18:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.952+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d025af350 con 0x557d026bfec0 2023-10-07T00:18:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.952+0000 7f9cf4f23b80 10 client.0 _ll_register_callbacks cb 0x557d0240c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:18:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.953+0000 7f9cda7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c0fd0 0x557d026ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.953+0000 7f9cda7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c0fd0 0x557d026ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:44058/0 (socket says 172.21.15.5:44058) 2023-10-07T00:18:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.953+0000 7f9cda7fc700 1 -- 172.21.15.5:0/3655362280 learned_addr learned my addr 172.21.15.5:0/3655362280 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.953+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.953+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c1990 0x557d026d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.954+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/3655362280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c0fd0 msgr2=0x557d026ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.954+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c0fd0 0x557d026ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.954+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/3655362280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c1990 msgr2=0x557d026d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.954+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c1990 0x557d026d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.954+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/3655362280 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd400bae0 con 0x557d026bfec0 2023-10-07T00:18:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.955+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c9bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400be30 tx=0x7f9cd400a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4a7d38ad9c6b1cd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.956+0000 7f9cc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:18:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.956+0000 7f9cc27fc700 1 -- 172.21.15.5:0/3655362280 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4004bb0 con 0x557d026bfec0 2023-10-07T00:18:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.956+0000 7f9cc27fc700 1 -- 172.21.15.5:0/3655362280 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9cd4004d10 con 0x557d026bfec0 2023-10-07T00:18:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.956+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3655362280 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d026b2d50 con 0x557d026bfec0 2023-10-07T00:18:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.957+0000 7f9cc27fc700 1 -- 172.21.15.5:0/3655362280 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cd4015810 con 0x557d026bfec0 2023-10-07T00:18:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.957+0000 7f9cf4f23b80 10 client.26314 fetch_fsmap learned FSMap version 36 2023-10-07T00:18:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.957+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3655362280 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557d02426c00 con 0x557d026bfec0 2023-10-07T00:18:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.958+0000 7f9cc27fc700 1 -- 172.21.15.5:0/3655362280 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557d026b2d50 con 0x557d026bfec0 2023-10-07T00:18:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.958+0000 7f9cc27fc700 1 -- 172.21.15.5:0/3655362280 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 36) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f9cd40168a0 con 0x557d026bfec0 2023-10-07T00:18:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.958+0000 7f9cf4f23b80 10 client.26314 fetch_fsmap finished waiting for FSMap version 36 2023-10-07T00:18:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.958+0000 7f9cf4f23b80 10 client.26314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:18:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.958+0000 7f9cf4f23b80 20 client.26314 populate_metadata read hostname 'smithi005' 2023-10-07T00:18:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.958+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557d026e6830 0x557d026e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.958+0000 7f9cf4f23b80 4 client.26314 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:18:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.958+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3655362280 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d0260bdb0 con 0x557d026e6830 2023-10-07T00:18:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.959+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557d026e6830 0x557d026e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.960+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557d026e6830 0x557d026e8c50 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b49130d47dfc80b server_cookie=e6e87e2837c6ae8d in_seq=0 out_seq=0 2023-10-07T00:18:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.960+0000 7f9cc27fc700 10 client.26314 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.963+0000 7f9cc27fc700 1 -- 172.21.15.5:0/3655362280 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557d0260bdb0 con 0x557d026e6830 2023-10-07T00:18:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.963+0000 7f9cc27fc700 10 client.26314 handle_command_reply: tid=0 2023-10-07T00:18:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.963+0000 7f9cf4f23b80 1 client.26314 shutdown 2023-10-07T00:18:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.964+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3655362280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 msgr2=0x557d026c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.964+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c9bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400be30 tx=0x7f9cd400a040 comp rx=0 tx=0).stop 2023-10-07T00:18:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.964+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3655362280 shutdown_connections 2023-10-07T00:18:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.964+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557d026e6830 0x557d026e8c50 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.964+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c1990 0x557d026d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.964+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026bfec0 0x557d026c9bb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.964+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/3655362280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c0fd0 0x557d026ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.964+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3655362280 >> 172.21.15.5:0/3655362280 conn(0x557d02634200 msgr2=0x557d026ba250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.965+0000 7f9cc27fc700 0 client.26314 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.965+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3655362280 shutdown_connections 2023-10-07T00:18:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.965+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/3655362280 wait complete. 2023-10-07T00:18:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.966+0000 7f9cf4f23b80 20 client.26314 trim_cache size 0 max 16384 2023-10-07T00:18:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.993+0000 7f9cf4f23b80 1 Processor -- start 2023-10-07T00:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.994+0000 7f9cf4f23b80 1 -- start start 2023-10-07T00:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.994+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026bfec0 0x557d026bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.994+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c0fd0 0x557d026d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.994+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.994+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d024938c0 con 0x557d026bfec0 2023-10-07T00:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.994+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d026c0740 con 0x557d026c1990 2023-10-07T00:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.994+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d026c9720 con 0x557d026c0fd0 2023-10-07T00:18:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.995+0000 7f9cda7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c0fd0 0x557d026d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.995+0000 7f9cdb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026bfec0 0x557d026bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cdb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026bfec0 0x557d026bbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44296/0 (socket says 172.21.15.5:44296) 2023-10-07T00:18:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/540537526 learned_addr learned my addr 172.21.15.5:0/540537526 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cda7fc700 1 -- 172.21.15.5:0/540537526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 msgr2=0x557d026c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cda7fc700 1 -- 172.21.15.5:0/540537526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026bfec0 msgr2=0x557d026bbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026bfec0 0x557d026bbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cda7fc700 1 -- 172.21.15.5:0/540537526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d024641f0 con 0x557d026c0fd0 2023-10-07T00:18:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026bfec0 0x557d026bbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:18:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.996+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c0fd0 0x557d026d10f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x557d026e6c10 tx=0x7f9cc4015040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9e412a5717e35b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.997+0000 7f9cd1ffb700 1 -- 172.21.15.5:0/540537526 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4027070 con 0x557d026c0fd0 2023-10-07T00:18:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.998+0000 7f9cd1ffb700 1 -- 172.21.15.5:0/540537526 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cc402b070 con 0x557d026c0fd0 2023-10-07T00:18:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.998+0000 7f9cd1ffb700 1 -- 172.21.15.5:0/540537526 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4003a60 con 0x557d026c0fd0 2023-10-07T00:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.998+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/540537526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c0fd0 msgr2=0x557d026d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.998+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c0fd0 0x557d026d10f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x557d026e6c10 tx=0x7f9cc4015040 comp rx=0 tx=0).stop 2023-10-07T00:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.999+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/540537526 shutdown_connections 2023-10-07T00:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.999+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026c1990 0x557d026c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.999+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026bfec0 0x557d026bbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.999+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/540537526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c0fd0 0x557d026d10f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.999+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/540537526 >> 172.21.15.5:0/540537526 conn(0x557d02634200 msgr2=0x557d026c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.999+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/540537526 shutdown_connections 2023-10-07T00:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.999+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/540537526 wait complete. 2023-10-07T00:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:08.999+0000 7f9cf4f23b80 1 -- start start 2023-10-07T00:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.000+0000 7f9cf4f23b80 1 Processor -- start 2023-10-07T00:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.000+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026bfec0 0x557d026ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.000+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.000+0000 7f9cf4f23b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c1990 0x557d026d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.000+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d026d0830 con 0x557d026c0fd0 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.000+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d026d09a0 con 0x557d026bfec0 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.000+0000 7f9cf4f23b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d026d0b60 con 0x557d026c1990 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.001+0000 7f9cf4f23b80 10 client.0 _ll_register_callbacks cb 0x7f9cd4015760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.001+0000 7f9cdb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c1990 0x557d026d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.001+0000 7f9cdb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026bfec0 0x557d026ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.001+0000 7f9cdb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026bfec0 0x557d026ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:44068/0 (socket says 172.21.15.5:44068) 2023-10-07T00:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.001+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/4272959142 learned_addr learned my addr 172.21.15.5:0/4272959142 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.002+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.002+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/4272959142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c1990 msgr2=0x557d026d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.002+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c1990 0x557d026d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.002+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/4272959142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 msgr2=0x557d026cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.002+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.002+0000 7f9cdb7fe700 1 -- 172.21.15.5:0/4272959142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d02426c00 con 0x557d026bfec0 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.002+0000 7f9cdb7fe700 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026bfec0 0x557d026ceda0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4008bd0 tx=0x7f9cd400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=163f0ea4b2b9032b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.002+0000 7f9cc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.003+0000 7f9cc27fc700 1 -- 172.21.15.5:0/4272959142 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4003ac0 con 0x557d026bfec0 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.003+0000 7f9cc27fc700 1 -- 172.21.15.5:0/4272959142 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9cd4003c20 con 0x557d026bfec0 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.003+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/4272959142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9cd400d630 con 0x557d026bfec0 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.003+0000 7f9cc27fc700 1 -- 172.21.15.5:0/4272959142 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cd4003de0 con 0x557d026bfec0 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.003+0000 7f9cf4f23b80 10 client.26342 fetch_fsmap learned FSMap version 36 2023-10-07T00:18:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.003+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/4272959142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f9cc40277a0 con 0x557d026bfec0 2023-10-07T00:18:09.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.004+0000 7f9cc27fc700 1 -- 172.21.15.5:0/4272959142 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cd400d630 con 0x557d026bfec0 2023-10-07T00:18:09.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.004+0000 7f9cc27fc700 1 -- 172.21.15.5:0/4272959142 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 36) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f9cd4015a90 con 0x557d026bfec0 2023-10-07T00:18:09.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.004+0000 7f9cf4f23b80 10 client.26342 fetch_fsmap finished waiting for FSMap version 36 2023-10-07T00:18:09.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.004+0000 7f9cf4f23b80 10 client.26342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:18:09.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.004+0000 7f9cf4f23b80 20 client.26342 populate_metadata read hostname 'smithi005' 2023-10-07T00:18:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.004+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557d0273b270 0x557d0273d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.004+0000 7f9cf4f23b80 4 client.26342 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:18:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.004+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/4272959142 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557d0260bad0 con 0x557d0273b270 2023-10-07T00:18:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.005+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557d0273b270 0x557d0273d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.006+0000 7f9cc27fc700 10 client.26342 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.006+0000 7f9cda7fc700 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557d0273b270 0x557d0273d690 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f25e6aaa5fe3df88 server_cookie=1ce82011a382da82 in_seq=0 out_seq=0 2023-10-07T00:18:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.042+0000 7f9cc27fc700 1 -- 172.21.15.5:0/4272959142 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557d0260bad0 con 0x557d0273b270 2023-10-07T00:18:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.042+0000 7f9cc27fc700 10 client.26342 handle_command_reply: tid=0 2023-10-07T00:18:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.042+0000 7f9cf4f23b80 1 client.26342 shutdown 2023-10-07T00:18:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/4272959142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026bfec0 msgr2=0x557d026ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026bfec0 0x557d026ceda0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4008bd0 tx=0x7f9cd400dcf0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/4272959142 shutdown_connections 2023-10-07T00:18:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557d0273b270 0x557d0273d690 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557d026c1990 0x557d026d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d026bfec0 0x557d026ceda0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 --2- 172.21.15.5:0/4272959142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d026c0fd0 0x557d026cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/4272959142 >> 172.21.15.5:0/4272959142 conn(0x557d02634200 msgr2=0x557d026c7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cc27fc700 0 client.26342 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.043+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/4272959142 shutdown_connections 2023-10-07T00:18:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.044+0000 7f9cf4f23b80 1 -- 172.21.15.5:0/4272959142 wait complete. 2023-10-07T00:18:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.044+0000 7f9cf4f23b80 20 client.26342 trim_cache size 0 max 16384 2023-10-07T00:18:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:18:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:18:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:18:09.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:18:09.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 -- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9cc80a1500 msgr2=0x7f9cc80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:09.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9cc80a1500 0x7f9cc80a39c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0ce520 tx=0x7f9ccc009310 comp rx=0 tx=0).stop 2023-10-07T00:18:09.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 -- 172.21.15.5:0/2869850880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 msgr2=0x7f9cdc1949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:09.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 0x7f9cdc1949b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0098e0 tx=0x7f9ccc004730 comp rx=0 tx=0).stop 2023-10-07T00:18:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 -- 172.21.15.5:0/2869850880 shutdown_connections 2023-10-07T00:18:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9cc80a1500 0x7f9cc80a39c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cdc102a40 0x7f9cdc19bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc100ea0 0x7f9cdc1949b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 --2- 172.21.15.5:0/2869850880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cdc102080 0x7f9cdc194ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.045+0000 7f9ce15ff700 1 -- 172.21.15.5:0/2869850880 >> 172.21.15.5:0/2869850880 conn(0x7f9cdc0fc460 msgr2=0x7f9cdc0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.046+0000 7f9ce15ff700 1 -- 172.21.15.5:0/2869850880 shutdown_connections 2023-10-07T00:18:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:09.046+0000 7f9ce15ff700 1 -- 172.21.15.5:0/2869850880 wait complete. 2023-10-07T00:18:09.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:08 smithi005 ceph-mon[129406]: pgmap v507: 97 pgs: 97 active+clean; 236 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.1 MiB/s wr, 156 op/s 2023-10-07T00:18:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:08 smithi088 ceph-mon[103111]: pgmap v507: 97 pgs: 97 active+clean; 236 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.1 MiB/s wr, 156 op/s 2023-10-07T00:18:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:08 smithi112 ceph-mon[133548]: pgmap v507: 97 pgs: 97 active+clean; 236 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.1 MiB/s wr, 156 op/s 2023-10-07T00:18:11.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:10 smithi005 ceph-mon[129406]: pgmap v508: 97 pgs: 97 active+clean; 238 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2023-10-07T00:18:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:10 smithi088 ceph-mon[103111]: pgmap v508: 97 pgs: 97 active+clean; 238 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2023-10-07T00:18:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:10 smithi112 ceph-mon[133548]: pgmap v508: 97 pgs: 97 active+clean; 238 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2023-10-07T00:18:13.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:12 smithi005 ceph-mon[129406]: pgmap v509: 97 pgs: 97 active+clean; 240 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 992 KiB/s wr, 126 op/s 2023-10-07T00:18:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:12 smithi088 ceph-mon[103111]: pgmap v509: 97 pgs: 97 active+clean; 240 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 992 KiB/s wr, 126 op/s 2023-10-07T00:18:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:12 smithi112 ceph-mon[133548]: pgmap v509: 97 pgs: 97 active+clean; 240 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 992 KiB/s wr, 126 op/s 2023-10-07T00:18:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:14 smithi005 ceph-mon[129406]: pgmap v510: 97 pgs: 97 active+clean; 241 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 899 KiB/s wr, 117 op/s 2023-10-07T00:18:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:14 smithi088 ceph-mon[103111]: pgmap v510: 97 pgs: 97 active+clean; 241 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 899 KiB/s wr, 117 op/s 2023-10-07T00:18:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:14 smithi112 ceph-mon[133548]: pgmap v510: 97 pgs: 97 active+clean; 241 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 899 KiB/s wr, 117 op/s 2023-10-07T00:18:17.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:16 smithi005 ceph-mon[129406]: pgmap v511: 97 pgs: 97 active+clean; 243 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 998 KiB/s wr, 130 op/s 2023-10-07T00:18:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:16 smithi088 ceph-mon[103111]: pgmap v511: 97 pgs: 97 active+clean; 243 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 998 KiB/s wr, 130 op/s 2023-10-07T00:18:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:16 smithi112 ceph-mon[133548]: pgmap v511: 97 pgs: 97 active+clean; 243 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 998 KiB/s wr, 130 op/s 2023-10-07T00:18:17.767 INFO:tasks.workunit.client.0.smithi005.stdout: 44 6230 39 4057 80 1758 73 2023-10-07T00:18:19.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:18 smithi005 ceph-mon[129406]: pgmap v512: 97 pgs: 97 active+clean; 246 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 1.1 MiB/s wr, 133 op/s 2023-10-07T00:18:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:18 smithi088 ceph-mon[103111]: pgmap v512: 97 pgs: 97 active+clean; 246 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 1.1 MiB/s wr, 133 op/s 2023-10-07T00:18:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:18 smithi112 ceph-mon[133548]: pgmap v512: 97 pgs: 97 active+clean; 246 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 1.1 MiB/s wr, 133 op/s 2023-10-07T00:18:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:20 smithi005 ceph-mon[129406]: pgmap v513: 97 pgs: 97 active+clean; 248 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.2 MiB/s wr, 143 op/s 2023-10-07T00:18:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:20 smithi088 ceph-mon[103111]: pgmap v513: 97 pgs: 97 active+clean; 248 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.2 MiB/s wr, 143 op/s 2023-10-07T00:18:21.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:20 smithi112 ceph-mon[133548]: pgmap v513: 97 pgs: 97 active+clean; 248 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.2 MiB/s wr, 143 op/s 2023-10-07T00:18:22.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.269+0000 7f38e679d700 1 -- 172.21.15.5:0/1024706137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e0104a40 msgr2=0x7f38e010b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.269+0000 7f38e679d700 1 --2- 172.21.15.5:0/1024706137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e0104a40 0x7f38e010b360 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009f90 tx=0x7f38d800b330 comp rx=0 tx=0).stop 2023-10-07T00:18:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.269+0000 7f38e679d700 1 -- 172.21.15.5:0/1024706137 shutdown_connections 2023-10-07T00:18:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.269+0000 7f38e679d700 1 --2- 172.21.15.5:0/1024706137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e0104a40 0x7f38e010b360 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.269+0000 7f38e679d700 1 --2- 172.21.15.5:0/1024706137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38e0102f30 0x7f38e0103350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.269+0000 7f38e679d700 1 --2- 172.21.15.5:0/1024706137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e0104080 0x7f38e0104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.269+0000 7f38e679d700 1 -- 172.21.15.5:0/1024706137 >> 172.21.15.5:0/1024706137 conn(0x7f38e00fe4c0 msgr2=0x7f38e01008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.270+0000 7f38e679d700 1 -- 172.21.15.5:0/1024706137 shutdown_connections 2023-10-07T00:18:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.270+0000 7f38e679d700 1 -- 172.21.15.5:0/1024706137 wait complete. 2023-10-07T00:18:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.271+0000 7f38e679d700 1 Processor -- start 2023-10-07T00:18:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.272+0000 7f38e679d700 1 -- start start 2023-10-07T00:18:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.272+0000 7f38e679d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38e0102f30 0x7f38e0198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.272+0000 7f38e679d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e0104080 0x7f38e0199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.272+0000 7f38e679d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e0104a40 0x7f38e01a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.272+0000 7f38e679d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e01a0750 con 0x7f38e0104080 2023-10-07T00:18:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.272+0000 7f38e679d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e006a8d0 con 0x7f38e0102f30 2023-10-07T00:18:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.272+0000 7f38e679d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e006aa60 con 0x7f38e0104a40 2023-10-07T00:18:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.272+0000 7f38e4f9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e0104080 0x7f38e0199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38e0102f30 0x7f38e0198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38e0102f30 0x7f38e0198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:54278/0 (socket says 172.21.15.5:54278) 2023-10-07T00:18:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e579b700 1 -- 172.21.15.5:0/2153206609 learned_addr learned my addr 172.21.15.5:0/2153206609 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e0104a40 0x7f38e01a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e579b700 1 -- 172.21.15.5:0/2153206609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e0104a40 msgr2=0x7f38e01a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e579b700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e0104a40 0x7f38e01a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e579b700 1 -- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e0104080 msgr2=0x7f38e0199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e579b700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e0104080 0x7f38e0199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.273+0000 7f38e579b700 1 -- 172.21.15.5:0/2153206609 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d8009c40 con 0x7f38e0102f30 2023-10-07T00:18:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.274+0000 7f38e579b700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38e0102f30 0x7f38e0198bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00e9c0 tx=0x7f38dc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.275+0000 7f38d67fc700 1 -- 172.21.15.5:0/2153206609 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc004a30 con 0x7f38e0102f30 2023-10-07T00:18:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.275+0000 7f38d67fc700 1 -- 172.21.15.5:0/2153206609 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38dc00cc50 con 0x7f38e0102f30 2023-10-07T00:18:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.275+0000 7f38d67fc700 1 -- 172.21.15.5:0/2153206609 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc005410 con 0x7f38e0102f30 2023-10-07T00:18:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.275+0000 7f38e679d700 1 -- 172.21.15.5:0/2153206609 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e006ad40 con 0x7f38e0102f30 2023-10-07T00:18:22.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.275+0000 7f38e679d700 1 -- 172.21.15.5:0/2153206609 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e006b250 con 0x7f38e0102f30 2023-10-07T00:18:22.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.280+0000 7f38d67fc700 1 -- 172.21.15.5:0/2153206609 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f38dc005570 con 0x7f38e0102f30 2023-10-07T00:18:22.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.281+0000 7f38fb38cb80 1 Processor -- start 2023-10-07T00:18:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.282+0000 7f38fb38cb80 1 -- start start 2023-10-07T00:18:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.282+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db855ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.282+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855f940 0x564db855fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.282+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db8566b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.282+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db84be400 con 0x564db855e830 2023-10-07T00:18:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.282+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db84afbc0 con 0x564db8560300 2023-10-07T00:18:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.282+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db84ad4e0 con 0x564db855f940 2023-10-07T00:18:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.282+0000 7f38e5f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db855ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38d67fc700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38cc0a15d0 0x7f38cc0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e5f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db855ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40930/0 (socket says 172.21.15.5:40930) 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e5f9c700 1 -- 172.21.15.5:0/1385925995 learned_addr learned my addr 172.21.15.5:0/1385925995 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e579b700 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855f940 0x564db855fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e4f9a700 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db8566b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38cc0a15d0 0x7f38cc0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e5f9c700 1 -- 172.21.15.5:0/1385925995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855f940 msgr2=0x564db855fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855f940 0x564db855fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e5f9c700 1 -- 172.21.15.5:0/1385925995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 msgr2=0x564db8566b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db8566b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38e5f9c700 1 -- 172.21.15.5:0/1385925995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564db82d3d80 con 0x564db855e830 2023-10-07T00:18:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.283+0000 7f38d67fc700 1 -- 172.21.15.5:0/2153206609 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f38dc014070 con 0x7f38e0102f30 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.284+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db855ec50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009c10 tx=0x7f38d8003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e78319f502564b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.284+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38cc0a15d0 0x7f38cc0a3a90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f38d8025000 tx=0x7f38d8027000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.284+0000 7f38cb7fe700 1 -- 172.21.15.5:0/1385925995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800e040 con 0x564db855e830 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.284+0000 7f38cb7fe700 1 -- 172.21.15.5:0/1385925995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38d800be20 con 0x564db855e830 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.284+0000 7f38cb7fe700 1 -- 172.21.15.5:0/1385925995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80056b0 con 0x564db855e830 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.285+0000 7f38fb38cb80 1 -- 172.21.15.5:0/1385925995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 msgr2=0x564db855ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.285+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db855ec50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009c10 tx=0x7f38d8003b00 comp rx=0 tx=0).stop 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.285+0000 7f38fb38cb80 1 -- 172.21.15.5:0/1385925995 shutdown_connections 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.285+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db8566b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.285+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db855ec50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.285+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/1385925995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855f940 0x564db855fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.285+0000 7f38fb38cb80 1 -- 172.21.15.5:0/1385925995 >> 172.21.15.5:0/1385925995 conn(0x564db84ca200 msgr2=0x564db8550c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.286+0000 7f38fb38cb80 1 -- 172.21.15.5:0/1385925995 shutdown_connections 2023-10-07T00:18:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.286+0000 7f38fb38cb80 1 -- 172.21.15.5:0/1385925995 wait complete. 2023-10-07T00:18:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.286+0000 7f38fb38cb80 1 -- start start 2023-10-07T00:18:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.287+0000 7f38fb38cb80 1 Processor -- start 2023-10-07T00:18:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db85685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 0x564db8568ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db84a8dd0 con 0x564db855f940 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db84456b0 con 0x564db8560300 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db8445350 con 0x564db855e830 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38fb38cb80 10 client.0 _ll_register_callbacks cb 0x564db82a27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e5f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e5f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:54296/0 (socket says 172.21.15.5:54296) 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e5f9c700 1 -- 172.21.15.5:0/932853565 learned_addr learned my addr 172.21.15.5:0/932853565 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e579b700 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db85685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e4f9a700 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 0x564db8568ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e5f9c700 1 -- 172.21.15.5:0/932853565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 msgr2=0x564db85685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db85685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e5f9c700 1 -- 172.21.15.5:0/932853565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 msgr2=0x564db8568ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 0x564db8568ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.288+0000 7f38e5f9c700 1 -- 172.21.15.5:0/932853565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e010bc90 con 0x564db8560300 2023-10-07T00:18:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.289+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856fb20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009550 tx=0x7f38d80075e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b05cb2426a2c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.289+0000 7f38c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:18:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.289+0000 7f38c8ff9700 1 -- 172.21.15.5:0/932853565 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800e040 con 0x564db8560300 2023-10-07T00:18:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.290+0000 7f38fb38cb80 1 -- 172.21.15.5:0/932853565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564db8548eb0 con 0x564db8560300 2023-10-07T00:18:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.290+0000 7f38c8ff9700 1 -- 172.21.15.5:0/932853565 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f38d8005600 con 0x564db8560300 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.290+0000 7f38c8ff9700 1 -- 172.21.15.5:0/932853565 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38d8005040 con 0x564db8560300 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.290+0000 7f38fb38cb80 10 client.26354 fetch_fsmap learned FSMap version 36 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.290+0000 7f38fb38cb80 1 -- 172.21.15.5:0/932853565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564db82bcc00 con 0x564db8560300 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.290+0000 7f38c8ff9700 1 -- 172.21.15.5:0/932853565 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564db8548eb0 con 0x564db8560300 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.291+0000 7f38c8ff9700 1 -- 172.21.15.5:0/932853565 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 36) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f38d8031420 con 0x564db8560300 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.291+0000 7f38fb38cb80 10 client.26354 fetch_fsmap finished waiting for FSMap version 36 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.291+0000 7f38fb38cb80 10 client.26354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.291+0000 7f38fb38cb80 20 client.26354 populate_metadata read hostname 'smithi005' 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.291+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564db8574160 0x564db8576580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.291+0000 7f38fb38cb80 4 client.26354 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:18:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.291+0000 7f38fb38cb80 1 -- 172.21.15.5:0/932853565 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564db84a1db0 con 0x564db8574160 2023-10-07T00:18:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.291+0000 7f38e579b700 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564db8574160 0x564db8576580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.292+0000 7f38c8ff9700 10 client.26354 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.292+0000 7f38e579b700 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564db8574160 0x564db8576580 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=678db477f2514527 server_cookie=2960b0a1f056a292 in_seq=0 out_seq=0 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.292+0000 7f38c8ff9700 1 -- 172.21.15.5:0/932853565 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564db84a1db0 con 0x564db8574160 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.292+0000 7f38c8ff9700 10 client.26354 handle_command_reply: tid=0 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 client.26354 shutdown 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 -- 172.21.15.5:0/932853565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 msgr2=0x564db856fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856fb20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009550 tx=0x7f38d80075e0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 -- 172.21.15.5:0/932853565 shutdown_connections 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564db8574160 0x564db8576580 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856fb20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db85685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38c8ff9700 0 client.26354 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:22.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/932853565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 0x564db8568ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 -- 172.21.15.5:0/932853565 >> 172.21.15.5:0/932853565 conn(0x564db84ca200 msgr2=0x564db85503b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:22.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 -- 172.21.15.5:0/932853565 shutdown_connections 2023-10-07T00:18:22.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.293+0000 7f38fb38cb80 1 -- 172.21.15.5:0/932853565 wait complete. 2023-10-07T00:18:22.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.294+0000 7f38fb38cb80 20 client.26354 trim_cache size 0 max 16384 2023-10-07T00:18:22.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.318+0000 7f38fb38cb80 1 Processor -- start 2023-10-07T00:18:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38fb38cb80 1 -- start start 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db85685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db855f940 0x564db856fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db8560300 0x564db8568ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db83298c0 con 0x564db855e830 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db8569790 con 0x564db855f940 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db8566ef0 con 0x564db8560300 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38e579b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db85685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38e579b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db85685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40948/0 (socket says 172.21.15.5:40948) 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38e579b700 1 -- 172.21.15.5:0/2118615360 learned_addr learned my addr 172.21.15.5:0/2118615360 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.319+0000 7f38e4f9a700 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db855f940 0x564db856fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db8560300 0x564db8568ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38e579b700 1 -- 172.21.15.5:0/2118615360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db8560300 msgr2=0x564db8568ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38e579b700 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db8560300 0x564db8568ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38e579b700 1 -- 172.21.15.5:0/2118615360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db855f940 msgr2=0x564db856fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38e579b700 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db855f940 0x564db856fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38e579b700 1 -- 172.21.15.5:0/2118615360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564db82fa1f0 con 0x564db855e830 2023-10-07T00:18:22.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38e579b700 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db85685a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f38dc099cd0 tx=0x7f38dc01cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f0dbcc201c4c99 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:22.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38cbfff700 1 -- 172.21.15.5:0/2118615360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc099fd0 con 0x564db855e830 2023-10-07T00:18:22.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.320+0000 7f38cbfff700 1 -- 172.21.15.5:0/2118615360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38dc09e120 con 0x564db855e830 2023-10-07T00:18:22.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.321+0000 7f38cbfff700 1 -- 172.21.15.5:0/2118615360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc004b90 con 0x564db855e830 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.321+0000 7f38fb38cb80 1 -- 172.21.15.5:0/2118615360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 msgr2=0x564db85685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.321+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db85685a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f38dc099cd0 tx=0x7f38dc01cf90 comp rx=0 tx=0).stop 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.321+0000 7f38fb38cb80 1 -- 172.21.15.5:0/2118615360 shutdown_connections 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.321+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db8560300 0x564db8568ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.321+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855e830 0x564db85685a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.321+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/2118615360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db855f940 0x564db856fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.321+0000 7f38fb38cb80 1 -- 172.21.15.5:0/2118615360 >> 172.21.15.5:0/2118615360 conn(0x564db84ca200 msgr2=0x564db85667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.322+0000 7f38fb38cb80 1 -- 172.21.15.5:0/2118615360 shutdown_connections 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.322+0000 7f38fb38cb80 1 -- 172.21.15.5:0/2118615360 wait complete. 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.322+0000 7f38fb38cb80 1 -- start start 2023-10-07T00:18:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.322+0000 7f38fb38cb80 1 Processor -- start 2023-10-07T00:18:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db856d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 0x564db856dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38fb38cb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db856f430 con 0x564db855f940 2023-10-07T00:18:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db856f5a0 con 0x564db8560300 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38fb38cb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db856f760 con 0x564db855e830 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38fb38cb80 10 client.0 _ll_register_callbacks cb 0x7f38d0009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e579b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db856d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e4f9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 0x564db856dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e579b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db856d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:50542/0 (socket says 172.21.15.5:50542) 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e579b700 1 -- 172.21.15.5:0/786121785 learned_addr learned my addr 172.21.15.5:0/786121785 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e5f9c700 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e579b700 1 -- 172.21.15.5:0/786121785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 msgr2=0x564db856eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e579b700 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e579b700 1 -- 172.21.15.5:0/786121785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 msgr2=0x564db856dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e579b700 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 0x564db856dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.323+0000 7f38e579b700 1 -- 172.21.15.5:0/786121785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e006b250 con 0x564db855e830 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.324+0000 7f38e579b700 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db856d9a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38dc099f60 tx=0x7f38dc09a840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849e2a3d4557c035 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.324+0000 7f38c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.324+0000 7f38c8ff9700 1 -- 172.21.15.5:0/786121785 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0b82a0 con 0x564db855e830 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.324+0000 7f38c8ff9700 1 -- 172.21.15.5:0/786121785 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f38dc0a2360 con 0x564db855e830 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.324+0000 7f38fb38cb80 1 -- 172.21.15.5:0/786121785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f38d800be20 con 0x564db855e830 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.324+0000 7f38c8ff9700 1 -- 172.21.15.5:0/786121785 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38dc004b90 con 0x564db855e830 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.324+0000 7f38fb38cb80 10 client.26338 fetch_fsmap learned FSMap version 36 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.324+0000 7f38fb38cb80 1 -- 172.21.15.5:0/786121785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564db82d2250 con 0x564db855e830 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.325+0000 7f38c8ff9700 1 -- 172.21.15.5:0/786121785 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38d800be20 con 0x564db855e830 2023-10-07T00:18:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.325+0000 7f38c8ff9700 1 -- 172.21.15.5:0/786121785 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 36) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f38dc094c70 con 0x564db855e830 2023-10-07T00:18:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.325+0000 7f38fb38cb80 10 client.26338 fetch_fsmap finished waiting for FSMap version 36 2023-10-07T00:18:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.325+0000 7f38fb38cb80 10 client.26338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:18:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.325+0000 7f38fb38cb80 20 client.26338 populate_metadata read hostname 'smithi005' 2023-10-07T00:18:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.325+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564db85c8d20 0x564db85cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.325+0000 7f38fb38cb80 4 client.26338 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:18:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.325+0000 7f38fb38cb80 1 -- 172.21.15.5:0/786121785 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564db84a1ad0 con 0x564db85c8d20 2023-10-07T00:18:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.326+0000 7f38e4f9a700 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564db85c8d20 0x564db85cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.326+0000 7f38e4f9a700 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564db85c8d20 0x564db85cb140 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edd6f80e4116a425 server_cookie=d2b0c7bcdd52dc3d in_seq=0 out_seq=0 2023-10-07T00:18:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.326+0000 7f38c8ff9700 10 client.26338 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38c8ff9700 1 -- 172.21.15.5:0/786121785 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564db84a1ad0 con 0x564db85c8d20 2023-10-07T00:18:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38c8ff9700 10 client.26338 handle_command_reply: tid=0 2023-10-07T00:18:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 client.26338 shutdown 2023-10-07T00:18:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 -- 172.21.15.5:0/786121785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 msgr2=0x564db856d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db856d9a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38dc099f60 tx=0x7f38dc09a840 comp rx=0 tx=0).stop 2023-10-07T00:18:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 -- 172.21.15.5:0/786121785 shutdown_connections 2023-10-07T00:18:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564db85c8d20 0x564db85cb140 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564db8560300 0x564db856eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564db855e830 0x564db856d9a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 --2- 172.21.15.5:0/786121785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db855f940 0x564db856dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38fb38cb80 1 -- 172.21.15.5:0/786121785 >> 172.21.15.5:0/786121785 conn(0x564db84ca200 msgr2=0x564db8563330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.510+0000 7f38c8ff9700 0 client.26338 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.511+0000 7f38fb38cb80 1 -- 172.21.15.5:0/786121785 shutdown_connections 2023-10-07T00:18:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.511+0000 7f38fb38cb80 1 -- 172.21.15.5:0/786121785 wait complete. 2023-10-07T00:18:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.511+0000 7f38fb38cb80 20 client.26338 trim_cache size 0 max 16384 2023-10-07T00:18:22.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:18:22.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:18:22.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:18:22.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.512+0000 7f38e679d700 1 -- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38cc0a15d0 msgr2=0x7f38cc0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38cc0a15d0 0x7f38cc0a3a90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f38d8025000 tx=0x7f38d8027000 comp rx=0 tx=0).stop 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 -- 172.21.15.5:0/2153206609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38e0102f30 msgr2=0x7f38e0198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38e0102f30 0x7f38e0198bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00e9c0 tx=0x7f38dc00ecd0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 -- 172.21.15.5:0/2153206609 shutdown_connections 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f38cc0a15d0 0x7f38cc0a3a90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e0104a40 0x7f38e01a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38e0102f30 0x7f38e0198bd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 --2- 172.21.15.5:0/2153206609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e0104080 0x7f38e0199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 -- 172.21.15.5:0/2153206609 >> 172.21.15.5:0/2153206609 conn(0x7f38e00fe4c0 msgr2=0x7f38e01006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 -- 172.21.15.5:0/2153206609 shutdown_connections 2023-10-07T00:18:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:22.513+0000 7f38e679d700 1 -- 172.21.15.5:0/2153206609 wait complete. 2023-10-07T00:18:23.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:22 smithi005 ceph-mon[129406]: pgmap v514: 97 pgs: 97 active+clean; 249 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-10-07T00:18:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:22 smithi088 ceph-mon[103111]: pgmap v514: 97 pgs: 97 active+clean; 249 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-10-07T00:18:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:22 smithi112 ceph-mon[133548]: pgmap v514: 97 pgs: 97 active+clean; 249 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-10-07T00:18:25.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:24 smithi005 ceph-mon[129406]: pgmap v515: 97 pgs: 97 active+clean; 251 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-10-07T00:18:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:24 smithi088 ceph-mon[103111]: pgmap v515: 97 pgs: 97 active+clean; 251 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-10-07T00:18:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:24 smithi112 ceph-mon[133548]: pgmap v515: 97 pgs: 97 active+clean; 251 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-10-07T00:18:27.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:26 smithi005 ceph-mon[129406]: pgmap v516: 97 pgs: 97 active+clean; 254 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2023-10-07T00:18:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:26 smithi088 ceph-mon[103111]: pgmap v516: 97 pgs: 97 active+clean; 254 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2023-10-07T00:18:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:26 smithi112 ceph-mon[133548]: pgmap v516: 97 pgs: 97 active+clean; 254 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2023-10-07T00:18:27.767 INFO:tasks.workunit.client.0.smithi005.stdout: 47 6969 63 4510 81 1103 67 2023-10-07T00:18:29.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:28 smithi005 ceph-mon[129406]: pgmap v517: 97 pgs: 97 active+clean; 256 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 1.2 MiB/s wr, 201 op/s 2023-10-07T00:18:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:28 smithi088 ceph-mon[103111]: pgmap v517: 97 pgs: 97 active+clean; 256 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 1.2 MiB/s wr, 201 op/s 2023-10-07T00:18:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:28 smithi112 ceph-mon[133548]: pgmap v517: 97 pgs: 97 active+clean; 256 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 1.2 MiB/s wr, 201 op/s 2023-10-07T00:18:31.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:30 smithi005 ceph-mon[129406]: pgmap v518: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.1 MiB/s wr, 188 op/s 2023-10-07T00:18:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:30 smithi088 ceph-mon[103111]: pgmap v518: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.1 MiB/s wr, 188 op/s 2023-10-07T00:18:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:30 smithi112 ceph-mon[133548]: pgmap v518: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.1 MiB/s wr, 188 op/s 2023-10-07T00:18:33.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:32 smithi005 ceph-mon[129406]: pgmap v519: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 1.0 MiB/s wr, 181 op/s 2023-10-07T00:18:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:32 smithi088 ceph-mon[103111]: pgmap v519: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 1.0 MiB/s wr, 181 op/s 2023-10-07T00:18:33.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:32 smithi112 ceph-mon[133548]: pgmap v519: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 1.0 MiB/s wr, 181 op/s 2023-10-07T00:18:34.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:33 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:18:34.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:33 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:18:34.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:33 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:18:35.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:34 smithi005 ceph-mon[129406]: pgmap v520: 97 pgs: 97 active+clean; 261 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.1 MiB/s wr, 184 op/s 2023-10-07T00:18:35.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:18:35.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:18:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:34 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:18:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:34 smithi088 ceph-mon[103111]: pgmap v520: 97 pgs: 97 active+clean; 261 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.1 MiB/s wr, 184 op/s 2023-10-07T00:18:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:18:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:18:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:34 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:18:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:34 smithi112 ceph-mon[133548]: pgmap v520: 97 pgs: 97 active+clean; 261 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.1 MiB/s wr, 184 op/s 2023-10-07T00:18:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:18:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:18:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:34 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:18:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/3553686935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 msgr2=0x7fe4f41024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/3553686935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 0x7fe4f41024e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009990 tx=0x7fe4e4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/3553686935 shutdown_connections 2023-10-07T00:18:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/3553686935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4f4102a20 0x7fe4f4109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/3553686935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f4100f10 0x7fe4f4101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/3553686935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 0x7fe4f41024e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/3553686935 >> 172.21.15.5:0/3553686935 conn(0x7fe4f40fc480 msgr2=0x7fe4f40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/3553686935 shutdown_connections 2023-10-07T00:18:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.751+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/3553686935 wait complete. 2023-10-07T00:18:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.752+0000 7fe4fb3ff700 1 Processor -- start 2023-10-07T00:18:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.753+0000 7fe4fb3ff700 1 -- start start 2023-10-07T00:18:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.753+0000 7fe4fb3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f4100f10 0x7fe4f419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.753+0000 7fe4fb3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 0x7fe4f419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.753+0000 7fe4fb3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4f4102a20 0x7fe4f41a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.753+0000 7fe4fb3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41a4cc0 con 0x7fe4f4100f10 2023-10-07T00:18:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.753+0000 7fe4fb3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41a4e00 con 0x7fe4f4102060 2023-10-07T00:18:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.754+0000 7fe4f899a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 0x7fe4f419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.754+0000 7fe4f899a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 0x7fe4f419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:39918/0 (socket says 172.21.15.5:39918) 2023-10-07T00:18:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.754+0000 7fe4f899a700 1 -- 172.21.15.5:0/454660617 learned_addr learned my addr 172.21.15.5:0/454660617 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.754+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41a4f90 con 0x7fe4f4102a20 2023-10-07T00:18:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.754+0000 7fe4f999c700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4f4102a20 0x7fe4f41a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.754+0000 7fe4f919b700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f4100f10 0x7fe4f419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.755+0000 7fe4f899a700 1 -- 172.21.15.5:0/454660617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4f4102a20 msgr2=0x7fe4f41a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.755+0000 7fe4f899a700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4f4102a20 0x7fe4f41a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.755+0000 7fe4f899a700 1 -- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f4100f10 msgr2=0x7fe4f419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.755+0000 7fe4f899a700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f4100f10 0x7fe4f419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.755+0000 7fe4f899a700 1 -- 172.21.15.5:0/454660617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e40095f0 con 0x7fe4f4102060 2023-10-07T00:18:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.755+0000 7fe4f999c700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4f4102a20 0x7fe4f41a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:18:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.755+0000 7fe4f899a700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 0x7fe4f419dbc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005950 tx=0x7fe4e40039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.756+0000 7fe4ea7fc700 1 -- 172.21.15.5:0/454660617 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e401d070 con 0x7fe4f4102060 2023-10-07T00:18:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.756+0000 7fe4ea7fc700 1 -- 172.21.15.5:0/454660617 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4e400bd50 con 0x7fe4f4102060 2023-10-07T00:18:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.756+0000 7fe4ea7fc700 1 -- 172.21.15.5:0/454660617 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400fda0 con 0x7fe4f4102060 2023-10-07T00:18:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.756+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f41a5210 con 0x7fe4f4102060 2023-10-07T00:18:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.756+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f41a55e0 con 0x7fe4f4102060 2023-10-07T00:18:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.761+0000 7fe4ea7fc700 1 -- 172.21.15.5:0/454660617 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe4e400f560 con 0x7fe4f4102060 2023-10-07T00:18:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.762+0000 7fe50ece3b80 1 Processor -- start 2023-10-07T00:18:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.762+0000 7fe50ece3b80 1 -- start start 2023-10-07T00:18:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.763+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 0x561cc45ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.763+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc45f7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc4557400 con 0x561cc45f0990 2023-10-07T00:18:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc4548bc0 con 0x561cc45effd0 2023-10-07T00:18:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc45464e0 con 0x561cc45eeec0 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe4ea7fc700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4e00a1600 0x7fe4e00a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe4ea7fc700 1 -- 172.21.15.5:0/454660617 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe4e40cdf20 con 0x7fe4f4102060 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe4f919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe4f919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:39934/0 (socket says 172.21.15.5:39934) 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe4f919b700 1 -- 172.21.15.5:0/3235146807 learned_addr learned my addr 172.21.15.5:0/3235146807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe4f999c700 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 0x561cc45ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.764+0000 7fe4f999c700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4e00a1600 0x7fe4e00a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.765+0000 7fe4f919b700 1 -- 172.21.15.5:0/3235146807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 msgr2=0x561cc45ef2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.765+0000 7fe4f919b700 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 0x561cc45ef2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.765+0000 7fe4f919b700 1 -- 172.21.15.5:0/3235146807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 msgr2=0x561cc45f7220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:18:35.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.765+0000 7fe4f899a700 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc45f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.765+0000 7fe4f919b700 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc45f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.765+0000 7fe4f919b700 1 -- 172.21.15.5:0/3235146807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cc436cd80 con 0x561cc45effd0 2023-10-07T00:18:35.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.765+0000 7fe4f899a700 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc45f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:18:35.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.765+0000 7fe4f999c700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4e00a1600 0x7fe4e00a3ac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x561cc45eec60 tx=0x7fe4ec00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:35.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.766+0000 7fe4f919b700 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f0450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009d00 tx=0x7fe4f0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d8f0543db32c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:35.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.766+0000 7fe4df7fe700 1 -- 172.21.15.5:0/3235146807 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0004230 con 0x561cc45effd0 2023-10-07T00:18:35.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.766+0000 7fe4df7fe700 1 -- 172.21.15.5:0/3235146807 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4f0009e50 con 0x561cc45effd0 2023-10-07T00:18:35.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.766+0000 7fe4df7fe700 1 -- 172.21.15.5:0/3235146807 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0019780 con 0x561cc45effd0 2023-10-07T00:18:35.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.767+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3235146807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 msgr2=0x561cc45f0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.767+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f0450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009d00 tx=0x7fe4f0011720 comp rx=0 tx=0).stop 2023-10-07T00:18:35.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.767+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3235146807 shutdown_connections 2023-10-07T00:18:35.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.767+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc45f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.767+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 0x561cc45ef2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.767+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3235146807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f0450 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.767+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3235146807 >> 172.21.15.5:0/3235146807 conn(0x561cc4563200 msgr2=0x561cc45e9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:35.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.768+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3235146807 shutdown_connections 2023-10-07T00:18:35.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.768+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3235146807 wait complete. 2023-10-07T00:18:35.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.769+0000 7fe50ece3b80 1 -- start start 2023-10-07T00:18:35.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.769+0000 7fe50ece3b80 1 Processor -- start 2023-10-07T00:18:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 0x561cc45f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc4600040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc4541dd0 con 0x561cc45f0990 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc44de6b0 con 0x561cc45effd0 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc44de350 con 0x561cc45eeec0 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe50ece3b80 10 client.0 _ll_register_callbacks cb 0x561cc433b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe4f999c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc4600040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe4f999c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc4600040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56276/0 (socket says 172.21.15.5:56276) 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe4f999c700 1 -- 172.21.15.5:0/3425200668 learned_addr learned my addr 172.21.15.5:0/3425200668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.770+0000 7fe4f919b700 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 0x561cc45f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.771+0000 7fe4f999c700 1 -- 172.21.15.5:0/3425200668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 msgr2=0x561cc45f8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.771+0000 7fe4f999c700 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 0x561cc45f8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.771+0000 7fe4f999c700 1 -- 172.21.15.5:0/3425200668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 msgr2=0x561cc45f9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.771+0000 7fe4f999c700 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.771+0000 7fe4f999c700 1 -- 172.21.15.5:0/3425200668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f00099e0 con 0x561cc45f0990 2023-10-07T00:18:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.772+0000 7fe4f999c700 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc4600040 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00ee60 tx=0x7fe4ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5196e8afceb5c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.772+0000 7fe4dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:18:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.772+0000 7fe4dcff9700 1 -- 172.21.15.5:0/3425200668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec004bb0 con 0x561cc45f0990 2023-10-07T00:18:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.772+0000 7fe4dcff9700 1 -- 172.21.15.5:0/3425200668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe4ec020050 con 0x561cc45f0990 2023-10-07T00:18:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.772+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3425200668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cc45e1d50 con 0x561cc45f0990 2023-10-07T00:18:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe4dcff9700 1 -- 172.21.15.5:0/3425200668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4ec004d10 con 0x561cc45f0990 2023-10-07T00:18:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe50ece3b80 10 client.16533 fetch_fsmap learned FSMap version 36 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3425200668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561cc4355c00 con 0x561cc45f0990 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe4dcff9700 1 -- 172.21.15.5:0/3425200668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561cc45e1d50 con 0x561cc45f0990 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe4dcff9700 1 -- 172.21.15.5:0/3425200668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fe4ec01b7e0 con 0x561cc45f0990 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe50ece3b80 10 client.16533 fetch_fsmap finished waiting for FSMap version 36 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe50ece3b80 10 client.16533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe50ece3b80 20 client.16533 populate_metadata read hostname 'smithi005' 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561cc46159c0 0x561cc4617de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe50ece3b80 4 client.16533 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.773+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3425200668 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561cc453adb0 con 0x561cc46159c0 2023-10-07T00:18:35.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.774+0000 7fe4f919b700 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561cc46159c0 0x561cc4617de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.775+0000 7fe4f919b700 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561cc46159c0 0x561cc4617de0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa639edd5b44a29 server_cookie=88f09680b2919aa7 in_seq=0 out_seq=0 2023-10-07T00:18:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.775+0000 7fe4dcff9700 10 client.16533 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.776+0000 7fe4dcff9700 1 -- 172.21.15.5:0/3425200668 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561cc453adb0 con 0x561cc46159c0 2023-10-07T00:18:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.776+0000 7fe4dcff9700 10 client.16533 handle_command_reply: tid=0 2023-10-07T00:18:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 client.16533 shutdown 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3425200668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 msgr2=0x561cc4600040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc4600040 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00ee60 tx=0x7fe4ec004ad0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3425200668 shutdown_connections 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561cc46159c0 0x561cc4617de0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45f0990 0x561cc4600040 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45eeec0 0x561cc45f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/3425200668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45effd0 0x561cc45f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3425200668 >> 172.21.15.5:0/3425200668 conn(0x561cc4563200 msgr2=0x561cc45e9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe4dcff9700 0 client.16533 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3425200668 shutdown_connections 2023-10-07T00:18:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.777+0000 7fe50ece3b80 1 -- 172.21.15.5:0/3425200668 wait complete. 2023-10-07T00:18:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.778+0000 7fe50ece3b80 20 client.16533 trim_cache size 0 max 16384 2023-10-07T00:18:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.804+0000 7fe50ece3b80 1 Processor -- start 2023-10-07T00:18:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.804+0000 7fe50ece3b80 1 -- start start 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.804+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45f8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.804+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.804+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 0x561cc45f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.804+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc43c28c0 con 0x561cc45effd0 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.804+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc45f6c10 con 0x561cc45eeec0 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.804+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc45f4500 con 0x561cc45f0990 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f999c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 0x561cc45f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f899a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f999c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 0x561cc45f77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:40998/0 (socket says 172.21.15.5:40998) 2023-10-07T00:18:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f999c700 1 -- 172.21.15.5:0/2179963249 learned_addr learned my addr 172.21.15.5:0/2179963249 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f919b700 1 --2- 172.21.15.5:0/2179963249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f899a700 1 -- 172.21.15.5:0/2179963249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 msgr2=0x561cc45f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f899a700 1 --2- 172.21.15.5:0/2179963249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 0x561cc45f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f899a700 1 -- 172.21.15.5:0/2179963249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 msgr2=0x561cc45f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f899a700 1 --2- 172.21.15.5:0/2179963249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f899a700 1 -- 172.21.15.5:0/2179963249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cc43931f0 con 0x561cc45effd0 2023-10-07T00:18:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.805+0000 7fe4f899a700 1 --2- 172.21.15.5:0/2179963249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fff60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40cb9a0 tx=0x7fe4e409b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7914967c891e77d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.806+0000 7fe4dffff700 1 -- 172.21.15.5:0/2179963249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e409b950 con 0x561cc45effd0 2023-10-07T00:18:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.806+0000 7fe4dffff700 1 -- 172.21.15.5:0/2179963249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4e409b250 con 0x561cc45effd0 2023-10-07T00:18:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.806+0000 7fe4dffff700 1 -- 172.21.15.5:0/2179963249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e409b4b0 con 0x561cc45effd0 2023-10-07T00:18:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 -- 172.21.15.5:0/2179963249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 msgr2=0x561cc45fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/2179963249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fff60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40cb9a0 tx=0x7fe4e409b070 comp rx=0 tx=0).stop 2023-10-07T00:18:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 -- 172.21.15.5:0/2179963249 shutdown_connections 2023-10-07T00:18:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/2179963249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 0x561cc45f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/2179963249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/2179963249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fff60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 -- 172.21.15.5:0/2179963249 >> 172.21.15.5:0/2179963249 conn(0x561cc4563200 msgr2=0x561cc45e9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 -- 172.21.15.5:0/2179963249 shutdown_connections 2023-10-07T00:18:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.807+0000 7fe50ece3b80 1 -- 172.21.15.5:0/2179963249 wait complete. 2023-10-07T00:18:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.808+0000 7fe50ece3b80 1 -- start start 2023-10-07T00:18:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.808+0000 7fe50ece3b80 1 Processor -- start 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe50ece3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 0x561cc45fe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc45febd0 con 0x561cc45effd0 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc45fed40 con 0x561cc45eeec0 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe50ece3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cc45fef00 con 0x561cc45f0990 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe50ece3b80 10 client.0 _ll_register_callbacks cb 0x561cc433b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe4f919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe4f919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:39958/0 (socket says 172.21.15.5:39958) 2023-10-07T00:18:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.809+0000 7fe4f919b700 1 -- 172.21.15.5:0/1862212951 learned_addr learned my addr 172.21.15.5:0/1862212951 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4f899a700 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4f919b700 1 -- 172.21.15.5:0/1862212951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 msgr2=0x561cc45fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4f919b700 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 0x561cc45fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4f919b700 1 -- 172.21.15.5:0/1862212951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 msgr2=0x561cc45fd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4f919b700 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4f919b700 1 -- 172.21.15.5:0/1862212951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f41a55e0 con 0x561cc45eeec0 2023-10-07T00:18:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4f899a700 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:18:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4f919b700 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45fd140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009cd0 tx=0x7fe4f0003da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd42bbd07b695ece server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.810+0000 7fe4dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:18:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.811+0000 7fe4dcff9700 1 -- 172.21.15.5:0/1862212951 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0003bb0 con 0x561cc45eeec0 2023-10-07T00:18:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.811+0000 7fe4dcff9700 1 -- 172.21.15.5:0/1862212951 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe4f0029040 con 0x561cc45eeec0 2023-10-07T00:18:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.811+0000 7fe50ece3b80 1 -- 172.21.15.5:0/1862212951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe4f0009e50 con 0x561cc45eeec0 2023-10-07T00:18:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.811+0000 7fe4dcff9700 1 -- 172.21.15.5:0/1862212951 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4f00050b0 con 0x561cc45eeec0 2023-10-07T00:18:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.812+0000 7fe50ece3b80 10 client.26375 fetch_fsmap learned FSMap version 36 2023-10-07T00:18:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.812+0000 7fe50ece3b80 1 -- 172.21.15.5:0/1862212951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561cc436b250 con 0x561cc45eeec0 2023-10-07T00:18:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.812+0000 7fe4dcff9700 1 -- 172.21.15.5:0/1862212951 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4f0009e50 con 0x561cc45eeec0 2023-10-07T00:18:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.812+0000 7fe4dcff9700 1 -- 172.21.15.5:0/1862212951 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 36) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fe4f0011440 con 0x561cc45eeec0 2023-10-07T00:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.812+0000 7fe50ece3b80 10 client.26375 fetch_fsmap finished waiting for FSMap version 36 2023-10-07T00:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.812+0000 7fe50ece3b80 10 client.26375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.812+0000 7fe50ece3b80 20 client.26375 populate_metadata read hostname 'smithi005' 2023-10-07T00:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.813+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561cc4669b20 0x561cc466bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.813+0000 7fe50ece3b80 4 client.26375 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.813+0000 7fe50ece3b80 1 -- 172.21.15.5:0/1862212951 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561cc453aad0 con 0x561cc4669b20 2023-10-07T00:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.813+0000 7fe4f899a700 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561cc4669b20 0x561cc466bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.813+0000 7fe4f899a700 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561cc4669b20 0x561cc466bf40 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71f1612bf48157d7 server_cookie=78e537a6bdbe4f87 in_seq=0 out_seq=0 2023-10-07T00:18:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.813+0000 7fe4dcff9700 10 client.26375 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.945+0000 7fe4dcff9700 1 -- 172.21.15.5:0/1862212951 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561cc453aad0 con 0x561cc4669b20 2023-10-07T00:18:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.945+0000 7fe4dcff9700 10 client.26375 handle_command_reply: tid=0 2023-10-07T00:18:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.945+0000 7fe50ece3b80 1 client.26375 shutdown 2023-10-07T00:18:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.945+0000 7fe50ece3b80 1 -- 172.21.15.5:0/1862212951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 msgr2=0x561cc45fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45fd140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009cd0 tx=0x7fe4f0003da0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 -- 172.21.15.5:0/1862212951 shutdown_connections 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x561cc4669b20 0x561cc466bf40 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cc45f0990 0x561cc45fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561cc45eeec0 0x561cc45fd140 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 --2- 172.21.15.5:0/1862212951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561cc45effd0 0x561cc45fd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 -- 172.21.15.5:0/1862212951 >> 172.21.15.5:0/1862212951 conn(0x561cc4563200 msgr2=0x561cc4611880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe4dcff9700 0 client.26375 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 -- 172.21.15.5:0/1862212951 shutdown_connections 2023-10-07T00:18:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.946+0000 7fe50ece3b80 1 -- 172.21.15.5:0/1862212951 wait complete. 2023-10-07T00:18:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.947+0000 7fe50ece3b80 20 client.26375 trim_cache size 0 max 16384 2023-10-07T00:18:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:18:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:18:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:18:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:18:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.947+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4e00a1600 msgr2=0x7fe4e00a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.947+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4e00a1600 0x7fe4e00a3ac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x561cc45eec60 tx=0x7fe4ec00b040 comp rx=0 tx=0).stop 2023-10-07T00:18:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.947+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 msgr2=0x7fe4f419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.947+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 0x7fe4f419dbc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005950 tx=0x7fe4e40039f0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.948+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 shutdown_connections 2023-10-07T00:18:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.948+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe4e00a1600 0x7fe4e00a3ac0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.948+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4f4102a20 0x7fe4f41a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.948+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f4100f10 0x7fe4f419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.948+0000 7fe4fb3ff700 1 --2- 172.21.15.5:0/454660617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f4102060 0x7fe4f419dbc0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005950 tx=0x7fe4e40039f0 comp rx=0 tx=0).stop 2023-10-07T00:18:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.948+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 >> 172.21.15.5:0/454660617 conn(0x7fe4f40fc480 msgr2=0x7fe4f40fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.948+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 shutdown_connections 2023-10-07T00:18:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:35.948+0000 7fe4fb3ff700 1 -- 172.21.15.5:0/454660617 wait complete. 2023-10-07T00:18:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:36 smithi005 ceph-mon[129406]: pgmap v521: 97 pgs: 97 active+clean; 262 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.0 MiB/s wr, 170 op/s 2023-10-07T00:18:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:36 smithi088 ceph-mon[103111]: pgmap v521: 97 pgs: 97 active+clean; 262 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.0 MiB/s wr, 170 op/s 2023-10-07T00:18:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:36 smithi112 ceph-mon[133548]: pgmap v521: 97 pgs: 97 active+clean; 262 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.0 MiB/s wr, 170 op/s 2023-10-07T00:18:37.767 INFO:tasks.workunit.client.0.smithi005.stdout: 47 6571 43 4036 63 1385 78 2023-10-07T00:18:39.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:38 smithi005 ceph-mon[129406]: pgmap v522: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 990 KiB/s wr, 143 op/s 2023-10-07T00:18:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:38 smithi088 ceph-mon[103111]: pgmap v522: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 990 KiB/s wr, 143 op/s 2023-10-07T00:18:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:38 smithi112 ceph-mon[133548]: pgmap v522: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 990 KiB/s wr, 143 op/s 2023-10-07T00:18:41.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:40 smithi005 ceph-mon[129406]: pgmap v523: 97 pgs: 97 active+clean; 262 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 944 KiB/s wr, 129 op/s 2023-10-07T00:18:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:40 smithi088 ceph-mon[103111]: pgmap v523: 97 pgs: 97 active+clean; 262 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 944 KiB/s wr, 129 op/s 2023-10-07T00:18:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:40 smithi112 ceph-mon[133548]: pgmap v523: 97 pgs: 97 active+clean; 262 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 944 KiB/s wr, 129 op/s 2023-10-07T00:18:43.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:42 smithi005 ceph-mon[129406]: pgmap v524: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1004 KiB/s wr, 153 op/s 2023-10-07T00:18:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:42 smithi088 ceph-mon[103111]: pgmap v524: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1004 KiB/s wr, 153 op/s 2023-10-07T00:18:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:42 smithi112 ceph-mon[133548]: pgmap v524: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1004 KiB/s wr, 153 op/s 2023-10-07T00:18:45.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:44 smithi005 ceph-mon[129406]: pgmap v525: 97 pgs: 97 active+clean; 265 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 989 KiB/s wr, 154 op/s 2023-10-07T00:18:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:44 smithi088 ceph-mon[103111]: pgmap v525: 97 pgs: 97 active+clean; 265 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 989 KiB/s wr, 154 op/s 2023-10-07T00:18:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:44 smithi112 ceph-mon[133548]: pgmap v525: 97 pgs: 97 active+clean; 265 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 989 KiB/s wr, 154 op/s 2023-10-07T00:18:47.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:46 smithi005 ceph-mon[129406]: pgmap v526: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 955 KiB/s wr, 153 op/s 2023-10-07T00:18:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:46 smithi088 ceph-mon[103111]: pgmap v526: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 955 KiB/s wr, 153 op/s 2023-10-07T00:18:47.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:46 smithi112 ceph-mon[133548]: pgmap v526: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 955 KiB/s wr, 153 op/s 2023-10-07T00:18:47.767 INFO:tasks.workunit.client.0.smithi005.stdout: 48 6693 41 4201 41 1580 73 2023-10-07T00:18:49.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:48 smithi005 ceph-mon[129406]: pgmap v527: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 923 KiB/s wr, 162 op/s 2023-10-07T00:18:49.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 -- 172.21.15.5:0/328550104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c10d280 msgr2=0x7fad4c10f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 --2- 172.21.15.5:0/328550104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c10d280 0x7fad4c10f670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad4400b0a0 tx=0x7fad4400b3b0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 -- 172.21.15.5:0/328550104 shutdown_connections 2023-10-07T00:18:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 --2- 172.21.15.5:0/328550104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c10d280 0x7fad4c10f670 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 --2- 172.21.15.5:0/328550104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad4c074ef0 0x7fad4c073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 --2- 172.21.15.5:0/328550104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4c073910 0x7fad4c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 -- 172.21.15.5:0/328550104 >> 172.21.15.5:0/328550104 conn(0x7fad4c0fc240 msgr2=0x7fad4c0fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 -- 172.21.15.5:0/328550104 shutdown_connections 2023-10-07T00:18:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.174+0000 7fad52f9d700 1 -- 172.21.15.5:0/328550104 wait complete. 2023-10-07T00:18:49.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.176+0000 7fad52f9d700 1 Processor -- start 2023-10-07T00:18:49.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.176+0000 7fad52f9d700 1 -- start start 2023-10-07T00:18:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad52f9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c073910 0x7fad4c109a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad52f9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4c074ef0 0x7fad4c109fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad52f9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad4c10d280 0x7fad4c1acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad52f9d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c10a600 con 0x7fad4c10d280 2023-10-07T00:18:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad52f9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c1ad520 con 0x7fad4c074ef0 2023-10-07T00:18:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad52f9d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c1ad660 con 0x7fad4c073910 2023-10-07T00:18:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad51f9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c073910 0x7fad4c109a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad51f9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c073910 0x7fad4c109a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:47588/0 (socket says 172.21.15.5:47588) 2023-10-07T00:18:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad51f9b700 1 -- 172.21.15.5:0/3557306123 learned_addr learned my addr 172.21.15.5:0/3557306123 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.177+0000 7fad5179a700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4c074ef0 0x7fad4c109fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.178+0000 7fad5279c700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad4c10d280 0x7fad4c1acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.178+0000 7fad51f9b700 1 -- 172.21.15.5:0/3557306123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4c074ef0 msgr2=0x7fad4c109fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.178+0000 7fad51f9b700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4c074ef0 0x7fad4c109fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.178+0000 7fad51f9b700 1 -- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad4c10d280 msgr2=0x7fad4c1acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.178+0000 7fad51f9b700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad4c10d280 0x7fad4c1acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.178+0000 7fad51f9b700 1 -- 172.21.15.5:0/3557306123 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44009d00 con 0x7fad4c073910 2023-10-07T00:18:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.178+0000 7fad51f9b700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c073910 0x7fad4c109a60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00e9a0 tx=0x7fad3c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.179+0000 7fad4affd700 1 -- 172.21.15.5:0/3557306123 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c009790 con 0x7fad4c073910 2023-10-07T00:18:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.179+0000 7fad4affd700 1 -- 172.21.15.5:0/3557306123 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad3c00cbd0 con 0x7fad4c073910 2023-10-07T00:18:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.179+0000 7fad4affd700 1 -- 172.21.15.5:0/3557306123 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c018680 con 0x7fad4c073910 2023-10-07T00:18:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.179+0000 7fad52f9d700 1 -- 172.21.15.5:0/3557306123 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4c1ad890 con 0x7fad4c073910 2023-10-07T00:18:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.179+0000 7fad52f9d700 1 -- 172.21.15.5:0/3557306123 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c1adcf0 con 0x7fad4c073910 2023-10-07T00:18:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.184+0000 7fad4affd700 1 -- 172.21.15.5:0/3557306123 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fad3c00cd40 con 0x7fad4c073910 2023-10-07T00:18:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.185+0000 7fad67c05b80 1 Processor -- start 2023-10-07T00:18:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.185+0000 7fad67c05b80 1 -- start start 2023-10-07T00:18:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 0x5654ea43f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea447380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad67c05b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea3a7400 con 0x5654ea43f020 2023-10-07T00:18:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad67c05b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea398bc0 con 0x5654ea440130 2023-10-07T00:18:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad67c05b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea3964e0 con 0x5654ea440af0 2023-10-07T00:18:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad5179a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea447380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad5179a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea447380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:47594/0 (socket says 172.21.15.5:47594) 2023-10-07T00:18:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.186+0000 7fad5179a700 1 -- 172.21.15.5:0/2452976484 learned_addr learned my addr 172.21.15.5:0/2452976484 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad5279c700 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 0x5654ea43f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad51f9b700 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad5179a700 1 -- 172.21.15.5:0/2452976484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 msgr2=0x5654ea4405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad5179a700 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad5179a700 1 -- 172.21.15.5:0/2452976484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 msgr2=0x5654ea43f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad5179a700 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 0x5654ea43f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad5179a700 1 -- 172.21.15.5:0/2452976484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654ea1bcd80 con 0x5654ea440af0 2023-10-07T00:18:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad51f9b700 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:18:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad4affd700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fad340a1650 0x7fad340a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad5179a700 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea447380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fad40009d30 tx=0x7fad40011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbe7e431bad0fe83 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.187+0000 7fad4affd700 1 -- 172.21.15.5:0/3557306123 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fad3c014070 con 0x7fad4c073910 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.188+0000 7fad5279c700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fad340a1650 0x7fad340a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.188+0000 7fad33fff700 1 -- 172.21.15.5:0/2452976484 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40004220 con 0x5654ea440af0 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.188+0000 7fad33fff700 1 -- 172.21.15.5:0/2452976484 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad40004380 con 0x5654ea440af0 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.188+0000 7fad33fff700 1 -- 172.21.15.5:0/2452976484 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400197a0 con 0x5654ea440af0 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 -- 172.21.15.5:0/2452976484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 msgr2=0x5654ea447380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad5279c700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fad340a1650 0x7fad340a3b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fad4400b780 tx=0x7fad44006230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea447380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fad40009d30 tx=0x7fad40011720 comp rx=0 tx=0).stop 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 -- 172.21.15.5:0/2452976484 shutdown_connections 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea447380 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 0x5654ea43f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2452976484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 -- 172.21.15.5:0/2452976484 >> 172.21.15.5:0/2452976484 conn(0x5654ea3b3200 msgr2=0x5654ea439ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 -- 172.21.15.5:0/2452976484 shutdown_connections 2023-10-07T00:18:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.189+0000 7fad67c05b80 1 -- 172.21.15.5:0/2452976484 wait complete. 2023-10-07T00:18:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.190+0000 7fad67c05b80 1 -- start start 2023-10-07T00:18:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.190+0000 7fad67c05b80 1 Processor -- start 2023-10-07T00:18:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea43f020 0x5654ea448ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440af0 0x5654ea450220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad67c05b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea391dd0 con 0x5654ea440af0 2023-10-07T00:18:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad67c05b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea32e6b0 con 0x5654ea440130 2023-10-07T00:18:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad67c05b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea32e350 con 0x5654ea43f020 2023-10-07T00:18:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad67c05b80 10 client.0 _ll_register_callbacks cb 0x5654ea18b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:18:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad5179a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad5179a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:42024/0 (socket says 172.21.15.5:42024) 2023-10-07T00:18:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.191+0000 7fad5179a700 1 -- 172.21.15.5:0/2711936418 learned_addr learned my addr 172.21.15.5:0/2711936418 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.192+0000 7fad5179a700 1 -- 172.21.15.5:0/2711936418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea43f020 msgr2=0x5654ea448ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T00:18:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.192+0000 7fad5179a700 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea43f020 0x5654ea448ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.192+0000 7fad5179a700 1 -- 172.21.15.5:0/2711936418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440af0 msgr2=0x5654ea450220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.192+0000 7fad5179a700 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440af0 0x5654ea450220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.192+0000 7fad5179a700 1 -- 172.21.15.5:0/2711936418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad40009960 con 0x5654ea440130 2023-10-07T00:18:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.192+0000 7fad5179a700 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4491e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad40009610 tx=0x7fad40003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2f1a19b1f8e70ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.192+0000 7fad317fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:18:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.193+0000 7fad317fa700 1 -- 172.21.15.5:0/2711936418 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40003b00 con 0x5654ea440130 2023-10-07T00:18:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.193+0000 7fad67c05b80 1 -- 172.21.15.5:0/2711936418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654ea431eb0 con 0x5654ea440130 2023-10-07T00:18:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.193+0000 7fad317fa700 1 -- 172.21.15.5:0/2711936418 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fad40005450 con 0x5654ea440130 2023-10-07T00:18:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.193+0000 7fad317fa700 1 -- 172.21.15.5:0/2711936418 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad40004560 con 0x5654ea440130 2023-10-07T00:18:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.193+0000 7fad67c05b80 10 client.26384 fetch_fsmap learned FSMap version 36 2023-10-07T00:18:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.193+0000 7fad67c05b80 1 -- 172.21.15.5:0/2711936418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5654ea1a5c00 con 0x5654ea440130 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.194+0000 7fad317fa700 1 -- 172.21.15.5:0/2711936418 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5654ea431eb0 con 0x5654ea440130 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.194+0000 7fad317fa700 1 -- 172.21.15.5:0/2711936418 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 36) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fad40021040 con 0x5654ea440130 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.194+0000 7fad67c05b80 10 client.26384 fetch_fsmap finished waiting for FSMap version 36 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.194+0000 7fad67c05b80 10 client.26384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.194+0000 7fad67c05b80 20 client.26384 populate_metadata read hostname 'smithi005' 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.194+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5654ea4549c0 0x5654ea456de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.194+0000 7fad67c05b80 4 client.26384 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.194+0000 7fad67c05b80 1 -- 172.21.15.5:0/2711936418 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654ea38adb0 con 0x5654ea4549c0 2023-10-07T00:18:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.195+0000 7fad51f9b700 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5654ea4549c0 0x5654ea456de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.196+0000 7fad51f9b700 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5654ea4549c0 0x5654ea456de0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=710dbe49b65a59f4 server_cookie=f135f55c562b0bcc in_seq=0 out_seq=0 2023-10-07T00:18:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.196+0000 7fad317fa700 10 client.26384 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.196+0000 7fad317fa700 1 -- 172.21.15.5:0/2711936418 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5654ea38adb0 con 0x5654ea4549c0 2023-10-07T00:18:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.196+0000 7fad317fa700 10 client.26384 handle_command_reply: tid=0 2023-10-07T00:18:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.197+0000 7fad67c05b80 1 client.26384 shutdown 2023-10-07T00:18:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.197+0000 7fad67c05b80 1 -- 172.21.15.5:0/2711936418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 msgr2=0x5654ea4491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.197+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4491e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad40009610 tx=0x7fad40003960 comp rx=0 tx=0).stop 2023-10-07T00:18:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad67c05b80 1 -- 172.21.15.5:0/2711936418 shutdown_connections 2023-10-07T00:18:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5654ea4549c0 0x5654ea456de0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440af0 0x5654ea450220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea43f020 0x5654ea448ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2711936418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440130 0x5654ea4491e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad67c05b80 1 -- 172.21.15.5:0/2711936418 >> 172.21.15.5:0/2711936418 conn(0x5654ea3b3200 msgr2=0x5654ea4393b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad317fa700 0 client.26384 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad67c05b80 1 -- 172.21.15.5:0/2711936418 shutdown_connections 2023-10-07T00:18:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.198+0000 7fad67c05b80 1 -- 172.21.15.5:0/2711936418 wait complete. 2023-10-07T00:18:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.199+0000 7fad67c05b80 20 client.26384 trim_cache size 0 max 16384 2023-10-07T00:18:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:48 smithi088 ceph-mon[103111]: pgmap v527: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 923 KiB/s wr, 162 op/s 2023-10-07T00:18:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.227+0000 7fad67c05b80 1 Processor -- start 2023-10-07T00:18:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.227+0000 7fad67c05b80 1 -- start start 2023-10-07T00:18:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.228+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 0x5654ea4393b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.228+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440130 0x5654ea4501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.228+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440af0 0x5654ea4569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.228+0000 7fad67c05b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea448870 con 0x5654ea43f020 2023-10-07T00:18:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.228+0000 7fad67c05b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea2128c0 con 0x5654ea440af0 2023-10-07T00:18:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.228+0000 7fad67c05b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea454500 con 0x5654ea440130 2023-10-07T00:18:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.229+0000 7fad5179a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440130 0x5654ea4501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.229+0000 7fad5179a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440130 0x5654ea4501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:47596/0 (socket says 172.21.15.5:47596) 2023-10-07T00:18:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.229+0000 7fad5179a700 1 -- 172.21.15.5:0/2703059927 learned_addr learned my addr 172.21.15.5:0/2703059927 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.229+0000 7fad5279c700 1 --2- 172.21.15.5:0/2703059927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440af0 0x5654ea4569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad5179a700 1 -- 172.21.15.5:0/2703059927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440af0 msgr2=0x5654ea4569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad5179a700 1 --2- 172.21.15.5:0/2703059927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440af0 0x5654ea4569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad5179a700 1 -- 172.21.15.5:0/2703059927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 msgr2=0x5654ea4393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad5179a700 1 --2- 172.21.15.5:0/2703059927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 0x5654ea4393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad5179a700 1 -- 172.21.15.5:0/2703059927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654ea1e31f0 con 0x5654ea440130 2023-10-07T00:18:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad5179a700 1 --2- 172.21.15.5:0/2703059927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440130 0x5654ea4501b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad40000c00 tx=0x7fad40019c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28df0e1074ad2f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad48ff9700 1 -- 172.21.15.5:0/2703059927 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400092a0 con 0x5654ea440130 2023-10-07T00:18:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad48ff9700 1 -- 172.21.15.5:0/2703059927 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad40019630 con 0x5654ea440130 2023-10-07T00:18:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.230+0000 7fad48ff9700 1 -- 172.21.15.5:0/2703059927 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400048c0 con 0x5654ea440130 2023-10-07T00:18:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.231+0000 7fad67c05b80 1 -- 172.21.15.5:0/2703059927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440130 msgr2=0x5654ea4501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.231+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2703059927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440130 0x5654ea4501b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad40000c00 tx=0x7fad40019c00 comp rx=0 tx=0).stop 2023-10-07T00:18:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.231+0000 7fad67c05b80 1 -- 172.21.15.5:0/2703059927 shutdown_connections 2023-10-07T00:18:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.231+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2703059927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea440af0 0x5654ea4569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.231+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2703059927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea43f020 0x5654ea4393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.231+0000 7fad67c05b80 1 --2- 172.21.15.5:0/2703059927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440130 0x5654ea4501b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.231+0000 7fad67c05b80 1 -- 172.21.15.5:0/2703059927 >> 172.21.15.5:0/2703059927 conn(0x5654ea3b3200 msgr2=0x5654ea435e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.232+0000 7fad67c05b80 1 -- 172.21.15.5:0/2703059927 shutdown_connections 2023-10-07T00:18:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.232+0000 7fad67c05b80 1 -- 172.21.15.5:0/2703059927 wait complete. 2023-10-07T00:18:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.232+0000 7fad67c05b80 1 -- start start 2023-10-07T00:18:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.233+0000 7fad67c05b80 1 Processor -- start 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.233+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea43f020 0x5654ea44d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.233+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440130 0x5654ea44db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.233+0000 7fad67c05b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea44eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.233+0000 7fad67c05b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea44f060 con 0x5654ea440130 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.233+0000 7fad67c05b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea44f1d0 con 0x5654ea43f020 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.233+0000 7fad67c05b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ea44f340 con 0x5654ea440af0 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.233+0000 7fad67c05b80 10 client.0 _ll_register_callbacks cb 0x7fad40009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad51f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea43f020 0x5654ea44d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad51f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea43f020 0x5654ea44d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:42042/0 (socket says 172.21.15.5:42042) 2023-10-07T00:18:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad51f9b700 1 -- 172.21.15.5:0/1158905512 learned_addr learned my addr 172.21.15.5:0/1158905512 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:18:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad5179a700 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440130 0x5654ea44db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad51f9b700 1 -- 172.21.15.5:0/1158905512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 msgr2=0x5654ea44eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad5279c700 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea44eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad51f9b700 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea44eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad51f9b700 1 -- 172.21.15.5:0/1158905512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440130 msgr2=0x5654ea44db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad51f9b700 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440130 0x5654ea44db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad51f9b700 1 -- 172.21.15.5:0/1158905512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654ea1a5c00 con 0x5654ea43f020 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.234+0000 7fad5279c700 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea44eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.235+0000 7fad51f9b700 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea43f020 0x5654ea44d5d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0cd420 tx=0x7fad3c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655272de7a9ebffe server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.235+0000 7fad317fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.235+0000 7fad317fa700 1 -- 172.21.15.5:0/1158905512 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c09a5e0 con 0x5654ea43f020 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.235+0000 7fad317fa700 1 -- 172.21.15.5:0/1158905512 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fad3c09e730 con 0x5654ea43f020 2023-10-07T00:18:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.235+0000 7fad67c05b80 1 -- 172.21.15.5:0/1158905512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad40004380 con 0x5654ea43f020 2023-10-07T00:18:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.236+0000 7fad317fa700 1 -- 172.21.15.5:0/1158905512 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad3c0b5030 con 0x5654ea43f020 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.236+0000 7fad67c05b80 10 client.26390 fetch_fsmap learned FSMap version 36 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.236+0000 7fad67c05b80 1 -- 172.21.15.5:0/1158905512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5654ea1bb250 con 0x5654ea43f020 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.236+0000 7fad317fa700 1 -- 172.21.15.5:0/1158905512 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad40004380 con 0x5654ea43f020 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.237+0000 7fad317fa700 1 -- 172.21.15.5:0/1158905512 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 36) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fad3c0b8020 con 0x5654ea43f020 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.237+0000 7fad67c05b80 10 client.26390 fetch_fsmap finished waiting for FSMap version 36 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.237+0000 7fad67c05b80 10 client.26390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.237+0000 7fad67c05b80 20 client.26390 populate_metadata read hostname 'smithi005' 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.237+0000 7fad67c05b80 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5654ea4b9e80 0x5654ea4bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.237+0000 7fad67c05b80 4 client.26390 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:18:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.237+0000 7fad67c05b80 1 -- 172.21.15.5:0/1158905512 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5654ea38aad0 con 0x5654ea4b9e80 2023-10-07T00:18:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.238+0000 7fad5179a700 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5654ea4b9e80 0x5654ea4bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:18:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.239+0000 7fad5179a700 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5654ea4b9e80 0x5654ea4bc2a0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfeb1f744b12873a server_cookie=d6eb70f49adf311e in_seq=0 out_seq=0 2023-10-07T00:18:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.239+0000 7fad317fa700 10 client.26390 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:48 smithi112 ceph-mon[133548]: pgmap v527: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 923 KiB/s wr, 162 op/s 2023-10-07T00:18:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.286+0000 7fad317fa700 1 -- 172.21.15.5:0/1158905512 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5654ea38aad0 con 0x5654ea4b9e80 2023-10-07T00:18:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.286+0000 7fad317fa700 10 client.26390 handle_command_reply: tid=0 2023-10-07T00:18:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.286+0000 7fad67c05b80 1 client.26390 shutdown 2023-10-07T00:18:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 -- 172.21.15.5:0/1158905512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea43f020 msgr2=0x5654ea44d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea43f020 0x5654ea44d5d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0cd420 tx=0x7fad3c00eef0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 -- 172.21.15.5:0/1158905512 shutdown_connections 2023-10-07T00:18:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5654ea4b9e80 0x5654ea4bc2a0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654ea440af0 0x5654ea44eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5654ea43f020 0x5654ea44d5d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 --2- 172.21.15.5:0/1158905512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654ea440130 0x5654ea44db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 -- 172.21.15.5:0/1158905512 >> 172.21.15.5:0/1158905512 conn(0x5654ea3b3200 msgr2=0x5654ea4393b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad317fa700 0 client.26390 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:18:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.287+0000 7fad67c05b80 1 -- 172.21.15.5:0/1158905512 shutdown_connections 2023-10-07T00:18:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.288+0000 7fad67c05b80 1 -- 172.21.15.5:0/1158905512 wait complete. 2023-10-07T00:18:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.289+0000 7fad67c05b80 20 client.26390 trim_cache size 0 max 16384 2023-10-07T00:18:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:18:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:18:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:18:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:18:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 -- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fad340a1650 msgr2=0x7fad340a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fad340a1650 0x7fad340a3b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fad4400b780 tx=0x7fad44006230 comp rx=0 tx=0).stop 2023-10-07T00:18:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 -- 172.21.15.5:0/3557306123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c073910 msgr2=0x7fad4c109a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:18:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c073910 0x7fad4c109a60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00e9a0 tx=0x7fad3c00ecb0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 -- 172.21.15.5:0/3557306123 shutdown_connections 2023-10-07T00:18:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fad340a1650 0x7fad340a3b10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad4c10d280 0x7fad4c1acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad4c073910 0x7fad4c109a60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 --2- 172.21.15.5:0/3557306123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4c074ef0 0x7fad4c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:18:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 -- 172.21.15.5:0/3557306123 >> 172.21.15.5:0/3557306123 conn(0x7fad4c0fc240 msgr2=0x7fad4c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:18:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.290+0000 7fad52f9d700 1 -- 172.21.15.5:0/3557306123 shutdown_connections 2023-10-07T00:18:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:18:49.291+0000 7fad52f9d700 1 -- 172.21.15.5:0/3557306123 wait complete. 2023-10-07T00:18:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:50 smithi088 ceph-mon[103111]: pgmap v528: 97 pgs: 97 active+clean; 269 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 864 KiB/s wr, 142 op/s 2023-10-07T00:18:51.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:50 smithi112 ceph-mon[133548]: pgmap v528: 97 pgs: 97 active+clean; 269 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 864 KiB/s wr, 142 op/s 2023-10-07T00:18:51.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:50 smithi005 ceph-mon[129406]: pgmap v528: 97 pgs: 97 active+clean; 269 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 864 KiB/s wr, 142 op/s 2023-10-07T00:18:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:52 smithi088 ceph-mon[103111]: pgmap v529: 97 pgs: 97 active+clean; 271 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 925 KiB/s wr, 150 op/s 2023-10-07T00:18:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:52 smithi112 ceph-mon[133548]: pgmap v529: 97 pgs: 97 active+clean; 271 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 925 KiB/s wr, 150 op/s 2023-10-07T00:18:53.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:52 smithi005 ceph-mon[129406]: pgmap v529: 97 pgs: 97 active+clean; 271 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 925 KiB/s wr, 150 op/s 2023-10-07T00:18:55.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:54 smithi088 ceph-mon[103111]: pgmap v530: 97 pgs: 97 active+clean; 272 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 829 KiB/s wr, 131 op/s 2023-10-07T00:18:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:54 smithi112 ceph-mon[133548]: pgmap v530: 97 pgs: 97 active+clean; 272 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 829 KiB/s wr, 131 op/s 2023-10-07T00:18:55.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:54 smithi005 ceph-mon[129406]: pgmap v530: 97 pgs: 97 active+clean; 272 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 829 KiB/s wr, 131 op/s 2023-10-07T00:18:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:56 smithi088 ceph-mon[103111]: pgmap v531: 97 pgs: 97 active+clean; 274 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 831 KiB/s wr, 130 op/s 2023-10-07T00:18:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:56 smithi112 ceph-mon[133548]: pgmap v531: 97 pgs: 97 active+clean; 274 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 831 KiB/s wr, 130 op/s 2023-10-07T00:18:57.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:56 smithi005 ceph-mon[129406]: pgmap v531: 97 pgs: 97 active+clean; 274 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 831 KiB/s wr, 130 op/s 2023-10-07T00:18:57.767 INFO:tasks.workunit.client.0.smithi005.stdout: 48 6977 77 4681 26 1427 70 2023-10-07T00:18:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:18:58 smithi088 ceph-mon[103111]: pgmap v532: 97 pgs: 97 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 912 KiB/s wr, 144 op/s 2023-10-07T00:18:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:18:58 smithi112 ceph-mon[133548]: pgmap v532: 97 pgs: 97 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 912 KiB/s wr, 144 op/s 2023-10-07T00:18:59.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:18:58 smithi005 ceph-mon[129406]: pgmap v532: 97 pgs: 97 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 912 KiB/s wr, 144 op/s 2023-10-07T00:19:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:00 smithi088 ceph-mon[103111]: pgmap v533: 97 pgs: 97 active+clean; 277 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 872 KiB/s wr, 131 op/s 2023-10-07T00:19:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:00 smithi112 ceph-mon[133548]: pgmap v533: 97 pgs: 97 active+clean; 277 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 872 KiB/s wr, 131 op/s 2023-10-07T00:19:01.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:00 smithi005 ceph-mon[129406]: pgmap v533: 97 pgs: 97 active+clean; 277 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 872 KiB/s wr, 131 op/s 2023-10-07T00:19:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.520+0000 7f7412bff700 1 -- 172.21.15.5:0/1894123905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c101980 msgr2=0x7f740c103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.520+0000 7f7412bff700 1 --2- 172.21.15.5:0/1894123905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c101980 0x7f740c103d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7400009990 tx=0x7f7400009ca0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.520+0000 7f7412bff700 1 -- 172.21.15.5:0/1894123905 shutdown_connections 2023-10-07T00:19:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.520+0000 7f7412bff700 1 --2- 172.21.15.5:0/1894123905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f740c106be0 0x7f740c109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.520+0000 7f7412bff700 1 --2- 172.21.15.5:0/1894123905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c101980 0x7f740c103d70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.520+0000 7f7412bff700 1 --2- 172.21.15.5:0/1894123905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f740c1042b0 0x7f740c1066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.520+0000 7f7412bff700 1 -- 172.21.15.5:0/1894123905 >> 172.21.15.5:0/1894123905 conn(0x7f740c0fb390 msgr2=0x7f740c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.520+0000 7f7412bff700 1 -- 172.21.15.5:0/1894123905 shutdown_connections 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.521+0000 7f7412bff700 1 -- 172.21.15.5:0/1894123905 wait complete. 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.521+0000 7f7412bff700 1 Processor -- start 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f7412bff700 1 -- start start 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f7412bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f740c101980 0x7f740c06ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f7412bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f740c1042b0 0x7f740c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f7412bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c106be0 0x7f740c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f7412bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0726c0 con 0x7f740c101980 2023-10-07T00:19:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f7412bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c072830 con 0x7f740c106be0 2023-10-07T00:19:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f7412bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0729f0 con 0x7f740c1042b0 2023-10-07T00:19:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f740bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f740c1042b0 0x7f740c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f740bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f740c1042b0 0x7f740c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:33060/0 (socket says 172.21.15.5:33060) 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.522+0000 7f740bfff700 1 -- 172.21.15.5:0/4158312178 learned_addr learned my addr 172.21.15.5:0/4158312178 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f741099b700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f740c101980 0x7f740c06ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f741119c700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c106be0 0x7f740c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f740bfff700 1 -- 172.21.15.5:0/4158312178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c106be0 msgr2=0x7f740c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f740bfff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c106be0 0x7f740c0720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f740bfff700 1 -- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f740c101980 msgr2=0x7f740c06ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f740bfff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f740c101980 0x7f740c06ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f740bfff700 1 -- 172.21.15.5:0/4158312178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74000095f0 con 0x7f740c1042b0 2023-10-07T00:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f741119c700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c106be0 0x7f740c0720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:19:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.523+0000 7f740bfff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f740c1042b0 0x7f740c06b0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f73f800e9a0 tx=0x7f73f800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.524+0000 7f7409ffb700 1 -- 172.21.15.5:0/4158312178 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8009790 con 0x7f740c1042b0 2023-10-07T00:19:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.524+0000 7f7409ffb700 1 -- 172.21.15.5:0/4158312178 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73f800cbd0 con 0x7f740c1042b0 2023-10-07T00:19:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.524+0000 7f7409ffb700 1 -- 172.21.15.5:0/4158312178 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8018680 con 0x7f740c1042b0 2023-10-07T00:19:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.524+0000 7f7412bff700 1 -- 172.21.15.5:0/4158312178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c072cd0 con 0x7f740c1042b0 2023-10-07T00:19:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.524+0000 7f7412bff700 1 -- 172.21.15.5:0/4158312178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c1ae070 con 0x7f740c1042b0 2023-10-07T00:19:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.529+0000 7f7409ffb700 1 -- 172.21.15.5:0/4158312178 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f73f800cd40 con 0x7f740c1042b0 2023-10-07T00:19:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7426499b80 1 Processor -- start 2023-10-07T00:19:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7426499b80 1 -- start start 2023-10-07T00:19:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7409ffb700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f73fc0a1580 0x7f73fc0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7426499b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee1ec0 0x56245cee22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7426499b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee2fd0 0x56245cee3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7409ffb700 1 -- 172.21.15.5:0/4158312178 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f73f8014070 con 0x7f740c1042b0 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7426499b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee3990 0x56245ceea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7426499b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245ce4a400 con 0x56245cee3990 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7426499b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245ce3bbc0 con 0x56245cee2fd0 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.532+0000 7f7426499b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245ce394e0 con 0x56245cee1ec0 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f741119c700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f73fc0a1580 0x7f73fc0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f740bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee2fd0 0x56245cee3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f740bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee2fd0 0x56245cee3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:43684/0 (socket says 172.21.15.5:43684) 2023-10-07T00:19:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f740bfff700 1 -- 172.21.15.5:0/1887558012 learned_addr learned my addr 172.21.15.5:0/1887558012 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f740bfff700 1 -- 172.21.15.5:0/1887558012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee1ec0 msgr2=0x56245cee22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f740bfff700 1 --2- 172.21.15.5:0/1887558012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee1ec0 0x56245cee22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f740bfff700 1 -- 172.21.15.5:0/1887558012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee3990 msgr2=0x56245ceea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f740bfff700 1 --2- 172.21.15.5:0/1887558012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee3990 0x56245ceea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.533+0000 7f740bfff700 1 -- 172.21.15.5:0/1887558012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56245cc5fd80 con 0x56245cee2fd0 2023-10-07T00:19:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.534+0000 7f740bfff700 1 --2- 172.21.15.5:0/1887558012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee2fd0 0x56245cee3450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f73f809a180 tx=0x7f73f8099e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e65f88477a70b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.534+0000 7f73f6ffd700 1 -- 172.21.15.5:0/1887558012 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f809e120 con 0x56245cee2fd0 2023-10-07T00:19:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.534+0000 7f73f6ffd700 1 -- 172.21.15.5:0/1887558012 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73f80cae90 con 0x56245cee2fd0 2023-10-07T00:19:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.534+0000 7f73f6ffd700 1 -- 172.21.15.5:0/1887558012 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8099900 con 0x56245cee2fd0 2023-10-07T00:19:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.535+0000 7f7426499b80 1 -- 172.21.15.5:0/1887558012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee2fd0 msgr2=0x56245cee3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.535+0000 7f7426499b80 1 --2- 172.21.15.5:0/1887558012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee2fd0 0x56245cee3450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f73f809a180 tx=0x7f73f8099e00 comp rx=0 tx=0).stop 2023-10-07T00:19:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.536+0000 7f741119c700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f73fc0a1580 0x7f73fc0a3a40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f74040060b0 tx=0x7f7404009160 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.536+0000 7f7426499b80 1 -- 172.21.15.5:0/1887558012 shutdown_connections 2023-10-07T00:19:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.536+0000 7f7426499b80 1 --2- 172.21.15.5:0/1887558012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee3990 0x56245ceea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.536+0000 7f7426499b80 1 --2- 172.21.15.5:0/1887558012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee1ec0 0x56245cee22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.536+0000 7f7426499b80 1 --2- 172.21.15.5:0/1887558012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee2fd0 0x56245cee3450 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f73f809a180 tx=0x7f73f8099e00 comp rx=0 tx=0).stop 2023-10-07T00:19:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.536+0000 7f7426499b80 1 -- 172.21.15.5:0/1887558012 >> 172.21.15.5:0/1887558012 conn(0x56245ce56200 msgr2=0x56245cedcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.536+0000 7f7426499b80 1 -- 172.21.15.5:0/1887558012 shutdown_connections 2023-10-07T00:19:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.536+0000 7f7426499b80 1 -- 172.21.15.5:0/1887558012 wait complete. 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.537+0000 7f7426499b80 1 -- start start 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.537+0000 7f7426499b80 1 Processor -- start 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f7426499b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceebd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f7426499b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee3990 0x56245ceec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f7426499b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cef12d0 0x56245cef36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f7426499b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245ce34dd0 con 0x56245cee3990 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f7426499b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245cdd16b0 con 0x56245cee1ec0 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f7426499b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245cdd1350 con 0x56245cef12d0 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f7426499b80 10 client.0 _ll_register_callbacks cb 0x56245cc2e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f741099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f741099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceebd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:43698/0 (socket says 172.21.15.5:43698) 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f741099b700 1 -- 172.21.15.5:0/516688624 learned_addr learned my addr 172.21.15.5:0/516688624 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f741119c700 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cef12d0 0x56245cef36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f741099b700 1 -- 172.21.15.5:0/516688624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cef12d0 msgr2=0x56245cef36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.538+0000 7f741099b700 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cef12d0 0x56245cef36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.539+0000 7f741099b700 1 -- 172.21.15.5:0/516688624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee3990 msgr2=0x56245ceec2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.539+0000 7f741099b700 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee3990 0x56245ceec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.539+0000 7f741099b700 1 -- 172.21.15.5:0/516688624 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c1ae070 con 0x56245cee1ec0 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.539+0000 7f741099b700 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceebd60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7400009990 tx=0x7f74000053f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6cf2c065b6ddcae server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.539+0000 7f73ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.539+0000 7f73ebfff700 1 -- 172.21.15.5:0/516688624 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740001d070 con 0x56245cee1ec0 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.539+0000 7f73ebfff700 1 -- 172.21.15.5:0/516688624 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7400003a90 con 0x56245cee1ec0 2023-10-07T00:19:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.540+0000 7f7426499b80 1 -- 172.21.15.5:0/516688624 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56245ced4d50 con 0x56245cee1ec0 2023-10-07T00:19:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.540+0000 7f73ebfff700 1 -- 172.21.15.5:0/516688624 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7400003c50 con 0x56245cee1ec0 2023-10-07T00:19:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.540+0000 7f7426499b80 10 client.26402 fetch_fsmap learned FSMap version 37 2023-10-07T00:19:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.540+0000 7f7426499b80 1 -- 172.21.15.5:0/516688624 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56245cc48c00 con 0x56245cee1ec0 2023-10-07T00:19:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.540+0000 7f73ebfff700 1 -- 172.21.15.5:0/516688624 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56245ced4d50 con 0x56245cee1ec0 2023-10-07T00:19:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.541+0000 7f73ebfff700 1 -- 172.21.15.5:0/516688624 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 37) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f740000b710 con 0x56245cee1ec0 2023-10-07T00:19:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.542+0000 7f7426499b80 10 client.26402 fetch_fsmap finished waiting for FSMap version 37 2023-10-07T00:19:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.542+0000 7f7426499b80 10 client.26402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.542+0000 7f7426499b80 20 client.26402 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.542+0000 7f7426499b80 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56245cef8020 0x56245cefa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.542+0000 7f7426499b80 4 client.26402 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:19:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.542+0000 7f7426499b80 1 -- 172.21.15.5:0/516688624 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56245ce2ddb0 con 0x56245cef8020 2023-10-07T00:19:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.542+0000 7f740bfff700 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56245cef8020 0x56245cefa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.543+0000 7f740bfff700 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56245cef8020 0x56245cefa440 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e377a323fcbd16 server_cookie=5239e10b62e54ac4 in_seq=0 out_seq=0 2023-10-07T00:19:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.543+0000 7f73ebfff700 10 client.26402 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.543+0000 7f73ebfff700 1 -- 172.21.15.5:0/516688624 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56245ce2ddb0 con 0x56245cef8020 2023-10-07T00:19:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.543+0000 7f73ebfff700 10 client.26402 handle_command_reply: tid=0 2023-10-07T00:19:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.543+0000 7f7426499b80 1 client.26402 shutdown 2023-10-07T00:19:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 -- 172.21.15.5:0/516688624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 msgr2=0x56245ceebd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceebd60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7400009990 tx=0x7f74000053f0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 -- 172.21.15.5:0/516688624 shutdown_connections 2023-10-07T00:19:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56245cef8020 0x56245cefa440 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cef12d0 0x56245cef36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceebd60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 --2- 172.21.15.5:0/516688624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee3990 0x56245ceec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 -- 172.21.15.5:0/516688624 >> 172.21.15.5:0/516688624 conn(0x56245ce56200 msgr2=0x56245cedc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f73ebfff700 0 client.26402 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 -- 172.21.15.5:0/516688624 shutdown_connections 2023-10-07T00:19:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.544+0000 7f7426499b80 1 -- 172.21.15.5:0/516688624 wait complete. 2023-10-07T00:19:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.545+0000 7f7426499b80 20 client.26402 trim_cache size 0 max 16384 2023-10-07T00:19:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.572+0000 7f7426499b80 1 Processor -- start 2023-10-07T00:19:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.572+0000 7f7426499b80 1 -- start start 2023-10-07T00:19:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.572+0000 7f7426499b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceeb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.572+0000 7f7426499b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 0x56245cf07c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.572+0000 7f7426499b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cef12d0 0x56245cee6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.572+0000 7f7426499b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245ccb58c0 con 0x56245cef12d0 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.572+0000 7f7426499b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245ceddf70 con 0x56245cee1ec0 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.572+0000 7f7426499b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245ceeb260 con 0x56245cee3990 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceeb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceeb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:43704/0 (socket says 172.21.15.5:43704) 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741099b700 1 -- 172.21.15.5:0/2983196657 learned_addr learned my addr 172.21.15.5:0/2983196657 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f740bfff700 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 0x56245cf07c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741099b700 1 -- 172.21.15.5:0/2983196657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 msgr2=0x56245cf07c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741099b700 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 0x56245cf07c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741119c700 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cef12d0 0x56245cee6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741099b700 1 -- 172.21.15.5:0/2983196657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cef12d0 msgr2=0x56245cee6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741099b700 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cef12d0 0x56245cee6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741099b700 1 -- 172.21.15.5:0/2983196657 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56245cc861f0 con 0x56245cee1ec0 2023-10-07T00:19:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.573+0000 7f741119c700 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cef12d0 0x56245cee6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:19:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.574+0000 7f741099b700 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceeb410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7400000c00 tx=0x7f7400009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4062f3683f29dcb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.574+0000 7f73f77fe700 1 -- 172.21.15.5:0/2983196657 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740001d040 con 0x56245cee1ec0 2023-10-07T00:19:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.574+0000 7f73f77fe700 1 -- 172.21.15.5:0/2983196657 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f740001e040 con 0x56245cee1ec0 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.574+0000 7f73f77fe700 1 -- 172.21.15.5:0/2983196657 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400004b50 con 0x56245cee1ec0 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.575+0000 7f7426499b80 1 -- 172.21.15.5:0/2983196657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 msgr2=0x56245ceeb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.575+0000 7f7426499b80 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceeb410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7400000c00 tx=0x7f7400009290 comp rx=0 tx=0).stop 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.575+0000 7f7426499b80 1 -- 172.21.15.5:0/2983196657 shutdown_connections 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.575+0000 7f7426499b80 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cef12d0 0x56245cee6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.575+0000 7f7426499b80 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cee1ec0 0x56245ceeb410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.575+0000 7f7426499b80 1 --2- 172.21.15.5:0/2983196657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 0x56245cf07c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.575+0000 7f7426499b80 1 -- 172.21.15.5:0/2983196657 >> 172.21.15.5:0/2983196657 conn(0x56245ce56200 msgr2=0x56245cef3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.575+0000 7f7426499b80 1 -- 172.21.15.5:0/2983196657 shutdown_connections 2023-10-07T00:19:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.576+0000 7f7426499b80 1 -- 172.21.15.5:0/2983196657 wait complete. 2023-10-07T00:19:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.576+0000 7f7426499b80 1 -- start start 2023-10-07T00:19:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.576+0000 7f7426499b80 1 Processor -- start 2023-10-07T00:19:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f7426499b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee1ec0 0x56245cf07250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f7426499b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 0x56245cf07790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f7426499b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cef12d0 0x56245cf4a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f7426499b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245cf4aef0 con 0x56245cee1ec0 2023-10-07T00:19:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f7426499b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245cf4b030 con 0x56245cef12d0 2023-10-07T00:19:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f7426499b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x56245cf5c200 con 0x56245cee3990 2023-10-07T00:19:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f7426499b80 10 client.0 _ll_register_callbacks cb 0x7f7400005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f741099b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee1ec0 0x56245cf07250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f741099b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee1ec0 0x56245cf07250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33458/0 (socket says 172.21.15.5:33458) 2023-10-07T00:19:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f741099b700 1 -- 172.21.15.5:0/3971880952 learned_addr learned my addr 172.21.15.5:0/3971880952 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.577+0000 7f740bfff700 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 0x56245cf07790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.578+0000 7f741119c700 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cef12d0 0x56245cf4a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.578+0000 7f741099b700 1 -- 172.21.15.5:0/3971880952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 msgr2=0x56245cf07790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.578+0000 7f741099b700 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 0x56245cf07790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.578+0000 7f741099b700 1 -- 172.21.15.5:0/3971880952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cef12d0 msgr2=0x56245cf4a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.578+0000 7f741099b700 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cef12d0 0x56245cf4a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.578+0000 7f741099b700 1 -- 172.21.15.5:0/3971880952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56245cc48c00 con 0x56245cee1ec0 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.578+0000 7f741099b700 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee1ec0 0x56245cf07250 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7400003f60 tx=0x7f7400003ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2b86bcc0891e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.578+0000 7f73ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.579+0000 7f73ebfff700 1 -- 172.21.15.5:0/3971880952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740001d040 con 0x56245cee1ec0 2023-10-07T00:19:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.579+0000 7f73ebfff700 1 -- 172.21.15.5:0/3971880952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7400000e40 con 0x56245cee1ec0 2023-10-07T00:19:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.579+0000 7f7426499b80 1 -- 172.21.15.5:0/3971880952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73f80cae90 con 0x56245cee1ec0 2023-10-07T00:19:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.579+0000 7f73ebfff700 1 -- 172.21.15.5:0/3971880952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f740000be50 con 0x56245cee1ec0 2023-10-07T00:19:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.579+0000 7f7426499b80 10 client.16557 fetch_fsmap learned FSMap version 37 2023-10-07T00:19:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.579+0000 7f7426499b80 1 -- 172.21.15.5:0/3971880952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56245cc5e250 con 0x56245cee1ec0 2023-10-07T00:19:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.579+0000 7f73ebfff700 1 -- 172.21.15.5:0/3971880952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73f80cae90 con 0x56245cee1ec0 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.580+0000 7f73ebfff700 1 -- 172.21.15.5:0/3971880952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 37) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f740003eb20 con 0x56245cee1ec0 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.580+0000 7f7426499b80 10 client.16557 fetch_fsmap finished waiting for FSMap version 37 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.580+0000 7f7426499b80 10 client.16557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.580+0000 7f7426499b80 20 client.16557 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.580+0000 7f7426499b80 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56245cf5d6c0 0x56245cf5fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.580+0000 7f7426499b80 4 client.16557 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.580+0000 7f7426499b80 1 -- 172.21.15.5:0/3971880952 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56245ce2dad0 con 0x56245cf5d6c0 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.580+0000 7f740bfff700 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56245cf5d6c0 0x56245cf5fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.581+0000 7f73ebfff700 10 client.16557 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.581+0000 7f740bfff700 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56245cf5d6c0 0x56245cf5fab0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565e1f0d2119fff2 server_cookie=50cbd047a6837a2 in_seq=0 out_seq=0 2023-10-07T00:19:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.840+0000 7f73ebfff700 1 -- 172.21.15.5:0/3971880952 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56245ce2dad0 con 0x56245cf5d6c0 2023-10-07T00:19:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.840+0000 7f73ebfff700 10 client.16557 handle_command_reply: tid=0 2023-10-07T00:19:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.840+0000 7f7426499b80 1 client.16557 shutdown 2023-10-07T00:19:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.840+0000 7f7426499b80 1 -- 172.21.15.5:0/3971880952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee1ec0 msgr2=0x56245cf07250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.840+0000 7f7426499b80 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee1ec0 0x56245cf07250 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7400003f60 tx=0x7f7400003ac0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.842+0000 7f7426499b80 1 -- 172.21.15.5:0/3971880952 shutdown_connections 2023-10-07T00:19:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.842+0000 7f7426499b80 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x56245cf5d6c0 0x56245cf5fab0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.842+0000 7f7426499b80 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56245cef12d0 0x56245cf4a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.842+0000 7f7426499b80 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56245cee1ec0 0x56245cf07250 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.842+0000 7f7426499b80 1 --2- 172.21.15.5:0/3971880952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56245cee3990 0x56245cf07790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.842+0000 7f7426499b80 1 -- 172.21.15.5:0/3971880952 >> 172.21.15.5:0/3971880952 conn(0x56245ce56200 msgr2=0x56245cee6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.845+0000 7f73ebfff700 0 client.16557 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.845+0000 7f7426499b80 1 -- 172.21.15.5:0/3971880952 shutdown_connections 2023-10-07T00:19:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.845+0000 7f7426499b80 1 -- 172.21.15.5:0/3971880952 wait complete. 2023-10-07T00:19:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.845+0000 7f7426499b80 20 client.16557 trim_cache size 0 max 16384 2023-10-07T00:19:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:19:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:19:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:19:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:19:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.846+0000 7f7412bff700 1 -- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f73fc0a1580 msgr2=0x7f73fc0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.846+0000 7f7412bff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f73fc0a1580 0x7f73fc0a3a40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f74040060b0 tx=0x7f7404009160 comp rx=0 tx=0).stop 2023-10-07T00:19:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.846+0000 7f7412bff700 1 -- 172.21.15.5:0/4158312178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f740c1042b0 msgr2=0x7f740c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.846+0000 7f7412bff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f740c1042b0 0x7f740c06b0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f73f800e9a0 tx=0x7f73f800ecb0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.847+0000 7f7412bff700 1 -- 172.21.15.5:0/4158312178 shutdown_connections 2023-10-07T00:19:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.847+0000 7f7412bff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f73fc0a1580 0x7f73fc0a3a40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.847+0000 7f7412bff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f740c106be0 0x7f740c0720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.847+0000 7f7412bff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f740c101980 0x7f740c06ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.847+0000 7f7412bff700 1 --2- 172.21.15.5:0/4158312178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f740c1042b0 0x7f740c06b0d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.847+0000 7f7412bff700 1 -- 172.21.15.5:0/4158312178 >> 172.21.15.5:0/4158312178 conn(0x7f740c0fb390 msgr2=0x7f740c1025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.847+0000 7f7412bff700 1 -- 172.21.15.5:0/4158312178 shutdown_connections 2023-10-07T00:19:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:02.847+0000 7f7412bff700 1 -- 172.21.15.5:0/4158312178 wait complete. 2023-10-07T00:19:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:02 smithi088 ceph-mon[103111]: pgmap v534: 97 pgs: 97 active+clean; 279 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 966 KiB/s wr, 140 op/s 2023-10-07T00:19:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:02 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:02 smithi112 ceph-mon[133548]: pgmap v534: 97 pgs: 97 active+clean; 279 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 966 KiB/s wr, 140 op/s 2023-10-07T00:19:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:02 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:03.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:02 smithi005 ceph-mon[129406]: pgmap v534: 97 pgs: 97 active+clean; 279 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 966 KiB/s wr, 140 op/s 2023-10-07T00:19:03.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:02 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:04 smithi088 ceph-mon[103111]: pgmap v535: 97 pgs: 97 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 804 KiB/s wr, 114 op/s 2023-10-07T00:19:05.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:04 smithi112 ceph-mon[133548]: pgmap v535: 97 pgs: 97 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 804 KiB/s wr, 114 op/s 2023-10-07T00:19:05.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:04 smithi005 ceph-mon[129406]: pgmap v535: 97 pgs: 97 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 804 KiB/s wr, 114 op/s 2023-10-07T00:19:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:06 smithi088 ceph-mon[103111]: pgmap v536: 97 pgs: 97 active+clean; 278 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 886 KiB/s wr, 122 op/s 2023-10-07T00:19:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:06 smithi112 ceph-mon[133548]: pgmap v536: 97 pgs: 97 active+clean; 278 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 886 KiB/s wr, 122 op/s 2023-10-07T00:19:07.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:06 smithi005 ceph-mon[129406]: pgmap v536: 97 pgs: 97 active+clean; 278 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 886 KiB/s wr, 122 op/s 2023-10-07T00:19:07.767 INFO:tasks.workunit.client.0.smithi005.stdout: 48 7056 58 4875 33 1575 55 2023-10-07T00:19:08.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:07 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:08.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:07 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:08.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:07 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:08 smithi088 ceph-mon[103111]: pgmap v537: 97 pgs: 97 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 902 KiB/s wr, 132 op/s 2023-10-07T00:19:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:08 smithi112 ceph-mon[133548]: pgmap v537: 97 pgs: 97 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 902 KiB/s wr, 132 op/s 2023-10-07T00:19:09.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:08 smithi005 ceph-mon[129406]: pgmap v537: 97 pgs: 97 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 902 KiB/s wr, 132 op/s 2023-10-07T00:19:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:10 smithi088 ceph-mon[103111]: pgmap v538: 97 pgs: 97 active+clean; 281 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 795 KiB/s wr, 114 op/s 2023-10-07T00:19:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:10 smithi112 ceph-mon[133548]: pgmap v538: 97 pgs: 97 active+clean; 281 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 795 KiB/s wr, 114 op/s 2023-10-07T00:19:11.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:10 smithi005 ceph-mon[129406]: pgmap v538: 97 pgs: 97 active+clean; 281 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 795 KiB/s wr, 114 op/s 2023-10-07T00:19:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:12 smithi088 ceph-mon[103111]: pgmap v539: 97 pgs: 97 active+clean; 283 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 975 KiB/s wr, 134 op/s 2023-10-07T00:19:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:12 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:12 smithi112 ceph-mon[133548]: pgmap v539: 97 pgs: 97 active+clean; 283 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 975 KiB/s wr, 134 op/s 2023-10-07T00:19:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:12 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:13.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:12 smithi005 ceph-mon[129406]: pgmap v539: 97 pgs: 97 active+clean; 283 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 975 KiB/s wr, 134 op/s 2023-10-07T00:19:13.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:12 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:14 smithi088 ceph-mon[103111]: pgmap v540: 97 pgs: 97 active+clean; 284 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 866 KiB/s wr, 118 op/s 2023-10-07T00:19:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:14 smithi112 ceph-mon[133548]: pgmap v540: 97 pgs: 97 active+clean; 284 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 866 KiB/s wr, 118 op/s 2023-10-07T00:19:15.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:14 smithi005 ceph-mon[129406]: pgmap v540: 97 pgs: 97 active+clean; 284 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 866 KiB/s wr, 118 op/s 2023-10-07T00:19:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.078+0000 7f29ad9ff700 1 -- 172.21.15.5:0/3508586265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104300 msgr2=0x7f29a8104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.078+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/3508586265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104300 0x7f29a8104760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29900099c0 tx=0x7f2990009cd0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.079+0000 7f29ad9ff700 1 -- 172.21.15.5:0/3508586265 shutdown_connections 2023-10-07T00:19:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.079+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/3508586265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a8104ca0 0x7f29a810b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.079+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/3508586265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a8103110 0x7f29a8103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.079+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/3508586265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104300 0x7f29a8104760 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.079+0000 7f29ad9ff700 1 -- 172.21.15.5:0/3508586265 >> 172.21.15.5:0/3508586265 conn(0x7f29a80fe6a0 msgr2=0x7f29a8100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.079+0000 7f29ad9ff700 1 -- 172.21.15.5:0/3508586265 shutdown_connections 2023-10-07T00:19:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.079+0000 7f29ad9ff700 1 -- 172.21.15.5:0/3508586265 wait complete. 2023-10-07T00:19:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.081+0000 7f29ad9ff700 1 Processor -- start 2023-10-07T00:19:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.081+0000 7f29ad9ff700 1 -- start start 2023-10-07T00:19:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.081+0000 7f29ad9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a8103110 0x7f29a819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.081+0000 7f29ad9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a8104300 0x7f29a819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.081+0000 7f29ad9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104ca0 0x7f29a81a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.081+0000 7f29ad9ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a81a4cd0 con 0x7f29a8104300 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.081+0000 7f29ad9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a81a4e10 con 0x7f29a8104ca0 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.081+0000 7f29ad9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a81a4fa0 con 0x7f29a8103110 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a8103110 0x7f29a819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a8103110 0x7f29a819d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54964/0 (socket says 172.21.15.5:54964) 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a6ffd700 1 -- 172.21.15.5:0/4086091643 learned_addr learned my addr 172.21.15.5:0/4086091643 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a77fe700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104ca0 0x7f29a81a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f299ffff700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a8104300 0x7f29a819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a6ffd700 1 -- 172.21.15.5:0/4086091643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104ca0 msgr2=0x7f29a81a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104ca0 0x7f29a81a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a6ffd700 1 -- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a8104300 msgr2=0x7f29a819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a8104300 0x7f29a819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a6ffd700 1 -- 172.21.15.5:0/4086091643 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900095f0 con 0x7f29a8103110 2023-10-07T00:19:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f29a77fe700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104ca0 0x7f29a81a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:19:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.082+0000 7f299ffff700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a8104300 0x7f29a819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:19:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.083+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a8103110 0x7f29a819d150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f299800efc0 tx=0x7f299800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.083+0000 7f29ac9fd700 1 -- 172.21.15.5:0/4086091643 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998018070 con 0x7f29a8103110 2023-10-07T00:19:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.084+0000 7f29ad9ff700 1 -- 172.21.15.5:0/4086091643 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a81a5220 con 0x7f29a8103110 2023-10-07T00:19:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.084+0000 7f29ad9ff700 1 -- 172.21.15.5:0/4086091643 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a81a5780 con 0x7f29a8103110 2023-10-07T00:19:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.084+0000 7f29ac9fd700 1 -- 172.21.15.5:0/4086091643 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f299800f040 con 0x7f29a8103110 2023-10-07T00:19:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.084+0000 7f29ac9fd700 1 -- 172.21.15.5:0/4086091643 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998004280 con 0x7f29a8103110 2023-10-07T00:19:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.090+0000 7f29ac9fd700 1 -- 172.21.15.5:0/4086091643 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f299800ca70 con 0x7f29a8103110 2023-10-07T00:19:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.091+0000 7f29c13a8b80 1 Processor -- start 2023-10-07T00:19:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.091+0000 7f29c13a8b80 1 -- start start 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f98f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 0x558a9f990450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f997220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f8f7400 con 0x558a9f98ffd0 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f8e8bc0 con 0x558a9f98eec0 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f8e64e0 con 0x558a9f990990 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29a77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f98f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29a77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f98f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:56786/0 (socket says 172.21.15.5:56786) 2023-10-07T00:19:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29a77fe700 1 -- 172.21.15.5:0/2139310267 learned_addr learned my addr 172.21.15.5:0/2139310267 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f299ffff700 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f997220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.092+0000 7f29ac9fd700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29940a1500 0x7f29940a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 0x558a9f990450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29a77fe700 1 -- 172.21.15.5:0/2139310267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 msgr2=0x558a9f997220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29a77fe700 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f997220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29a77fe700 1 -- 172.21.15.5:0/2139310267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 msgr2=0x558a9f990450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29a77fe700 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 0x558a9f990450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29a77fe700 1 -- 172.21.15.5:0/2139310267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a9f70cd80 con 0x558a9f98eec0 2023-10-07T00:19:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29ac9fd700 1 -- 172.21.15.5:0/4086091643 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f29980ccbd0 con 0x7f29a8103110 2023-10-07T00:19:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29a77fe700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29940a1500 0x7f29940a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.093+0000 7f29a77fe700 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f98f2e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29a00046e0 tx=0x7f29a00119a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca89e7551d7c3c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.094+0000 7f299dffb700 1 -- 172.21.15.5:0/2139310267 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000f660 con 0x558a9f98eec0 2023-10-07T00:19:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.094+0000 7f299dffb700 1 -- 172.21.15.5:0/2139310267 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29a000fe80 con 0x558a9f98eec0 2023-10-07T00:19:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.094+0000 7f299dffb700 1 -- 172.21.15.5:0/2139310267 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a001b830 con 0x558a9f98eec0 2023-10-07T00:19:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 -- 172.21.15.5:0/2139310267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 msgr2=0x558a9f98f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29a77fe700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29940a1500 0x7f29940a39c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29a0023000 tx=0x7f29a0024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f98f2e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29a00046e0 tx=0x7f29a00119a0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 -- 172.21.15.5:0/2139310267 shutdown_connections 2023-10-07T00:19:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f997220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f98f2e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/2139310267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 0x558a9f990450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 -- 172.21.15.5:0/2139310267 >> 172.21.15.5:0/2139310267 conn(0x558a9f903200 msgr2=0x558a9f989bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 -- 172.21.15.5:0/2139310267 shutdown_connections 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.095+0000 7f29c13a8b80 1 -- 172.21.15.5:0/2139310267 wait complete. 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.096+0000 7f29c13a8b80 1 -- start start 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.096+0000 7f29c13a8b80 1 Processor -- start 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.097+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f998b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.097+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 0x558a9f9990b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.097+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f9a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.097+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f8e1dd0 con 0x558a9f98ffd0 2023-10-07T00:19:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.097+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f87e6b0 con 0x558a9f98eec0 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.097+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f87e350 con 0x558a9f990990 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.097+0000 7f29c13a8b80 10 client.0 _ll_register_callbacks cb 0x558a9f6db7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.097+0000 7f29a77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f9a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f29a77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f9a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54978/0 (socket says 172.21.15.5:54978) 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f29a77fe700 1 -- 172.21.15.5:0/3413227158 learned_addr learned my addr 172.21.15.5:0/3413227158 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f299ffff700 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 0x558a9f9990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f998b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f29a6ffd700 1 -- 172.21.15.5:0/3413227158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 msgr2=0x558a9f9a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f9a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f29a6ffd700 1 -- 172.21.15.5:0/3413227158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 msgr2=0x558a9f9990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 0x558a9f9990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.098+0000 7f29a6ffd700 1 -- 172.21.15.5:0/3413227158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a0009e20 con 0x558a9f98eec0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.099+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f998b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f29980ca700 tx=0x7f29980962a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9414be46eb5fb8f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.099+0000 7f2986ffd700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.099+0000 7f2986ffd700 1 -- 172.21.15.5:0/3413227158 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980998c0 con 0x558a9f98eec0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.099+0000 7f2986ffd700 1 -- 172.21.15.5:0/3413227158 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f299809a660 con 0x558a9f98eec0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.099+0000 7f29c13a8b80 1 -- 172.21.15.5:0/3413227158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a9f8dadb0 con 0x558a9f98eec0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.100+0000 7f2986ffd700 1 -- 172.21.15.5:0/3413227158 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29980092e0 con 0x558a9f98eec0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.100+0000 7f29c13a8b80 10 client.26420 fetch_fsmap learned FSMap version 39 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.100+0000 7f29c13a8b80 1 -- 172.21.15.5:0/3413227158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x558a9f6f5c00 con 0x558a9f98eec0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.100+0000 7f2986ffd700 1 -- 172.21.15.5:0/3413227158 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a9f8dadb0 con 0x558a9f98eec0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.100+0000 7f2986ffd700 1 -- 172.21.15.5:0/3413227158 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 39) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f2998099450 con 0x558a9f98eec0 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.101+0000 7f29c13a8b80 10 client.26420 fetch_fsmap finished waiting for FSMap version 39 2023-10-07T00:19:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.101+0000 7f29c13a8b80 10 client.26420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.101+0000 7f29c13a8b80 20 client.26420 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.101+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x558a9f9b5a90 0x558a9f9b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.101+0000 7f29c13a8b80 4 client.26420 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:19:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.101+0000 7f29c13a8b80 1 -- 172.21.15.5:0/3413227158 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a9f8daad0 con 0x558a9f9b5a90 2023-10-07T00:19:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.101+0000 7f299ffff700 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x558a9f9b5a90 0x558a9f9b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.102+0000 7f299ffff700 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x558a9f9b5a90 0x558a9f9b7eb0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3cb7a75187d873 server_cookie=22ee13356ca65372 in_seq=0 out_seq=0 2023-10-07T00:19:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.102+0000 7f2986ffd700 10 client.26420 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.103+0000 7f2986ffd700 1 -- 172.21.15.5:0/3413227158 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558a9f8daad0 con 0x558a9f9b5a90 2023-10-07T00:19:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.103+0000 7f2986ffd700 10 client.26420 handle_command_reply: tid=0 2023-10-07T00:19:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.103+0000 7f29c13a8b80 1 client.26420 shutdown 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.103+0000 7f29c13a8b80 1 -- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 msgr2=0x558a9f998b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.103+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f998b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f29980ca700 tx=0x7f29980962a0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f29c13a8b80 1 -- 172.21.15.5:0/3413227158 shutdown_connections 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x558a9f9b5a90 0x558a9f9b7eb0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f990990 0x558a9f9a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98eec0 0x558a9f998b70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/3413227158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98ffd0 0x558a9f9990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f29c13a8b80 1 -- 172.21.15.5:0/3413227158 >> 172.21.15.5:0/3413227158 conn(0x558a9f903200 msgr2=0x558a9f989250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f2986ffd700 0 client.26420 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f29c13a8b80 1 -- 172.21.15.5:0/3413227158 shutdown_connections 2023-10-07T00:19:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.104+0000 7f29c13a8b80 1 -- 172.21.15.5:0/3413227158 wait complete. 2023-10-07T00:19:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.105+0000 7f29c13a8b80 20 client.26420 trim_cache size 0 max 16384 2023-10-07T00:19:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.131+0000 7f29c13a8b80 1 Processor -- start 2023-10-07T00:19:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.131+0000 7f29c13a8b80 1 -- start start 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98eec0 0x558a9f9b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98ffd0 0x558a9f9a0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f990990 0x558a9f993840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f7628c0 con 0x558a9f990990 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f981890 con 0x558a9f98ffd0 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f990d70 con 0x558a9f98eec0 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29a6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98eec0 0x558a9f9b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29a6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98eec0 0x558a9f9b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54988/0 (socket says 172.21.15.5:54988) 2023-10-07T00:19:16.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29a6ffd700 1 -- 172.21.15.5:0/4105549908 learned_addr learned my addr 172.21.15.5:0/4105549908 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f299ffff700 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98ffd0 0x558a9f9a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.132+0000 7f29a77fe700 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f990990 0x558a9f993840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.133+0000 7f29a6ffd700 1 -- 172.21.15.5:0/4105549908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98ffd0 msgr2=0x558a9f9a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.133+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98ffd0 0x558a9f9a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.133+0000 7f29a6ffd700 1 -- 172.21.15.5:0/4105549908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f990990 msgr2=0x558a9f993840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.133+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f990990 0x558a9f993840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.133+0000 7f29a6ffd700 1 -- 172.21.15.5:0/4105549908 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a9f7331f0 con 0x558a9f98eec0 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.133+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98eec0 0x558a9f9b7aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f299800c7a0 tx=0x7f29980ccf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=166b92e787454611 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.134+0000 7f299e7fc700 1 -- 172.21.15.5:0/4105549908 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998098420 con 0x558a9f98eec0 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.134+0000 7f299e7fc700 1 -- 172.21.15.5:0/4105549908 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29980998c0 con 0x558a9f98eec0 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.134+0000 7f299e7fc700 1 -- 172.21.15.5:0/4105549908 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980092e0 con 0x558a9f98eec0 2023-10-07T00:19:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.134+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4105549908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98eec0 msgr2=0x558a9f9b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.134+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98eec0 0x558a9f9b7aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f299800c7a0 tx=0x7f29980ccf20 comp rx=0 tx=0).stop 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.135+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4105549908 shutdown_connections 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.135+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f990990 0x558a9f993840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.135+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98eec0 0x558a9f9b7aa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.135+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4105549908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f98ffd0 0x558a9f9a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.135+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4105549908 >> 172.21.15.5:0/4105549908 conn(0x558a9f903200 msgr2=0x558a9f9b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.135+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4105549908 shutdown_connections 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.135+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4105549908 wait complete. 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.136+0000 7f29c13a8b80 1 -- start start 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.136+0000 7f29c13a8b80 1 Processor -- start 2023-10-07T00:19:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98eec0 0x558a9f99d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98ffd0 0x558a9f99dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f29c13a8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f990990 0x558a9f99eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f99f040 con 0x558a9f98eec0 2023-10-07T00:19:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f99f1b0 con 0x558a9f990990 2023-10-07T00:19:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f29c13a8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9f99f320 con 0x558a9f98ffd0 2023-10-07T00:19:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f29c13a8b80 10 client.0 _ll_register_callbacks cb 0x7f2998003f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f299ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98ffd0 0x558a9f99dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f299ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98ffd0 0x558a9f99dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54994/0 (socket says 172.21.15.5:54994) 2023-10-07T00:19:16.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f299ffff700 1 -- 172.21.15.5:0/4198040966 learned_addr learned my addr 172.21.15.5:0/4198040966 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:16.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.137+0000 7f29a77fe700 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f990990 0x558a9f99eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.138+0000 7f299ffff700 1 -- 172.21.15.5:0/4198040966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f990990 msgr2=0x558a9f99eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:16.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.138+0000 7f299ffff700 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f990990 0x558a9f99eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.138+0000 7f299ffff700 1 -- 172.21.15.5:0/4198040966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98eec0 msgr2=0x558a9f99d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:16.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.138+0000 7f299ffff700 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98eec0 0x558a9f99d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.138+0000 7f299ffff700 1 -- 172.21.15.5:0/4198040966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a9f6f5c00 con 0x558a9f98ffd0 2023-10-07T00:19:16.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.139+0000 7f299ffff700 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98ffd0 0x558a9f99dc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f299000b600 tx=0x7f2990009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b73c762067ef900a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:16.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.139+0000 7f2986ffd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:19:16.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.139+0000 7f2986ffd700 1 -- 172.21.15.5:0/4198040966 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299001d030 con 0x558a9f98ffd0 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.139+0000 7f2986ffd700 1 -- 172.21.15.5:0/4198040966 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2990028ce0 con 0x558a9f98ffd0 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.139+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4198040966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a9f981d50 con 0x558a9f98ffd0 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.139+0000 7f2986ffd700 1 -- 172.21.15.5:0/4198040966 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2990028ea0 con 0x558a9f98ffd0 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f29c13a8b80 10 client.26395 fetch_fsmap learned FSMap version 39 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4198040966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x558a9f70b250 con 0x558a9f98ffd0 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f2986ffd700 1 -- 172.21.15.5:0/4198040966 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a9f981d50 con 0x558a9f98ffd0 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f2986ffd700 1 -- 172.21.15.5:0/4198040966 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 39) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f2990003760 con 0x558a9f98ffd0 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f29c13a8b80 10 client.26395 fetch_fsmap finished waiting for FSMap version 39 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f29c13a8b80 10 client.26395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f29c13a8b80 20 client.26395 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x558a9fa0a1e0 0x558a9fa0c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f29c13a8b80 4 client.26395 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:19:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.140+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4198040966 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558a9f72df10 con 0x558a9fa0a1e0 2023-10-07T00:19:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.141+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x558a9fa0a1e0 0x558a9fa0c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.142+0000 7f2986ffd700 10 client.26395 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.142+0000 7f29a6ffd700 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x558a9fa0a1e0 0x558a9fa0c600 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cac40e7ef01da20 server_cookie=26b53eb7ef7cf431 in_seq=0 out_seq=0 2023-10-07T00:19:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f2986ffd700 1 -- 172.21.15.5:0/4198040966 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558a9f72df10 con 0x558a9fa0a1e0 2023-10-07T00:19:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f2986ffd700 10 client.26395 handle_command_reply: tid=0 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 client.26395 shutdown 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4198040966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98ffd0 msgr2=0x558a9f99dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98ffd0 0x558a9f99dc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f299000b600 tx=0x7f2990009500 comp rx=0 tx=0).stop 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4198040966 shutdown_connections 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x558a9fa0a1e0 0x558a9fa0c600 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a9f990990 0x558a9f99eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558a9f98eec0 0x558a9f99d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 --2- 172.21.15.5:0/4198040966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558a9f98ffd0 0x558a9f99dc90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4198040966 >> 172.21.15.5:0/4198040966 conn(0x558a9f903200 msgr2=0x558a9f9b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:16.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.172+0000 7f2986ffd700 0 client.26395 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.173+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4198040966 shutdown_connections 2023-10-07T00:19:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.173+0000 7f29c13a8b80 1 -- 172.21.15.5:0/4198040966 wait complete. 2023-10-07T00:19:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.173+0000 7f29c13a8b80 20 client.26395 trim_cache size 0 max 16384 2023-10-07T00:19:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:19:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:19:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:19:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:19:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 -- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29940a1500 msgr2=0x7f29940a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29940a1500 0x7f29940a39c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29a0023000 tx=0x7f29a0024000 comp rx=0 tx=0).stop 2023-10-07T00:19:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 -- 172.21.15.5:0/4086091643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a8103110 msgr2=0x7f29a819d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a8103110 0x7f29a819d150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f299800efc0 tx=0x7f299800c3a0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 -- 172.21.15.5:0/4086091643 shutdown_connections 2023-10-07T00:19:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29940a1500 0x7f29940a39c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a8104ca0 0x7f29a81a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a8103110 0x7f29a819d150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 --2- 172.21.15.5:0/4086091643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a8104300 0x7f29a819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.174+0000 7f29ad9ff700 1 -- 172.21.15.5:0/4086091643 >> 172.21.15.5:0/4086091643 conn(0x7f29a80fe6a0 msgr2=0x7f29a8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.175+0000 7f29ad9ff700 1 -- 172.21.15.5:0/4086091643 shutdown_connections 2023-10-07T00:19:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:16.175+0000 7f29ad9ff700 1 -- 172.21.15.5:0/4086091643 wait complete. 2023-10-07T00:19:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:16 smithi088 ceph-mon[103111]: pgmap v541: 97 pgs: 97 active+clean; 285 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 873 KiB/s wr, 117 op/s 2023-10-07T00:19:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:16 smithi112 ceph-mon[133548]: pgmap v541: 97 pgs: 97 active+clean; 285 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 873 KiB/s wr, 117 op/s 2023-10-07T00:19:17.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:16 smithi005 ceph-mon[129406]: pgmap v541: 97 pgs: 97 active+clean; 285 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 873 KiB/s wr, 117 op/s 2023-10-07T00:19:17.767 INFO:tasks.workunit.client.0.smithi005.stdout: 51 7467 94 5385 13 1661 52 2023-10-07T00:19:18.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:17 smithi112 ceph-mon[133548]: pgmap v542: 97 pgs: 97 active+clean; 287 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 875 KiB/s wr, 117 op/s 2023-10-07T00:19:18.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:17 smithi005 ceph-mon[129406]: pgmap v542: 97 pgs: 97 active+clean; 287 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 875 KiB/s wr, 117 op/s 2023-10-07T00:19:18.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:17 smithi088 ceph-mon[103111]: pgmap v542: 97 pgs: 97 active+clean; 287 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 875 KiB/s wr, 117 op/s 2023-10-07T00:19:21.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:20 smithi005 ceph-mon[129406]: pgmap v543: 97 pgs: 97 active+clean; 288 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 803 KiB/s wr, 102 op/s 2023-10-07T00:19:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:20 smithi088 ceph-mon[103111]: pgmap v543: 97 pgs: 97 active+clean; 288 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 803 KiB/s wr, 102 op/s 2023-10-07T00:19:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:20 smithi112 ceph-mon[133548]: pgmap v543: 97 pgs: 97 active+clean; 288 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 803 KiB/s wr, 102 op/s 2023-10-07T00:19:22.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:21 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:22.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:21 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:22.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:21 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:23.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:22 smithi005 ceph-mon[129406]: pgmap v544: 97 pgs: 97 active+clean; 290 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 859 KiB/s wr, 109 op/s 2023-10-07T00:19:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:22 smithi088 ceph-mon[103111]: pgmap v544: 97 pgs: 97 active+clean; 290 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 859 KiB/s wr, 109 op/s 2023-10-07T00:19:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:22 smithi112 ceph-mon[133548]: pgmap v544: 97 pgs: 97 active+clean; 290 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 859 KiB/s wr, 109 op/s 2023-10-07T00:19:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:24 smithi088 ceph-mon[103111]: pgmap v545: 97 pgs: 97 active+clean; 293 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 862 KiB/s wr, 94 op/s 2023-10-07T00:19:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:24 smithi112 ceph-mon[133548]: pgmap v545: 97 pgs: 97 active+clean; 293 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 862 KiB/s wr, 94 op/s 2023-10-07T00:19:25.361 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:24 smithi005 ceph-mon[129406]: pgmap v545: 97 pgs: 97 active+clean; 293 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 862 KiB/s wr, 94 op/s 2023-10-07T00:19:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:26 smithi088 ceph-mon[103111]: pgmap v546: 97 pgs: 97 active+clean; 294 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 887 KiB/s wr, 100 op/s 2023-10-07T00:19:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:26 smithi112 ceph-mon[133548]: pgmap v546: 97 pgs: 97 active+clean; 294 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 887 KiB/s wr, 100 op/s 2023-10-07T00:19:27.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:26 smithi005 ceph-mon[129406]: pgmap v546: 97 pgs: 97 active+clean; 294 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 887 KiB/s wr, 100 op/s 2023-10-07T00:19:27.767 INFO:tasks.workunit.client.0.smithi005.stdout: 51 7316 85 4187 28 1507 60 2023-10-07T00:19:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:28 smithi088 ceph-mon[103111]: pgmap v547: 97 pgs: 97 active+clean; 295 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 883 KiB/s wr, 103 op/s 2023-10-07T00:19:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:28 smithi112 ceph-mon[133548]: pgmap v547: 97 pgs: 97 active+clean; 295 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 883 KiB/s wr, 103 op/s 2023-10-07T00:19:29.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:28 smithi005 ceph-mon[129406]: pgmap v547: 97 pgs: 97 active+clean; 295 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 883 KiB/s wr, 103 op/s 2023-10-07T00:19:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.413+0000 7f4de3bff700 1 -- 172.21.15.5:0/71632803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ddc073910 msgr2=0x7f4ddc073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.413+0000 7f4de3bff700 1 --2- 172.21.15.5:0/71632803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ddc073910 0x7f4ddc073d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40098f0 tx=0x7f4dd4009c00 comp rx=0 tx=0).stop 2023-10-07T00:19:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.414+0000 7f4de3bff700 1 -- 172.21.15.5:0/71632803 shutdown_connections 2023-10-07T00:19:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.414+0000 7f4de3bff700 1 --2- 172.21.15.5:0/71632803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ddc10d4e0 0x7f4ddc10f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.414+0000 7f4de3bff700 1 --2- 172.21.15.5:0/71632803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ddc074ef0 0x7f4ddc073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.414+0000 7f4de3bff700 1 --2- 172.21.15.5:0/71632803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ddc073910 0x7f4ddc073d90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.414+0000 7f4de3bff700 1 -- 172.21.15.5:0/71632803 >> 172.21.15.5:0/71632803 conn(0x7f4ddc0fc480 msgr2=0x7f4ddc0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.414+0000 7f4de3bff700 1 -- 172.21.15.5:0/71632803 shutdown_connections 2023-10-07T00:19:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.414+0000 7f4de3bff700 1 -- 172.21.15.5:0/71632803 wait complete. 2023-10-07T00:19:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.416+0000 7f4de3bff700 1 Processor -- start 2023-10-07T00:19:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.416+0000 7f4de3bff700 1 -- start start 2023-10-07T00:19:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.416+0000 7f4de3bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ddc074ef0 0x7f4ddc19d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.416+0000 7f4de3bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ddc10d4e0 0x7f4ddc19d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.416+0000 7f4de3bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ddc1a2930 0x7f4ddc1a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.416+0000 7f4de3bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1a52f0 con 0x7f4ddc074ef0 2023-10-07T00:19:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de3bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc104cd0 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de3bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc104e60 con 0x7f4ddc1a2930 2023-10-07T00:19:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de119a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ddc10d4e0 0x7f4ddc19d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de119a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ddc10d4e0 0x7f4ddc19d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:58742/0 (socket says 172.21.15.5:58742) 2023-10-07T00:19:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de119a700 1 -- 172.21.15.5:0/2211119852 learned_addr learned my addr 172.21.15.5:0/2211119852 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de119a700 1 -- 172.21.15.5:0/2211119852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ddc1a2930 msgr2=0x7f4ddc1a4d20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-07T00:19:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de119a700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ddc1a2930 0x7f4ddc1a4d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de119a700 1 -- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ddc074ef0 msgr2=0x7f4ddc19d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de119a700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ddc074ef0 0x7f4ddc19d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.417+0000 7f4de119a700 1 -- 172.21.15.5:0/2211119852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0095f0 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.418+0000 7f4de119a700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ddc10d4e0 0x7f4ddc19d8d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4000c00 tx=0x7f4dd400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.418+0000 7f4dd2ffd700 1 -- 172.21.15.5:0/2211119852 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd401c070 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.418+0000 7f4dd2ffd700 1 -- 172.21.15.5:0/2211119852 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dd400f7b0 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.418+0000 7f4dd2ffd700 1 -- 172.21.15.5:0/2211119852 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40038c0 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.418+0000 7f4de3bff700 1 -- 172.21.15.5:0/2211119852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd4009520 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.419+0000 7f4de3bff700 1 -- 172.21.15.5:0/2211119852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc105320 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.425+0000 7f4df7537b80 1 Processor -- start 2023-10-07T00:19:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.425+0000 7f4dd2ffd700 1 -- 172.21.15.5:0/2211119852 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4dd4020030 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.425+0000 7f4df7537b80 1 -- start start 2023-10-07T00:19:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.426+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbab52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.426+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbab6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.426+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbabd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.426+0000 7f4df7537b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dba1d400 con 0x5642dbab4ec0 2023-10-07T00:19:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.426+0000 7f4df7537b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dba0ebc0 con 0x5642dbab5fd0 2023-10-07T00:19:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.426+0000 7f4df7537b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dba0c4e0 con 0x5642dbab6990 2023-10-07T00:19:29.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.427+0000 7f4de119a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbabd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.427+0000 7f4de199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbab6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.427+0000 7f4de199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbab6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:58752/0 (socket says 172.21.15.5:58752) 2023-10-07T00:19:29.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.427+0000 7f4de199b700 1 -- 172.21.15.5:0/1239551859 learned_addr learned my addr 172.21.15.5:0/1239551859 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.427+0000 7f4de219c700 1 --2- 172.21.15.5:0/1239551859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbab52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.427+0000 7f4de199b700 1 -- 172.21.15.5:0/1239551859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 msgr2=0x5642dbabd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.427+0000 7f4de199b700 1 --2- 172.21.15.5:0/1239551859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbabd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4de199b700 1 -- 172.21.15.5:0/1239551859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 msgr2=0x5642dbab52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4de199b700 1 --2- 172.21.15.5:0/1239551859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbab52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4de199b700 1 -- 172.21.15.5:0/1239551859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642db832d80 con 0x5642dbab5fd0 2023-10-07T00:19:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4dd2ffd700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4dc80a15d0 0x7f4dc80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4de199b700 1 --2- 172.21.15.5:0/1239551859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbab6450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800e400 tx=0x7f4dd800e710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fea965cc4c12e9f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4dd2ffd700 1 -- 172.21.15.5:0/2211119852 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4dd40cdc00 con 0x7f4ddc10d4e0 2023-10-07T00:19:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4dc7fff700 1 -- 172.21.15.5:0/1239551859 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8018070 con 0x5642dbab5fd0 2023-10-07T00:19:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4dc7fff700 1 -- 172.21.15.5:0/1239551859 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dd800f040 con 0x5642dbab5fd0 2023-10-07T00:19:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4dc7fff700 1 -- 172.21.15.5:0/1239551859 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8004020 con 0x5642dbab5fd0 2023-10-07T00:19:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.428+0000 7f4de219c700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4dc80a15d0 0x7f4dc80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.429+0000 7f4df7537b80 1 -- 172.21.15.5:0/1239551859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 msgr2=0x5642dbab6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.429+0000 7f4df7537b80 1 --2- 172.21.15.5:0/1239551859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbab6450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800e400 tx=0x7f4dd800e710 comp rx=0 tx=0).stop 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.430+0000 7f4de219c700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4dc80a15d0 0x7f4dc80a3a90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5642dbab4c60 tx=0x7f4dcc009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.430+0000 7f4df7537b80 1 -- 172.21.15.5:0/1239551859 shutdown_connections 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.430+0000 7f4df7537b80 1 --2- 172.21.15.5:0/1239551859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbabd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.430+0000 7f4df7537b80 1 --2- 172.21.15.5:0/1239551859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbab52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.430+0000 7f4df7537b80 1 --2- 172.21.15.5:0/1239551859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbab6450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.430+0000 7f4df7537b80 1 -- 172.21.15.5:0/1239551859 >> 172.21.15.5:0/1239551859 conn(0x5642dba29200 msgr2=0x5642dbaafbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.430+0000 7f4df7537b80 1 -- 172.21.15.5:0/1239551859 shutdown_connections 2023-10-07T00:19:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.430+0000 7f4df7537b80 1 -- 172.21.15.5:0/1239551859 wait complete. 2023-10-07T00:19:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.431+0000 7f4df7537b80 1 -- start start 2023-10-07T00:19:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.431+0000 7f4df7537b80 1 Processor -- start 2023-10-07T00:19:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbabeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab5fd0 0x5642dbabf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4df7537b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dba07dd0 con 0x5642dbab4ec0 2023-10-07T00:19:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4df7537b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642db9a46b0 con 0x5642dbab6990 2023-10-07T00:19:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4df7537b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642db9a4350 con 0x5642dbab5fd0 2023-10-07T00:19:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4df7537b80 10 client.0 _ll_register_callbacks cb 0x5642db8017a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:29.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4de119a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab5fd0 0x5642dbabf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4de119a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab5fd0 0x5642dbabf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:32890/0 (socket says 172.21.15.5:32890) 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4de119a700 1 -- 172.21.15.5:0/614044503 learned_addr learned my addr 172.21.15.5:0/614044503 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4de199b700 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbabeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.433+0000 7f4de219c700 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.434+0000 7f4de219c700 1 -- 172.21.15.5:0/614044503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab5fd0 msgr2=0x5642dbabf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.434+0000 7f4de219c700 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab5fd0 0x5642dbabf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.434+0000 7f4de219c700 1 -- 172.21.15.5:0/614044503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 msgr2=0x5642dbabeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.434+0000 7f4de219c700 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbabeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.434+0000 7f4de219c700 1 -- 172.21.15.5:0/614044503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd800e140 con 0x5642dbab6990 2023-10-07T00:19:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.435+0000 7f4de219c700 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac60c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc005fd0 tx=0x7f4dcc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eed13241153390e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.435+0000 7f4dc57fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:19:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.435+0000 7f4dc57fa700 1 -- 172.21.15.5:0/614044503 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00e840 con 0x5642dbab6990 2023-10-07T00:19:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.435+0000 7f4dc57fa700 1 -- 172.21.15.5:0/614044503 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4dcc00e9a0 con 0x5642dbab6990 2023-10-07T00:19:29.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.435+0000 7f4df7537b80 1 -- 172.21.15.5:0/614044503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642dbaa7d50 con 0x5642dbab6990 2023-10-07T00:19:29.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.436+0000 7f4dc57fa700 1 -- 172.21.15.5:0/614044503 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dcc00eb60 con 0x5642dbab6990 2023-10-07T00:19:29.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.436+0000 7f4df7537b80 10 client.26438 fetch_fsmap learned FSMap version 40 2023-10-07T00:19:29.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.436+0000 7f4df7537b80 1 -- 172.21.15.5:0/614044503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5642db81bc00 con 0x5642dbab6990 2023-10-07T00:19:29.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.437+0000 7f4dc57fa700 1 -- 172.21.15.5:0/614044503 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5642dbaa7d50 con 0x5642dbab6990 2023-10-07T00:19:29.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.437+0000 7f4dc57fa700 1 -- 172.21.15.5:0/614044503 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 40) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f4dcc024020 con 0x5642dbab6990 2023-10-07T00:19:29.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.438+0000 7f4df7537b80 10 client.26438 fetch_fsmap finished waiting for FSMap version 40 2023-10-07T00:19:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.438+0000 7f4df7537b80 10 client.26438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.438+0000 7f4df7537b80 20 client.26438 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.438+0000 7f4df7537b80 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5642dbacaa80 0x5642dbaccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.438+0000 7f4df7537b80 4 client.26438 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:19:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.438+0000 7f4df7537b80 1 -- 172.21.15.5:0/614044503 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642dba00db0 con 0x5642dbacaa80 2023-10-07T00:19:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.438+0000 7f4de199b700 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5642dbacaa80 0x5642dbaccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.439+0000 7f4de199b700 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5642dbacaa80 0x5642dbaccea0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=851ab669a5130b12 server_cookie=2944f13fb561e87c in_seq=0 out_seq=0 2023-10-07T00:19:29.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.439+0000 7f4dc57fa700 10 client.26438 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:29.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.439+0000 7f4dc57fa700 1 -- 172.21.15.5:0/614044503 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5642dba00db0 con 0x5642dbacaa80 2023-10-07T00:19:29.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.439+0000 7f4dc57fa700 10 client.26438 handle_command_reply: tid=0 2023-10-07T00:19:29.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.439+0000 7f4df7537b80 1 client.26438 shutdown 2023-10-07T00:19:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4df7537b80 1 -- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 msgr2=0x5642dbac60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4df7537b80 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac60c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc005fd0 tx=0x7f4dcc0047c0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4df7537b80 1 -- 172.21.15.5:0/614044503 shutdown_connections 2023-10-07T00:19:29.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4df7537b80 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5642dbacaa80 0x5642dbaccea0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4df7537b80 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac60c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4df7537b80 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbabeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4df7537b80 1 --2- 172.21.15.5:0/614044503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab5fd0 0x5642dbabf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4df7537b80 1 -- 172.21.15.5:0/614044503 >> 172.21.15.5:0/614044503 conn(0x5642dba29200 msgr2=0x5642dbaaf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:29.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.440+0000 7f4dc57fa700 0 client.26438 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:29.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.441+0000 7f4df7537b80 1 -- 172.21.15.5:0/614044503 shutdown_connections 2023-10-07T00:19:29.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.441+0000 7f4df7537b80 1 -- 172.21.15.5:0/614044503 wait complete. 2023-10-07T00:19:29.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.442+0000 7f4df7537b80 20 client.26438 trim_cache size 0 max 16384 2023-10-07T00:19:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.472+0000 7f4df7537b80 1 Processor -- start 2023-10-07T00:19:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.472+0000 7f4df7537b80 1 -- start start 2023-10-07T00:19:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.473+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab4ec0 0x5642dbaaf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.473+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab5fd0 0x5642dbac6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.473+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.473+0000 7f4df7537b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642db8888c0 con 0x5642dbab5fd0 2023-10-07T00:19:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.473+0000 7f4df7537b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dbaa7890 con 0x5642dbab6990 2023-10-07T00:19:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.473+0000 7f4df7537b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dbabf7c0 con 0x5642dbab4ec0 2023-10-07T00:19:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de219c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de219c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:58766/0 (socket says 172.21.15.5:58766) 2023-10-07T00:19:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de219c700 1 -- 172.21.15.5:0/43365008 learned_addr learned my addr 172.21.15.5:0/43365008 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de199b700 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab4ec0 0x5642dbaaf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de119a700 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab5fd0 0x5642dbac6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de219c700 1 -- 172.21.15.5:0/43365008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab4ec0 msgr2=0x5642dbaaf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de219c700 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab4ec0 0x5642dbaaf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de219c700 1 -- 172.21.15.5:0/43365008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab5fd0 msgr2=0x5642dbac6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de219c700 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab5fd0 0x5642dbac6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.474+0000 7f4de219c700 1 -- 172.21.15.5:0/43365008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642db8591f0 con 0x5642dbab6990 2023-10-07T00:19:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.475+0000 7f4de219c700 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac68f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc01e560 tx=0x7f4dcc01e600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d030dd0d2f40f2cc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:29.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.475+0000 7f4dd0bff700 1 -- 172.21.15.5:0/43365008 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc035050 con 0x5642dbab6990 2023-10-07T00:19:29.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.475+0000 7f4dd0bff700 1 -- 172.21.15.5:0/43365008 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dcc01ec30 con 0x5642dbab6990 2023-10-07T00:19:29.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.475+0000 7f4dd0bff700 1 -- 172.21.15.5:0/43365008 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00ed30 con 0x5642dbab6990 2023-10-07T00:19:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.476+0000 7f4df7537b80 1 -- 172.21.15.5:0/43365008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 msgr2=0x5642dbac68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.476+0000 7f4df7537b80 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac68f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc01e560 tx=0x7f4dcc01e600 comp rx=0 tx=0).stop 2023-10-07T00:19:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.477+0000 7f4df7537b80 1 -- 172.21.15.5:0/43365008 shutdown_connections 2023-10-07T00:19:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.477+0000 7f4df7537b80 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab6990 0x5642dbac68f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.477+0000 7f4df7537b80 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab4ec0 0x5642dbaaf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.477+0000 7f4df7537b80 1 --2- 172.21.15.5:0/43365008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab5fd0 0x5642dbac6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.477+0000 7f4df7537b80 1 -- 172.21.15.5:0/43365008 >> 172.21.15.5:0/43365008 conn(0x5642dba29200 msgr2=0x5642dbaafb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.477+0000 7f4df7537b80 1 -- 172.21.15.5:0/43365008 shutdown_connections 2023-10-07T00:19:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.477+0000 7f4df7537b80 1 -- 172.21.15.5:0/43365008 wait complete. 2023-10-07T00:19:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.477+0000 7f4df7537b80 1 -- start start 2023-10-07T00:19:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.478+0000 7f4df7537b80 1 Processor -- start 2023-10-07T00:19:29.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.478+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbac3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.478+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbac4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.478+0000 7f4df7537b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbac5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.478+0000 7f4df7537b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dbac56d0 con 0x5642dbab4ec0 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.478+0000 7f4df7537b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dbac5840 con 0x5642dbab5fd0 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.478+0000 7f4df7537b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dbac5a00 con 0x5642dbab6990 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4df7537b80 10 client.0 _ll_register_callbacks cb 0x7f4dcc004420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de119a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbac4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de119a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbac4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:58782/0 (socket says 172.21.15.5:58782) 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de119a700 1 -- 172.21.15.5:0/661850726 learned_addr learned my addr 172.21.15.5:0/661850726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de219c700 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbac5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de119a700 1 -- 172.21.15.5:0/661850726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 msgr2=0x5642dbac5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de119a700 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbac5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de119a700 1 -- 172.21.15.5:0/661850726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 msgr2=0x5642dbac3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de119a700 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbac3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de119a700 1 -- 172.21.15.5:0/661850726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642db81bc00 con 0x5642dbab5fd0 2023-10-07T00:19:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.479+0000 7f4de219c700 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbac5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:19:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.480+0000 7f4de119a700 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbac4180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40cb730 tx=0x7f4dd400ba60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b701ad8ac615e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.480+0000 7f4dc57fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:19:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.480+0000 7f4dc57fa700 1 -- 172.21.15.5:0/661850726 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd409af90 con 0x5642dbab5fd0 2023-10-07T00:19:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.480+0000 7f4dc57fa700 1 -- 172.21.15.5:0/661850726 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4dd409f0e0 con 0x5642dbab5fd0 2023-10-07T00:19:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.480+0000 7f4df7537b80 1 -- 172.21.15.5:0/661850726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4dd800f040 con 0x5642dbab5fd0 2023-10-07T00:19:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.481+0000 7f4dc57fa700 1 -- 172.21.15.5:0/661850726 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dd40a3290 con 0x5642dbab5fd0 2023-10-07T00:19:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.481+0000 7f4df7537b80 10 client.26444 fetch_fsmap learned FSMap version 40 2023-10-07T00:19:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.481+0000 7f4df7537b80 1 -- 172.21.15.5:0/661850726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5642db831250 con 0x5642dbab5fd0 2023-10-07T00:19:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.481+0000 7f4dc57fa700 1 -- 172.21.15.5:0/661850726 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dd40a7080 con 0x5642dbab5fd0 2023-10-07T00:19:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.482+0000 7f4dc57fa700 1 -- 172.21.15.5:0/661850726 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 40) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f4dd4021380 con 0x5642dbab5fd0 2023-10-07T00:19:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.482+0000 7f4df7537b80 10 client.26444 fetch_fsmap finished waiting for FSMap version 40 2023-10-07T00:19:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.482+0000 7f4df7537b80 10 client.26444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.482+0000 7f4df7537b80 20 client.26444 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.482+0000 7f4df7537b80 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5642dbb1f410 0x5642dbb21830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.482+0000 7f4df7537b80 4 client.26444 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:19:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.482+0000 7f4df7537b80 1 -- 172.21.15.5:0/661850726 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5642dba00ad0 con 0x5642dbb1f410 2023-10-07T00:19:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.482+0000 7f4de199b700 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5642dbb1f410 0x5642dbb21830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.483+0000 7f4de199b700 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5642dbb1f410 0x5642dbb21830 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c7f3e51b9b5c53 server_cookie=d1d242e1bf04630b in_seq=0 out_seq=0 2023-10-07T00:19:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.483+0000 7f4dc57fa700 10 client.26444 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.541+0000 7f4dc57fa700 1 -- 172.21.15.5:0/661850726 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5642dba00ad0 con 0x5642dbb1f410 2023-10-07T00:19:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.541+0000 7f4dc57fa700 10 client.26444 handle_command_reply: tid=0 2023-10-07T00:19:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.541+0000 7f4df7537b80 1 client.26444 shutdown 2023-10-07T00:19:29.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.541+0000 7f4df7537b80 1 -- 172.21.15.5:0/661850726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 msgr2=0x5642dbac4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:29.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.541+0000 7f4df7537b80 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbac4180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40cb730 tx=0x7f4dd400ba60 comp rx=0 tx=0).stop 2023-10-07T00:19:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 1 -- 172.21.15.5:0/661850726 shutdown_connections 2023-10-07T00:19:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5642dbb1f410 0x5642dbb21830 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642dbab6990 0x5642dbac5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642dbab4ec0 0x5642dbac3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4dc57fa700 0 client.26444 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 1 --2- 172.21.15.5:0/661850726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5642dbab5fd0 0x5642dbac4180 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 1 -- 172.21.15.5:0/661850726 >> 172.21.15.5:0/661850726 conn(0x5642dba29200 msgr2=0x5642dbabd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 1 -- 172.21.15.5:0/661850726 shutdown_connections 2023-10-07T00:19:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 1 -- 172.21.15.5:0/661850726 wait complete. 2023-10-07T00:19:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:19:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:19:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:19:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:19:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.542+0000 7f4df7537b80 20 client.26444 trim_cache size 0 max 16384 2023-10-07T00:19:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.543+0000 7f4de3bff700 1 -- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4dc80a15d0 msgr2=0x7f4dc80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.543+0000 7f4de3bff700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4dc80a15d0 0x7f4dc80a3a90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5642dbab4c60 tx=0x7f4dcc009310 comp rx=0 tx=0).stop 2023-10-07T00:19:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.543+0000 7f4de3bff700 1 -- 172.21.15.5:0/2211119852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ddc10d4e0 msgr2=0x7f4ddc19d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.543+0000 7f4de3bff700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ddc10d4e0 0x7f4ddc19d8d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4000c00 tx=0x7f4dd400b840 comp rx=0 tx=0).stop 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.544+0000 7f4de3bff700 1 -- 172.21.15.5:0/2211119852 shutdown_connections 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.544+0000 7f4de3bff700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4dc80a15d0 0x7f4dc80a3a90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.544+0000 7f4de3bff700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ddc1a2930 0x7f4ddc1a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.544+0000 7f4de3bff700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ddc074ef0 0x7f4ddc19d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.544+0000 7f4de3bff700 1 --2- 172.21.15.5:0/2211119852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ddc10d4e0 0x7f4ddc19d8d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.544+0000 7f4de3bff700 1 -- 172.21.15.5:0/2211119852 >> 172.21.15.5:0/2211119852 conn(0x7f4ddc0fc480 msgr2=0x7f4ddc10f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.544+0000 7f4de3bff700 1 -- 172.21.15.5:0/2211119852 shutdown_connections 2023-10-07T00:19:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:29.544+0000 7f4de3bff700 1 -- 172.21.15.5:0/2211119852 wait complete. 2023-10-07T00:19:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:30 smithi088 ceph-mon[103111]: pgmap v548: 97 pgs: 97 active+clean; 297 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 909 KiB/s wr, 95 op/s 2023-10-07T00:19:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:30 smithi112 ceph-mon[133548]: pgmap v548: 97 pgs: 97 active+clean; 297 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 909 KiB/s wr, 95 op/s 2023-10-07T00:19:31.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:30 smithi005 ceph-mon[129406]: pgmap v548: 97 pgs: 97 active+clean; 297 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 909 KiB/s wr, 95 op/s 2023-10-07T00:19:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:32 smithi088 ceph-mon[103111]: pgmap v549: 97 pgs: 97 active+clean; 299 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 991 KiB/s wr, 107 op/s 2023-10-07T00:19:33.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:32 smithi112 ceph-mon[133548]: pgmap v549: 97 pgs: 97 active+clean; 299 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 991 KiB/s wr, 107 op/s 2023-10-07T00:19:33.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:32 smithi005 ceph-mon[129406]: pgmap v549: 97 pgs: 97 active+clean; 299 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 991 KiB/s wr, 107 op/s 2023-10-07T00:19:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:34 smithi088 ceph-mon[103111]: pgmap v550: 97 pgs: 97 active+clean; 301 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2023-10-07T00:19:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:34 smithi112 ceph-mon[133548]: pgmap v550: 97 pgs: 97 active+clean; 301 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2023-10-07T00:19:35.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:34 smithi005 ceph-mon[129406]: pgmap v550: 97 pgs: 97 active+clean; 301 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2023-10-07T00:19:36.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:35 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:19:36.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:35 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:19:36.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:35 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:19:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:36 smithi088 ceph-mon[103111]: pgmap v551: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 943 KiB/s wr, 137 op/s 2023-10-07T00:19:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:19:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:19:37.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:19:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:36 smithi112 ceph-mon[133548]: pgmap v551: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 943 KiB/s wr, 137 op/s 2023-10-07T00:19:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:19:37.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:19:37.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:19:37.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:36 smithi005 ceph-mon[129406]: pgmap v551: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 943 KiB/s wr, 137 op/s 2023-10-07T00:19:37.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:19:37.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:19:37.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:19:37.360 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:19:38.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:37 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi005 to 222.0M 2023-10-07T00:19:38.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:37 smithi088 ceph-mon[103111]: Unable to set osd_memory_target on smithi005 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-07T00:19:38.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:37 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi005 to 222.0M 2023-10-07T00:19:38.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:37 smithi112 ceph-mon[133548]: Unable to set osd_memory_target on smithi005 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-07T00:19:38.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:37 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi005 to 222.0M 2023-10-07T00:19:38.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:37 smithi005 ceph-mon[129406]: Unable to set osd_memory_target on smithi005 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-07T00:19:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:38 smithi088 ceph-mon[103111]: pgmap v552: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 843 KiB/s wr, 126 op/s 2023-10-07T00:19:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:38 smithi112 ceph-mon[133548]: pgmap v552: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 843 KiB/s wr, 126 op/s 2023-10-07T00:19:39.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:38 smithi005 ceph-mon[129406]: pgmap v552: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 843 KiB/s wr, 126 op/s 2023-10-07T00:19:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:40 smithi088 ceph-mon[103111]: pgmap v553: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 805 KiB/s wr, 122 op/s 2023-10-07T00:19:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:40 smithi112 ceph-mon[133548]: pgmap v553: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 805 KiB/s wr, 122 op/s 2023-10-07T00:19:41.361 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:40 smithi005 ceph-mon[129406]: pgmap v553: 97 pgs: 97 active+clean; 303 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 805 KiB/s wr, 122 op/s 2023-10-07T00:19:42.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:41 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:42.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:41 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:42.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:41 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:19:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 -- 172.21.15.5:0/1704932252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88100eb0 msgr2=0x7f0f881012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/1704932252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88100eb0 0x7f0f881012d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009990 tx=0x7f0f78009ca0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 -- 172.21.15.5:0/1704932252 shutdown_connections 2023-10-07T00:19:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/1704932252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f88102a50 0x7f0f88109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/1704932252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88100eb0 0x7f0f881012d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/1704932252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f88102090 0x7f0f88102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 -- 172.21.15.5:0/1704932252 >> 172.21.15.5:0/1704932252 conn(0x7f0f880fc470 msgr2=0x7f0f880fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 -- 172.21.15.5:0/1704932252 shutdown_connections 2023-10-07T00:19:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.715+0000 7f0f8cfff700 1 -- 172.21.15.5:0/1704932252 wait complete. 2023-10-07T00:19:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.716+0000 7f0f8cfff700 1 Processor -- start 2023-10-07T00:19:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.716+0000 7f0f8cfff700 1 -- start start 2023-10-07T00:19:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.716+0000 7f0f8cfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f88100eb0 0x7f0f88074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.716+0000 7f0f8cfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f88102090 0x7f0f880732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f8cfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88102a50 0x7f0f880737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f8cfff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88073f80 con 0x7f0f88102a50 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f8cfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880740f0 con 0x7f0f88100eb0 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f8cfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881a0b20 con 0x7f0f88102090 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f86d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88102a50 0x7f0f880737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f86d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88102a50 0x7f0f880737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43178/0 (socket says 172.21.15.5:43178) 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f86d9d700 1 -- 172.21.15.5:0/2275326907 learned_addr learned my addr 172.21.15.5:0/2275326907 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f88102090 0x7f0f880732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f8659c700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f88100eb0 0x7f0f88074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f86d9d700 1 -- 172.21.15.5:0/2275326907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f88102090 msgr2=0x7f0f880732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f86d9d700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f88102090 0x7f0f880732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f86d9d700 1 -- 172.21.15.5:0/2275326907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f88100eb0 msgr2=0x7f0f88074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f86d9d700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f88100eb0 0x7f0f88074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.717+0000 7f0f86d9d700 1 -- 172.21.15.5:0/2275326907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f780095f0 con 0x7f0f88102a50 2023-10-07T00:19:42.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.718+0000 7f0f86d9d700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88102a50 0x7f0f880737e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007ee0 tx=0x7f0f8000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:42.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.718+0000 7f0f777fe700 1 -- 172.21.15.5:0/2275326907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80017070 con 0x7f0f88102a50 2023-10-07T00:19:42.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.718+0000 7f0f777fe700 1 -- 172.21.15.5:0/2275326907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f8000f040 con 0x7f0f88102a50 2023-10-07T00:19:42.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.718+0000 7f0f8cfff700 1 -- 172.21.15.5:0/2275326907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f881a0e00 con 0x7f0f88102a50 2023-10-07T00:19:42.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.718+0000 7f0f777fe700 1 -- 172.21.15.5:0/2275326907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80005570 con 0x7f0f88102a50 2023-10-07T00:19:42.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.718+0000 7f0f8cfff700 1 -- 172.21.15.5:0/2275326907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f881a1230 con 0x7f0f88102a50 2023-10-07T00:19:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.723+0000 7f0f777fe700 1 -- 172.21.15.5:0/2275326907 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0f8000db20 con 0x7f0f88102a50 2023-10-07T00:19:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.724+0000 7f0fa09c3b80 1 Processor -- start 2023-10-07T00:19:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.724+0000 7f0fa09c3b80 1 -- start start 2023-10-07T00:19:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.724+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b76d0 0x5573224b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.724+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.724+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224bfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.724+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557322417400 con 0x5573224b91a0 2023-10-07T00:19:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.724+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557322408bc0 con 0x5573224b76d0 2023-10-07T00:19:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.724+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573224064e0 con 0x5573224b87e0 2023-10-07T00:19:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f777fe700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0f700a1480 0x7f0f700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224bfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f8659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b76d0 0x5573224b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f8659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224b8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:52314/0 (socket says 172.21.15.5:52314) 2023-10-07T00:19:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f8659c700 1 -- 172.21.15.5:0/1830935062 learned_addr learned my addr 172.21.15.5:0/1830935062 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f777fe700 1 -- 172.21.15.5:0/2275326907 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0f800cc480 con 0x7f0f88102a50 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f86d9d700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0f700a1480 0x7f0f700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f85d9b700 1 -- 172.21.15.5:0/1830935062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 msgr2=0x5573224b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/1830935062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f85d9b700 1 -- 172.21.15.5:0/1830935062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 msgr2=0x5573224bfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/1830935062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224bfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f85d9b700 1 -- 172.21.15.5:0/1830935062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55732222cd80 con 0x5573224b76d0 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.725+0000 7f0f8659c700 1 --2- 172.21.15.5:0/1830935062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.726+0000 7f0f86d9d700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0f700a1480 0x7f0f700a3940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007fd0 tx=0x7f0f8000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.726+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/1830935062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b76d0 0x5573224b7af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0117b0 tx=0x7f0f7c00af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bca587693c4e2bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.726+0000 7f0f74ff9700 1 -- 172.21.15.5:0/1830935062 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0110d0 con 0x5573224b76d0 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.726+0000 7f0f74ff9700 1 -- 172.21.15.5:0/1830935062 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f7c011230 con 0x5573224b76d0 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.726+0000 7f0f74ff9700 1 -- 172.21.15.5:0/1830935062 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c004da0 con 0x5573224b76d0 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1830935062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b76d0 msgr2=0x5573224b7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1830935062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b76d0 0x5573224b7af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0117b0 tx=0x7f0f7c00af90 comp rx=0 tx=0).stop 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1830935062 shutdown_connections 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1830935062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224bfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1830935062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b76d0 0x5573224b7af0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1830935062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1830935062 >> 172.21.15.5:0/1830935062 conn(0x557322423200 msgr2=0x5573224a9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1830935062 shutdown_connections 2023-10-07T00:19:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1830935062 wait complete. 2023-10-07T00:19:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.727+0000 7f0fa09c3b80 1 -- start start 2023-10-07T00:19:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.728+0000 7f0fa09c3b80 1 Processor -- start 2023-10-07T00:19:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.728+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 0x5573224c12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.728+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.728+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.728+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557322401dd0 con 0x5573224b91a0 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.728+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55732239e6b0 con 0x5573224b87e0 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.728+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55732239e350 con 0x5573224b76d0 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.728+0000 7f0fa09c3b80 10 client.0 _ll_register_callbacks cb 0x5573221fb7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43206/0 (socket says 172.21.15.5:43206) 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 -- 172.21.15.5:0/1899749767 learned_addr learned my addr 172.21.15.5:0/1899749767 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f8659c700 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 0x5573224c12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 -- 172.21.15.5:0/1899749767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 msgr2=0x5573224c12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 0x5573224c12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 -- 172.21.15.5:0/1899749767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 msgr2=0x5573224c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 -- 172.21.15.5:0/1899749767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f88109ca0 con 0x5573224b91a0 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c8860 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0048d0 tx=0x7f0f7c0113a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd658d51b6e0e25 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.729+0000 7f0f6dffb700 1 -- 172.21.15.5:0/1899749767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0055f0 con 0x5573224b91a0 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1899749767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573224a1d50 con 0x5573224b91a0 2023-10-07T00:19:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0f6dffb700 1 -- 172.21.15.5:0/1899749767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0f7c004030 con 0x5573224b91a0 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0f6dffb700 1 -- 172.21.15.5:0/1899749767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f7c0041f0 con 0x5573224b91a0 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 10 client.16593 fetch_fsmap learned FSMap version 41 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1899749767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f0f7c019040 con 0x5573224b91a0 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0f6dffb700 1 -- 172.21.15.5:0/1899749767 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f7c027020 con 0x5573224b91a0 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0f6dffb700 1 -- 172.21.15.5:0/1899749767 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f0f7c003b50 con 0x5573224b91a0 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 10 client.16593 fetch_fsmap finished waiting for FSMap version 41 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 10 client.16593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 20 client.16593 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5573224cd020 0x5573224cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 4 client.16593 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.730+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1899749767 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573223fadb0 con 0x5573224cd020 2023-10-07T00:19:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.731+0000 7f0f8659c700 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5573224cd020 0x5573224cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.732+0000 7f0f8659c700 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5573224cd020 0x5573224cf440 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db692c76be2b30f3 server_cookie=b1d9b1e9cefaef43 in_seq=0 out_seq=0 2023-10-07T00:19:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.732+0000 7f0f6dffb700 10 client.16593 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.732+0000 7f0f6dffb700 1 -- 172.21.15.5:0/1899749767 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5573223fadb0 con 0x5573224cd020 2023-10-07T00:19:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.732+0000 7f0f6dffb700 10 client.16593 handle_command_reply: tid=0 2023-10-07T00:19:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.732+0000 7f0fa09c3b80 1 client.16593 shutdown 2023-10-07T00:19:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1899749767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 msgr2=0x5573224c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c8860 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0048d0 tx=0x7f0f7c0113a0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1899749767 shutdown_connections 2023-10-07T00:19:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5573224cd020 0x5573224cf440 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c8860 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 0x5573224c12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/1899749767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1899749767 >> 172.21.15.5:0/1899749767 conn(0x557322423200 msgr2=0x5573224a9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0f6dffb700 0 client.16593 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1899749767 shutdown_connections 2023-10-07T00:19:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/1899749767 wait complete. 2023-10-07T00:19:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.733+0000 7f0fa09c3b80 20 client.16593 trim_cache size 0 max 16384 2023-10-07T00:19:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.748+0000 7f0fa09c3b80 1 Processor -- start 2023-10-07T00:19:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0fa09c3b80 1 -- start start 2023-10-07T00:19:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 0x5573224c0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573222828c0 con 0x5573224b91a0 2023-10-07T00:19:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573224a6860 con 0x5573224b87e0 2023-10-07T00:19:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573224a1890 con 0x5573224b76d0 2023-10-07T00:19:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0f8659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43222/0 (socket says 172.21.15.5:43222) 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0f8659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:36996/0 (socket says 172.21.15.5:36996) 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0f85d9b700 1 -- 172.21.15.5:0/441307455 learned_addr learned my addr 172.21.15.5:0/441307455 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.749+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 0x5573224c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f8659c700 1 -- 172.21.15.5:0/441307455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 msgr2=0x5573224c0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f8659c700 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 0x5573224c0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f8659c700 1 -- 172.21.15.5:0/441307455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 msgr2=0x5573224c0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f8659c700 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f8659c700 1 -- 172.21.15.5:0/441307455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557322215c00 con 0x5573224b87e0 2023-10-07T00:19:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f8659c700 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c8780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c010 tx=0x7f0f78005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff1a8efc55211d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f757fa700 1 -- 172.21.15.5:0/441307455 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7801d040 con 0x5573224b87e0 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.750+0000 7f0f757fa700 1 -- 172.21.15.5:0/441307455 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f7801e040 con 0x5573224b87e0 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0f757fa700 1 -- 172.21.15.5:0/441307455 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78003820 con 0x5573224b87e0 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/441307455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 msgr2=0x5573224c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c8780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c010 tx=0x7f0f78005fb0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/441307455 shutdown_connections 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b91a0 0x5573224c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b76d0 0x5573224c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/441307455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b87e0 0x5573224c8780 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/441307455 >> 172.21.15.5:0/441307455 conn(0x557322423200 msgr2=0x5573224a9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/441307455 shutdown_connections 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.751+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/441307455 wait complete. 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.752+0000 7f0fa09c3b80 1 -- start start 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.752+0000 7f0fa09c3b80 1 Processor -- start 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.752+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b76d0 0x5573224c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.752+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.752+0000 7f0fa09c3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b91a0 0x5573224c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.752+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573224c7e40 con 0x5573224b76d0 2023-10-07T00:19:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.752+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573224c7fb0 con 0x5573224b91a0 2023-10-07T00:19:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.752+0000 7f0fa09c3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573224c8170 con 0x5573224b87e0 2023-10-07T00:19:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0fa09c3b80 10 client.0 _ll_register_callbacks cb 0x7f0f7c0116b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b76d0 0x5573224c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b76d0 0x5573224c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43232/0 (socket says 172.21.15.5:43232) 2023-10-07T00:19:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 -- 172.21.15.5:0/308959806 learned_addr learned my addr 172.21.15.5:0/308959806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f8659c700 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 -- 172.21.15.5:0/308959806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 msgr2=0x5573224c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 -- 172.21.15.5:0/308959806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b91a0 msgr2=0x5573224c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b91a0 0x5573224c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 -- 172.21.15.5:0/308959806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c019040 con 0x5573224b76d0 2023-10-07T00:19:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f85d9b700 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b76d0 0x5573224c63b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c003ee0 tx=0x7f0f7c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c40fc3cabdce1bd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.753+0000 7f0f6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:19:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0f6dffb700 1 -- 172.21.15.5:0/308959806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c005820 con 0x5573224b76d0 2023-10-07T00:19:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/308959806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f7c011230 con 0x5573224b76d0 2023-10-07T00:19:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0f6dffb700 1 -- 172.21.15.5:0/308959806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0f7c000e40 con 0x5573224b76d0 2023-10-07T00:19:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0f6dffb700 1 -- 172.21.15.5:0/308959806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f7c003fe0 con 0x5573224b76d0 2023-10-07T00:19:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0fa09c3b80 10 client.16599 fetch_fsmap learned FSMap version 41 2023-10-07T00:19:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/308959806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f0f78005510 con 0x5573224b76d0 2023-10-07T00:19:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0f6dffb700 1 -- 172.21.15.5:0/308959806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f7c011230 con 0x5573224b76d0 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0f6dffb700 1 -- 172.21.15.5:0/308959806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f0f7c003680 con 0x5573224b76d0 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0fa09c3b80 10 client.16599 fetch_fsmap finished waiting for FSMap version 41 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0fa09c3b80 10 client.16599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0fa09c3b80 20 client.16599 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.754+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557322521ab0 0x557322523ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.755+0000 7f0fa09c3b80 4 client.16599 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.755+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/308959806 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5573223faad0 con 0x557322521ab0 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.755+0000 7f0f8659c700 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557322521ab0 0x557322523ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.756+0000 7f0f8659c700 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557322521ab0 0x557322523ed0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b66005655a87481a server_cookie=d40c37ac8c08c75c in_seq=0 out_seq=0 2023-10-07T00:19:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.756+0000 7f0f6dffb700 10 client.16599 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0f6dffb700 1 -- 172.21.15.5:0/308959806 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5573223faad0 con 0x557322521ab0 2023-10-07T00:19:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0f6dffb700 10 client.16599 handle_command_reply: tid=0 2023-10-07T00:19:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 client.16599 shutdown 2023-10-07T00:19:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/308959806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b76d0 msgr2=0x5573224c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b76d0 0x5573224c63b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c003ee0 tx=0x7f0f7c011440 comp rx=0 tx=0).stop 2023-10-07T00:19:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/308959806 shutdown_connections 2023-10-07T00:19:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557322521ab0 0x557322523ed0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5573224b91a0 0x5573224c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573224b76d0 0x5573224c63b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 --2- 172.21.15.5:0/308959806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5573224b87e0 0x5573224c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0f6dffb700 0 client.16599 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.784+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/308959806 >> 172.21.15.5:0/308959806 conn(0x557322423200 msgr2=0x5573224bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.785+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/308959806 shutdown_connections 2023-10-07T00:19:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.785+0000 7f0fa09c3b80 1 -- 172.21.15.5:0/308959806 wait complete. 2023-10-07T00:19:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.785+0000 7f0fa09c3b80 20 client.16599 trim_cache size 0 max 16384 2023-10-07T00:19:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:19:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:19:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:19:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:19:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.785+0000 7f0f8cfff700 1 -- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0f700a1480 msgr2=0x7f0f700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.785+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0f700a1480 0x7f0f700a3940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007fd0 tx=0x7f0f8000b040 comp rx=0 tx=0).stop 2023-10-07T00:19:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.785+0000 7f0f8cfff700 1 -- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88102a50 msgr2=0x7f0f880737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.785+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88102a50 0x7f0f880737e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007ee0 tx=0x7f0f8000d3b0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.786+0000 7f0f8cfff700 1 -- 172.21.15.5:0/2275326907 shutdown_connections 2023-10-07T00:19:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.786+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f0f700a1480 0x7f0f700a3940 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.786+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f88102a50 0x7f0f880737e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.786+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f88100eb0 0x7f0f88074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.786+0000 7f0f8cfff700 1 --2- 172.21.15.5:0/2275326907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f88102090 0x7f0f880732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.786+0000 7f0f8cfff700 1 -- 172.21.15.5:0/2275326907 >> 172.21.15.5:0/2275326907 conn(0x7f0f880fc470 msgr2=0x7f0f880fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.786+0000 7f0f8cfff700 1 -- 172.21.15.5:0/2275326907 shutdown_connections 2023-10-07T00:19:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:42.786+0000 7f0f8cfff700 1 -- 172.21.15.5:0/2275326907 wait complete. 2023-10-07T00:19:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:42 smithi088 ceph-mon[103111]: pgmap v554: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 642 KiB/s wr, 114 op/s 2023-10-07T00:19:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:42 smithi112 ceph-mon[133548]: pgmap v554: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 642 KiB/s wr, 114 op/s 2023-10-07T00:19:43.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:42 smithi005 ceph-mon[129406]: pgmap v554: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 642 KiB/s wr, 114 op/s 2023-10-07T00:19:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:44 smithi088 ceph-mon[103111]: pgmap v555: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 457 KiB/s wr, 91 op/s 2023-10-07T00:19:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:44 smithi112 ceph-mon[133548]: pgmap v555: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 457 KiB/s wr, 91 op/s 2023-10-07T00:19:45.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:44 smithi005 ceph-mon[129406]: pgmap v555: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 457 KiB/s wr, 91 op/s 2023-10-07T00:19:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:46 smithi088 ceph-mon[103111]: pgmap v556: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 275 KiB/s wr, 72 op/s 2023-10-07T00:19:47.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:46 smithi112 ceph-mon[133548]: pgmap v556: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 275 KiB/s wr, 72 op/s 2023-10-07T00:19:47.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:46 smithi005 ceph-mon[129406]: pgmap v556: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 275 KiB/s wr, 72 op/s 2023-10-07T00:19:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:48 smithi088 ceph-mon[103111]: pgmap v557: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 149 KiB/s wr, 50 op/s 2023-10-07T00:19:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:48 smithi112 ceph-mon[133548]: pgmap v557: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 149 KiB/s wr, 50 op/s 2023-10-07T00:19:49.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:48 smithi005 ceph-mon[129406]: pgmap v557: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 149 KiB/s wr, 50 op/s 2023-10-07T00:19:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:50 smithi088 ceph-mon[103111]: pgmap v558: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 124 KiB/s wr, 46 op/s 2023-10-07T00:19:51.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:50 smithi112 ceph-mon[133548]: pgmap v558: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 124 KiB/s wr, 46 op/s 2023-10-07T00:19:51.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:50 smithi005 ceph-mon[129406]: pgmap v558: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 124 KiB/s wr, 46 op/s 2023-10-07T00:19:52.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:51 smithi112 ceph-mon[133548]: pgmap v559: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 82 KiB/s wr, 41 op/s 2023-10-07T00:19:52.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:51 smithi005 ceph-mon[129406]: pgmap v559: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 82 KiB/s wr, 41 op/s 2023-10-07T00:19:52.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:51 smithi088 ceph-mon[103111]: pgmap v559: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 82 KiB/s wr, 41 op/s 2023-10-07T00:19:55.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:54 smithi005 ceph-mon[129406]: pgmap v560: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 67 KiB/s wr, 37 op/s 2023-10-07T00:19:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:54 smithi088 ceph-mon[103111]: pgmap v560: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 67 KiB/s wr, 37 op/s 2023-10-07T00:19:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:54 smithi112 ceph-mon[133548]: pgmap v560: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 67 KiB/s wr, 37 op/s 2023-10-07T00:19:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2257150980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102060 msgr2=0x7f3cf81024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2257150980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102060 0x7f3cf81024e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009990 tx=0x7f3ce8009ca0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2257150980 shutdown_connections 2023-10-07T00:19:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2257150980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf8102a20 0x7f3cf8109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2257150980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cf8100f10 0x7f3cf8101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2257150980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102060 0x7f3cf81024e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2257150980 >> 172.21.15.5:0/2257150980 conn(0x7f3cf80fc480 msgr2=0x7f3cf80fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2257150980 shutdown_connections 2023-10-07T00:19:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.947+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2257150980 wait complete. 2023-10-07T00:19:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.948+0000 7f3cff3ff700 1 Processor -- start 2023-10-07T00:19:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.948+0000 7f3cff3ff700 1 -- start start 2023-10-07T00:19:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.948+0000 7f3cff3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf8100f10 0x7f3cf8198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cff3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cf8102060 0x7f3cf8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cff3ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102a20 0x7f3cf81a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cff3ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf81a08d0 con 0x7f3cf8102a20 2023-10-07T00:19:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cff3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf81a0a10 con 0x7f3cf8102060 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cff3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf81a0ba0 con 0x7f3cf8100f10 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfd99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102a20 0x7f3cf81a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfc99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cf8102060 0x7f3cf8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfd99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102a20 0x7f3cf81a0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59288/0 (socket says 172.21.15.5:59288) 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfc99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cf8102060 0x7f3cf8199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:34356/0 (socket says 172.21.15.5:34356) 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfd99c700 1 -- 172.21.15.5:0/2569459346 learned_addr learned my addr 172.21.15.5:0/2569459346 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf8100f10 0x7f3cf8198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfc99a700 1 -- 172.21.15.5:0/2569459346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf8100f10 msgr2=0x7f3cf8198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf8100f10 0x7f3cf8198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfc99a700 1 -- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102a20 msgr2=0x7f3cf81a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102a20 0x7f3cf81a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfc99a700 1 -- 172.21.15.5:0/2569459346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80095f0 con 0x7f3cf8102060 2023-10-07T00:19:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.949+0000 7f3cfd99c700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102a20 0x7f3cf81a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:19:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.950+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cf8102060 0x7f3cf8199290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80098e0 tx=0x7f3ce8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.950+0000 7f3cee7fc700 1 -- 172.21.15.5:0/2569459346 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce801d070 con 0x7f3cf8102060 2023-10-07T00:19:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.950+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2569459346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf81a0e20 con 0x7f3cf8102060 2023-10-07T00:19:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.950+0000 7f3cee7fc700 1 -- 172.21.15.5:0/2569459346 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ce800bdd0 con 0x7f3cf8102060 2023-10-07T00:19:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.950+0000 7f3cee7fc700 1 -- 172.21.15.5:0/2569459346 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8022da0 con 0x7f3cf8102060 2023-10-07T00:19:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.950+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2569459346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf81a1240 con 0x7f3cf8102060 2023-10-07T00:19:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.955+0000 7f3cee7fc700 1 -- 172.21.15.5:0/2569459346 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3ce8022570 con 0x7f3cf8102060 2023-10-07T00:19:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.956+0000 7f3d12e1fb80 1 Processor -- start 2023-10-07T00:19:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.956+0000 7f3d12e1fb80 1 -- start start 2023-10-07T00:19:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.956+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b56ec0 0x55e394b572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.956+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b57fd0 0x55e394b58450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.956+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b5f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.956+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394abf400 con 0x55e394b56ec0 2023-10-07T00:19:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.956+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394ab0bc0 con 0x55e394b58990 2023-10-07T00:19:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.956+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394aae4e0 con 0x55e394b57fd0 2023-10-07T00:19:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cee7fc700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3ce40a1500 0x7f3ce40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b56ec0 0x55e394b572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b56ec0 0x55e394b572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59294/0 (socket says 172.21.15.5:59294) 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd99c700 1 -- 172.21.15.5:0/1262836934 learned_addr learned my addr 172.21.15.5:0/1262836934 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cee7fc700 1 -- 172.21.15.5:0/2569459346 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3ce80cdfd0 con 0x7f3cf8102060 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b57fd0 0x55e394b58450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b5f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd99c700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3ce40a1500 0x7f3ce40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd19b700 1 -- 172.21.15.5:0/1262836934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 msgr2=0x55e394b5f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b5f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd19b700 1 -- 172.21.15.5:0/1262836934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b56ec0 msgr2=0x55e394b572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b56ec0 0x55e394b572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.957+0000 7f3cfd19b700 1 -- 172.21.15.5:0/1262836934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3948d4d80 con 0x55e394b57fd0 2023-10-07T00:19:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.958+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b57fd0 0x55e394b58450 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009cb0 tx=0x7f3cf4011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1c242a9aa6e328 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.958+0000 7f3cfd99c700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3ce40a1500 0x7f3ce40a39c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55e394b56c60 tx=0x7f3cf0004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.958+0000 7f3ce37fe700 1 -- 172.21.15.5:0/1262836934 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4011cc0 con 0x55e394b57fd0 2023-10-07T00:19:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.958+0000 7f3ce37fe700 1 -- 172.21.15.5:0/1262836934 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3cf4011e20 con 0x55e394b57fd0 2023-10-07T00:19:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.958+0000 7f3ce37fe700 1 -- 172.21.15.5:0/1262836934 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4005280 con 0x55e394b57fd0 2023-10-07T00:19:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1262836934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b57fd0 msgr2=0x55e394b58450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b57fd0 0x55e394b58450 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009cb0 tx=0x7f3cf4011440 comp rx=0 tx=0).stop 2023-10-07T00:19:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1262836934 shutdown_connections 2023-10-07T00:19:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b5f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b56ec0 0x55e394b572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1262836934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b57fd0 0x55e394b58450 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1262836934 >> 172.21.15.5:0/1262836934 conn(0x55e394acb200 msgr2=0x55e394b51bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1262836934 shutdown_connections 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1262836934 wait complete. 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 -- start start 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.959+0000 7f3d12e1fb80 1 Processor -- start 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b60b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394aa9dd0 con 0x55e394b57fd0 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394a466b0 con 0x55e394b58990 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394a46350 con 0x55e394b56ec0 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3d12e1fb80 10 client.0 _ll_register_callbacks cb 0x55e3948a37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3cfc99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3cfc99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59298/0 (socket says 172.21.15.5:59298) 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3cfc99a700 1 -- 172.21.15.5:0/1753170011 learned_addr learned my addr 172.21.15.5:0/1753170011 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3cfd99c700 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.960+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b60b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3cfc99a700 1 -- 172.21.15.5:0/1753170011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 msgr2=0x55e394b60b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b60b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3cfc99a700 1 -- 172.21.15.5:0/1753170011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 msgr2=0x55e394b680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3cfc99a700 1 -- 172.21.15.5:0/1753170011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf40098e0 con 0x55e394b57fd0 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b610b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80cba50 tx=0x7f3ce8005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134972b428ef651 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3ce0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/1753170011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce809ac60 con 0x55e394b57fd0 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1753170011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e394b49d50 con 0x55e394b57fd0 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/1753170011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3ce80a1040 con 0x55e394b57fd0 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/1753170011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce809ba00 con 0x55e394b57fd0 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3d12e1fb80 10 client.16611 fetch_fsmap learned FSMap version 41 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.961+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1753170011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55e3948bdc00 con 0x55e394b57fd0 2023-10-07T00:19:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/1753170011 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e394b49d50 con 0x55e394b57fd0 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/1753170011 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f3ce80a3290 con 0x55e394b57fd0 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3d12e1fb80 10 client.16611 fetch_fsmap finished waiting for FSMap version 41 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3d12e1fb80 10 client.16611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3d12e1fb80 20 client.16611 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e394b6c7f0 0x55e394b6ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3d12e1fb80 4 client.16611 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1753170011 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e394aa2db0 con 0x55e394b6c7f0 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.962+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e394b6c7f0 0x55e394b6ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.963+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e394b6c7f0 0x55e394b6ec10 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=451fdba1489a2d0a server_cookie=b3e26905db333371 in_seq=0 out_seq=0 2023-10-07T00:19:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.963+0000 7f3ce0ff9700 10 client.16611 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/1753170011 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e394aa2db0 con 0x55e394b6c7f0 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3ce0ff9700 10 client.16611 handle_command_reply: tid=0 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 client.16611 shutdown 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1753170011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 msgr2=0x55e394b610b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b610b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80cba50 tx=0x7f3ce8005910 comp rx=0 tx=0).stop 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1753170011 shutdown_connections 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e394b6c7f0 0x55e394b6ec10 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b60b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3ce0ff9700 0 client.16611 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1753170011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b610b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1753170011 >> 172.21.15.5:0/1753170011 conn(0x55e394acb200 msgr2=0x55e394b51250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1753170011 shutdown_connections 2023-10-07T00:19:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1753170011 wait complete. 2023-10-07T00:19:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.964+0000 7f3d12e1fb80 20 client.16611 trim_cache size 0 max 16384 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.980+0000 7f3d12e1fb80 1 Processor -- start 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.980+0000 7f3d12e1fb80 1 -- start start 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.980+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b51b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.980+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.980+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b5f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.980+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e39492a8c0 con 0x55e394b57fd0 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.980+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394b61d90 con 0x55e394b58990 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.980+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394b52f50 con 0x55e394b56ec0 2023-10-07T00:19:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b680b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59302/0 (socket says 172.21.15.5:59302) 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 -- 172.21.15.5:0/1005605873 learned_addr learned my addr 172.21.15.5:0/1005605873 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfd99c700 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b5f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 -- 172.21.15.5:0/1005605873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 msgr2=0x55e394b51b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b51b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 -- 172.21.15.5:0/1005605873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 msgr2=0x55e394b5f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b5f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 -- 172.21.15.5:0/1005605873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3948fb1f0 con 0x55e394b57fd0 2023-10-07T00:19:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b51b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:19:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.981+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b680b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8097800 tx=0x7f3ce809f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c719b68db5dc8a1e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3ce3fff700 1 -- 172.21.15.5:0/1005605873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce809b300 con 0x55e394b57fd0 2023-10-07T00:19:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3ce3fff700 1 -- 172.21.15.5:0/1005605873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ce809f450 con 0x55e394b57fd0 2023-10-07T00:19:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3ce3fff700 1 -- 172.21.15.5:0/1005605873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80a33d0 con 0x55e394b57fd0 2023-10-07T00:19:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1005605873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 msgr2=0x55e394b680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b680b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8097800 tx=0x7f3ce809f380 comp rx=0 tx=0).stop 2023-10-07T00:19:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1005605873 shutdown_connections 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b5f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b51b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/1005605873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b680b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1005605873 >> 172.21.15.5:0/1005605873 conn(0x55e394acb200 msgr2=0x55e394b51250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.982+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1005605873 shutdown_connections 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.983+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/1005605873 wait complete. 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.983+0000 7f3d12e1fb80 1 -- start start 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.983+0000 7f3d12e1fb80 1 Processor -- start 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b659a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b65ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3d12e1fb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b66ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394b673e0 con 0x55e394b57fd0 2023-10-07T00:19:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394b67550 con 0x55e394b58990 2023-10-07T00:19:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3d12e1fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e394b67710 con 0x55e394b56ec0 2023-10-07T00:19:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3d12e1fb80 10 client.0 _ll_register_callbacks cb 0x7f3ce809b170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:19:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3cfc99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b65ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3cfc99a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b65ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59308/0 (socket says 172.21.15.5:59308) 2023-10-07T00:19:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3cfc99a700 1 -- 172.21.15.5:0/668455104 learned_addr learned my addr 172.21.15.5:0/668455104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.984+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3cfd99c700 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b66ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3cfc99a700 1 -- 172.21.15.5:0/668455104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 msgr2=0x55e394b659a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b659a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3cfc99a700 1 -- 172.21.15.5:0/668455104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 msgr2=0x55e394b66ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b66ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3cfc99a700 1 -- 172.21.15.5:0/668455104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3948bdc00 con 0x55e394b57fd0 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b659a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3cfc99a700 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b65ee0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8006010 tx=0x7f3ce809af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a96ace66a089d1d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3ce0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/668455104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce809b300 con 0x55e394b57fd0 2023-10-07T00:19:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/668455104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3cf4011e20 con 0x55e394b57fd0 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.985+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/668455104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3ce80a1040 con 0x55e394b57fd0 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/668455104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce80a3600 con 0x55e394b57fd0 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3d12e1fb80 10 client.16617 fetch_fsmap learned FSMap version 41 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/668455104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55e3948d3250 con 0x55e394b57fd0 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/668455104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3cf4011e20 con 0x55e394b57fd0 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/668455104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f3ce809a380 con 0x55e394b57fd0 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3d12e1fb80 10 client.16617 fetch_fsmap finished waiting for FSMap version 41 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3d12e1fb80 10 client.16617 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3d12e1fb80 20 client.16617 populate_metadata read hostname 'smithi005' 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e394bc0b00 0x55e394bc2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:19:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3d12e1fb80 4 client.16617 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:19:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/668455104 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e394aa2ad0 con 0x55e394bc0b00 2023-10-07T00:19:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.986+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e394bc0b00 0x55e394bc2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:19:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.987+0000 7f3cfd19b700 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e394bc0b00 0x55e394bc2ef0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae1110310c63056 server_cookie=f78fb0d6970ab193 in_seq=0 out_seq=0 2023-10-07T00:19:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:55.987+0000 7f3ce0ff9700 10 client.16617 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3ce0ff9700 1 -- 172.21.15.5:0/668455104 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e394aa2ad0 con 0x55e394bc0b00 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3ce0ff9700 10 client.16617 handle_command_reply: tid=0 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 client.16617 shutdown 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/668455104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 msgr2=0x55e394b65ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b65ee0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8006010 tx=0x7f3ce809af70 comp rx=0 tx=0).stop 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/668455104 shutdown_connections 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e394bc0b00 0x55e394bc2ef0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e394b58990 0x55e394b66ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e394b56ec0 0x55e394b659a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3ce0ff9700 0 client.16617 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 --2- 172.21.15.5:0/668455104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e394b57fd0 0x55e394b65ee0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/668455104 >> 172.21.15.5:0/668455104 conn(0x55e394acb200 msgr2=0x55e394b5b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/668455104 shutdown_connections 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 1 -- 172.21.15.5:0/668455104 wait complete. 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.010+0000 7f3d12e1fb80 20 client.16617 trim_cache size 0 max 16384 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:19:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:19:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3ce40a1500 msgr2=0x7f3ce40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3ce40a1500 0x7f3ce40a39c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55e394b56c60 tx=0x7f3cf0004b40 comp rx=0 tx=0).stop 2023-10-07T00:19:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2569459346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cf8102060 msgr2=0x7f3cf8199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:19:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cf8102060 0x7f3cf8199290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80098e0 tx=0x7f3ce8005740 comp rx=0 tx=0).stop 2023-10-07T00:19:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2569459346 shutdown_connections 2023-10-07T00:19:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3ce40a1500 0x7f3ce40a39c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cf8102a20 0x7f3cf81a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf8100f10 0x7f3cf8198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 --2- 172.21.15.5:0/2569459346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cf8102060 0x7f3cf8199290 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:19:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.011+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2569459346 >> 172.21.15.5:0/2569459346 conn(0x7f3cf80fc480 msgr2=0x7f3cf80fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:19:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.012+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2569459346 shutdown_connections 2023-10-07T00:19:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:19:56.012+0000 7f3cff3ff700 1 -- 172.21.15.5:0/2569459346 wait complete. 2023-10-07T00:19:57.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:56 smithi005 ceph-mon[129406]: pgmap v561: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 36 op/s 2023-10-07T00:19:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:56 smithi088 ceph-mon[103111]: pgmap v561: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 36 op/s 2023-10-07T00:19:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:56 smithi112 ceph-mon[133548]: pgmap v561: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 36 op/s 2023-10-07T00:19:59.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:19:58 smithi005 ceph-mon[129406]: pgmap v562: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 58 KiB/s wr, 26 op/s 2023-10-07T00:19:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:19:58 smithi088 ceph-mon[103111]: pgmap v562: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 58 KiB/s wr, 26 op/s 2023-10-07T00:19:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:19:58 smithi112 ceph-mon[133548]: pgmap v562: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 58 KiB/s wr, 26 op/s 2023-10-07T00:20:00.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a[129381]: 2023-10-07T00:19:59.999+0000 7f38e549e700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-07T00:20:00.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a[129381]: 2023-10-07T00:19:59.999+0000 7f38e549e700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-07T00:20:00.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a[129381]: 2023-10-07T00:19:59.999+0000 7f38e549e700 -1 log_channel(cluster) log [ERR] : mds.a(mds.1): Metadata damage detected 2023-10-07T00:20:01.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:00 smithi005 ceph-mon[129406]: pgmap v563: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 48 KiB/s wr, 23 op/s 2023-10-07T00:20:01.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:00 smithi005 ceph-mon[129406]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-07T00:20:01.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:00 smithi005 ceph-mon[129406]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-07T00:20:01.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:00 smithi005 ceph-mon[129406]: mds.a(mds.1): Metadata damage detected 2023-10-07T00:20:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:00 smithi088 ceph-mon[103111]: pgmap v563: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 48 KiB/s wr, 23 op/s 2023-10-07T00:20:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:00 smithi088 ceph-mon[103111]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-07T00:20:01.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:00 smithi088 ceph-mon[103111]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-07T00:20:01.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:00 smithi088 ceph-mon[103111]: mds.a(mds.1): Metadata damage detected 2023-10-07T00:20:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:00 smithi112 ceph-mon[133548]: pgmap v563: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 48 KiB/s wr, 23 op/s 2023-10-07T00:20:01.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:00 smithi112 ceph-mon[133548]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-07T00:20:01.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:00 smithi112 ceph-mon[133548]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-07T00:20:01.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:00 smithi112 ceph-mon[133548]: mds.a(mds.1): Metadata damage detected 2023-10-07T00:20:02.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:01 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:02.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:01 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:02.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:01 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:02 smithi088 ceph-mon[103111]: pgmap v564: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 25 op/s 2023-10-07T00:20:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:02 smithi112 ceph-mon[133548]: pgmap v564: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 25 op/s 2023-10-07T00:20:03.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:02 smithi005 ceph-mon[129406]: pgmap v564: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 25 op/s 2023-10-07T00:20:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:04 smithi088 ceph-mon[103111]: pgmap v565: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 22 op/s 2023-10-07T00:20:05.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:04 smithi112 ceph-mon[133548]: pgmap v565: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 22 op/s 2023-10-07T00:20:05.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:04 smithi005 ceph-mon[129406]: pgmap v565: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 22 op/s 2023-10-07T00:20:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:06 smithi088 ceph-mon[103111]: pgmap v566: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 23 op/s 2023-10-07T00:20:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:06 smithi112 ceph-mon[133548]: pgmap v566: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 23 op/s 2023-10-07T00:20:07.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:06 smithi005 ceph-mon[129406]: pgmap v566: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 23 op/s 2023-10-07T00:20:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 -- 172.21.15.5:0/1639018368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 msgr2=0x7f4ab80732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/1639018368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 0x7f4ab80732e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009990 tx=0x7f4ab4009ca0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 -- 172.21.15.5:0/1639018368 shutdown_connections 2023-10-07T00:20:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/1639018368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab8108de0 0x7f4ab810b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/1639018368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 0x7f4ab80732e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/1639018368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ab80738b0 0x7f4ab8073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 -- 172.21.15.5:0/1639018368 >> 172.21.15.5:0/1639018368 conn(0x7f4ab80fc480 msgr2=0x7f4ab80fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 -- 172.21.15.5:0/1639018368 shutdown_connections 2023-10-07T00:20:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.177+0000 7f4ac01ff700 1 -- 172.21.15.5:0/1639018368 wait complete. 2023-10-07T00:20:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.178+0000 7f4ac01ff700 1 Processor -- start 2023-10-07T00:20:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.178+0000 7f4ac01ff700 1 -- start start 2023-10-07T00:20:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.178+0000 7f4ac01ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80738b0 0x7f4ab8198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.178+0000 7f4ac01ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 0x7f4ab8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4ac01ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ab8108de0 0x7f4ab81a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4ac01ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab81a0870 con 0x7f4ab8074e90 2023-10-07T00:20:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4ac01ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab81a09e0 con 0x7f4ab80738b0 2023-10-07T00:20:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4ac01ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab81a0ba0 con 0x7f4ab8108de0 2023-10-07T00:20:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abd79a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 0x7f4ab8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abd79a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 0x7f4ab8199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48948/0 (socket says 172.21.15.5:48948) 2023-10-07T00:20:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abd79a700 1 -- 172.21.15.5:0/3845195571 learned_addr learned my addr 172.21.15.5:0/3845195571 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80738b0 0x7f4ab8198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abe79c700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ab8108de0 0x7f4ab81a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abd79a700 1 -- 172.21.15.5:0/3845195571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ab8108de0 msgr2=0x7f4ab81a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abd79a700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ab8108de0 0x7f4ab81a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abd79a700 1 -- 172.21.15.5:0/3845195571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80738b0 msgr2=0x7f4ab8198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abd79a700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80738b0 0x7f4ab8198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abd79a700 1 -- 172.21.15.5:0/3845195571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40095f0 con 0x7f4ab8074e90 2023-10-07T00:20:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.179+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80738b0 0x7f4ab8198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:20:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.180+0000 7f4abd79a700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 0x7f4ab8199270 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800e9a0 tx=0x7f4aa800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.180+0000 7f4aaeffd700 1 -- 172.21.15.5:0/3845195571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8009790 con 0x7f4ab8074e90 2023-10-07T00:20:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.180+0000 7f4aaeffd700 1 -- 172.21.15.5:0/3845195571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4aa800cbd0 con 0x7f4ab8074e90 2023-10-07T00:20:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.180+0000 7f4ac01ff700 1 -- 172.21.15.5:0/3845195571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab81a0e80 con 0x7f4ab8074e90 2023-10-07T00:20:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.180+0000 7f4aaeffd700 1 -- 172.21.15.5:0/3845195571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8018680 con 0x7f4ab8074e90 2023-10-07T00:20:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.180+0000 7f4ac01ff700 1 -- 172.21.15.5:0/3845195571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab81a12a0 con 0x7f4ab8074e90 2023-10-07T00:20:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.183+0000 7f4aaeffd700 1 -- 172.21.15.5:0/3845195571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4aa800cd40 con 0x7f4ab8074e90 2023-10-07T00:20:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.185+0000 7f4ad3ab5b80 1 Processor -- start 2023-10-07T00:20:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4ad3ab5b80 1 -- start start 2023-10-07T00:20:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4aaeffd700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4aa40a1480 0x7f4aa40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.188 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:08 smithi005 ceph-mon[129406]: pgmap v567: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 20 op/s 2023-10-07T00:20:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4aaeffd700 1 -- 172.21.15.5:0/3845195571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4aa8014070 con 0x7f4ab8074e90 2023-10-07T00:20:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc5ec0 0x5611c9dc62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dc7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc7990 0x5611c9dce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9d2e400 con 0x5611c9dc7990 2023-10-07T00:20:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9d1fbc0 con 0x5611c9dc6fd0 2023-10-07T00:20:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9d1d4e0 con 0x5611c9dc5ec0 2023-10-07T00:20:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.186+0000 7f4abe79c700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4aa40a1480 0x7f4aa40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc7990 0x5611c9dce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc7990 0x5611c9dce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48952/0 (socket says 172.21.15.5:48952) 2023-10-07T00:20:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 -- 172.21.15.5:0/3608622076 learned_addr learned my addr 172.21.15.5:0/3608622076 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abd79a700 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dc7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc5ec0 0x5611c9dc62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 -- 172.21.15.5:0/3608622076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc5ec0 msgr2=0x5611c9dc62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc5ec0 0x5611c9dc62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 -- 172.21.15.5:0/3608622076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 msgr2=0x5611c9dc7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dc7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 -- 172.21.15.5:0/3608622076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c9b43d80 con 0x5611c9dc7990 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abd79a700 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dc7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4aa40a1480 0x7f4aa40a3940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009550 tx=0x7f4ab0009d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.187+0000 7f4abe79c700 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc7990 0x5611c9dce220 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009790 tx=0x7f4ab001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4437bfc7bf41d2bd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.188+0000 7f4aa3fff700 1 -- 172.21.15.5:0/3608622076 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0026070 con 0x5611c9dc7990 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.188+0000 7f4aa3fff700 1 -- 172.21.15.5:0/3608622076 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ab000f050 con 0x5611c9dc7990 2023-10-07T00:20:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.188+0000 7f4aa3fff700 1 -- 172.21.15.5:0/3608622076 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab001aab0 con 0x5611c9dc7990 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.188+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/3608622076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc7990 msgr2=0x5611c9dce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.188+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc7990 0x5611c9dce220 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009790 tx=0x7f4ab001b000 comp rx=0 tx=0).stop 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/3608622076 shutdown_connections 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc7990 0x5611c9dce220 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc5ec0 0x5611c9dc62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/3608622076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dc7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/3608622076 >> 172.21.15.5:0/3608622076 conn(0x5611c9d3a200 msgr2=0x5611c9dc0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/3608622076 shutdown_connections 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/3608622076 wait complete. 2023-10-07T00:20:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 -- start start 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.189+0000 7f4ad3ab5b80 1 Processor -- start 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc5ec0 0x5611c9dcfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 0x5611c9dd70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9d18dd0 con 0x5611c9dc5ec0 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9cb56b0 con 0x5611c9dc6fd0 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9cb5350 con 0x5611c9dc7990 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4ad3ab5b80 10 client.0 _ll_register_callbacks cb 0x5611c9b127a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4abdf9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc5ec0 0x5611c9dcfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4abdf9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc5ec0 0x5611c9dcfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48960/0 (socket says 172.21.15.5:48960) 2023-10-07T00:20:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4abdf9b700 1 -- 172.21.15.5:0/700948395 learned_addr learned my addr 172.21.15.5:0/700948395 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.190+0000 7f4abd79a700 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4abdf9b700 1 -- 172.21.15.5:0/700948395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 msgr2=0x5611c9dd70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 0x5611c9dd70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4abdf9b700 1 -- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 msgr2=0x5611c9dd0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4abdf9b700 1 -- 172.21.15.5:0/700948395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab81a12a0 con 0x5611c9dc5ec0 2023-10-07T00:20:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4abd79a700 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:20:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc5ec0 0x5611c9dcfb20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000c00 tx=0x7f4ab4003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ac49614f5ad1f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4aa17fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4aa17fa700 1 -- 172.21.15.5:0/700948395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400b9b0 con 0x5611c9dc5ec0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/700948395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611c9db8d50 con 0x5611c9dc5ec0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.191+0000 7f4aa17fa700 1 -- 172.21.15.5:0/700948395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4ab400bb10 con 0x5611c9dc5ec0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4aa17fa700 1 -- 172.21.15.5:0/700948395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ab400bcd0 con 0x5611c9dc5ec0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4ad3ab5b80 10 client.16629 fetch_fsmap learned FSMap version 42 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/700948395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x7f4ab00188e0 con 0x5611c9dc5ec0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4aa17fa700 1 -- 172.21.15.5:0/700948395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ab4033020 con 0x5611c9dc5ec0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4aa17fa700 1 -- 172.21.15.5:0/700948395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 42) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f4ab400f460 con 0x5611c9dc5ec0 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4ad3ab5b80 10 client.16629 fetch_fsmap finished waiting for FSMap version 42 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4ad3ab5b80 10 client.16629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:20:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4ad3ab5b80 20 client.16629 populate_metadata read hostname 'smithi005' 2023-10-07T00:20:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9ddba70 0x5611c9ddde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4ad3ab5b80 4 client.16629 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:20:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.192+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/700948395 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611c9d11db0 con 0x5611c9ddba70 2023-10-07T00:20:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.193+0000 7f4abd79a700 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9ddba70 0x5611c9ddde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.193+0000 7f4abd79a700 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9ddba70 0x5611c9ddde90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e91a63cbe2b5395 server_cookie=4bf3bcdbae1a3e74 in_seq=0 out_seq=0 2023-10-07T00:20:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.193+0000 7f4aa17fa700 10 client.16629 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.194+0000 7f4aa17fa700 1 -- 172.21.15.5:0/700948395 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5611c9d11db0 con 0x5611c9ddba70 2023-10-07T00:20:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.194+0000 7f4aa17fa700 10 client.16629 handle_command_reply: tid=0 2023-10-07T00:20:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.194+0000 7f4ad3ab5b80 1 client.16629 shutdown 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.194+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/700948395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc5ec0 msgr2=0x5611c9dcfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.194+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc5ec0 0x5611c9dcfb20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000c00 tx=0x7f4ab4003730 comp rx=0 tx=0).stop 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/700948395 shutdown_connections 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9ddba70 0x5611c9ddde90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 0x5611c9dd70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc5ec0 0x5611c9dcfb20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4aa17fa700 0 client.16629 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/700948395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/700948395 >> 172.21.15.5:0/700948395 conn(0x5611c9d3a200 msgr2=0x5611c9dc0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/700948395 shutdown_connections 2023-10-07T00:20:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/700948395 wait complete. 2023-10-07T00:20:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.195+0000 7f4ad3ab5b80 20 client.16629 trim_cache size 0 max 16384 2023-10-07T00:20:09.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:08 smithi088 ceph-mon[103111]: pgmap v567: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 20 op/s 2023-10-07T00:20:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.212+0000 7f4ad3ab5b80 1 Processor -- start 2023-10-07T00:20:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.212+0000 7f4ad3ab5b80 1 -- start start 2023-10-07T00:20:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.212+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dcf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.212+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 0x5611c9dd7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.212+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc0250 0x5611c9dce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.212+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9b998c0 con 0x5611c9dc0250 2023-10-07T00:20:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.212+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9dcb4c0 con 0x5611c9dc6fd0 2023-10-07T00:20:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.212+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9dd07a0 con 0x5611c9dc7990 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc0250 0x5611c9dce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc0250 0x5611c9dce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48964/0 (socket says 172.21.15.5:48964) 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 -- 172.21.15.5:0/1325759809 learned_addr learned my addr 172.21.15.5:0/1325759809 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dcf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abd79a700 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 0x5611c9dd7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 -- 172.21.15.5:0/1325759809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 msgr2=0x5611c9dd7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 0x5611c9dd7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 -- 172.21.15.5:0/1325759809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 msgr2=0x5611c9dcf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dcf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 -- 172.21.15.5:0/1325759809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c9b2cc00 con 0x5611c9dc0250 2023-10-07T00:20:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abd79a700 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 0x5611c9dd7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:20:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.213+0000 7f4abe79c700 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc0250 0x5611c9dce840 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00187a0 tx=0x7f4ab00075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c884591fb003e4f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.214+0000 7f4aacff9700 1 -- 172.21.15.5:0/1325759809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0026040 con 0x5611c9dc0250 2023-10-07T00:20:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.214+0000 7f4aacff9700 1 -- 172.21.15.5:0/1325759809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ab0009380 con 0x5611c9dc0250 2023-10-07T00:20:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.214+0000 7f4aacff9700 1 -- 172.21.15.5:0/1325759809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab00052a0 con 0x5611c9dc0250 2023-10-07T00:20:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.214+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/1325759809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc0250 msgr2=0x5611c9dce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.214+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc0250 0x5611c9dce840 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00187a0 tx=0x7f4ab00075c0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/1325759809 shutdown_connections 2023-10-07T00:20:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc0250 0x5611c9dce840 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc6fd0 0x5611c9dcf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/1325759809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc7990 0x5611c9dd7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/1325759809 >> 172.21.15.5:0/1325759809 conn(0x5611c9d3a200 msgr2=0x5611c9de2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/1325759809 shutdown_connections 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/1325759809 wait complete. 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 -- start start 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.215+0000 7f4ad3ab5b80 1 Processor -- start 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc0250 0x5611c9dd5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4ad3ab5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc7990 0x5611c9dd6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9dd6ad0 con 0x5611c9dc6fd0 2023-10-07T00:20:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9dd6c40 con 0x5611c9dc7990 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4ad3ab5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c9dd6e00 con 0x5611c9dc0250 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4ad3ab5b80 10 client.0 _ll_register_callbacks cb 0x7f4ab40058e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abd79a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abd79a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48966/0 (socket says 172.21.15.5:48966) 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abd79a700 1 -- 172.21.15.5:0/164534812 learned_addr learned my addr 172.21.15.5:0/164534812 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc0250 0x5611c9dd5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abe79c700 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc7990 0x5611c9dd6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abd79a700 1 -- 172.21.15.5:0/164534812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc0250 msgr2=0x5611c9dd5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abd79a700 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc0250 0x5611c9dd5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abd79a700 1 -- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc7990 msgr2=0x5611c9dd6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abd79a700 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc7990 0x5611c9dd6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abd79a700 1 -- 172.21.15.5:0/164534812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611c9b43d80 con 0x5611c9dc6fd0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.216+0000 7f4abe79c700 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc7990 0x5611c9dd6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4abd79a700 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd5580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8096d90 tx=0x7f4aa8096710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd002ed03a07161 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4aa17fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4aa17fa700 1 -- 172.21.15.5:0/164534812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa809e170 con 0x5611c9dc6fd0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4aa17fa700 1 -- 172.21.15.5:0/164534812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4aa8099810 con 0x5611c9dc6fd0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/164534812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ab000f050 con 0x5611c9dc6fd0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4aa17fa700 1 -- 172.21.15.5:0/164534812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4aa80999d0 con 0x5611c9dc6fd0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4ad3ab5b80 10 client.16635 fetch_fsmap learned FSMap version 42 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/164534812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5611c9b6a1f0 con 0x5611c9dc6fd0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.217+0000 7f4aa17fa700 1 -- 172.21.15.5:0/164534812 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ab000f050 con 0x5611c9dc6fd0 2023-10-07T00:20:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.218+0000 7f4aa17fa700 1 -- 172.21.15.5:0/164534812 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 42) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f4aa8099280 con 0x5611c9dc6fd0 2023-10-07T00:20:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.218+0000 7f4ad3ab5b80 10 client.16635 fetch_fsmap finished waiting for FSMap version 42 2023-10-07T00:20:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.218+0000 7f4ad3ab5b80 10 client.16635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:20:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.218+0000 7f4ad3ab5b80 20 client.16635 populate_metadata read hostname 'smithi005' 2023-10-07T00:20:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.218+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9e30b10 0x5611c9e32f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.218+0000 7f4ad3ab5b80 4 client.16635 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:20:09.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.218+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/164534812 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5611c9d11ad0 con 0x5611c9e30b10 2023-10-07T00:20:09.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.218+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9e30b10 0x5611c9e32f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:09.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.219+0000 7f4abdf9b700 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9e30b10 0x5611c9e32f30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de43f49285cf1e53 server_cookie=ad5071014316ec41 in_seq=0 out_seq=0 2023-10-07T00:20:09.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.219+0000 7f4aa17fa700 10 client.16635 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:09.264 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:08 smithi112 ceph-mon[133548]: pgmap v567: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 20 op/s 2023-10-07T00:20:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.231+0000 7f4aa17fa700 1 -- 172.21.15.5:0/164534812 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5611c9d11ad0 con 0x5611c9e30b10 2023-10-07T00:20:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.231+0000 7f4aa17fa700 10 client.16635 handle_command_reply: tid=0 2023-10-07T00:20:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 client.16635 shutdown 2023-10-07T00:20:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/164534812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc6fd0 msgr2=0x5611c9dd5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd5580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8096d90 tx=0x7f4aa8096710 comp rx=0 tx=0).stop 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/164534812 shutdown_connections 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5611c9e30b10 0x5611c9e32f30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611c9dc7990 0x5611c9dd6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4aa17fa700 0 client.16635 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5611c9dc0250 0x5611c9dd5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 --2- 172.21.15.5:0/164534812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611c9dc6fd0 0x5611c9dd5580 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/164534812 >> 172.21.15.5:0/164534812 conn(0x5611c9d3a200 msgr2=0x5611c9dce840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/164534812 shutdown_connections 2023-10-07T00:20:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 1 -- 172.21.15.5:0/164534812 wait complete. 2023-10-07T00:20:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.232+0000 7f4ad3ab5b80 20 client.16635 trim_cache size 0 max 16384 2023-10-07T00:20:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:20:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:20:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:20:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:20:09.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 -- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4aa40a1480 msgr2=0x7f4aa40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4aa40a1480 0x7f4aa40a3940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009550 tx=0x7f4ab0009d10 comp rx=0 tx=0).stop 2023-10-07T00:20:09.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 -- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 msgr2=0x7f4ab8199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:09.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 0x7f4ab8199270 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800e9a0 tx=0x7f4aa800ed60 comp rx=0 tx=0).stop 2023-10-07T00:20:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 -- 172.21.15.5:0/3845195571 shutdown_connections 2023-10-07T00:20:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4aa40a1480 0x7f4aa40a3940 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ab8108de0 0x7f4ab81a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80738b0 0x7f4ab8198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 --2- 172.21.15.5:0/3845195571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ab8074e90 0x7f4ab8199270 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 -- 172.21.15.5:0/3845195571 >> 172.21.15.5:0/3845195571 conn(0x7f4ab80fc480 msgr2=0x7f4ab80fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 -- 172.21.15.5:0/3845195571 shutdown_connections 2023-10-07T00:20:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:09.233+0000 7f4ac01ff700 1 -- 172.21.15.5:0/3845195571 wait complete. 2023-10-07T00:20:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:10 smithi088 ceph-mon[103111]: pgmap v568: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 20 op/s 2023-10-07T00:20:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:10 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:10 smithi112 ceph-mon[133548]: pgmap v568: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 20 op/s 2023-10-07T00:20:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:10 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:11.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:10 smithi005 ceph-mon[129406]: pgmap v568: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 20 op/s 2023-10-07T00:20:11.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:10 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:12 smithi088 ceph-mon[103111]: pgmap v569: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 20 op/s 2023-10-07T00:20:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:12 smithi112 ceph-mon[133548]: pgmap v569: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 20 op/s 2023-10-07T00:20:13.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:12 smithi005 ceph-mon[129406]: pgmap v569: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 20 op/s 2023-10-07T00:20:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:14 smithi088 ceph-mon[103111]: pgmap v570: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 18 op/s 2023-10-07T00:20:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:14 smithi112 ceph-mon[133548]: pgmap v570: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 18 op/s 2023-10-07T00:20:15.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:14 smithi005 ceph-mon[129406]: pgmap v570: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 18 op/s 2023-10-07T00:20:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:16 smithi088 ceph-mon[103111]: pgmap v571: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-07T00:20:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:16 smithi112 ceph-mon[133548]: pgmap v571: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-07T00:20:17.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:16 smithi005 ceph-mon[129406]: pgmap v571: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-07T00:20:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:18 smithi088 ceph-mon[103111]: pgmap v572: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:20:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:18 smithi112 ceph-mon[133548]: pgmap v572: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:20:19.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:18 smithi005 ceph-mon[129406]: pgmap v572: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:20:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:20 smithi088 ceph-mon[103111]: pgmap v573: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:20:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:20 smithi112 ceph-mon[133548]: pgmap v573: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:20:21.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:20 smithi005 ceph-mon[129406]: pgmap v573: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:20:22.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:21 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:22.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:21 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:22.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:21 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:20:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 -- 172.21.15.5:0/2883145024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b841042c0 msgr2=0x7f3b841066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 --2- 172.21.15.5:0/2883145024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b841042c0 0x7f3b841066b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009990 tx=0x7f3b78009ca0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 -- 172.21.15.5:0/2883145024 shutdown_connections 2023-10-07T00:20:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 --2- 172.21.15.5:0/2883145024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b84106bf0 0x7f3b84109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 --2- 172.21.15.5:0/2883145024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b84101990 0x7f3b84103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 --2- 172.21.15.5:0/2883145024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b841042c0 0x7f3b841066b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 -- 172.21.15.5:0/2883145024 >> 172.21.15.5:0/2883145024 conn(0x7f3b840fb380 msgr2=0x7f3b840fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 -- 172.21.15.5:0/2883145024 shutdown_connections 2023-10-07T00:20:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.395+0000 7f3b89fff700 1 -- 172.21.15.5:0/2883145024 wait complete. 2023-10-07T00:20:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.396+0000 7f3b89fff700 1 Processor -- start 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b89fff700 1 -- start start 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b89fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b84101990 0x7f3b84198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b89fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b841042c0 0x7f3b84199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b89fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b84106bf0 0x7f3b841a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b89fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841a0830 con 0x7f3b84106bf0 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b89fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841a09a0 con 0x7f3b841042c0 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b89fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841a0b60 con 0x7f3b84101990 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b837fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b84101990 0x7f3b84198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b837fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b84101990 0x7f3b84198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:33996/0 (socket says 172.21.15.5:33996) 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b837fe700 1 -- 172.21.15.5:0/1513635930 learned_addr learned my addr 172.21.15.5:0/1513635930 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b83fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b84106bf0 0x7f3b841a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.397+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b841042c0 0x7f3b84199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b837fe700 1 -- 172.21.15.5:0/1513635930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b841042c0 msgr2=0x7f3b84199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b837fe700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b841042c0 0x7f3b84199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b837fe700 1 -- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b84106bf0 msgr2=0x7f3b841a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b837fe700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b84106bf0 0x7f3b841a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b837fe700 1 -- 172.21.15.5:0/1513635930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780095f0 con 0x7f3b84101990 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b841042c0 0x7f3b84199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b83fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b84106bf0 0x7f3b841a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:20:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b837fe700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b84101990 0x7f3b84198cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400d950 tx=0x7f3b7400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b80ff9700 1 -- 172.21.15.5:0/1513635930 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400f890 con 0x7f3b84101990 2023-10-07T00:20:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b89fff700 1 -- 172.21.15.5:0/1513635930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b841a0e40 con 0x7f3b84101990 2023-10-07T00:20:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b80ff9700 1 -- 172.21.15.5:0/1513635930 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b7400fe80 con 0x7f3b84101990 2023-10-07T00:20:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.398+0000 7f3b80ff9700 1 -- 172.21.15.5:0/1513635930 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400e3b0 con 0x7f3b84101990 2023-10-07T00:20:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.399+0000 7f3b89fff700 1 -- 172.21.15.5:0/1513635930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b841a1270 con 0x7f3b84101990 2023-10-07T00:20:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.402+0000 7f3b80ff9700 1 -- 172.21.15.5:0/1513635930 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3b74010460 con 0x7f3b84101990 2023-10-07T00:20:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.403+0000 7f3b9d9d1b80 1 Processor -- start 2023-10-07T00:20:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.403+0000 7f3b9d9d1b80 1 -- start start 2023-10-07T00:20:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.403+0000 7f3b80ff9700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b6c0a1480 0x7f3b6c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b80ff9700 1 -- 172.21.15.5:0/1513635930 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3b740ccb10 con 0x7f3b84101990 2023-10-07T00:20:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b83fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b6c0a1480 0x7f3b6c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 0x5563d60782e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6079450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 0x5563d6080220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d5fe0400 con 0x5563d6078fd0 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d5fd1bc0 con 0x5563d6077ec0 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d5fcf4e0 con 0x5563d6079990 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b82ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6079450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b82ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6079450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51802/0 (socket says 172.21.15.5:51802) 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b82ffd700 1 -- 172.21.15.5:0/2370870620 learned_addr learned my addr 172.21.15.5:0/2370870620 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b83fff700 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 0x5563d6080220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.404+0000 7f3b837fe700 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 0x5563d60782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b82ffd700 1 -- 172.21.15.5:0/2370870620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 msgr2=0x5563d6080220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 0x5563d6080220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b83fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b6c0a1480 0x7f3b6c0a3940 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c003e40 tx=0x7f3b7c009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b82ffd700 1 -- 172.21.15.5:0/2370870620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 msgr2=0x5563d60782e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 0x5563d60782e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b82ffd700 1 -- 172.21.15.5:0/2370870620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563d5df5d80 con 0x5563d6078fd0 2023-10-07T00:20:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6079450 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3b78000c00 tx=0x7f3b78004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3fdb822bcc0b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b69ffb700 1 -- 172.21.15.5:0/2370870620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7801d070 con 0x5563d6078fd0 2023-10-07T00:20:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b69ffb700 1 -- 172.21.15.5:0/2370870620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b7801e040 con 0x5563d6078fd0 2023-10-07T00:20:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.405+0000 7f3b69ffb700 1 -- 172.21.15.5:0/2370870620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800bb70 con 0x5563d6078fd0 2023-10-07T00:20:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2370870620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 msgr2=0x5563d6079450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6079450 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3b78000c00 tx=0x7f3b78004000 comp rx=0 tx=0).stop 2023-10-07T00:20:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2370870620 shutdown_connections 2023-10-07T00:20:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 0x5563d6080220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 0x5563d60782e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2370870620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6079450 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2370870620 >> 172.21.15.5:0/2370870620 conn(0x5563d5fec200 msgr2=0x5563d6072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2370870620 shutdown_connections 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.406+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2370870620 wait complete. 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 1 -- start start 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 1 Processor -- start 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6077ec0 0x5563d6081b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6078fd0 0x5563d6082070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6079990 0x5563d60890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d5fcadd0 con 0x5563d6079990 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d5f676b0 con 0x5563d6078fd0 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d5f67350 con 0x5563d6077ec0 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.407+0000 7f3b9d9d1b80 10 client.0 _ll_register_callbacks cb 0x5563d5dc47a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b837fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6077ec0 0x5563d6081b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b837fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6077ec0 0x5563d6081b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:34008/0 (socket says 172.21.15.5:34008) 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b837fe700 1 -- 172.21.15.5:0/2521588746 learned_addr learned my addr 172.21.15.5:0/2521588746 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b83fff700 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6079990 0x5563d60890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6078fd0 0x5563d6082070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b837fe700 1 -- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6078fd0 msgr2=0x5563d6082070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b837fe700 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6078fd0 0x5563d6082070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b837fe700 1 -- 172.21.15.5:0/2521588746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6079990 msgr2=0x5563d60890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b837fe700 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6079990 0x5563d60890b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b837fe700 1 -- 172.21.15.5:0/2521588746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b84109c50 con 0x5563d6077ec0 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.408+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6078fd0 0x5563d6082070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b837fe700 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6077ec0 0x5563d6081b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b740ca590 tx=0x7f3b74099a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3b1fc0c8595faa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b62ffd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b62ffd700 1 -- 172.21.15.5:0/2521588746 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7409a210 con 0x5563d6077ec0 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b62ffd700 1 -- 172.21.15.5:0/2521588746 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3b740a2140 con 0x5563d6077ec0 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2521588746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563d606ad50 con 0x5563d6077ec0 2023-10-07T00:20:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b62ffd700 1 -- 172.21.15.5:0/2521588746 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b740992a0 con 0x5563d6077ec0 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b9d9d1b80 10 client.26470 fetch_fsmap learned FSMap version 44 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2521588746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x5563d5ddec00 con 0x5563d6077ec0 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b62ffd700 1 -- 172.21.15.5:0/2521588746 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b74063080 con 0x5563d6077ec0 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.409+0000 7f3b62ffd700 1 -- 172.21.15.5:0/2521588746 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f3b740adb90 con 0x5563d6077ec0 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.410+0000 7f3b9d9d1b80 10 client.26470 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.410+0000 7f3b9d9d1b80 10 client.26470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.410+0000 7f3b9d9d1b80 20 client.26470 populate_metadata read hostname 'smithi005' 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.410+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5563d608daa0 0x5563d608fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.410+0000 7f3b9d9d1b80 4 client.26470 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:20:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.410+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2521588746 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563d5fc3db0 con 0x5563d608daa0 2023-10-07T00:20:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.410+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5563d608daa0 0x5563d608fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.411+0000 7f3b62ffd700 10 client.26470 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.411+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5563d608daa0 0x5563d608fec0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5885d7da1426546a server_cookie=22a7310c126df850 in_seq=0 out_seq=0 2023-10-07T00:20:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b62ffd700 1 -- 172.21.15.5:0/2521588746 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5563d5fc3db0 con 0x5563d608daa0 2023-10-07T00:20:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b62ffd700 10 client.26470 handle_command_reply: tid=0 2023-10-07T00:20:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 client.26470 shutdown 2023-10-07T00:20:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2521588746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6077ec0 msgr2=0x5563d6081b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6077ec0 0x5563d6081b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b740ca590 tx=0x7f3b74099a00 comp rx=0 tx=0).stop 2023-10-07T00:20:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2521588746 shutdown_connections 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5563d608daa0 0x5563d608fec0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6079990 0x5563d60890b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b62ffd700 0 client.26470 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6077ec0 0x5563d6081b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/2521588746 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6078fd0 0x5563d6082070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2521588746 >> 172.21.15.5:0/2521588746 conn(0x5563d5fec200 msgr2=0x5563d6072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2521588746 shutdown_connections 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/2521588746 wait complete. 2023-10-07T00:20:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.412+0000 7f3b9d9d1b80 20 client.26470 trim_cache size 0 max 16384 2023-10-07T00:20:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.428+0000 7f3b9d9d1b80 1 Processor -- start 2023-10-07T00:20:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.428+0000 7f3b9d9d1b80 1 -- start start 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.428+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 0x5563d60811e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.428+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6089070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.428+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 0x5563d607c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.428+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d5e4b8c0 con 0x5563d6078fd0 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.428+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d6073980 con 0x5563d6077ec0 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.428+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d607fab0 con 0x5563d6079990 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6089070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6089070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51822/0 (socket says 172.21.15.5:51822) 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 -- 172.21.15.5:0/224471122 learned_addr learned my addr 172.21.15.5:0/224471122 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b837fe700 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 0x5563d60811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b83fff700 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 0x5563d607c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 -- 172.21.15.5:0/224471122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 msgr2=0x5563d607c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 0x5563d607c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 -- 172.21.15.5:0/224471122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 msgr2=0x5563d60811e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 0x5563d60811e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 -- 172.21.15.5:0/224471122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563d5e1c1f0 con 0x5563d6078fd0 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6089070 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009990 tx=0x7f3b78004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ec00a9d0908cd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.429+0000 7f3b6a7fc700 1 -- 172.21.15.5:0/224471122 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7801d040 con 0x5563d6078fd0 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b6a7fc700 1 -- 172.21.15.5:0/224471122 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b7800bab0 con 0x5563d6078fd0 2023-10-07T00:20:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b6a7fc700 1 -- 172.21.15.5:0/224471122 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78005430 con 0x5563d6078fd0 2023-10-07T00:20:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/224471122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 msgr2=0x5563d6089070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6089070 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009990 tx=0x7f3b78004000 comp rx=0 tx=0).stop 2023-10-07T00:20:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/224471122 shutdown_connections 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6079990 0x5563d607c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6077ec0 0x5563d60811e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/224471122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6078fd0 0x5563d6089070 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/224471122 >> 172.21.15.5:0/224471122 conn(0x5563d5fec200 msgr2=0x5563d60808d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/224471122 shutdown_connections 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.430+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/224471122 wait complete. 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 1 -- start start 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 1 Processor -- start 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6077ec0 0x5563d6086880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6078fd0 0x5563d6086dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6079990 0x5563d6087dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d6088310 con 0x5563d6077ec0 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d6088480 con 0x5563d6079990 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563d6088640 con 0x5563d6078fd0 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.431+0000 7f3b9d9d1b80 10 client.0 _ll_register_callbacks cb 0x7f3b74099710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6077ec0 0x5563d6086880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6077ec0 0x5563d6086880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51832/0 (socket says 172.21.15.5:51832) 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 -- 172.21.15.5:0/4141762980 learned_addr learned my addr 172.21.15.5:0/4141762980 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6078fd0 0x5563d6086dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b83fff700 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6079990 0x5563d6087dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 -- 172.21.15.5:0/4141762980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6078fd0 msgr2=0x5563d6086dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6078fd0 0x5563d6086dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 -- 172.21.15.5:0/4141762980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6079990 msgr2=0x5563d6087dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6079990 0x5563d6087dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 -- 172.21.15.5:0/4141762980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563d5df5d80 con 0x5563d6077ec0 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b837fe700 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6077ec0 0x5563d6086880 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3b74010710 tx=0x7f3b74010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6b46cec8402aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b62ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b62ffd700 1 -- 172.21.15.5:0/4141762980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74014040 con 0x5563d6077ec0 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/4141762980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b7801e040 con 0x5563d6077ec0 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.432+0000 7f3b62ffd700 1 -- 172.21.15.5:0/4141762980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3b740a2140 con 0x5563d6077ec0 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b62ffd700 1 -- 172.21.15.5:0/4141762980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7409a010 con 0x5563d6077ec0 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b9d9d1b80 10 client.16653 fetch_fsmap learned FSMap version 44 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/4141762980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x5563d5df4250 con 0x5563d6077ec0 2023-10-07T00:20:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b62ffd700 1 -- 172.21.15.5:0/4141762980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b7801e040 con 0x5563d6077ec0 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b62ffd700 1 -- 172.21.15.5:0/4141762980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f3b7405fca0 con 0x5563d6077ec0 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b9d9d1b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b9d9d1b80 10 client.16653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b9d9d1b80 20 client.16653 populate_metadata read hostname 'smithi005' 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5563d60e1ed0 0x5563d60e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b9d9d1b80 4 client.16653 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.433+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/4141762980 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5563d5fc3ad0 con 0x5563d60e1ed0 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.434+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5563d60e1ed0 0x5563d60e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.434+0000 7f3b82ffd700 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5563d60e1ed0 0x5563d60e42c0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77932ab8df68c760 server_cookie=7f276e9eef0321a2 in_seq=0 out_seq=0 2023-10-07T00:20:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.434+0000 7f3b62ffd700 10 client.16653 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b62ffd700 1 -- 172.21.15.5:0/4141762980 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5563d5fc3ad0 con 0x5563d60e1ed0 2023-10-07T00:20:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b62ffd700 10 client.16653 handle_command_reply: tid=0 2023-10-07T00:20:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 client.16653 shutdown 2023-10-07T00:20:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/4141762980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6077ec0 msgr2=0x5563d6086880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6077ec0 0x5563d6086880 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3b74010710 tx=0x7f3b74010000 comp rx=0 tx=0).stop 2023-10-07T00:20:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/4141762980 shutdown_connections 2023-10-07T00:20:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5563d60e1ed0 0x5563d60e42c0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5563d6079990 0x5563d6087dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563d6077ec0 0x5563d6086880 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b62ffd700 0 client.16653 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 --2- 172.21.15.5:0/4141762980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5563d6078fd0 0x5563d6086dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/4141762980 >> 172.21.15.5:0/4141762980 conn(0x5563d5fec200 msgr2=0x5563d607c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/4141762980 shutdown_connections 2023-10-07T00:20:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 1 -- 172.21.15.5:0/4141762980 wait complete. 2023-10-07T00:20:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.446+0000 7f3b9d9d1b80 20 client.16653 trim_cache size 0 max 16384 2023-10-07T00:20:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:20:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:20:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:20:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:20:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 -- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b6c0a1480 msgr2=0x7f3b6c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b6c0a1480 0x7f3b6c0a3940 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c003e40 tx=0x7f3b7c009920 comp rx=0 tx=0).stop 2023-10-07T00:20:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 -- 172.21.15.5:0/1513635930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b84101990 msgr2=0x7f3b84198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b84101990 0x7f3b84198cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400d950 tx=0x7f3b7400dc60 comp rx=0 tx=0).stop 2023-10-07T00:20:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 -- 172.21.15.5:0/1513635930 shutdown_connections 2023-10-07T00:20:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3b6c0a1480 0x7f3b6c0a3940 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b84106bf0 0x7f3b841a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b84101990 0x7f3b84198cf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 --2- 172.21.15.5:0/1513635930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b841042c0 0x7f3b84199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 -- 172.21.15.5:0/1513635930 >> 172.21.15.5:0/1513635930 conn(0x7f3b840fb380 msgr2=0x7f3b840ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 -- 172.21.15.5:0/1513635930 shutdown_connections 2023-10-07T00:20:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:22.447+0000 7f3b89fff700 1 -- 172.21.15.5:0/1513635930 wait complete. 2023-10-07T00:20:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:22 smithi088 ceph-mon[103111]: pgmap v574: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:20:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:22 smithi112 ceph-mon[133548]: pgmap v574: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:20:23.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:22 smithi005 ceph-mon[129406]: pgmap v574: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:20:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:24 smithi088 ceph-mon[103111]: pgmap v575: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-10-07T00:20:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:24 smithi112 ceph-mon[133548]: pgmap v575: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-10-07T00:20:25.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:24 smithi005 ceph-mon[129406]: pgmap v575: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-10-07T00:20:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:26 smithi088 ceph-mon[103111]: pgmap v576: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 19 op/s 2023-10-07T00:20:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:26 smithi112 ceph-mon[133548]: pgmap v576: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 19 op/s 2023-10-07T00:20:27.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:26 smithi005 ceph-mon[129406]: pgmap v576: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 19 op/s 2023-10-07T00:20:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:28 smithi088 ceph-mon[103111]: pgmap v577: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:20:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:28 smithi112 ceph-mon[133548]: pgmap v577: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:20:29.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:28 smithi005 ceph-mon[129406]: pgmap v577: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:20:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:30 smithi088 ceph-mon[103111]: pgmap v578: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:20:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:30 smithi112 ceph-mon[133548]: pgmap v578: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:20:31.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:30 smithi005 ceph-mon[129406]: pgmap v578: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:20:32.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:31 smithi112 ceph-mon[133548]: pgmap v579: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 18 op/s 2023-10-07T00:20:32.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:31 smithi005 ceph-mon[129406]: pgmap v579: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 18 op/s 2023-10-07T00:20:32.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:31 smithi088 ceph-mon[103111]: pgmap v579: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 18 op/s 2023-10-07T00:20:35.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:34 smithi005 ceph-mon[129406]: pgmap v580: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 17 op/s 2023-10-07T00:20:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:34 smithi088 ceph-mon[103111]: pgmap v580: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 17 op/s 2023-10-07T00:20:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:34 smithi112 ceph-mon[133548]: pgmap v580: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 17 op/s 2023-10-07T00:20:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 -- 172.21.15.5:0/2021612978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 msgr2=0x7f2d5c1092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 --2- 172.21.15.5:0/2021612978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 0x7f2d5c1092a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400b0a0 tx=0x7f2d5400b3b0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 -- 172.21.15.5:0/2021612978 shutdown_connections 2023-10-07T00:20:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 --2- 172.21.15.5:0/2021612978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 0x7f2d5c1092a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 --2- 172.21.15.5:0/2021612978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c100e70 0x7f2d5c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 --2- 172.21.15.5:0/2021612978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d5c101fc0 0x7f2d5c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 -- 172.21.15.5:0/2021612978 >> 172.21.15.5:0/2021612978 conn(0x7f2d5c0fc3a0 msgr2=0x7f2d5c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 -- 172.21.15.5:0/2021612978 shutdown_connections 2023-10-07T00:20:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.608+0000 7f2d639ff700 1 -- 172.21.15.5:0/2021612978 wait complete. 2023-10-07T00:20:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.609+0000 7f2d639ff700 1 Processor -- start 2023-10-07T00:20:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.610+0000 7f2d639ff700 1 -- start start 2023-10-07T00:20:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.610+0000 7f2d639ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c100e70 0x7f2d5c196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.610+0000 7f2d639ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d5c101fc0 0x7f2d5c197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.610+0000 7f2d639ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 0x7f2d5c19e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.610+0000 7f2d639ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c19e740 con 0x7f2d5c102980 2023-10-07T00:20:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.610+0000 7f2d639ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c19e880 con 0x7f2d5c100e70 2023-10-07T00:20:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.610+0000 7f2d639ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c19ea10 con 0x7f2d5c101fc0 2023-10-07T00:20:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 0x7f2d5c19e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 0x7f2d5c19e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46044/0 (socket says 172.21.15.5:46044) 2023-10-07T00:20:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d6179b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c100e70 0x7f2d5c196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 -- 172.21.15.5:0/4248936296 learned_addr learned my addr 172.21.15.5:0/4248936296 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d5c101fc0 0x7f2d5c197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 -- 172.21.15.5:0/4248936296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d5c101fc0 msgr2=0x7f2d5c197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d5c101fc0 0x7f2d5c197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 -- 172.21.15.5:0/4248936296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c100e70 msgr2=0x7f2d5c196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c100e70 0x7f2d5c196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 -- 172.21.15.5:0/4248936296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d54009d00 con 0x7f2d5c102980 2023-10-07T00:20:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.611+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 0x7f2d5c19e170 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400b070 tx=0x7f2d54004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.612+0000 7f2d527fc700 1 -- 172.21.15.5:0/4248936296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5400e040 con 0x7f2d5c102980 2023-10-07T00:20:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.612+0000 7f2d527fc700 1 -- 172.21.15.5:0/4248936296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d54003e90 con 0x7f2d5c102980 2023-10-07T00:20:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.612+0000 7f2d527fc700 1 -- 172.21.15.5:0/4248936296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5401b450 con 0x7f2d5c102980 2023-10-07T00:20:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.612+0000 7f2d639ff700 1 -- 172.21.15.5:0/4248936296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c19ec90 con 0x7f2d5c102980 2023-10-07T00:20:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.612+0000 7f2d639ff700 1 -- 172.21.15.5:0/4248936296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c19f110 con 0x7f2d5c102980 2023-10-07T00:20:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.615+0000 7f2d527fc700 1 -- 172.21.15.5:0/4248936296 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2d54004020 con 0x7f2d5c102980 2023-10-07T00:20:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.616+0000 7f2d77319b80 1 Processor -- start 2023-10-07T00:20:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d527fc700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d480a1500 0x7f2d480a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d77319b80 1 -- start start 2023-10-07T00:20:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d527fc700 1 -- 172.21.15.5:0/4248936296 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2d540ce280 con 0x7f2d5c102980 2023-10-07T00:20:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d480a1500 0x7f2d480a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6d7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6de220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d77319b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e63e400 con 0x55f38e6d5ec0 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d77319b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e62fbc0 con 0x55f38e6d6fd0 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.617+0000 7f2d77319b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e62d4e0 con 0x55f38e6d7990 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46060/0 (socket says 172.21.15.5:46060) 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 -- 172.21.15.5:0/1761705514 learned_addr learned my addr 172.21.15.5:0/1761705514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6d7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 -- 172.21.15.5:0/1761705514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 msgr2=0x55f38e6de220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6de220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 -- 172.21.15.5:0/1761705514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 msgr2=0x55f38e6d7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6d7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d480a1500 0x7f2d480a39c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005950 tx=0x7f2d4c0106b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 -- 172.21.15.5:0/1761705514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f38e453d80 con 0x55f38e6d5ec0 2023-10-07T00:20:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.618+0000 7f2d6179b700 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d62e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800bd70 tx=0x7f2d580106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3113e0055b6247bb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d477fe700 1 -- 172.21.15.5:0/1761705514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58010bb0 con 0x55f38e6d5ec0 2023-10-07T00:20:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d477fe700 1 -- 172.21.15.5:0/1761705514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d58015070 con 0x55f38e6d5ec0 2023-10-07T00:20:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d477fe700 1 -- 172.21.15.5:0/1761705514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580116a0 con 0x55f38e6d5ec0 2023-10-07T00:20:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d77319b80 1 -- 172.21.15.5:0/1761705514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 msgr2=0x55f38e6d62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d77319b80 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d62e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800bd70 tx=0x7f2d580106b0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d77319b80 1 -- 172.21.15.5:0/1761705514 shutdown_connections 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d77319b80 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6de220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d77319b80 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d62e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d77319b80 1 --2- 172.21.15.5:0/1761705514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6d7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.619+0000 7f2d77319b80 1 -- 172.21.15.5:0/1761705514 >> 172.21.15.5:0/1761705514 conn(0x55f38e64a200 msgr2=0x55f38e6d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.620+0000 7f2d77319b80 1 -- 172.21.15.5:0/1761705514 shutdown_connections 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.620+0000 7f2d77319b80 1 -- 172.21.15.5:0/1761705514 wait complete. 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.620+0000 7f2d77319b80 1 -- start start 2023-10-07T00:20:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.620+0000 7f2d77319b80 1 Processor -- start 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d77319b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e628dd0 con 0x55f38e6d6fd0 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d77319b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e5c56b0 con 0x55f38e6d5ec0 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d77319b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e5c5350 con 0x55f38e6d7990 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d77319b80 10 client.0 _ll_register_callbacks cb 0x55f38e4227a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d60f9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d60f9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46070/0 (socket says 172.21.15.5:46070) 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d60f9a700 1 -- 172.21.15.5:0/444696783 learned_addr learned my addr 172.21.15.5:0/444696783 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d6179b700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.621+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d60f9a700 1 -- 172.21.15.5:0/444696783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 msgr2=0x55f38e6e7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d60f9a700 1 -- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 msgr2=0x55f38e6dfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6dfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d60f9a700 1 -- 172.21.15.5:0/444696783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5800b9a0 con 0x55f38e6d6fd0 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d6179b700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e0110 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0136c0 tx=0x7f2d4c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc210300861791ee server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d44ff9700 1 -- 172.21.15.5:0/444696783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c028640 con 0x55f38e6d6fd0 2023-10-07T00:20:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d77319b80 1 -- 172.21.15.5:0/444696783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f38e6c8d50 con 0x55f38e6d6fd0 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d44ff9700 1 -- 172.21.15.5:0/444696783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2d4c019040 con 0x55f38e6d6fd0 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d44ff9700 1 -- 172.21.15.5:0/444696783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d4c0132e0 con 0x55f38e6d6fd0 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d77319b80 10 client.16665 fetch_fsmap learned FSMap version 44 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.622+0000 7f2d77319b80 1 -- 172.21.15.5:0/444696783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55f38e43cc00 con 0x55f38e6d6fd0 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.623+0000 7f2d44ff9700 1 -- 172.21.15.5:0/444696783 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f38e6c8d50 con 0x55f38e6d6fd0 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.623+0000 7f2d44ff9700 1 -- 172.21.15.5:0/444696783 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f2d4c005370 con 0x55f38e6d6fd0 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.623+0000 7f2d77319b80 10 client.16665 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.623+0000 7f2d77319b80 10 client.16665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.623+0000 7f2d77319b80 20 client.16665 populate_metadata read hostname 'smithi005' 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.623+0000 7f2d77319b80 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55f38e6ebbc0 0x55f38e6edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.623+0000 7f2d77319b80 4 client.16665 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.623+0000 7f2d77319b80 1 -- 172.21.15.5:0/444696783 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f38e621db0 con 0x55f38e6ebbc0 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.624+0000 7f2d6179b700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55f38e6ebbc0 0x55f38e6edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.624+0000 7f2d6179b700 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55f38e6ebbc0 0x55f38e6edfe0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453287e45c26417b server_cookie=c47d1f3cd329922 in_seq=0 out_seq=0 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.624+0000 7f2d44ff9700 10 client.16665 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d44ff9700 1 -- 172.21.15.5:0/444696783 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f38e621db0 con 0x55f38e6ebbc0 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d44ff9700 10 client.16665 handle_command_reply: tid=0 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 client.16665 shutdown 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 -- 172.21.15.5:0/444696783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d6fd0 msgr2=0x55f38e6e0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e0110 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0136c0 tx=0x7f2d4c0047c0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 -- 172.21.15.5:0/444696783 shutdown_connections 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55f38e6ebbc0 0x55f38e6edfe0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d44ff9700 0 client.16665 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 --2- 172.21.15.5:0/444696783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e0110 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 -- 172.21.15.5:0/444696783 >> 172.21.15.5:0/444696783 conn(0x55f38e64a200 msgr2=0x55f38e6d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 -- 172.21.15.5:0/444696783 shutdown_connections 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.625+0000 7f2d77319b80 1 -- 172.21.15.5:0/444696783 wait complete. 2023-10-07T00:20:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.626+0000 7f2d77319b80 20 client.16665 trim_cache size 0 max 16384 2023-10-07T00:20:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.641+0000 7f2d77319b80 1 Processor -- start 2023-10-07T00:20:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.641+0000 7f2d77319b80 1 -- start start 2023-10-07T00:20:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.641+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.641+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.641+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d7990 0x55f38e6dde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.641+0000 7f2d77319b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e4a98c0 con 0x55f38e6d7990 2023-10-07T00:20:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.641+0000 7f2d77319b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e6d26c0 con 0x55f38e6d5ec0 2023-10-07T00:20:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.641+0000 7f2d77319b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e6da450 con 0x55f38e6d6fd0 2023-10-07T00:20:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d61f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d7990 0x55f38e6dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d61f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d7990 0x55f38e6dde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46084/0 (socket says 172.21.15.5:46084) 2023-10-07T00:20:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d61f9c700 1 -- 172.21.15.5:0/2191316050 learned_addr learned my addr 172.21.15.5:0/2191316050 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d6179b700 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d61f9c700 1 -- 172.21.15.5:0/2191316050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d6fd0 msgr2=0x55f38e6e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d61f9c700 1 -- 172.21.15.5:0/2191316050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 msgr2=0x55f38e6d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d61f9c700 1 -- 172.21.15.5:0/2191316050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f38e47a1f0 con 0x55f38e6d7990 2023-10-07T00:20:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.642+0000 7f2d6179b700 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:20:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d7990 0x55f38e6dde10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2d5409b540 tx=0x7f2d54009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768e1dc5fe52af16 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d47fff700 1 -- 172.21.15.5:0/2191316050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5409af10 con 0x55f38e6d7990 2023-10-07T00:20:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d47fff700 1 -- 172.21.15.5:0/2191316050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d54009440 con 0x55f38e6d7990 2023-10-07T00:20:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d47fff700 1 -- 172.21.15.5:0/2191316050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d540a3920 con 0x55f38e6d7990 2023-10-07T00:20:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d77319b80 1 -- 172.21.15.5:0/2191316050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d7990 msgr2=0x55f38e6dde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d77319b80 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d7990 0x55f38e6dde10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2d5409b540 tx=0x7f2d54009040 comp rx=0 tx=0).stop 2023-10-07T00:20:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d77319b80 1 -- 172.21.15.5:0/2191316050 shutdown_connections 2023-10-07T00:20:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d77319b80 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d7990 0x55f38e6dde10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d77319b80 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d5ec0 0x55f38e6d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d77319b80 1 --2- 172.21.15.5:0/2191316050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.643+0000 7f2d77319b80 1 -- 172.21.15.5:0/2191316050 >> 172.21.15.5:0/2191316050 conn(0x55f38e64a200 msgr2=0x55f38e6de8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.644+0000 7f2d77319b80 1 -- 172.21.15.5:0/2191316050 shutdown_connections 2023-10-07T00:20:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.644+0000 7f2d77319b80 1 -- 172.21.15.5:0/2191316050 wait complete. 2023-10-07T00:20:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.644+0000 7f2d77319b80 1 -- start start 2023-10-07T00:20:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.644+0000 7f2d77319b80 1 Processor -- start 2023-10-07T00:20:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d77319b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d77319b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e6e6780 con 0x55f38e6d5ec0 2023-10-07T00:20:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d77319b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e6e68f0 con 0x55f38e6d6fd0 2023-10-07T00:20:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d77319b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38e6e6ab0 con 0x55f38e6d7990 2023-10-07T00:20:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d77319b80 10 client.0 _ll_register_callbacks cb 0x7f2d4c010e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:20:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d6179b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d6179b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6e4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46092/0 (socket says 172.21.15.5:46092) 2023-10-07T00:20:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.645+0000 7f2d6179b700 1 -- 172.21.15.5:0/3559062692 learned_addr learned my addr 172.21.15.5:0/3559062692 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d61f9c700 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d6179b700 1 -- 172.21.15.5:0/3559062692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 msgr2=0x55f38e6e6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d6179b700 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d6179b700 1 -- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 msgr2=0x55f38e6e5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d6179b700 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d6179b700 1 -- 172.21.15.5:0/3559062692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c19f110 con 0x55f38e6d5ec0 2023-10-07T00:20:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:20:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d6179b700 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6e4cf0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55f38e6d5c60 tx=0x7f2d5800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbeca0d7a8c1309 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:20:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d44ff9700 1 -- 172.21.15.5:0/3559062692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58022040 con 0x55f38e6d5ec0 2023-10-07T00:20:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d77319b80 1 -- 172.21.15.5:0/3559062692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d58015070 con 0x55f38e6d5ec0 2023-10-07T00:20:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d44ff9700 1 -- 172.21.15.5:0/3559062692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2d58017070 con 0x55f38e6d5ec0 2023-10-07T00:20:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d44ff9700 1 -- 172.21.15.5:0/3559062692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d580275a0 con 0x55f38e6d5ec0 2023-10-07T00:20:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d77319b80 10 client.16671 fetch_fsmap learned FSMap version 44 2023-10-07T00:20:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.646+0000 7f2d77319b80 1 -- 172.21.15.5:0/3559062692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55f38e452250 con 0x55f38e6d5ec0 2023-10-07T00:20:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d44ff9700 1 -- 172.21.15.5:0/3559062692 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d58015070 con 0x55f38e6d5ec0 2023-10-07T00:20:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d44ff9700 1 -- 172.21.15.5:0/3559062692 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f2d580054d0 con 0x55f38e6d5ec0 2023-10-07T00:20:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d77319b80 10 client.16671 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:20:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d77319b80 10 client.16671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:20:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d77319b80 20 client.16671 populate_metadata read hostname 'smithi005' 2023-10-07T00:20:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d77319b80 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55f38e7406f0 0x55f38e742bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d77319b80 4 client.16671 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:20:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d77319b80 1 -- 172.21.15.5:0/3559062692 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f38e621ad0 con 0x55f38e7406f0 2023-10-07T00:20:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.647+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55f38e7406f0 0x55f38e742bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.648+0000 7f2d60f9a700 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55f38e7406f0 0x55f38e742bb0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e546645bcbb79243 server_cookie=48a4648c1efa0594 in_seq=0 out_seq=0 2023-10-07T00:20:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.648+0000 7f2d44ff9700 10 client.16671 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:35.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d44ff9700 1 -- 172.21.15.5:0/3559062692 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f38e621ad0 con 0x55f38e7406f0 2023-10-07T00:20:35.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d44ff9700 10 client.16671 handle_command_reply: tid=0 2023-10-07T00:20:35.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 client.16671 shutdown 2023-10-07T00:20:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 -- 172.21.15.5:0/3559062692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 msgr2=0x55f38e6e4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6e4cf0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55f38e6d5c60 tx=0x7f2d5800b4a0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 -- 172.21.15.5:0/3559062692 shutdown_connections 2023-10-07T00:20:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55f38e7406f0 0x55f38e742bb0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f38e6d7990 0x55f38e6e6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38e6d5ec0 0x55f38e6e4cf0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 --2- 172.21.15.5:0/3559062692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f38e6d6fd0 0x55f38e6e5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d44ff9700 0 client.16671 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 -- 172.21.15.5:0/3559062692 >> 172.21.15.5:0/3559062692 conn(0x55f38e64a200 msgr2=0x55f38e6d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 -- 172.21.15.5:0/3559062692 shutdown_connections 2023-10-07T00:20:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.660+0000 7f2d77319b80 1 -- 172.21.15.5:0/3559062692 wait complete. 2023-10-07T00:20:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.661+0000 7f2d77319b80 20 client.16671 trim_cache size 0 max 16384 2023-10-07T00:20:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:20:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:20:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:20:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:20:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.661+0000 7f2d639ff700 1 -- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d480a1500 msgr2=0x7f2d480a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.661+0000 7f2d639ff700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d480a1500 0x7f2d480a39c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005950 tx=0x7f2d4c0106b0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.661+0000 7f2d639ff700 1 -- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 msgr2=0x7f2d5c19e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.661+0000 7f2d639ff700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 0x7f2d5c19e170 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400b070 tx=0x7f2d54004c80 comp rx=0 tx=0).stop 2023-10-07T00:20:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.662+0000 7f2d639ff700 1 -- 172.21.15.5:0/4248936296 shutdown_connections 2023-10-07T00:20:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.662+0000 7f2d639ff700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f2d480a1500 0x7f2d480a39c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.662+0000 7f2d639ff700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c102980 0x7f2d5c19e170 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.662+0000 7f2d639ff700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c100e70 0x7f2d5c196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.662+0000 7f2d639ff700 1 --2- 172.21.15.5:0/4248936296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d5c101fc0 0x7f2d5c197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.662+0000 7f2d639ff700 1 -- 172.21.15.5:0/4248936296 >> 172.21.15.5:0/4248936296 conn(0x7f2d5c0fc3a0 msgr2=0x7f2d5c1055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.662+0000 7f2d639ff700 1 -- 172.21.15.5:0/4248936296 shutdown_connections 2023-10-07T00:20:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:35.662+0000 7f2d639ff700 1 -- 172.21.15.5:0/4248936296 wait complete. 2023-10-07T00:20:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:36 smithi005 ceph-mon[129406]: pgmap v581: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-10-07T00:20:37.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:36 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:20:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:36 smithi088 ceph-mon[103111]: pgmap v581: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-10-07T00:20:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:36 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:20:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:36 smithi112 ceph-mon[133548]: pgmap v581: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-10-07T00:20:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:36 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:20:38.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:20:38.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:20:38.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:20:38.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:20:38.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:20:38.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:20:38.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:20:39.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:38 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi088 to 220.9M 2023-10-07T00:20:39.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:38 smithi005 ceph-mon[129406]: Adjusting osd_memory_target on smithi112 to 220.9M 2023-10-07T00:20:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:38 smithi005 ceph-mon[129406]: Unable to set osd_memory_target on smithi088 to 231674777: error parsing value: Value '231674777' is below minimum 939524096 2023-10-07T00:20:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:38 smithi005 ceph-mon[129406]: Unable to set osd_memory_target on smithi112 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-10-07T00:20:39.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:38 smithi005 ceph-mon[129406]: pgmap v582: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 15 op/s 2023-10-07T00:20:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:38 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi088 to 220.9M 2023-10-07T00:20:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:38 smithi088 ceph-mon[103111]: Adjusting osd_memory_target on smithi112 to 220.9M 2023-10-07T00:20:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:38 smithi088 ceph-mon[103111]: Unable to set osd_memory_target on smithi088 to 231674777: error parsing value: Value '231674777' is below minimum 939524096 2023-10-07T00:20:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:38 smithi088 ceph-mon[103111]: Unable to set osd_memory_target on smithi112 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-10-07T00:20:39.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:38 smithi088 ceph-mon[103111]: pgmap v582: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 15 op/s 2023-10-07T00:20:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:38 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi088 to 220.9M 2023-10-07T00:20:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:38 smithi112 ceph-mon[133548]: Adjusting osd_memory_target on smithi112 to 220.9M 2023-10-07T00:20:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:38 smithi112 ceph-mon[133548]: Unable to set osd_memory_target on smithi088 to 231674777: error parsing value: Value '231674777' is below minimum 939524096 2023-10-07T00:20:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:38 smithi112 ceph-mon[133548]: Unable to set osd_memory_target on smithi112 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-10-07T00:20:39.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:38 smithi112 ceph-mon[133548]: pgmap v582: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 15 op/s 2023-10-07T00:20:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:40 smithi088 ceph-mon[103111]: pgmap v583: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 17 op/s 2023-10-07T00:20:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:40 smithi112 ceph-mon[133548]: pgmap v583: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 17 op/s 2023-10-07T00:20:41.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:40 smithi005 ceph-mon[129406]: pgmap v583: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 17 op/s 2023-10-07T00:20:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:42 smithi088 ceph-mon[103111]: pgmap v584: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 20 op/s 2023-10-07T00:20:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:42 smithi112 ceph-mon[133548]: pgmap v584: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 20 op/s 2023-10-07T00:20:43.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:42 smithi005 ceph-mon[129406]: pgmap v584: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 20 op/s 2023-10-07T00:20:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:44 smithi088 ceph-mon[103111]: pgmap v585: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 KiB/s wr, 19 op/s 2023-10-07T00:20:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:44 smithi112 ceph-mon[133548]: pgmap v585: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 KiB/s wr, 19 op/s 2023-10-07T00:20:45.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:44 smithi005 ceph-mon[129406]: pgmap v585: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 KiB/s wr, 19 op/s 2023-10-07T00:20:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:46 smithi088 ceph-mon[103111]: pgmap v586: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 21 op/s 2023-10-07T00:20:47.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:46 smithi112 ceph-mon[133548]: pgmap v586: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 21 op/s 2023-10-07T00:20:47.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:46 smithi005 ceph-mon[129406]: pgmap v586: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 21 op/s 2023-10-07T00:20:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.822+0000 7f39c5bff700 1 -- 172.21.15.5:0/724128709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0108dd0 msgr2=0x7f39c010b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.822+0000 7f39c5bff700 1 --2- 172.21.15.5:0/724128709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0108dd0 0x7f39c010b260 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f39b800b0a0 tx=0x7f39b800b3b0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.823+0000 7f39c5bff700 1 -- 172.21.15.5:0/724128709 shutdown_connections 2023-10-07T00:20:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.823+0000 7f39c5bff700 1 --2- 172.21.15.5:0/724128709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0108dd0 0x7f39c010b260 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.823+0000 7f39c5bff700 1 --2- 172.21.15.5:0/724128709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39c0074ef0 0x7f39c0073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.823+0000 7f39c5bff700 1 --2- 172.21.15.5:0/724128709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c0073910 0x7f39c0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.823+0000 7f39c5bff700 1 -- 172.21.15.5:0/724128709 >> 172.21.15.5:0/724128709 conn(0x7f39c00fc480 msgr2=0x7f39c00fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.823+0000 7f39c5bff700 1 -- 172.21.15.5:0/724128709 shutdown_connections 2023-10-07T00:20:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.823+0000 7f39c5bff700 1 -- 172.21.15.5:0/724128709 wait complete. 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.824+0000 7f39c5bff700 1 Processor -- start 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.824+0000 7f39c5bff700 1 -- start start 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.824+0000 7f39c5bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c0073910 0x7f39c0198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.824+0000 7f39c5bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0074ef0 0x7f39c0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.824+0000 7f39c5bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39c0108dd0 0x7f39c01a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.824+0000 7f39c5bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a0970 con 0x7f39c0074ef0 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.824+0000 7f39c5bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a0ab0 con 0x7f39c0108dd0 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.824+0000 7f39c5bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a0c40 con 0x7f39c0073910 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0074ef0 0x7f39c0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0074ef0 0x7f39c0199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47034/0 (socket says 172.21.15.5:47034) 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 -- 172.21.15.5:0/4120087479 learned_addr learned my addr 172.21.15.5:0/4120087479 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c0073910 0x7f39c0198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 -- 172.21.15.5:0/4120087479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c0073910 msgr2=0x7f39c0198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c0073910 0x7f39c0198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 -- 172.21.15.5:0/4120087479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39c0108dd0 msgr2=0x7f39c01a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39bffff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39c0108dd0 0x7f39c01a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39c0108dd0 0x7f39c01a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 -- 172.21.15.5:0/4120087479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009520 con 0x7f39c0074ef0 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39bffff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39c0108dd0 0x7f39c01a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.825+0000 7f39beffd700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0074ef0 0x7f39c0199330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f39b400e970 tx=0x7f39b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.826+0000 7f39bcff9700 1 -- 172.21.15.5:0/4120087479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4009790 con 0x7f39c0074ef0 2023-10-07T00:20:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.826+0000 7f39bcff9700 1 -- 172.21.15.5:0/4120087479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b40044b0 con 0x7f39c0074ef0 2023-10-07T00:20:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.826+0000 7f39bcff9700 1 -- 172.21.15.5:0/4120087479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4003dd0 con 0x7f39c0074ef0 2023-10-07T00:20:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.826+0000 7f39c5bff700 1 -- 172.21.15.5:0/4120087479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b8009d00 con 0x7f39c0074ef0 2023-10-07T00:20:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.826+0000 7f39c5bff700 1 -- 172.21.15.5:0/4120087479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c01a11f0 con 0x7f39c0074ef0 2023-10-07T00:20:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.829+0000 7f39bcff9700 1 -- 172.21.15.5:0/4120087479 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f39b4003f30 con 0x7f39c0074ef0 2023-10-07T00:20:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.830+0000 7f39d95edb80 1 Processor -- start 2023-10-07T00:20:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.830+0000 7f39bcff9700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f39a80a1480 0x7f39a80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39bcff9700 1 -- 172.21.15.5:0/4120087479 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f39b4014070 con 0x7f39c0074ef0 2023-10-07T00:20:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39d95edb80 1 -- start start 2023-10-07T00:20:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39bffff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f39a80a1480 0x7f39a80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d3184af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 0x55c0d3185c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d318ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39d95edb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d30e4400 con 0x55c0d31861a0 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39d95edb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d30d5bc0 con 0x55c0d31857e0 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39d95edb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d30d34e0 con 0x55c0d31846d0 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.831+0000 7f39bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d318ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f39a80a1480 0x7f39a80a3940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f39b800b070 tx=0x7f39b800b720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d318ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47038/0 (socket says 172.21.15.5:47038) 2023-10-07T00:20:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 -- 172.21.15.5:0/2678359528 learned_addr learned my addr 172.21.15.5:0/2678359528 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39beffd700 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 0x55c0d3185c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d3184af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 -- 172.21.15.5:0/2678359528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 msgr2=0x55c0d3184af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d3184af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 -- 172.21.15.5:0/2678359528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 msgr2=0x55c0d3185c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 0x55c0d3185c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 -- 172.21.15.5:0/2678359528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0d2ef9d80 con 0x55c0d31861a0 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.832+0000 7f39bffff700 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d318ca30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007610 tx=0x7f39b801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28d5184cd9311ba server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39a5ffb700 1 -- 172.21.15.5:0/2678359528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800e040 con 0x55c0d31861a0 2023-10-07T00:20:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39a5ffb700 1 -- 172.21.15.5:0/2678359528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b8004a50 con 0x55c0d31861a0 2023-10-07T00:20:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39a5ffb700 1 -- 172.21.15.5:0/2678359528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b801d990 con 0x55c0d31861a0 2023-10-07T00:20:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39d95edb80 1 -- 172.21.15.5:0/2678359528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 msgr2=0x55c0d318ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39d95edb80 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d318ca30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007610 tx=0x7f39b801a000 comp rx=0 tx=0).stop 2023-10-07T00:20:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39d95edb80 1 -- 172.21.15.5:0/2678359528 shutdown_connections 2023-10-07T00:20:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39d95edb80 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d318ca30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39d95edb80 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d3184af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39d95edb80 1 --2- 172.21.15.5:0/2678359528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 0x55c0d3185c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.833+0000 7f39d95edb80 1 -- 172.21.15.5:0/2678359528 >> 172.21.15.5:0/2678359528 conn(0x55c0d30f0200 msgr2=0x55c0d3176bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.834+0000 7f39d95edb80 1 -- 172.21.15.5:0/2678359528 shutdown_connections 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.834+0000 7f39d95edb80 1 -- 172.21.15.5:0/2678359528 wait complete. 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.834+0000 7f39d95edb80 1 -- start start 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.834+0000 7f39d95edb80 1 Processor -- start 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31846d0 0x55c0d318e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31857e0 0x55c0d318e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d3195760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39d95edb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d30cedd0 con 0x55c0d31846d0 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39d95edb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d306b6b0 con 0x55c0d31861a0 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39d95edb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d306b350 con 0x55c0d31857e0 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39d95edb80 10 client.0 _ll_register_callbacks cb 0x55c0d2ec87a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:20:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31846d0 0x55c0d318e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31846d0 0x55c0d318e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47046/0 (socket says 172.21.15.5:47046) 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bf7fe700 1 -- 172.21.15.5:0/4017417520 learned_addr learned my addr 172.21.15.5:0/4017417520 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bffff700 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d3195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39beffd700 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31857e0 0x55c0d318e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bffff700 1 -- 172.21.15.5:0/4017417520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31857e0 msgr2=0x55c0d318e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bffff700 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31857e0 0x55c0d318e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bffff700 1 -- 172.21.15.5:0/4017417520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31846d0 msgr2=0x55c0d318e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bffff700 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31846d0 0x55c0d318e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bffff700 1 -- 172.21.15.5:0/4017417520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c010be80 con 0x55c0d31861a0 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.835+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31846d0 0x55c0d318e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.836+0000 7f39bffff700 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d3195760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f39b800d010 tx=0x7f39b800bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a08deff70b2a15 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.836+0000 7f399effd700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.836+0000 7f399effd700 1 -- 172.21.15.5:0/4017417520 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800e030 con 0x55c0d31861a0 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.836+0000 7f39d95edb80 1 -- 172.21.15.5:0/4017417520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0d316ed50 con 0x55c0d31861a0 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.836+0000 7f399effd700 1 -- 172.21.15.5:0/4017417520 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f39b8022040 con 0x55c0d31861a0 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.836+0000 7f399effd700 1 -- 172.21.15.5:0/4017417520 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b801daa0 con 0x55c0d31861a0 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.836+0000 7f39d95edb80 10 client.26528 fetch_fsmap learned FSMap version 44 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.836+0000 7f39d95edb80 1 -- 172.21.15.5:0/4017417520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55c0d2ee2c00 con 0x55c0d31861a0 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f399effd700 1 -- 172.21.15.5:0/4017417520 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c0d316ed50 con 0x55c0d31861a0 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f399effd700 1 -- 172.21.15.5:0/4017417520 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f39b8038c10 con 0x55c0d31861a0 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f39d95edb80 10 client.26528 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f39d95edb80 10 client.26528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:20:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f39d95edb80 20 client.26528 populate_metadata read hostname 'smithi005' 2023-10-07T00:20:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f39d95edb80 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c0d3199cb0 0x55c0d319c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f39d95edb80 4 client.26528 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:20:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f39d95edb80 1 -- 172.21.15.5:0/4017417520 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0d30c7db0 con 0x55c0d3199cb0 2023-10-07T00:20:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.837+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c0d3199cb0 0x55c0d319c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.838+0000 7f399effd700 10 client.26528 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.838+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c0d3199cb0 0x55c0d319c0d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcfc0d2c5b9d0787 server_cookie=9f4e2ce38d9414dc in_seq=0 out_seq=0 2023-10-07T00:20:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f399effd700 1 -- 172.21.15.5:0/4017417520 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c0d30c7db0 con 0x55c0d3199cb0 2023-10-07T00:20:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f399effd700 10 client.26528 handle_command_reply: tid=0 2023-10-07T00:20:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 client.26528 shutdown 2023-10-07T00:20:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 -- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 msgr2=0x55c0d3195760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d3195760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f39b800d010 tx=0x7f39b800bce0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 -- 172.21.15.5:0/4017417520 shutdown_connections 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c0d3199cb0 0x55c0d319c0d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d3195760 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31846d0 0x55c0d318e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f399effd700 0 client.26528 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 --2- 172.21.15.5:0/4017417520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31857e0 0x55c0d318e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 -- 172.21.15.5:0/4017417520 >> 172.21.15.5:0/4017417520 conn(0x55c0d30f0200 msgr2=0x55c0d3176250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 -- 172.21.15.5:0/4017417520 shutdown_connections 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 1 -- 172.21.15.5:0/4017417520 wait complete. 2023-10-07T00:20:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.839+0000 7f39d95edb80 20 client.26528 trim_cache size 0 max 16384 2023-10-07T00:20:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.856+0000 7f39d95edb80 1 Processor -- start 2023-10-07T00:20:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.856+0000 7f39d95edb80 1 -- start start 2023-10-07T00:20:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.856+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d318d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.856+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31857e0 0x55c0d3195720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.856+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d318e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.856+0000 7f39d95edb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d2f4f8c0 con 0x55c0d31857e0 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.856+0000 7f39d95edb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d3171200 con 0x55c0d31861a0 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.856+0000 7f39d95edb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d3177b60 con 0x55c0d31846d0 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39beffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31857e0 0x55c0d3195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39beffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31857e0 0x55c0d3195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47052/0 (socket says 172.21.15.5:47052) 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39beffd700 1 -- 172.21.15.5:0/1222240438 learned_addr learned my addr 172.21.15.5:0/1222240438 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d318d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39bffff700 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d318e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39bf7fe700 1 -- 172.21.15.5:0/1222240438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 msgr2=0x55c0d318e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d318e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39bf7fe700 1 -- 172.21.15.5:0/1222240438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31857e0 msgr2=0x55c0d3195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31857e0 0x55c0d3195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39bf7fe700 1 -- 172.21.15.5:0/1222240438 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0d2f201f0 con 0x55c0d31846d0 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39beffd700 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31857e0 0x55c0d3195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.857+0000 7f39bffff700 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d318e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.858+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d318d000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55c0d319c6b0 tx=0x7f39b0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b26e152be94758 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.858+0000 7f39a67fc700 1 -- 172.21.15.5:0/1222240438 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0017070 con 0x55c0d31846d0 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.858+0000 7f39a67fc700 1 -- 172.21.15.5:0/1222240438 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b0018040 con 0x55c0d31846d0 2023-10-07T00:20:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.858+0000 7f39a67fc700 1 -- 172.21.15.5:0/1222240438 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0004510 con 0x55c0d31846d0 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 -- 172.21.15.5:0/1222240438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 msgr2=0x55c0d318d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d318d000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55c0d319c6b0 tx=0x7f39b0009260 comp rx=0 tx=0).stop 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 -- 172.21.15.5:0/1222240438 shutdown_connections 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31861a0 0x55c0d318e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d318d000 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 --2- 172.21.15.5:0/1222240438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31857e0 0x55c0d3195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 -- 172.21.15.5:0/1222240438 >> 172.21.15.5:0/1222240438 conn(0x55c0d30f0200 msgr2=0x55c0d31a09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 -- 172.21.15.5:0/1222240438 shutdown_connections 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 -- 172.21.15.5:0/1222240438 wait complete. 2023-10-07T00:20:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 -- start start 2023-10-07T00:20:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.859+0000 7f39d95edb80 1 Processor -- start 2023-10-07T00:20:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d3193200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 0x55c0d3193740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39d95edb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d3194750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39d95edb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d3194c90 con 0x55c0d31861a0 2023-10-07T00:20:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39d95edb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d3194e00 con 0x55c0d31857e0 2023-10-07T00:20:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39d95edb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d3194fc0 con 0x55c0d31846d0 2023-10-07T00:20:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39d95edb80 10 client.0 _ll_register_callbacks cb 0x7f39b4095f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:20:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d3194750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d3194750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47066/0 (socket says 172.21.15.5:47066) 2023-10-07T00:20:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39bffff700 1 -- 172.21.15.5:0/952576275 learned_addr learned my addr 172.21.15.5:0/952576275 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:20:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39beffd700 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 0x55c0d3193740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.860+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d3193200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39bffff700 1 -- 172.21.15.5:0/952576275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 msgr2=0x55c0d3193200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39bffff700 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d3193200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39bffff700 1 -- 172.21.15.5:0/952576275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 msgr2=0x55c0d3193740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:20:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39bffff700 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 0x55c0d3193740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39bffff700 1 -- 172.21.15.5:0/952576275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c01a11f0 con 0x55c0d31861a0 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39bffff700 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d3194750 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f39b800d010 tx=0x7f39b800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9f058cbbd0dadf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f399effd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f399effd700 1 -- 172.21.15.5:0/952576275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800e060 con 0x55c0d31861a0 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39d95edb80 1 -- 172.21.15.5:0/952576275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39b8004a50 con 0x55c0d31861a0 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f399effd700 1 -- 172.21.15.5:0/952576275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f39b801bbe0 con 0x55c0d31861a0 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f399effd700 1 -- 172.21.15.5:0/952576275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b801bda0 con 0x55c0d31861a0 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39d95edb80 10 client.16689 fetch_fsmap learned FSMap version 44 2023-10-07T00:20:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.861+0000 7f39d95edb80 1 -- 172.21.15.5:0/952576275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x7f39b0020a60 con 0x55c0d31861a0 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.862+0000 7f399effd700 1 -- 172.21.15.5:0/952576275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b8004a50 con 0x55c0d31861a0 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.862+0000 7f399effd700 1 -- 172.21.15.5:0/952576275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f39b80387f0 con 0x55c0d31861a0 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.862+0000 7f39d95edb80 10 client.16689 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.862+0000 7f39d95edb80 10 client.16689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.862+0000 7f39d95edb80 20 client.16689 populate_metadata read hostname 'smithi005' 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.862+0000 7f39d95edb80 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c0d31ee360 0x55c0d31f0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.862+0000 7f39d95edb80 4 client.16689 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.862+0000 7f39d95edb80 1 -- 172.21.15.5:0/952576275 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c0d30c7ad0 con 0x55c0d31ee360 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.863+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c0d31ee360 0x55c0d31f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:20:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.863+0000 7f39bf7fe700 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c0d31ee360 0x55c0d31f0780 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=997d3b67739b8b67 server_cookie=314b54cbcc2b9cd5 in_seq=0 out_seq=0 2023-10-07T00:20:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.863+0000 7f399effd700 10 client.16689 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.875+0000 7f399effd700 1 -- 172.21.15.5:0/952576275 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c0d30c7ad0 con 0x55c0d31ee360 2023-10-07T00:20:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.875+0000 7f399effd700 10 client.16689 handle_command_reply: tid=0 2023-10-07T00:20:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.875+0000 7f39d95edb80 1 client.16689 shutdown 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.875+0000 7f39d95edb80 1 -- 172.21.15.5:0/952576275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 msgr2=0x55c0d3194750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.875+0000 7f39d95edb80 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d3194750 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f39b800d010 tx=0x7f39b800be00 comp rx=0 tx=0).stop 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 1 -- 172.21.15.5:0/952576275 shutdown_connections 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55c0d31ee360 0x55c0d31f0780 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d31861a0 0x55c0d3194750 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0d31846d0 0x55c0d3193200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 1 --2- 172.21.15.5:0/952576275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c0d31857e0 0x55c0d3193740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f399effd700 0 client.16689 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 1 -- 172.21.15.5:0/952576275 >> 172.21.15.5:0/952576275 conn(0x55c0d30f0200 msgr2=0x55c0d3189050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 1 -- 172.21.15.5:0/952576275 shutdown_connections 2023-10-07T00:20:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 1 -- 172.21.15.5:0/952576275 wait complete. 2023-10-07T00:20:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.876+0000 7f39d95edb80 20 client.16689 trim_cache size 0 max 16384 2023-10-07T00:20:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:20:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:20:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:20:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:20:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 -- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f39a80a1480 msgr2=0x7f39a80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f39a80a1480 0x7f39a80a3940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f39b800b070 tx=0x7f39b800b720 comp rx=0 tx=0).stop 2023-10-07T00:20:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 -- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0074ef0 msgr2=0x7f39c0199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:20:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0074ef0 0x7f39c0199330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f39b400e970 tx=0x7f39b400ed30 comp rx=0 tx=0).stop 2023-10-07T00:20:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 -- 172.21.15.5:0/4120087479 shutdown_connections 2023-10-07T00:20:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f39a80a1480 0x7f39a80a3940 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39c0108dd0 0x7f39c01a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c0073910 0x7f39c0198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 --2- 172.21.15.5:0/4120087479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c0074ef0 0x7f39c0199330 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:20:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 -- 172.21.15.5:0/4120087479 >> 172.21.15.5:0/4120087479 conn(0x7f39c00fc480 msgr2=0x7f39c00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:20:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 -- 172.21.15.5:0/4120087479 shutdown_connections 2023-10-07T00:20:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:20:48.877+0000 7f39c5bff700 1 -- 172.21.15.5:0/4120087479 wait complete. 2023-10-07T00:20:49.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:48 smithi088 ceph-mon[103111]: pgmap v587: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 KiB/s wr, 19 op/s 2023-10-07T00:20:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:48 smithi112 ceph-mon[133548]: pgmap v587: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 KiB/s wr, 19 op/s 2023-10-07T00:20:49.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:48 smithi005 ceph-mon[129406]: pgmap v587: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 KiB/s wr, 19 op/s 2023-10-07T00:20:51.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:50 smithi088 ceph-mon[103111]: pgmap v588: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-07T00:20:51.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:50 smithi112 ceph-mon[133548]: pgmap v588: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-07T00:20:51.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:50 smithi005 ceph-mon[129406]: pgmap v588: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-07T00:20:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:52 smithi088 ceph-mon[103111]: pgmap v589: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 19 op/s 2023-10-07T00:20:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:52 smithi112 ceph-mon[133548]: pgmap v589: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 19 op/s 2023-10-07T00:20:53.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:52 smithi005 ceph-mon[129406]: pgmap v589: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 19 op/s 2023-10-07T00:20:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:54 smithi088 ceph-mon[103111]: pgmap v590: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-07T00:20:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:54 smithi112 ceph-mon[133548]: pgmap v590: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-07T00:20:55.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:54 smithi005 ceph-mon[129406]: pgmap v590: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-07T00:20:57.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:56 smithi088 ceph-mon[103111]: pgmap v591: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 21 op/s 2023-10-07T00:20:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:56 smithi112 ceph-mon[133548]: pgmap v591: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 21 op/s 2023-10-07T00:20:57.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:56 smithi005 ceph-mon[129406]: pgmap v591: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 21 op/s 2023-10-07T00:20:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:20:58 smithi088 ceph-mon[103111]: pgmap v592: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-07T00:20:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:20:58 smithi112 ceph-mon[133548]: pgmap v592: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-07T00:20:59.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:20:58 smithi005 ceph-mon[129406]: pgmap v592: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-07T00:21:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:00 smithi088 ceph-mon[103111]: pgmap v593: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 19 op/s 2023-10-07T00:21:01.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:00 smithi112 ceph-mon[133548]: pgmap v593: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 19 op/s 2023-10-07T00:21:01.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:00 smithi005 ceph-mon[129406]: pgmap v593: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 19 op/s 2023-10-07T00:21:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 -- 172.21.15.5:0/511407521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102060 msgr2=0x7fccfc1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 --2- 172.21.15.5:0/511407521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102060 0x7fccfc1024e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fccec009990 tx=0x7fccec009ca0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 -- 172.21.15.5:0/511407521 shutdown_connections 2023-10-07T00:21:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 --2- 172.21.15.5:0/511407521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccfc102a20 0x7fccfc109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 --2- 172.21.15.5:0/511407521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccfc100f10 0x7fccfc101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 --2- 172.21.15.5:0/511407521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102060 0x7fccfc1024e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 -- 172.21.15.5:0/511407521 >> 172.21.15.5:0/511407521 conn(0x7fccfc0fc480 msgr2=0x7fccfc0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 -- 172.21.15.5:0/511407521 shutdown_connections 2023-10-07T00:21:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.037+0000 7fcd03fff700 1 -- 172.21.15.5:0/511407521 wait complete. 2023-10-07T00:21:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.038+0000 7fcd03fff700 1 Processor -- start 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.038+0000 7fcd03fff700 1 -- start start 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd03fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccfc100f10 0x7fccfc196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd03fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccfc102060 0x7fccfc197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd03fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102a20 0x7fccfc19e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd03fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc19e6c0 con 0x7fccfc102a20 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd03fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc19e800 con 0x7fccfc102060 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd03fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc19e990 con 0x7fccfc100f10 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102a20 0x7fccfc19e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd01d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccfc100f10 0x7fccfc196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102a20 0x7fccfc19e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45892/0 (socket says 172.21.15.5:45892) 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd0259c700 1 -- 172.21.15.5:0/4080523051 learned_addr learned my addr 172.21.15.5:0/4080523051 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd0159a700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccfc102060 0x7fccfc197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.039+0000 7fcd0259c700 1 -- 172.21.15.5:0/4080523051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccfc100f10 msgr2=0x7fccfc196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fcd0259c700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccfc100f10 0x7fccfc196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fcd0259c700 1 -- 172.21.15.5:0/4080523051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccfc102060 msgr2=0x7fccfc197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fcd0259c700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccfc102060 0x7fccfc197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fcd0259c700 1 -- 172.21.15.5:0/4080523051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0095f0 con 0x7fccfc102a20 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fcd0259c700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102a20 0x7fccfc19e0f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fccf400ef30 tx=0x7fccf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fccf2ffd700 1 -- 172.21.15.5:0/4080523051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4018070 con 0x7fccfc102a20 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fccf2ffd700 1 -- 172.21.15.5:0/4080523051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccf400f040 con 0x7fccfc102a20 2023-10-07T00:21:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fcd03fff700 1 -- 172.21.15.5:0/4080523051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc19ec10 con 0x7fccfc102a20 2023-10-07T00:21:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fccf2ffd700 1 -- 172.21.15.5:0/4080523051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf400cbc0 con 0x7fccfc102a20 2023-10-07T00:21:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.040+0000 7fcd03fff700 1 -- 172.21.15.5:0/4080523051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc19f0d0 con 0x7fccfc102a20 2023-10-07T00:21:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.043+0000 7fccf2ffd700 1 -- 172.21.15.5:0/4080523051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fccf4007500 con 0x7fccfc102a20 2023-10-07T00:21:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.045+0000 7fcd178c4b80 1 Processor -- start 2023-10-07T00:21:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.045+0000 7fccf2ffd700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcce80a1480 0x7fcce80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.045+0000 7fcd178c4b80 1 -- start start 2023-10-07T00:21:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.045+0000 7fccf2ffd700 1 -- 172.21.15.5:0/4080523051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fccf40cc850 con 0x7fccfc102a20 2023-10-07T00:21:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.045+0000 7fcd0159a700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcce80a1480 0x7fcce80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.045+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.045+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644ceb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 0x559644cf2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644c4e400 con 0x559644ceb3e0 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644c3fbc0 con 0x559644cebda0 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644c3d4e0 con 0x559644cea2d0 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd01d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd01d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:36318/0 (socket says 172.21.15.5:36318) 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd01d9b700 1 -- 172.21.15.5:0/2199406857 learned_addr learned my addr 172.21.15.5:0/2199406857 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd0159a700 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644ceb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd0259c700 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 0x559644cf2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd01d9b700 1 -- 172.21.15.5:0/2199406857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 msgr2=0x559644cf2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 0x559644cf2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd01d9b700 1 -- 172.21.15.5:0/2199406857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 msgr2=0x559644ceb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644ceb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd01d9b700 1 -- 172.21.15.5:0/2199406857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559644a63d80 con 0x559644cea2d0 2023-10-07T00:21:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.046+0000 7fcd0159a700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcce80a1480 0x7fcce80a3940 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fccec006010 tx=0x7fccec004160 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.047+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cea6f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fccf800bd70 tx=0x7fccf80106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fbd527bedf1aad4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.047+0000 7fcce7fff700 1 -- 172.21.15.5:0/2199406857 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8010db0 con 0x559644cea2d0 2023-10-07T00:21:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.047+0000 7fcce7fff700 1 -- 172.21.15.5:0/2199406857 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccf8015070 con 0x559644cea2d0 2023-10-07T00:21:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.047+0000 7fcce7fff700 1 -- 172.21.15.5:0/2199406857 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80116a0 con 0x559644cea2d0 2023-10-07T00:21:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2199406857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 msgr2=0x559644cea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cea6f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fccf800bd70 tx=0x7fccf80106b0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2199406857 shutdown_connections 2023-10-07T00:21:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 0x559644cf2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cea6f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2199406857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644ceb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2199406857 >> 172.21.15.5:0/2199406857 conn(0x559644c5a200 msgr2=0x559644ce0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2199406857 shutdown_connections 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2199406857 wait complete. 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.048+0000 7fcd178c4b80 1 -- start start 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.049+0000 7fcd178c4b80 1 Processor -- start 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cea2d0 0x559644cf3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644ceb3e0 0x559644cf44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 0x559644cfb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644c38dd0 con 0x559644cea2d0 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644bd56b0 con 0x559644cebda0 2023-10-07T00:21:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644bd5350 con 0x559644ceb3e0 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd178c4b80 10 client.0 _ll_register_callbacks cb 0x559644a327a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd01d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cea2d0 0x559644cf3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd01d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cea2d0 0x559644cf3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45914/0 (socket says 172.21.15.5:45914) 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd01d9b700 1 -- 172.21.15.5:0/2327308441 learned_addr learned my addr 172.21.15.5:0/2327308441 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd0259c700 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 0x559644cfb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd0159a700 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644ceb3e0 0x559644cf44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd01d9b700 1 -- 172.21.15.5:0/2327308441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644ceb3e0 msgr2=0x559644cf44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644ceb3e0 0x559644cf44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd01d9b700 1 -- 172.21.15.5:0/2327308441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 msgr2=0x559644cfb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 0x559644cfb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.050+0000 7fcd01d9b700 1 -- 172.21.15.5:0/2327308441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf800b9a0 con 0x559644cea2d0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.051+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cea2d0 0x559644cf3f90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fccf80059d0 tx=0x7fccf8010e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8603d572b389e2c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.051+0000 7fcce57fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.051+0000 7fcce57fa700 1 -- 172.21.15.5:0/2327308441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf801c890 con 0x559644cea2d0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.051+0000 7fcce57fa700 1 -- 172.21.15.5:0/2327308441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fccf8017070 con 0x559644cea2d0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.051+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2327308441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559644cd8d50 con 0x559644cea2d0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.051+0000 7fcce57fa700 1 -- 172.21.15.5:0/2327308441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccf8004030 con 0x559644cea2d0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.051+0000 7fcd178c4b80 10 client.16701 fetch_fsmap learned FSMap version 44 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.051+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2327308441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x559644a4cc00 con 0x559644cea2d0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcce57fa700 1 -- 172.21.15.5:0/2327308441 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559644cd8d50 con 0x559644cea2d0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcce57fa700 1 -- 172.21.15.5:0/2327308441 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fccf802f020 con 0x559644cea2d0 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcd178c4b80 10 client.16701 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:21:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcd178c4b80 10 client.16701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcd178c4b80 20 client.16701 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559644cffde0 0x559644d02200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcd178c4b80 4 client.16701 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:21:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2327308441 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559644c31db0 con 0x559644cffde0 2023-10-07T00:21:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.052+0000 7fcd0159a700 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559644cffde0 0x559644d02200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.053+0000 7fcd0159a700 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559644cffde0 0x559644d02200 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4d54ea68ceb4a05 server_cookie=c99ed99c91495c0a in_seq=0 out_seq=0 2023-10-07T00:21:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.053+0000 7fcce57fa700 10 client.16701 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcce57fa700 1 -- 172.21.15.5:0/2327308441 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559644c31db0 con 0x559644cffde0 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcce57fa700 10 client.16701 handle_command_reply: tid=0 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 client.16701 shutdown 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2327308441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cea2d0 msgr2=0x559644cf3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cea2d0 0x559644cf3f90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fccf80059d0 tx=0x7fccf8010e60 comp rx=0 tx=0).stop 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2327308441 shutdown_connections 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559644cffde0 0x559644d02200 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cebda0 0x559644cfb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cea2d0 0x559644cf3f90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcce57fa700 0 client.16701 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2327308441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644ceb3e0 0x559644cf44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2327308441 >> 172.21.15.5:0/2327308441 conn(0x559644c5a200 msgr2=0x559644ce0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2327308441 shutdown_connections 2023-10-07T00:21:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2327308441 wait complete. 2023-10-07T00:21:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.054+0000 7fcd178c4b80 20 client.16701 trim_cache size 0 max 16384 2023-10-07T00:21:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd178c4b80 1 Processor -- start 2023-10-07T00:21:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd178c4b80 1 -- start start 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cea2d0 0x559644cf2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644cfb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cebda0 0x559644cf2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644ab98c0 con 0x559644ceb3e0 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644cf1f40 con 0x559644cea2d0 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644cef830 con 0x559644cebda0 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd0159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644cfb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd0159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644cfb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45924/0 (socket says 172.21.15.5:45924) 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd0159a700 1 -- 172.21.15.5:0/1928042676 learned_addr learned my addr 172.21.15.5:0/1928042676 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.070+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cea2d0 0x559644cf2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fcd0259c700 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cebda0 0x559644cf2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fcd0159a700 1 -- 172.21.15.5:0/1928042676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cebda0 msgr2=0x559644cf2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fcd0159a700 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cebda0 0x559644cf2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fcd0159a700 1 -- 172.21.15.5:0/1928042676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cea2d0 msgr2=0x559644cf2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fcd0159a700 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cea2d0 0x559644cf2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fcd0159a700 1 -- 172.21.15.5:0/1928042676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559644a8a1f0 con 0x559644ceb3e0 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fcd0259c700 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cebda0 0x559644cf2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fcd0159a700 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644cfb4d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fccec003f60 tx=0x7fccec022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19258e6f7cf4f3b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fccf0ff9700 1 -- 172.21.15.5:0/1928042676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec004000 con 0x559644ceb3e0 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fccf0ff9700 1 -- 172.21.15.5:0/1928042676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccec01e040 con 0x559644ceb3e0 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.071+0000 7fccf0ff9700 1 -- 172.21.15.5:0/1928042676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00b910 con 0x559644ceb3e0 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 -- 172.21.15.5:0/1928042676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 msgr2=0x559644cfb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644cfb4d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fccec003f60 tx=0x7fccec022000 comp rx=0 tx=0).stop 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 -- 172.21.15.5:0/1928042676 shutdown_connections 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cebda0 0x559644cf2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644cea2d0 0x559644cf2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/1928042676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644ceb3e0 0x559644cfb4d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 -- 172.21.15.5:0/1928042676 >> 172.21.15.5:0/1928042676 conn(0x559644c5a200 msgr2=0x559644d06b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 -- 172.21.15.5:0/1928042676 shutdown_connections 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 -- 172.21.15.5:0/1928042676 wait complete. 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.072+0000 7fcd178c4b80 1 -- start start 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd178c4b80 1 Processor -- start 2023-10-07T00:21:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cf9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644ceb3e0 0x559644cf9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd178c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cebda0 0x559644cfa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644cfaae0 con 0x559644cebda0 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644cfac50 con 0x559644ceb3e0 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd178c4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x559644cfae10 con 0x559644cea2d0 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd178c4b80 10 client.0 _ll_register_callbacks cb 0x7fccec004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cebda0 0x559644cfa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd01d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cf9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cebda0 0x559644cfa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45938/0 (socket says 172.21.15.5:45938) 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.073+0000 7fcd0259c700 1 -- 172.21.15.5:0/2443703447 learned_addr learned my addr 172.21.15.5:0/2443703447 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd0159a700 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644ceb3e0 0x559644cf9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd0259c700 1 -- 172.21.15.5:0/2443703447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 msgr2=0x559644cf9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd0259c700 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cf9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd0259c700 1 -- 172.21.15.5:0/2443703447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644ceb3e0 msgr2=0x559644cf9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd0259c700 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644ceb3e0 0x559644cf9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd0259c700 1 -- 172.21.15.5:0/2443703447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc109c70 con 0x559644cebda0 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd0259c700 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cebda0 0x559644cfa5a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fccf400ef00 tx=0x7fccf409a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a56779adc354da9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcce57fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcce57fa700 1 -- 172.21.15.5:0/2443703447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf409a280 con 0x559644cebda0 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2443703447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fccf8015070 con 0x559644cebda0 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcce57fa700 1 -- 172.21.15.5:0/2443703447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fccf4099b80 con 0x559644cebda0 2023-10-07T00:21:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcce57fa700 1 -- 172.21.15.5:0/2443703447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccf409dcd0 con 0x559644cebda0 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd178c4b80 10 client.16707 fetch_fsmap learned FSMap version 44 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.074+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2443703447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x559644a62250 con 0x559644cebda0 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcce57fa700 1 -- 172.21.15.5:0/2443703447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccf4065030 con 0x559644cebda0 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcce57fa700 1 -- 172.21.15.5:0/2443703447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fccf40b2270 con 0x559644cebda0 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcd178c4b80 10 client.16707 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcd178c4b80 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcd178c4b80 20 client.16707 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559644d54a00 0x559644d56e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcd178c4b80 4 client.16707 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2443703447 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559644c31ad0 con 0x559644d54a00 2023-10-07T00:21:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.075+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559644d54a00 0x559644d56e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.076+0000 7fcd01d9b700 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559644d54a00 0x559644d56e20 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae54cfefcaf0b8a server_cookie=dca9f0773f301be1 in_seq=0 out_seq=0 2023-10-07T00:21:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.076+0000 7fcce57fa700 10 client.16707 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcce57fa700 1 -- 172.21.15.5:0/2443703447 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559644c31ad0 con 0x559644d54a00 2023-10-07T00:21:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcce57fa700 10 client.16707 handle_command_reply: tid=0 2023-10-07T00:21:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 client.16707 shutdown 2023-10-07T00:21:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2443703447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cebda0 msgr2=0x559644cfa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cebda0 0x559644cfa5a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fccf400ef00 tx=0x7fccf409a0c0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2443703447 shutdown_connections 2023-10-07T00:21:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x559644d54a00 0x559644d56e20 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559644cebda0 0x559644cfa5a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559644cea2d0 0x559644cf9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 --2- 172.21.15.5:0/2443703447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559644ceb3e0 0x559644cf9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2443703447 >> 172.21.15.5:0/2443703447 conn(0x559644c5a200 msgr2=0x559644cf2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcce57fa700 0 client.16707 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.082+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2443703447 shutdown_connections 2023-10-07T00:21:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd178c4b80 1 -- 172.21.15.5:0/2443703447 wait complete. 2023-10-07T00:21:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd178c4b80 20 client.16707 trim_cache size 0 max 16384 2023-10-07T00:21:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:21:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:21:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:21:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:21:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 -- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcce80a1480 msgr2=0x7fcce80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcce80a1480 0x7fcce80a3940 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fccec006010 tx=0x7fccec004160 comp rx=0 tx=0).stop 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 -- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102a20 msgr2=0x7fccfc19e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102a20 0x7fccfc19e0f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fccf400ef30 tx=0x7fccf400c3a0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 -- 172.21.15.5:0/4080523051 shutdown_connections 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fcce80a1480 0x7fcce80a3940 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccfc102a20 0x7fccfc19e0f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccfc100f10 0x7fccfc196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 --2- 172.21.15.5:0/4080523051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccfc102060 0x7fccfc197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.083+0000 7fcd03fff700 1 -- 172.21.15.5:0/4080523051 >> 172.21.15.5:0/4080523051 conn(0x7fccfc0fc480 msgr2=0x7fccfc105680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.084+0000 7fcd03fff700 1 -- 172.21.15.5:0/4080523051 shutdown_connections 2023-10-07T00:21:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:02.084+0000 7fcd03fff700 1 -- 172.21.15.5:0/4080523051 wait complete. 2023-10-07T00:21:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:02 smithi088 ceph-mon[103111]: pgmap v594: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 20 op/s 2023-10-07T00:21:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:02 smithi112 ceph-mon[133548]: pgmap v594: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 20 op/s 2023-10-07T00:21:03.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:02 smithi005 ceph-mon[129406]: pgmap v594: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 20 op/s 2023-10-07T00:21:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:04 smithi088 ceph-mon[103111]: pgmap v595: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 KiB/s wr, 18 op/s 2023-10-07T00:21:05.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:04 smithi112 ceph-mon[133548]: pgmap v595: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 KiB/s wr, 18 op/s 2023-10-07T00:21:05.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:04 smithi005 ceph-mon[129406]: pgmap v595: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 KiB/s wr, 18 op/s 2023-10-07T00:21:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:06 smithi088 ceph-mon[103111]: pgmap v596: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:06 smithi112 ceph-mon[133548]: pgmap v596: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:07.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:06 smithi005 ceph-mon[129406]: pgmap v596: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:08 smithi088 ceph-mon[103111]: pgmap v597: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 15 op/s 2023-10-07T00:21:09.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:08 smithi112 ceph-mon[133548]: pgmap v597: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 15 op/s 2023-10-07T00:21:09.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:08 smithi005 ceph-mon[129406]: pgmap v597: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 15 op/s 2023-10-07T00:21:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:10 smithi088 ceph-mon[103111]: pgmap v598: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 16 op/s 2023-10-07T00:21:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:10 smithi112 ceph-mon[133548]: pgmap v598: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 16 op/s 2023-10-07T00:21:11.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:10 smithi005 ceph-mon[129406]: pgmap v598: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 16 op/s 2023-10-07T00:21:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:12 smithi088 ceph-mon[103111]: pgmap v599: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2023-10-07T00:21:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:12 smithi112 ceph-mon[133548]: pgmap v599: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2023-10-07T00:21:13.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:12 smithi005 ceph-mon[129406]: pgmap v599: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2023-10-07T00:21:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:14 smithi088 ceph-mon[103111]: pgmap v600: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 14 op/s 2023-10-07T00:21:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.244+0000 7f70e69ff700 1 -- 172.21.15.5:0/467654857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 msgr2=0x7f70e0109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.244+0000 7f70e69ff700 1 --2- 172.21.15.5:0/467654857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 0x7f70e0109370 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b0a0 tx=0x7f70d800b3b0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.244+0000 7f70e69ff700 1 -- 172.21.15.5:0/467654857 shutdown_connections 2023-10-07T00:21:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.244+0000 7f70e69ff700 1 --2- 172.21.15.5:0/467654857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 0x7f70e0109370 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.244+0000 7f70e69ff700 1 --2- 172.21.15.5:0/467654857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e0100eb0 0x7f70e01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.244+0000 7f70e69ff700 1 --2- 172.21.15.5:0/467654857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e0102090 0x7f70e0102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.244+0000 7f70e69ff700 1 -- 172.21.15.5:0/467654857 >> 172.21.15.5:0/467654857 conn(0x7f70e00fc470 msgr2=0x7f70e00fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.244+0000 7f70e69ff700 1 -- 172.21.15.5:0/467654857 shutdown_connections 2023-10-07T00:21:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.245+0000 7f70e69ff700 1 -- 172.21.15.5:0/467654857 wait complete. 2023-10-07T00:21:15.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:14 smithi112 ceph-mon[133548]: pgmap v600: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 14 op/s 2023-10-07T00:21:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e69ff700 1 Processor -- start 2023-10-07T00:21:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e69ff700 1 -- start start 2023-10-07T00:21:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e69ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e0100eb0 0x7f70e0198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e69ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e0102090 0x7f70e0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e69ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 0x7f70e01a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e69ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e01a0950 con 0x7f70e0102a50 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e69ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e01a0a90 con 0x7f70e0100eb0 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e69ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e01a0c20 con 0x7f70e0102090 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e4f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 0x7f70e01a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e4f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 0x7f70e01a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34092/0 (socket says 172.21.15.5:34092) 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e0102090 0x7f70e0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.246+0000 7f70e4f9c700 1 -- 172.21.15.5:0/689519818 learned_addr learned my addr 172.21.15.5:0/689519818 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70dffff700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e0100eb0 0x7f70e0198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70e4f9c700 1 -- 172.21.15.5:0/689519818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e0102090 msgr2=0x7f70e0199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70e4f9c700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e0102090 0x7f70e0199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70e4f9c700 1 -- 172.21.15.5:0/689519818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e0100eb0 msgr2=0x7f70e0198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70e4f9c700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e0100eb0 0x7f70e0198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70e4f9c700 1 -- 172.21.15.5:0/689519818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8009d00 con 0x7f70e0102a50 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70e4f9c700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 0x7f70e01a0380 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b780 tx=0x7f70d800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70dd7fa700 1 -- 172.21.15.5:0/689519818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800e040 con 0x7f70e0102a50 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70dd7fa700 1 -- 172.21.15.5:0/689519818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70d8004e60 con 0x7f70e0102a50 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70dd7fa700 1 -- 172.21.15.5:0/689519818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80052a0 con 0x7f70e0102a50 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.247+0000 7f70e69ff700 1 -- 172.21.15.5:0/689519818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e01a0ea0 con 0x7f70e0102a50 2023-10-07T00:21:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.248+0000 7f70e69ff700 1 -- 172.21.15.5:0/689519818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e01a1270 con 0x7f70e0102a50 2023-10-07T00:21:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.251+0000 7f70dd7fa700 1 -- 172.21.15.5:0/689519818 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f70d801d470 con 0x7f70e0102a50 2023-10-07T00:21:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.252+0000 7f70fa317b80 1 Processor -- start 2023-10-07T00:21:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.252+0000 7f70fa317b80 1 -- start start 2023-10-07T00:21:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.252+0000 7f70dd7fa700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70c80a1500 0x7f70c80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.252+0000 7f70dd7fa700 1 -- 172.21.15.5:0/689519818 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f70d80ce300 con 0x7f70e0102a50 2023-10-07T00:21:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.252+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 0x55e8930c6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c6990 0x55e8930cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70fa317b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89302d400 con 0x55e8930c6990 2023-10-07T00:21:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70fa317b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89301ebc0 con 0x55e8930c5fd0 2023-10-07T00:21:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70fa317b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89301c4e0 con 0x55e8930c4ec0 2023-10-07T00:21:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70df7fe700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70c80a1500 0x7f70c80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70dffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70e4f9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c6990 0x55e8930cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70dffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:56444/0 (socket says 172.21.15.5:56444) 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70dffff700 1 -- 172.21.15.5:0/2008208359 learned_addr learned my addr 172.21.15.5:0/2008208359 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70df7fe700 1 --2- 172.21.15.5:0/2008208359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 0x55e8930c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70dffff700 1 -- 172.21.15.5:0/2008208359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 msgr2=0x55e8930c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70dffff700 1 --2- 172.21.15.5:0/2008208359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 0x55e8930c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70dffff700 1 -- 172.21.15.5:0/2008208359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c6990 msgr2=0x55e8930cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70dffff700 1 --2- 172.21.15.5:0/2008208359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c6990 0x55e8930cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.253+0000 7f70dffff700 1 -- 172.21.15.5:0/2008208359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e892e42d80 con 0x55e8930c4ec0 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.254+0000 7f70df7fe700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70c80a1500 0x7f70c80a39c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f70e0100bd0 tx=0x7f70d4013840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.254+0000 7f70dffff700 1 --2- 172.21.15.5:0/2008208359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930c52e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f70d000bcc0 tx=0x7f70d000f360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1278350b59e48c6c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.254+0000 7f70c67fc700 1 -- 172.21.15.5:0/2008208359 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d000fb50 con 0x55e8930c4ec0 2023-10-07T00:21:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.254+0000 7f70c67fc700 1 -- 172.21.15.5:0/2008208359 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70d000fcb0 con 0x55e8930c4ec0 2023-10-07T00:21:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.254+0000 7f70c67fc700 1 -- 172.21.15.5:0/2008208359 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00116a0 con 0x55e8930c4ec0 2023-10-07T00:21:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 -- 172.21.15.5:0/2008208359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 msgr2=0x55e8930c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 --2- 172.21.15.5:0/2008208359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930c52e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f70d000bcc0 tx=0x7f70d000f360 comp rx=0 tx=0).stop 2023-10-07T00:21:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 -- 172.21.15.5:0/2008208359 shutdown_connections 2023-10-07T00:21:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 --2- 172.21.15.5:0/2008208359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c6990 0x55e8930cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 --2- 172.21.15.5:0/2008208359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930c52e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 --2- 172.21.15.5:0/2008208359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 0x55e8930c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 -- 172.21.15.5:0/2008208359 >> 172.21.15.5:0/2008208359 conn(0x55e893039200 msgr2=0x55e8930bfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 -- 172.21.15.5:0/2008208359 shutdown_connections 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 -- 172.21.15.5:0/2008208359 wait complete. 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.255+0000 7f70fa317b80 1 -- start start 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.256+0000 7f70fa317b80 1 Processor -- start 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.256+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c4ec0 0x55e8930ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.256+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 0x55e8930cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.256+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c6990 0x55e8930d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.256+0000 7f70fa317b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e893017dd0 con 0x55e8930c4ec0 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.256+0000 7f70fa317b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892fb46b0 con 0x55e8930c5fd0 2023-10-07T00:21:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.256+0000 7f70fa317b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892fb4350 con 0x55e8930c6990 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.256+0000 7f70fa317b80 10 client.0 _ll_register_callbacks cb 0x55e892e117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c4ec0 0x55e8930ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c4ec0 0x55e8930ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34096/0 (socket says 172.21.15.5:34096) 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 -- 172.21.15.5:0/3967941400 learned_addr learned my addr 172.21.15.5:0/3967941400 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 0x55e8930cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70e4f9c700 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c6990 0x55e8930d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 -- 172.21.15.5:0/3967941400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c6990 msgr2=0x55e8930d60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c6990 0x55e8930d60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 -- 172.21.15.5:0/3967941400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 msgr2=0x55e8930cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 0x55e8930cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 -- 172.21.15.5:0/3967941400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d000b920 con 0x55e8930c4ec0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70dffff700 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c4ec0 0x55e8930ceb70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f70d0006010 tx=0x7f70d000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5567de0956a66973 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.257+0000 7f70bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.258+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3967941400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0020070 con 0x55e8930c4ec0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.258+0000 7f70fa317b80 1 -- 172.21.15.5:0/3967941400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8930b7d50 con 0x55e8930c4ec0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.258+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3967941400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f70d001a460 con 0x55e8930c4ec0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.258+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3967941400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d001a620 con 0x55e8930c4ec0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.258+0000 7f70fa317b80 10 client.16719 fetch_fsmap learned FSMap version 44 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.258+0000 7f70fa317b80 1 -- 172.21.15.5:0/3967941400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55e892e2bc00 con 0x55e8930c4ec0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.258+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3967941400 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70d0034080 con 0x55e8930c4ec0 2023-10-07T00:21:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.258+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3967941400 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f70d002e030 con 0x55e8930c4ec0 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.259+0000 7f70fa317b80 10 client.16719 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.259+0000 7f70fa317b80 10 client.16719 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.259+0000 7f70fa317b80 20 client.16719 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.259+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8930da8d0 0x55e8930dccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.259+0000 7f70fa317b80 4 client.16719 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.259+0000 7f70fa317b80 1 -- 172.21.15.5:0/3967941400 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e893010db0 con 0x55e8930da8d0 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.259+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8930da8d0 0x55e8930dccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.260+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8930da8d0 0x55e8930dccf0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f6a0f925acb6b6 server_cookie=f95c18cfb5556e0b in_seq=0 out_seq=0 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.260+0000 7f70bf7fe700 10 client.16719 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.260+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3967941400 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e893010db0 con 0x55e8930da8d0 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.260+0000 7f70bf7fe700 10 client.16719 handle_command_reply: tid=0 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 client.16719 shutdown 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 -- 172.21.15.5:0/3967941400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c4ec0 msgr2=0x55e8930ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c4ec0 0x55e8930ceb70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f70d0006010 tx=0x7f70d000b8b0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 -- 172.21.15.5:0/3967941400 shutdown_connections 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e8930da8d0 0x55e8930dccf0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c6990 0x55e8930d60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c4ec0 0x55e8930ceb70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3967941400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c5fd0 0x55e8930cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 -- 172.21.15.5:0/3967941400 >> 172.21.15.5:0/3967941400 conn(0x55e893039200 msgr2=0x55e8930bf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70bf7fe700 0 client.16719 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 -- 172.21.15.5:0/3967941400 shutdown_connections 2023-10-07T00:21:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 1 -- 172.21.15.5:0/3967941400 wait complete. 2023-10-07T00:21:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.261+0000 7f70fa317b80 20 client.16719 trim_cache size 0 max 16384 2023-10-07T00:21:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.276+0000 7f70fa317b80 1 Processor -- start 2023-10-07T00:21:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70fa317b80 1 -- start start 2023-10-07T00:21:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 0x55e8930ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70fa317b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892e988c0 con 0x55e8930c5fd0 2023-10-07T00:21:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70fa317b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8930c9450 con 0x55e8930c6990 2023-10-07T00:21:15.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70fa317b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8930c16a0 con 0x55e8930c4ec0 2023-10-07T00:21:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34100/0 (socket says 172.21.15.5:34100) 2023-10-07T00:21:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70df7fe700 1 -- 172.21.15.5:0/3717713504 learned_addr learned my addr 172.21.15.5:0/3717713504 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70dffff700 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.277+0000 7f70e4f9c700 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 0x55e8930ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70df7fe700 1 -- 172.21.15.5:0/3717713504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 msgr2=0x55e8930cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70df7fe700 1 -- 172.21.15.5:0/3717713504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 msgr2=0x55e8930ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 0x55e8930ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70df7fe700 1 -- 172.21.15.5:0/3717713504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e892e691f0 con 0x55e8930c5fd0 2023-10-07T00:21:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d60b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009b90 tx=0x7f70d401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66aab29a06be2012 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70c6ffd700 1 -- 172.21.15.5:0/3717713504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40271e0 con 0x55e8930c5fd0 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70c6ffd700 1 -- 172.21.15.5:0/3717713504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70d4014e90 con 0x55e8930c5fd0 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.278+0000 7f70c6ffd700 1 -- 172.21.15.5:0/3717713504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4021410 con 0x55e8930c5fd0 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 -- 172.21.15.5:0/3717713504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 msgr2=0x55e8930d60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d60b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009b90 tx=0x7f70d401f000 comp rx=0 tx=0).stop 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 -- 172.21.15.5:0/3717713504 shutdown_connections 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 0x55e8930ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3717713504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d60b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 -- 172.21.15.5:0/3717713504 >> 172.21.15.5:0/3717713504 conn(0x55e893039200 msgr2=0x55e8930e1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 -- 172.21.15.5:0/3717713504 shutdown_connections 2023-10-07T00:21:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 -- 172.21.15.5:0/3717713504 wait complete. 2023-10-07T00:21:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 -- start start 2023-10-07T00:21:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.279+0000 7f70fa317b80 1 Processor -- start 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930d3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70fa317b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 0x55e8930d5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70fa317b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8930d58a0 con 0x55e8930c5fd0 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70fa317b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8930d5a10 con 0x55e8930c6990 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70fa317b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8930d5bd0 con 0x55e8930c4ec0 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70fa317b80 10 client.0 _ll_register_callbacks cb 0x55e892e117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34102/0 (socket says 172.21.15.5:34102) 2023-10-07T00:21:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70df7fe700 1 -- 172.21.15.5:0/3617792949 learned_addr learned my addr 172.21.15.5:0/3617792949 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70e4f9c700 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 0x55e8930d5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70dffff700 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930d3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.280+0000 7f70df7fe700 1 -- 172.21.15.5:0/3617792949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 msgr2=0x55e8930d3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930d3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70df7fe700 1 -- 172.21.15.5:0/3617792949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 msgr2=0x55e8930d5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 0x55e8930d5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70df7fe700 1 -- 172.21.15.5:0/3617792949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d40277a0 con 0x55e8930c5fd0 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70dffff700 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930d3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70df7fe700 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d4350 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f70d4028fd0 tx=0x7f70d4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57da6b45aa0934f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:21:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3617792949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40106c0 con 0x55e8930c5fd0 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70fa317b80 1 -- 172.21.15.5:0/3617792949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70d000fcb0 con 0x55e8930c5fd0 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3617792949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f70d4010820 con 0x55e8930c5fd0 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3617792949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d40271e0 con 0x55e8930c5fd0 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70fa317b80 10 client.16725 fetch_fsmap learned FSMap version 44 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.281+0000 7f70fa317b80 1 -- 172.21.15.5:0/3617792949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55e892e41250 con 0x55e8930c5fd0 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3617792949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70d4041080 con 0x55e8930c5fd0 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3617792949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f70d403b030 con 0x55e8930c5fd0 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70fa317b80 10 client.16725 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70fa317b80 10 client.16725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70fa317b80 20 client.16725 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e89312f720 0x55e893131ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70fa317b80 4 client.16725 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:21:15.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70fa317b80 1 -- 172.21.15.5:0/3617792949 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e893010ad0 con 0x55e89312f720 2023-10-07T00:21:15.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.282+0000 7f70dffff700 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e89312f720 0x55e893131ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:15.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.283+0000 7f70dffff700 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e89312f720 0x55e893131ba0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5338f61c3495f63 server_cookie=4cc9e3fe8208786e in_seq=0 out_seq=0 2023-10-07T00:21:15.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.283+0000 7f70bf7fe700 10 client.16725 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70bf7fe700 1 -- 172.21.15.5:0/3617792949 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e893010ad0 con 0x55e89312f720 2023-10-07T00:21:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70bf7fe700 10 client.16725 handle_command_reply: tid=0 2023-10-07T00:21:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 client.16725 shutdown 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 -- 172.21.15.5:0/3617792949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 msgr2=0x55e8930d4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d4350 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f70d4028fd0 tx=0x7f70d4010c20 comp rx=0 tx=0).stop 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 -- 172.21.15.5:0/3617792949 shutdown_connections 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55e89312f720 0x55e893131ba0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e8930c6990 0x55e8930d5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8930c4ec0 0x55e8930d3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70bf7fe700 0 client.16725 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 --2- 172.21.15.5:0/3617792949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e8930c5fd0 0x55e8930d4350 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 -- 172.21.15.5:0/3617792949 >> 172.21.15.5:0/3617792949 conn(0x55e893039200 msgr2=0x55e8930ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 -- 172.21.15.5:0/3617792949 shutdown_connections 2023-10-07T00:21:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 1 -- 172.21.15.5:0/3617792949 wait complete. 2023-10-07T00:21:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.294+0000 7f70fa317b80 20 client.16725 trim_cache size 0 max 16384 2023-10-07T00:21:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:21:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:21:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:21:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:21:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 -- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70c80a1500 msgr2=0x7f70c80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70c80a1500 0x7f70c80a39c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f70e0100bd0 tx=0x7f70d4013840 comp rx=0 tx=0).stop 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 -- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 msgr2=0x7f70e01a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 0x7f70e01a0380 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b780 tx=0x7f70d800bd40 comp rx=0 tx=0).stop 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 -- 172.21.15.5:0/689519818 shutdown_connections 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f70c80a1500 0x7f70c80a39c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e0102a50 0x7f70e01a0380 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e0100eb0 0x7f70e0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 --2- 172.21.15.5:0/689519818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e0102090 0x7f70e0199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 -- 172.21.15.5:0/689519818 >> 172.21.15.5:0/689519818 conn(0x7f70e00fc470 msgr2=0x7f70e0107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 -- 172.21.15.5:0/689519818 shutdown_connections 2023-10-07T00:21:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:15.295+0000 7f70e69ff700 1 -- 172.21.15.5:0/689519818 wait complete. 2023-10-07T00:21:15.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:14 smithi005 ceph-mon[129406]: pgmap v600: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 14 op/s 2023-10-07T00:21:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:16 smithi088 ceph-mon[103111]: pgmap v601: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-10-07T00:21:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:16 smithi112 ceph-mon[133548]: pgmap v601: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-10-07T00:21:17.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:16 smithi005 ceph-mon[129406]: pgmap v601: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-10-07T00:21:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:18 smithi088 ceph-mon[103111]: pgmap v602: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 14 op/s 2023-10-07T00:21:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:18 smithi112 ceph-mon[133548]: pgmap v602: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 14 op/s 2023-10-07T00:21:19.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:18 smithi005 ceph-mon[129406]: pgmap v602: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 14 op/s 2023-10-07T00:21:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:20 smithi088 ceph-mon[103111]: pgmap v603: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 16 op/s 2023-10-07T00:21:21.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:20 smithi112 ceph-mon[133548]: pgmap v603: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 16 op/s 2023-10-07T00:21:21.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:20 smithi005 ceph-mon[129406]: pgmap v603: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 16 op/s 2023-10-07T00:21:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:22 smithi088 ceph-mon[103111]: pgmap v604: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-10-07T00:21:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:22 smithi112 ceph-mon[133548]: pgmap v604: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-10-07T00:21:23.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:22 smithi005 ceph-mon[129406]: pgmap v604: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-10-07T00:21:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:24 smithi088 ceph-mon[103111]: pgmap v605: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 17 op/s 2023-10-07T00:21:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:24 smithi112 ceph-mon[133548]: pgmap v605: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 17 op/s 2023-10-07T00:21:25.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:24 smithi005 ceph-mon[129406]: pgmap v605: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 17 op/s 2023-10-07T00:21:26.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:25 smithi005 ceph-mon[129406]: pgmap v606: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:21:26.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:25 smithi088 ceph-mon[103111]: pgmap v606: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:21:26.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:25 smithi112 ceph-mon[133548]: pgmap v606: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 -- 172.21.15.5:0/9534138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 msgr2=0x7f335c103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 --2- 172.21.15.5:0/9534138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 0x7f335c103530 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f334c0099c0 tx=0x7f334c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 -- 172.21.15.5:0/9534138 shutdown_connections 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 --2- 172.21.15.5:0/9534138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c104ca0 0x7f335c10b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 --2- 172.21.15.5:0/9534138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 0x7f335c103530 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 --2- 172.21.15.5:0/9534138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c104300 0x7f335c104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 -- 172.21.15.5:0/9534138 >> 172.21.15.5:0/9534138 conn(0x7f335c0fe6a0 msgr2=0x7f335c100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 -- 172.21.15.5:0/9534138 shutdown_connections 2023-10-07T00:21:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.455+0000 7f33615ff700 1 -- 172.21.15.5:0/9534138 wait complete. 2023-10-07T00:21:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.456+0000 7f33615ff700 1 Processor -- start 2023-10-07T00:21:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.456+0000 7f33615ff700 1 -- start start 2023-10-07T00:21:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f33615ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 0x7f335c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f33615ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c104300 0x7f335c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f33615ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c104ca0 0x7f335c1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f33615ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c1a08d0 con 0x7f335c103110 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f33615ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c1a0a10 con 0x7f335c104300 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f33615ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c1a0ba0 con 0x7f335c104ca0 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 0x7f335c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 0x7f335c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36330/0 (socket says 172.21.15.5:36330) 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335affd700 1 -- 172.21.15.5:0/2224135964 learned_addr learned my addr 172.21.15.5:0/2224135964 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f3353fff700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c104300 0x7f335c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335b7fe700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c104ca0 0x7f335c1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335affd700 1 -- 172.21.15.5:0/2224135964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c104ca0 msgr2=0x7f335c1a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335affd700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c104ca0 0x7f335c1a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335affd700 1 -- 172.21.15.5:0/2224135964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c104300 msgr2=0x7f335c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335affd700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c104300 0x7f335c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.457+0000 7f335affd700 1 -- 172.21.15.5:0/2224135964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0095f0 con 0x7f335c103110 2023-10-07T00:21:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.458+0000 7f335affd700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 0x7f335c198d50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f334c009f50 tx=0x7f334c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.458+0000 7f3358ff9700 1 -- 172.21.15.5:0/2224135964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c01d070 con 0x7f335c103110 2023-10-07T00:21:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.458+0000 7f33615ff700 1 -- 172.21.15.5:0/2224135964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c1a0e20 con 0x7f335c103110 2023-10-07T00:21:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.458+0000 7f3358ff9700 1 -- 172.21.15.5:0/2224135964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334c004220 con 0x7f335c103110 2023-10-07T00:21:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.458+0000 7f3358ff9700 1 -- 172.21.15.5:0/2224135964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c022cd0 con 0x7f335c103110 2023-10-07T00:21:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.458+0000 7f33615ff700 1 -- 172.21.15.5:0/2224135964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c1a1190 con 0x7f335c103110 2023-10-07T00:21:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.461+0000 7f3358ff9700 1 -- 172.21.15.5:0/2224135964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f334c022470 con 0x7f335c103110 2023-10-07T00:21:28.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.463+0000 7f3374f89b80 1 Processor -- start 2023-10-07T00:21:28.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3374f89b80 1 -- start start 2023-10-07T00:21:28.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3358ff9700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33480a1480 0x7f33480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9b9ec0 0x55837d9ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bb990 0x55837d9c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3358ff9700 1 -- 172.21.15.5:0/2224135964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f334c0ce1b0 con 0x7f335c103110 2023-10-07T00:21:28.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3374f89b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d922400 con 0x55837d9b9ec0 2023-10-07T00:21:28.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3374f89b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d913bc0 con 0x55837d9bb990 2023-10-07T00:21:28.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f3374f89b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d9114e0 con 0x55837d9bafd0 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f335b7fe700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33480a1480 0x7f33480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f335affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9b9ec0 0x55837d9ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f335affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9b9ec0 0x55837d9ba2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36340/0 (socket says 172.21.15.5:36340) 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.464+0000 7f335affd700 1 -- 172.21.15.5:0/1394289586 learned_addr learned my addr 172.21.15.5:0/1394289586 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f3353fff700 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f335affd700 1 -- 172.21.15.5:0/1394289586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 msgr2=0x55837d9bb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f335affd700 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9bb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f335affd700 1 -- 172.21.15.5:0/1394289586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bb990 msgr2=0x55837d9c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f335affd700 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bb990 0x55837d9c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f335affd700 1 -- 172.21.15.5:0/1394289586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55837d737d80 con 0x55837d9b9ec0 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f3353fff700 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9bb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f335b7fe700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33480a1480 0x7f33480a3940 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3354009910 tx=0x7f3354003aa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f335affd700 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9b9ec0 0x55837d9ba2e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f334c0979e0 tx=0x7f334c0978a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d4acf84dff3d88 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f33517fa700 1 -- 172.21.15.5:0/1394289586 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c09b2b0 con 0x55837d9b9ec0 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f33517fa700 1 -- 172.21.15.5:0/1394289586 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334c09b020 con 0x55837d9b9ec0 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.465+0000 7f33517fa700 1 -- 172.21.15.5:0/1394289586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0a37e0 con 0x55837d9b9ec0 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 -- 172.21.15.5:0/1394289586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9b9ec0 msgr2=0x55837d9ba2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9b9ec0 0x55837d9ba2e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f334c0979e0 tx=0x7f334c0978a0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 -- 172.21.15.5:0/1394289586 shutdown_connections 2023-10-07T00:21:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bb990 0x55837d9c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9b9ec0 0x55837d9ba2e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1394289586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9bb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 -- 172.21.15.5:0/1394289586 >> 172.21.15.5:0/1394289586 conn(0x55837d92e200 msgr2=0x55837d9b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 -- 172.21.15.5:0/1394289586 shutdown_connections 2023-10-07T00:21:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.466+0000 7f3374f89b80 1 -- 172.21.15.5:0/1394289586 wait complete. 2023-10-07T00:21:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.467+0000 7f3374f89b80 1 -- start start 2023-10-07T00:21:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.467+0000 7f3374f89b80 1 Processor -- start 2023-10-07T00:21:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9b9ec0 0x55837d9c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f3374f89b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d90cdd0 con 0x55837d9bb990 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f3374f89b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d8a96b0 con 0x55837d9b9ec0 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f3374f89b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d8a9350 con 0x55837d9bafd0 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f3374f89b80 10 client.0 _ll_register_callbacks cb 0x55837d7067a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f335b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f335affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9b9ec0 0x55837d9c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f335affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9b9ec0 0x55837d9c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:58782/0 (socket says 172.21.15.5:58782) 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f335b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36344/0 (socket says 172.21.15.5:36344) 2023-10-07T00:21:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f335affd700 1 -- 172.21.15.5:0/3427155254 learned_addr learned my addr 172.21.15.5:0/3427155254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.468+0000 7f3353fff700 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f335affd700 1 -- 172.21.15.5:0/3427155254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 msgr2=0x55837d9c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f335affd700 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f335affd700 1 -- 172.21.15.5:0/3427155254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 msgr2=0x55837d9cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f335affd700 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f335affd700 1 -- 172.21.15.5:0/3427155254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c1a1190 con 0x55837d9b9ec0 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f335affd700 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9b9ec0 0x55837d9c3880 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f334c09b1e0 tx=0x7f334c09b520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee00db913cd593a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f33427fc700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f33427fc700 1 -- 172.21.15.5:0/3427155254 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c09b2b0 con 0x55837d9b9ec0 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f3374f89b80 1 -- 172.21.15.5:0/3427155254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55837d9acd50 con 0x55837d9b9ec0 2023-10-07T00:21:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f33427fc700 1 -- 172.21.15.5:0/3427155254 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f334c09bbe0 con 0x55837d9b9ec0 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f33427fc700 1 -- 172.21.15.5:0/3427155254 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f334c0a37e0 con 0x55837d9b9ec0 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f3374f89b80 10 client.26579 fetch_fsmap learned FSMap version 44 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.469+0000 7f3374f89b80 1 -- 172.21.15.5:0/3427155254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55837d720c00 con 0x55837d9b9ec0 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f33427fc700 1 -- 172.21.15.5:0/3427155254 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55837d9acd50 con 0x55837d9b9ec0 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f33427fc700 1 -- 172.21.15.5:0/3427155254 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f334c062070 con 0x55837d9b9ec0 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f3374f89b80 10 client.26579 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f3374f89b80 10 client.26579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f3374f89b80 20 client.26579 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f3374f89b80 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55837d9cf3a0 0x55837d9d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f3374f89b80 4 client.26579 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:21:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f3374f89b80 1 -- 172.21.15.5:0/3427155254 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55837d905db0 con 0x55837d9cf3a0 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.470+0000 7f3353fff700 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55837d9cf3a0 0x55837d9d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.471+0000 7f3353fff700 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55837d9cf3a0 0x55837d9d17c0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f959dbe88f855c9d server_cookie=e2b3b5bb7df53560 in_seq=0 out_seq=0 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.471+0000 7f33427fc700 10 client.26579 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f33427fc700 1 -- 172.21.15.5:0/3427155254 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55837d905db0 con 0x55837d9cf3a0 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f33427fc700 10 client.26579 handle_command_reply: tid=0 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 client.26579 shutdown 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 -- 172.21.15.5:0/3427155254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9b9ec0 msgr2=0x55837d9c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9b9ec0 0x55837d9c3880 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f334c09b1e0 tx=0x7f334c09b520 comp rx=0 tx=0).stop 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 -- 172.21.15.5:0/3427155254 shutdown_connections 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55837d9cf3a0 0x55837d9d17c0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9b9ec0 0x55837d9c3880 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 --2- 172.21.15.5:0/3427155254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9bafd0 0x55837d9c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f33427fc700 0 client.26579 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 -- 172.21.15.5:0/3427155254 >> 172.21.15.5:0/3427155254 conn(0x55837d92e200 msgr2=0x55837d9b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 -- 172.21.15.5:0/3427155254 shutdown_connections 2023-10-07T00:21:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 1 -- 172.21.15.5:0/3427155254 wait complete. 2023-10-07T00:21:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.472+0000 7f3374f89b80 20 client.26579 trim_cache size 0 max 16384 2023-10-07T00:21:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.488+0000 7f3374f89b80 1 Processor -- start 2023-10-07T00:21:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.488+0000 7f3374f89b80 1 -- start start 2023-10-07T00:21:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.488+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.488+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bafd0 0x55837d9cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.488+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9be750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.488+0000 7f3374f89b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d78d8c0 con 0x55837d9bb990 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.488+0000 7f3374f89b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d9c4910 con 0x55837d9bafd0 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.488+0000 7f3374f89b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d9c2d30 con 0x55837d9b9ec0 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9be750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f3353fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bafd0 0x55837d9cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9be750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36350/0 (socket says 172.21.15.5:36350) 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 -- 172.21.15.5:0/4285822231 learned_addr learned my addr 172.21.15.5:0/4285822231 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335affd700 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 -- 172.21.15.5:0/4285822231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 msgr2=0x55837d9cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 -- 172.21.15.5:0/4285822231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bafd0 msgr2=0x55837d9cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bafd0 0x55837d9cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 -- 172.21.15.5:0/4285822231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55837d75e1f0 con 0x55837d9bb990 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f3353fff700 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bafd0 0x55837d9cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.489+0000 7f335b7fe700 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9be750 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3354004920 tx=0x7f3354018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa42f2fb79ea4a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3351ffb700 1 -- 172.21.15.5:0/4285822231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354028070 con 0x55837d9bb990 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3351ffb700 1 -- 172.21.15.5:0/4285822231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3354020040 con 0x55837d9bb990 2023-10-07T00:21:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3351ffb700 1 -- 172.21.15.5:0/4285822231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335401f050 con 0x55837d9bb990 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 -- 172.21.15.5:0/4285822231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 msgr2=0x55837d9be750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9be750 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3354004920 tx=0x7f3354018000 comp rx=0 tx=0).stop 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 -- 172.21.15.5:0/4285822231 shutdown_connections 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bb990 0x55837d9be750 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 --2- 172.21.15.5:0/4285822231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bafd0 0x55837d9cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 -- 172.21.15.5:0/4285822231 >> 172.21.15.5:0/4285822231 conn(0x55837d92e200 msgr2=0x55837d9b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 -- 172.21.15.5:0/4285822231 shutdown_connections 2023-10-07T00:21:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.490+0000 7f3374f89b80 1 -- 172.21.15.5:0/4285822231 wait complete. 2023-10-07T00:21:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.491+0000 7f3374f89b80 1 -- start start 2023-10-07T00:21:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.491+0000 7f3374f89b80 1 Processor -- start 2023-10-07T00:21:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bafd0 0x55837d9c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f3374f89b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bb990 0x55837d9ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f3374f89b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d9ca840 con 0x55837d9bafd0 2023-10-07T00:21:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f3374f89b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d9ca9b0 con 0x55837d9bb990 2023-10-07T00:21:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f3374f89b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837d9cab70 con 0x55837d9b9ec0 2023-10-07T00:21:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f3374f89b80 10 client.0 _ll_register_callbacks cb 0x7f334c00be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f3353fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bafd0 0x55837d9c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f335affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f335affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:34372/0 (socket says 172.21.15.5:34372) 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f335affd700 1 -- 172.21.15.5:0/1509616224 learned_addr learned my addr 172.21.15.5:0/1509616224 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f335affd700 1 -- 172.21.15.5:0/1509616224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bb990 msgr2=0x55837d9ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f335affd700 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bb990 0x55837d9ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f335affd700 1 -- 172.21.15.5:0/1509616224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bafd0 msgr2=0x55837d9c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f335affd700 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bafd0 0x55837d9c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.492+0000 7f335affd700 1 -- 172.21.15.5:0/1509616224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33540045d0 con 0x55837d9b9ec0 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f335affd700 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9c8db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f334c09add0 tx=0x7f334c09af60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99630b390561d25b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f33427fc700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f33427fc700 1 -- 172.21.15.5:0/1509616224 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c09b2b0 con 0x55837d9b9ec0 2023-10-07T00:21:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f3374f89b80 1 -- 172.21.15.5:0/1509616224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f334c09b020 con 0x55837d9b9ec0 2023-10-07T00:21:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f33427fc700 1 -- 172.21.15.5:0/1509616224 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f334c09bbe0 con 0x55837d9b9ec0 2023-10-07T00:21:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f33427fc700 1 -- 172.21.15.5:0/1509616224 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f334c0a37e0 con 0x55837d9b9ec0 2023-10-07T00:21:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f3374f89b80 10 client.26563 fetch_fsmap learned FSMap version 44 2023-10-07T00:21:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f3374f89b80 1 -- 172.21.15.5:0/1509616224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55837d736250 con 0x55837d9b9ec0 2023-10-07T00:21:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.493+0000 7f33427fc700 1 -- 172.21.15.5:0/1509616224 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334c09b020 con 0x55837d9b9ec0 2023-10-07T00:21:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.494+0000 7f33427fc700 1 -- 172.21.15.5:0/1509616224 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f334c062070 con 0x55837d9b9ec0 2023-10-07T00:21:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.494+0000 7f3374f89b80 10 client.26563 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:21:28.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.494+0000 7f3374f89b80 10 client.26563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:28.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.494+0000 7f3374f89b80 20 client.26563 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:28.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.494+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55837da23d90 0x55837da26180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:28.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.494+0000 7f3374f89b80 4 client.26563 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:21:28.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.494+0000 7f3374f89b80 1 -- 172.21.15.5:0/1509616224 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55837d905ad0 con 0x55837da23d90 2023-10-07T00:21:28.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.494+0000 7f3353fff700 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55837da23d90 0x55837da26180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:28.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.495+0000 7f3353fff700 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55837da23d90 0x55837da26180 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2315db1253a6251 server_cookie=1ce7c95f770c7368 in_seq=0 out_seq=0 2023-10-07T00:21:28.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.495+0000 7f33427fc700 10 client.26563 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.506+0000 7f33427fc700 1 -- 172.21.15.5:0/1509616224 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55837d905ad0 con 0x55837da23d90 2023-10-07T00:21:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.506+0000 7f33427fc700 10 client.26563 handle_command_reply: tid=0 2023-10-07T00:21:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.506+0000 7f3374f89b80 1 client.26563 shutdown 2023-10-07T00:21:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.506+0000 7f3374f89b80 1 -- 172.21.15.5:0/1509616224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 msgr2=0x55837d9c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.506+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9c8db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f334c09add0 tx=0x7f334c09af60 comp rx=0 tx=0).stop 2023-10-07T00:21:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 1 -- 172.21.15.5:0/1509616224 shutdown_connections 2023-10-07T00:21:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55837da23d90 0x55837da26180 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55837d9bb990 0x55837d9ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55837d9b9ec0 0x55837d9c8db0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f33427fc700 0 client.26563 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 1 --2- 172.21.15.5:0/1509616224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55837d9bafd0 0x55837d9c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 1 -- 172.21.15.5:0/1509616224 >> 172.21.15.5:0/1509616224 conn(0x55837d92e200 msgr2=0x55837d9cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 1 -- 172.21.15.5:0/1509616224 shutdown_connections 2023-10-07T00:21:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 1 -- 172.21.15.5:0/1509616224 wait complete. 2023-10-07T00:21:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f3374f89b80 20 client.26563 trim_cache size 0 max 16384 2023-10-07T00:21:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:21:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:21:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:21:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:21:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f33615ff700 1 -- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33480a1480 msgr2=0x7f33480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f33615ff700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33480a1480 0x7f33480a3940 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3354009910 tx=0x7f3354003aa0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f33615ff700 1 -- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 msgr2=0x7f335c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.507+0000 7f33615ff700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 0x7f335c198d50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f334c009f50 tx=0x7f334c003a50 comp rx=0 tx=0).stop 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.508+0000 7f33615ff700 1 -- 172.21.15.5:0/2224135964 shutdown_connections 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.508+0000 7f33615ff700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f33480a1480 0x7f33480a3940 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.508+0000 7f33615ff700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c104ca0 0x7f335c1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.508+0000 7f33615ff700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f335c103110 0x7f335c198d50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.508+0000 7f33615ff700 1 --2- 172.21.15.5:0/2224135964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f335c104300 0x7f335c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.508+0000 7f33615ff700 1 -- 172.21.15.5:0/2224135964 >> 172.21.15.5:0/2224135964 conn(0x7f335c0fe6a0 msgr2=0x7f335c1009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.508+0000 7f33615ff700 1 -- 172.21.15.5:0/2224135964 shutdown_connections 2023-10-07T00:21:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:28.508+0000 7f33615ff700 1 -- 172.21.15.5:0/2224135964 wait complete. 2023-10-07T00:21:29.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:28 smithi088 ceph-mon[103111]: pgmap v607: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 16 op/s 2023-10-07T00:21:29.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:28 smithi112 ceph-mon[133548]: pgmap v607: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 16 op/s 2023-10-07T00:21:29.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:28 smithi005 ceph-mon[129406]: pgmap v607: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 16 op/s 2023-10-07T00:21:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:30 smithi088 ceph-mon[103111]: pgmap v608: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-10-07T00:21:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:30 smithi112 ceph-mon[133548]: pgmap v608: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-10-07T00:21:31.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:30 smithi005 ceph-mon[129406]: pgmap v608: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-10-07T00:21:33.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:32 smithi088 ceph-mon[103111]: pgmap v609: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 18 op/s 2023-10-07T00:21:33.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:32 smithi112 ceph-mon[133548]: pgmap v609: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 18 op/s 2023-10-07T00:21:33.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:32 smithi005 ceph-mon[129406]: pgmap v609: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 18 op/s 2023-10-07T00:21:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:34 smithi088 ceph-mon[103111]: pgmap v610: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:21:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:34 smithi112 ceph-mon[133548]: pgmap v610: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:21:35.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:34 smithi005 ceph-mon[129406]: pgmap v610: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:21:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:36 smithi088 ceph-mon[103111]: pgmap v611: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 19 op/s 2023-10-07T00:21:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:36 smithi112 ceph-mon[133548]: pgmap v611: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 19 op/s 2023-10-07T00:21:37.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:36 smithi005 ceph-mon[129406]: pgmap v611: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 19 op/s 2023-10-07T00:21:38.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:37 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:21:38.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:37 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:21:38.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:37 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:21:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:38 smithi088 ceph-mon[103111]: pgmap v612: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:21:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:38 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:21:39.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:38 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:21:39.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:38 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:21:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:38 smithi112 ceph-mon[133548]: pgmap v612: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:21:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:38 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:21:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:38 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:21:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:38 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:21:39.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:38 smithi005 ceph-mon[129406]: pgmap v612: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 17 op/s 2023-10-07T00:21:39.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:38 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:21:39.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:38 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:21:39.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:38 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:21:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:40 smithi088 ceph-mon[103111]: pgmap v613: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:21:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:40 smithi112 ceph-mon[133548]: pgmap v613: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:21:41.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:40 smithi005 ceph-mon[129406]: pgmap v613: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 18 op/s 2023-10-07T00:21:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 -- 172.21.15.5:0/673622601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4073910 msgr2=0x7f01a4073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 --2- 172.21.15.5:0/673622601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4073910 0x7f01a4073d90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0190009990 tx=0x7f0190009ca0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 -- 172.21.15.5:0/673622601 shutdown_connections 2023-10-07T00:21:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 --2- 172.21.15.5:0/673622601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a4108dc0 0x7f01a410b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 --2- 172.21.15.5:0/673622601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4074ef0 0x7f01a4073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 --2- 172.21.15.5:0/673622601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4073910 0x7f01a4073d90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 -- 172.21.15.5:0/673622601 >> 172.21.15.5:0/673622601 conn(0x7f01a40fc470 msgr2=0x7f01a40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 -- 172.21.15.5:0/673622601 shutdown_connections 2023-10-07T00:21:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.668+0000 7f01aadff700 1 -- 172.21.15.5:0/673622601 wait complete. 2023-10-07T00:21:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.670+0000 7f01aadff700 1 Processor -- start 2023-10-07T00:21:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.670+0000 7f01aadff700 1 -- start start 2023-10-07T00:21:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.670+0000 7f01aadff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a4073910 0x7f01a4198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.670+0000 7f01aadff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4074ef0 0x7f01a4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.670+0000 7f01aadff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4108dc0 0x7f01a41a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.670+0000 7f01aadff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a41a0880 con 0x7f01a4108dc0 2023-10-07T00:21:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.670+0000 7f01aadff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a41a09f0 con 0x7f01a4073910 2023-10-07T00:21:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.670+0000 7f01aadff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a41a0bb0 con 0x7f01a4074ef0 2023-10-07T00:21:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4108dc0 0x7f01a41a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4108dc0 0x7f01a41a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48484/0 (socket says 172.21.15.5:48484) 2023-10-07T00:21:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 -- 172.21.15.5:0/2421578722 learned_addr learned my addr 172.21.15.5:0/2421578722 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a4073910 0x7f01a4198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4074ef0 0x7f01a4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 -- 172.21.15.5:0/2421578722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4074ef0 msgr2=0x7f01a4199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4074ef0 0x7f01a4199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 -- 172.21.15.5:0/2421578722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a4073910 msgr2=0x7f01a4198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a4073910 0x7f01a4198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 -- 172.21.15.5:0/2421578722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900095f0 con 0x7f01a4108dc0 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.671+0000 7f01a939c700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4108dc0 0x7f01a41a02b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f019c007ee0 tx=0x7f019c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.672+0000 7f01a1ffb700 1 -- 172.21.15.5:0/2421578722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c017070 con 0x7f01a4108dc0 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.672+0000 7f01a1ffb700 1 -- 172.21.15.5:0/2421578722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f019c00f040 con 0x7f01a4108dc0 2023-10-07T00:21:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.672+0000 7f01aadff700 1 -- 172.21.15.5:0/2421578722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a41a0e90 con 0x7f01a4108dc0 2023-10-07T00:21:41.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.672+0000 7f01a1ffb700 1 -- 172.21.15.5:0/2421578722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c005710 con 0x7f01a4108dc0 2023-10-07T00:21:41.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.672+0000 7f01aadff700 1 -- 172.21.15.5:0/2421578722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a41a12b0 con 0x7f01a4108dc0 2023-10-07T00:21:41.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.675+0000 7f01a1ffb700 1 -- 172.21.15.5:0/2421578722 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f019c005870 con 0x7f01a4108dc0 2023-10-07T00:21:41.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.676+0000 7f01be7deb80 1 Processor -- start 2023-10-07T00:21:41.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.676+0000 7f01a1ffb700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01940a1500 0x7f01940a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.676+0000 7f01be7deb80 1 -- start start 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01a1ffb700 1 -- 172.21.15.5:0/2421578722 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f019c0cc540 con 0x7f01a4108dc0 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01be7deb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc02e400 con 0x55fefc0c6fd0 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01be7deb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc01fbc0 con 0x55fefc0c5ec0 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01be7deb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc01d4e0 con 0x55fefc0c7990 2023-10-07T00:21:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01940a1500 0x7f01940a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48494/0 (socket says 172.21.15.5:48494) 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01a8b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01a3fff700 1 -- 172.21.15.5:0/215872852 learned_addr learned my addr 172.21.15.5:0/215872852 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.677+0000 7f01a939c700 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f01a3fff700 1 -- 172.21.15.5:0/215872852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 msgr2=0x55fefc0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f01a3fff700 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f01a3fff700 1 -- 172.21.15.5:0/215872852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 msgr2=0x55fefc0c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f01a3fff700 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f01a3fff700 1 -- 172.21.15.5:0/215872852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fefbe43d80 con 0x55fefc0c6fd0 2023-10-07T00:21:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01940a1500 0x7f01940a39c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f019000b2e0 tx=0x7f0190005590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f01a3fff700 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0c7450 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f01a4074c10 tx=0x7f0190028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2346f27980f923 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f018effd700 1 -- 172.21.15.5:0/215872852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000bcd0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f018effd700 1 -- 172.21.15.5:0/215872852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f019002c070 con 0x55fefc0c6fd0 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.678+0000 7f018effd700 1 -- 172.21.15.5:0/215872852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000f460 con 0x55fefc0c6fd0 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 -- 172.21.15.5:0/215872852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 msgr2=0x55fefc0c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0c7450 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f01a4074c10 tx=0x7f0190028000 comp rx=0 tx=0).stop 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 -- 172.21.15.5:0/215872852 shutdown_connections 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 --2- 172.21.15.5:0/215872852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0c7450 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 -- 172.21.15.5:0/215872852 >> 172.21.15.5:0/215872852 conn(0x55fefc03a200 msgr2=0x55fefc0c0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 -- 172.21.15.5:0/215872852 shutdown_connections 2023-10-07T00:21:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.679+0000 7f01be7deb80 1 -- 172.21.15.5:0/215872852 wait complete. 2023-10-07T00:21:41.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.680+0000 7f01be7deb80 1 -- start start 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.680+0000 7f01be7deb80 1 Processor -- start 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.680+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c5ec0 0x55fefc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.680+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.680+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c7990 0x55fefc0d7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.680+0000 7f01be7deb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc018dd0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.680+0000 7f01be7deb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefbfb56b0 con 0x55fefc0c7990 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.680+0000 7f01be7deb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefbfb5350 con 0x55fefc0c5ec0 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01be7deb80 10 client.0 _ll_register_callbacks cb 0x55fefbe127a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48506/0 (socket says 172.21.15.5:48506) 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a3fff700 1 -- 172.21.15.5:0/189349710 learned_addr learned my addr 172.21.15.5:0/189349710 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c5ec0 0x55fefc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a939c700 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c7990 0x55fefc0d7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a3fff700 1 -- 172.21.15.5:0/189349710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c5ec0 msgr2=0x55fefc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a3fff700 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c5ec0 0x55fefc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a3fff700 1 -- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c7990 msgr2=0x55fefc0d7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a3fff700 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c7990 0x55fefc0d7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a3fff700 1 -- 172.21.15.5:0/189349710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01980098e0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.681+0000 7f01a939c700 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c7990 0x55fefc0d7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f01a3fff700 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d0130 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0190009ce0 tx=0x7f01900057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a04533f9c1079f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f0183fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f0183fff700 1 -- 172.21.15.5:0/189349710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190028cd0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f01be7deb80 1 -- 172.21.15.5:0/189349710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fefc0b8d50 con 0x55fefc0c6fd0 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f0183fff700 1 -- 172.21.15.5:0/189349710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0190028e30 con 0x55fefc0c6fd0 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f0183fff700 1 -- 172.21.15.5:0/189349710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0190028460 con 0x55fefc0c6fd0 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f01be7deb80 10 client.16755 fetch_fsmap learned FSMap version 44 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f01be7deb80 1 -- 172.21.15.5:0/189349710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x7f01a410be70 con 0x55fefc0c6fd0 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.682+0000 7f0183fff700 1 -- 172.21.15.5:0/189349710 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fefc0b8d50 con 0x55fefc0c6fd0 2023-10-07T00:21:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.683+0000 7f0183fff700 1 -- 172.21.15.5:0/189349710 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f019000faf0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.683+0000 7f01be7deb80 10 client.16755 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.683+0000 7f01be7deb80 10 client.16755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.683+0000 7f01be7deb80 20 client.16755 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.683+0000 7f01be7deb80 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fefc0db6c0 0x55fefc0ddae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.683+0000 7f01be7deb80 4 client.16755 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.683+0000 7f01be7deb80 1 -- 172.21.15.5:0/189349710 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fefc011db0 con 0x55fefc0db6c0 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.683+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fefc0db6c0 0x55fefc0ddae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.684+0000 7f0183fff700 10 client.16755 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.684+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fefc0db6c0 0x55fefc0ddae0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ca82bdeb72b8a8 server_cookie=453d83cffe3cd7bf in_seq=0 out_seq=0 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.684+0000 7f0183fff700 1 -- 172.21.15.5:0/189349710 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fefc011db0 con 0x55fefc0db6c0 2023-10-07T00:21:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.684+0000 7f0183fff700 10 client.16755 handle_command_reply: tid=0 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.684+0000 7f01be7deb80 1 client.16755 shutdown 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 -- 172.21.15.5:0/189349710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 msgr2=0x55fefc0d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d0130 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0190009ce0 tx=0x7f01900057a0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 -- 172.21.15.5:0/189349710 shutdown_connections 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fefc0db6c0 0x55fefc0ddae0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c7990 0x55fefc0d7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f0183fff700 0 client.16755 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c5ec0 0x55fefc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 --2- 172.21.15.5:0/189349710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d0130 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 -- 172.21.15.5:0/189349710 >> 172.21.15.5:0/189349710 conn(0x55fefc03a200 msgr2=0x55fefc0c0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 -- 172.21.15.5:0/189349710 shutdown_connections 2023-10-07T00:21:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 1 -- 172.21.15.5:0/189349710 wait complete. 2023-10-07T00:21:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.685+0000 7f01be7deb80 20 client.16755 trim_cache size 0 max 16384 2023-10-07T00:21:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01be7deb80 1 Processor -- start 2023-10-07T00:21:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01be7deb80 1 -- start start 2023-10-07T00:21:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01be7deb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefbe998c0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01be7deb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc0cf0a0 con 0x55fefc0c5ec0 2023-10-07T00:21:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01be7deb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc0bd860 con 0x55fefc0c7990 2023-10-07T00:21:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.701+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48514/0 (socket says 172.21.15.5:48514) 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a3fff700 1 -- 172.21.15.5:0/2262613684 learned_addr learned my addr 172.21.15.5:0/2262613684 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a3fff700 1 -- 172.21.15.5:0/2262613684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 msgr2=0x55fefc0d7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a939c700 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a3fff700 1 -- 172.21.15.5:0/2262613684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 msgr2=0x55fefc0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a3fff700 1 -- 172.21.15.5:0/2262613684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fefbe2cc00 con 0x55fefc0c6fd0 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a939c700 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0caed0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0190004360 tx=0x7f0190005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20d10980747475a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f018f7fe700 1 -- 172.21.15.5:0/2262613684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000bed0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f018f7fe700 1 -- 172.21.15.5:0/2262613684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f019001e030 con 0x55fefc0c6fd0 2023-10-07T00:21:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.702+0000 7f018f7fe700 1 -- 172.21.15.5:0/2262613684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000f940 con 0x55fefc0c6fd0 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 -- 172.21.15.5:0/2262613684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 msgr2=0x55fefc0caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0caed0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0190004360 tx=0x7f0190005ab0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 -- 172.21.15.5:0/2262613684 shutdown_connections 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2262613684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0caed0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 -- 172.21.15.5:0/2262613684 >> 172.21.15.5:0/2262613684 conn(0x55fefc03a200 msgr2=0x55fefc0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 -- 172.21.15.5:0/2262613684 shutdown_connections 2023-10-07T00:21:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.703+0000 7f01be7deb80 1 -- 172.21.15.5:0/2262613684 wait complete. 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 1 -- start start 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 1 Processor -- start 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0d4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc0d6320 con 0x55fefc0c6fd0 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc0d6490 con 0x55fefc0c5ec0 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fefc0d6650 con 0x55fefc0c7990 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.704+0000 7f01be7deb80 10 client.0 _ll_register_callbacks cb 0x7f0198009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48530/0 (socket says 172.21.15.5:48530) 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 -- 172.21.15.5:0/2936965782 learned_addr learned my addr 172.21.15.5:0/2936965782 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a939c700 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 -- 172.21.15.5:0/2936965782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 msgr2=0x55fefc0d5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 -- 172.21.15.5:0/2936965782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 msgr2=0x55fefc0d4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0d4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 -- 172.21.15.5:0/2936965782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a410be70 con 0x55fefc0c6fd0 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a939c700 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f01a3fff700 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d4dd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f01900057d0 tx=0x7f0190005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1983a85bbf746b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f0183fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.705+0000 7f0183fff700 1 -- 172.21.15.5:0/2936965782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190028660 con 0x55fefc0c6fd0 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 1 -- 172.21.15.5:0/2936965782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f019002c070 con 0x55fefc0c6fd0 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f0183fff700 1 -- 172.21.15.5:0/2936965782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0190054070 con 0x55fefc0c6fd0 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f0183fff700 1 -- 172.21.15.5:0/2936965782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01900287c0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 10 client.16761 fetch_fsmap learned FSMap version 44 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 1 -- 172.21.15.5:0/2936965782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55fefbe6a1f0 con 0x55fefc0c6fd0 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f0183fff700 1 -- 172.21.15.5:0/2936965782 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f019002c070 con 0x55fefc0c6fd0 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f0183fff700 1 -- 172.21.15.5:0/2936965782 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 44) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f0190045800 con 0x55fefc0c6fd0 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 10 client.16761 fetch_fsmap finished waiting for FSMap version 44 2023-10-07T00:21:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 10 client.16761 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 20 client.16761 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fefc12f920 0x55fefc131d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 4 client.16761 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:21:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.706+0000 7f01be7deb80 1 -- 172.21.15.5:0/2936965782 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fefc011ad0 con 0x55fefc12f920 2023-10-07T00:21:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.707+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fefc12f920 0x55fefc131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.707+0000 7f01a8b9b700 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fefc12f920 0x55fefc131d40 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731af41210b18184 server_cookie=8a8da17806936e5a in_seq=0 out_seq=0 2023-10-07T00:21:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.707+0000 7f0183fff700 10 client.16761 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f0183fff700 1 -- 172.21.15.5:0/2936965782 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fefc011ad0 con 0x55fefc12f920 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f0183fff700 10 client.16761 handle_command_reply: tid=0 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 client.16761 shutdown 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 -- 172.21.15.5:0/2936965782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 msgr2=0x55fefc0d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d4dd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f01900057d0 tx=0x7f0190005800 comp rx=0 tx=0).stop 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 -- 172.21.15.5:0/2936965782 shutdown_connections 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x55fefc12f920 0x55fefc131d40 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fefc0c7990 0x55fefc0d5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fefc0c5ec0 0x55fefc0d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f0183fff700 0 client.16761 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 --2- 172.21.15.5:0/2936965782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fefc0c6fd0 0x55fefc0d4dd0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 -- 172.21.15.5:0/2936965782 >> 172.21.15.5:0/2936965782 conn(0x55fefc03a200 msgr2=0x55fefc0ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 -- 172.21.15.5:0/2936965782 shutdown_connections 2023-10-07T00:21:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 1 -- 172.21.15.5:0/2936965782 wait complete. 2023-10-07T00:21:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.719+0000 7f01be7deb80 20 client.16761 trim_cache size 0 max 16384 2023-10-07T00:21:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:21:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:21:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:21:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:21:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 -- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01940a1500 msgr2=0x7f01940a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01940a1500 0x7f01940a39c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f019000b2e0 tx=0x7f0190005590 comp rx=0 tx=0).stop 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 -- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4108dc0 msgr2=0x7f01a41a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4108dc0 0x7f01a41a02b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f019c007ee0 tx=0x7f019c00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 -- 172.21.15.5:0/2421578722 shutdown_connections 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f01940a1500 0x7f01940a39c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a4108dc0 0x7f01a41a02b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a4073910 0x7f01a4198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 --2- 172.21.15.5:0/2421578722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4074ef0 0x7f01a4199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 -- 172.21.15.5:0/2421578722 >> 172.21.15.5:0/2421578722 conn(0x7f01a40fc470 msgr2=0x7f01a40fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 -- 172.21.15.5:0/2421578722 shutdown_connections 2023-10-07T00:21:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:41.720+0000 7f01aadff700 1 -- 172.21.15.5:0/2421578722 wait complete. 2023-10-07T00:21:43.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:42 smithi088 ceph-mon[103111]: pgmap v614: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:21:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:42 smithi112 ceph-mon[133548]: pgmap v614: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:21:43.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:42 smithi005 ceph-mon[129406]: pgmap v614: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 18 op/s 2023-10-07T00:21:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:44 smithi088 ceph-mon[103111]: pgmap v615: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 16 op/s 2023-10-07T00:21:45.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:44 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:44 smithi112 ceph-mon[133548]: pgmap v615: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 16 op/s 2023-10-07T00:21:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:44 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:45.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:44 smithi005 ceph-mon[129406]: pgmap v615: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 16 op/s 2023-10-07T00:21:45.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:44 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:47.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:46 smithi088 ceph-mon[103111]: pgmap v616: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-10-07T00:21:47.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:46 smithi112 ceph-mon[133548]: pgmap v616: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-10-07T00:21:47.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:46 smithi005 ceph-mon[129406]: pgmap v616: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-10-07T00:21:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:48 smithi088 ceph-mon[103111]: pgmap v617: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-10-07T00:21:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:48 smithi112 ceph-mon[133548]: pgmap v617: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-10-07T00:21:49.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:48 smithi005 ceph-mon[129406]: pgmap v617: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-10-07T00:21:50.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:49 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:50.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:49 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:50.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:49 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:51.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:50 smithi088 ceph-mon[103111]: pgmap v618: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:51.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:50 smithi112 ceph-mon[133548]: pgmap v618: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:52.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:50 smithi005 ceph-mon[129406]: pgmap v618: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:52.408 INFO:tasks.workunit.client.0.smithi005.stdout: 2023-10-07T00:21:52.408 INFO:tasks.workunit.client.0.smithi005.stdout:Final score for writes: 51 2023-10-07T00:21:52.408 INFO:tasks.workunit.client.0.smithi005.stdout:Final score for reads : 4043 2023-10-07T00:21:52.408 INFO:tasks.workunit.client.0.smithi005.stdout: 2023-10-07T00:21:52.409 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-07T00:21:52.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-07T00:21:53.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:52 smithi088 ceph-mon[103111]: pgmap v619: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:52 smithi112 ceph-mon[133548]: pgmap v619: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:53.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:52 smithi005 ceph-mon[129406]: pgmap v619: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-10-07T00:21:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.878+0000 7f52775ff700 1 -- 172.21.15.5:0/3512094640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270074ef0 msgr2=0x7f5270073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.878+0000 7f52775ff700 1 --2- 172.21.15.5:0/3512094640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270074ef0 0x7f5270073340 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f526c009990 tx=0x7f526c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.878+0000 7f52775ff700 1 -- 172.21.15.5:0/3512094640 shutdown_connections 2023-10-07T00:21:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.878+0000 7f52775ff700 1 --2- 172.21.15.5:0/3512094640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5270108dc0 0x7f527010b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.878+0000 7f52775ff700 1 --2- 172.21.15.5:0/3512094640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270074ef0 0x7f5270073340 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.878+0000 7f52775ff700 1 --2- 172.21.15.5:0/3512094640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5270073910 0x7f5270073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.878+0000 7f52775ff700 1 -- 172.21.15.5:0/3512094640 >> 172.21.15.5:0/3512094640 conn(0x7f52700fc470 msgr2=0x7f52700fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:54.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.879+0000 7f52775ff700 1 -- 172.21.15.5:0/3512094640 shutdown_connections 2023-10-07T00:21:54.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.879+0000 7f52775ff700 1 -- 172.21.15.5:0/3512094640 wait complete. 2023-10-07T00:21:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f52775ff700 1 Processor -- start 2023-10-07T00:21:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f52775ff700 1 -- start start 2023-10-07T00:21:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f52775ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5270073910 0x7f5270198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f52775ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5270074ef0 0x7f5270199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f52775ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270108dc0 0x7f52701a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f52775ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701a08c0 con 0x7f5270108dc0 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f52775ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701a0a00 con 0x7f5270074ef0 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f52775ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701a0b90 con 0x7f5270073910 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f527539b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5270073910 0x7f5270198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f527539b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5270073910 0x7f5270198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:60130/0 (socket says 172.21.15.5:60130) 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.880+0000 7f527539b700 1 -- 172.21.15.5:0/4229222870 learned_addr learned my addr 172.21.15.5:0/4229222870 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f5275b9c700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270108dc0 0x7f52701a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f5274b9a700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5270074ef0 0x7f5270199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f527539b700 1 -- 172.21.15.5:0/4229222870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5270074ef0 msgr2=0x7f5270199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f527539b700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5270074ef0 0x7f5270199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f527539b700 1 -- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270108dc0 msgr2=0x7f52701a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f527539b700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270108dc0 0x7f52701a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f527539b700 1 -- 172.21.15.5:0/4229222870 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c0095f0 con 0x7f5270073910 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f5274b9a700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5270074ef0 0x7f5270199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f5275b9c700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270108dc0 0x7f52701a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f527539b700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5270073910 0x7f5270198d40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f526c005910 tx=0x7f526c0057d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f52667fc700 1 -- 172.21.15.5:0/4229222870 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c01d070 con 0x7f5270073910 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f52775ff700 1 -- 172.21.15.5:0/4229222870 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52701a0e10 con 0x7f5270073910 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f52667fc700 1 -- 172.21.15.5:0/4229222870 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f526c022470 con 0x7f5270073910 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.881+0000 7f52667fc700 1 -- 172.21.15.5:0/4229222870 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c00f6c0 con 0x7f5270073910 2023-10-07T00:21:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.882+0000 7f52775ff700 1 -- 172.21.15.5:0/4229222870 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52701a1180 con 0x7f5270073910 2023-10-07T00:21:54.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.885+0000 7f52667fc700 1 -- 172.21.15.5:0/4229222870 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f526c0225e0 con 0x7f5270073910 2023-10-07T00:21:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.886+0000 7f52667fc700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f525c0a1480 0x7f525c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.886+0000 7f528afb5b80 1 Processor -- start 2023-10-07T00:21:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.886+0000 7f52667fc700 1 -- 172.21.15.5:0/4229222870 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f526c0ce390 con 0x7f5270073910 2023-10-07T00:21:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f528afb5b80 1 -- start start 2023-10-07T00:21:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f5274b9a700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f525c0a1480 0x7f525c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bdec0 0x5574601be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601befd0 0x5574601bf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f528afb5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557460126400 con 0x5574601befd0 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f528afb5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x557460117bc0 con 0x5574601bf990 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f528afb5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574601154e0 con 0x5574601bdec0 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f527539b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bdec0 0x5574601be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f5274b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601befd0 0x5574601bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f527539b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bdec0 0x5574601be2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:60138/0 (socket says 172.21.15.5:60138) 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.887+0000 7f527539b700 1 -- 172.21.15.5:0/655560112 learned_addr learned my addr 172.21.15.5:0/655560112 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f5275b9c700 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f5274b9a700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f525c0a1480 0x7f525c0a3940 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5270074c10 tx=0x7f526000e5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f527539b700 1 -- 172.21.15.5:0/655560112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 msgr2=0x5574601c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f527539b700 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f527539b700 1 -- 172.21.15.5:0/655560112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601befd0 msgr2=0x5574601bf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f527539b700 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601befd0 0x5574601bf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f527539b700 1 -- 172.21.15.5:0/655560112 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55745ff3bd80 con 0x5574601bdec0 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f5275b9c700 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f527539b700 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bdec0 0x5574601be2e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f526c022890 tx=0x7f526c09b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35fd01f693246f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.888+0000 7f525b7fe700 1 -- 172.21.15.5:0/655560112 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c09b020 con 0x5574601bdec0 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f525b7fe700 1 -- 172.21.15.5:0/655560112 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f526c0228e0 con 0x5574601bdec0 2023-10-07T00:21:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f525b7fe700 1 -- 172.21.15.5:0/655560112 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c099a60 con 0x5574601bdec0 2023-10-07T00:21:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f528afb5b80 1 -- 172.21.15.5:0/655560112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bdec0 msgr2=0x5574601be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f528afb5b80 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bdec0 0x5574601be2e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f526c022890 tx=0x7f526c09b560 comp rx=0 tx=0).stop 2023-10-07T00:21:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f528afb5b80 1 -- 172.21.15.5:0/655560112 shutdown_connections 2023-10-07T00:21:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f528afb5b80 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f528afb5b80 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bdec0 0x5574601be2e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f528afb5b80 1 --2- 172.21.15.5:0/655560112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601befd0 0x5574601bf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.889+0000 7f528afb5b80 1 -- 172.21.15.5:0/655560112 >> 172.21.15.5:0/655560112 conn(0x557460132200 msgr2=0x5574601b8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.890+0000 7f528afb5b80 1 -- 172.21.15.5:0/655560112 shutdown_connections 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.890+0000 7f528afb5b80 1 -- 172.21.15.5:0/655560112 wait complete. 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.890+0000 7f528afb5b80 1 -- start start 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.890+0000 7f528afb5b80 1 Processor -- start 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601befd0 0x5574601c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bf990 0x5574601cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f528afb5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557460110dd0 con 0x5574601bdec0 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f528afb5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574600ad6b0 con 0x5574601befd0 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f528afb5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574600ad350 con 0x5574601bf990 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f528afb5b80 10 client.0 _ll_register_callbacks cb 0x55745ff0a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f527539b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f5275b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bf990 0x5574601cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f5275b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bf990 0x5574601cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:60140/0 (socket says 172.21.15.5:60140) 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f5275b9c700 1 -- 172.21.15.5:0/241248608 learned_addr learned my addr 172.21.15.5:0/241248608 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.891+0000 7f5274b9a700 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601befd0 0x5574601c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f527539b700 1 -- 172.21.15.5:0/241248608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bf990 msgr2=0x5574601cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f527539b700 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bf990 0x5574601cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f527539b700 1 -- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601befd0 msgr2=0x5574601c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f527539b700 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601befd0 0x5574601c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f527539b700 1 -- 172.21.15.5:0/241248608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52701a1180 con 0x5574601bdec0 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f5274b9a700 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601befd0 0x5574601c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f5275b9c700 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bf990 0x5574601cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f527539b700 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601c7890 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f526c022890 tx=0x7f526c022b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af588ed500b2866 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f5258ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f5258ff9700 1 -- 172.21.15.5:0/241248608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c09bdc0 con 0x5574601bdec0 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f5258ff9700 1 -- 172.21.15.5:0/241248608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f526c0b6030 con 0x5574601bdec0 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f528afb5b80 1 -- 172.21.15.5:0/241248608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574601b0d50 con 0x5574601bdec0 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f5258ff9700 1 -- 172.21.15.5:0/241248608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f526c09abb0 con 0x5574601bdec0 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f528afb5b80 10 client.16773 fetch_fsmap learned FSMap version 46 2023-10-07T00:21:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.892+0000 7f528afb5b80 1 -- 172.21.15.5:0/241248608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55745ff24c00 con 0x5574601bdec0 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f5258ff9700 1 -- 172.21.15.5:0/241248608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5574601b0d50 con 0x5574601bdec0 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f5258ff9700 1 -- 172.21.15.5:0/241248608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f526c0974b0 con 0x5574601bdec0 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f528afb5b80 10 client.16773 fetch_fsmap finished waiting for FSMap version 46 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f528afb5b80 10 client.16773 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f528afb5b80 20 client.16773 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f528afb5b80 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5574601d3390 0x5574601d57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f528afb5b80 4 client.16773 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f528afb5b80 1 -- 172.21.15.5:0/241248608 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557460109db0 con 0x5574601d3390 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.893+0000 7f5274b9a700 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5574601d3390 0x5574601d57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.894+0000 7f5274b9a700 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5574601d3390 0x5574601d57b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5416b82eeed2a770 server_cookie=42866660813e443b in_seq=0 out_seq=0 2023-10-07T00:21:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.894+0000 7f5258ff9700 10 client.16773 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f5258ff9700 1 -- 172.21.15.5:0/241248608 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557460109db0 con 0x5574601d3390 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f5258ff9700 10 client.16773 handle_command_reply: tid=0 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 client.16773 shutdown 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 -- 172.21.15.5:0/241248608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 msgr2=0x5574601c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601c7890 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f526c022890 tx=0x7f526c022b40 comp rx=0 tx=0).stop 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 -- 172.21.15.5:0/241248608 shutdown_connections 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5574601d3390 0x5574601d57b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601bf990 0x5574601cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601c7890 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f5258ff9700 0 client.16773 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 --2- 172.21.15.5:0/241248608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601befd0 0x5574601c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 -- 172.21.15.5:0/241248608 >> 172.21.15.5:0/241248608 conn(0x557460132200 msgr2=0x5574601b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 -- 172.21.15.5:0/241248608 shutdown_connections 2023-10-07T00:21:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.895+0000 7f528afb5b80 1 -- 172.21.15.5:0/241248608 wait complete. 2023-10-07T00:21:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.896+0000 7f528afb5b80 20 client.16773 trim_cache size 0 max 16384 2023-10-07T00:21:54.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.913+0000 7f528afb5b80 1 Processor -- start 2023-10-07T00:21:54.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.913+0000 7f528afb5b80 1 -- start start 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.913+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.913+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 0x5574601cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.913+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.913+0000 7f528afb5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745ff918c0 con 0x5574601bdec0 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.913+0000 7f528afb5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574601c6d40 con 0x5574601bf990 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.913+0000 7f528afb5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574601c7430 con 0x5574601befd0 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601be2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34550/0 (socket says 172.21.15.5:34550) 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 -- 172.21.15.5:0/3004150661 learned_addr learned my addr 172.21.15.5:0/3004150661 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f5274b9a700 1 --2- 172.21.15.5:0/3004150661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 0x5574601cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 -- 172.21.15.5:0/3004150661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 msgr2=0x5574601cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 --2- 172.21.15.5:0/3004150661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 0x5574601cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 -- 172.21.15.5:0/3004150661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 msgr2=0x5574601cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 --2- 172.21.15.5:0/3004150661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 -- 172.21.15.5:0/3004150661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55745ff621f0 con 0x5574601bdec0 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f527539b700 1 --2- 172.21.15.5:0/3004150661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601be2c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f526c09b3c0 tx=0x7f526c097960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86484b6fcfb705a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f525bfff700 1 -- 172.21.15.5:0/3004150661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c09b020 con 0x5574601bdec0 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f525bfff700 1 -- 172.21.15.5:0/3004150661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f526c09b490 con 0x5574601bdec0 2023-10-07T00:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.914+0000 7f525bfff700 1 -- 172.21.15.5:0/3004150661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a3530 con 0x5574601bdec0 2023-10-07T00:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 -- 172.21.15.5:0/3004150661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 msgr2=0x5574601be2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 --2- 172.21.15.5:0/3004150661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601be2c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f526c09b3c0 tx=0x7f526c097960 comp rx=0 tx=0).stop 2023-10-07T00:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 -- 172.21.15.5:0/3004150661 shutdown_connections 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 --2- 172.21.15.5:0/3004150661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 --2- 172.21.15.5:0/3004150661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601be2c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 --2- 172.21.15.5:0/3004150661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 0x5574601cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 -- 172.21.15.5:0/3004150661 >> 172.21.15.5:0/3004150661 conn(0x557460132200 msgr2=0x5574601b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 -- 172.21.15.5:0/3004150661 shutdown_connections 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.915+0000 7f528afb5b80 1 -- 172.21.15.5:0/3004150661 wait complete. 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.916+0000 7f528afb5b80 1 -- start start 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.916+0000 7f528afb5b80 1 Processor -- start 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.916+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.916+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 0x5574601cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.916+0000 7f528afb5b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.916+0000 7f528afb5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574601cdf10 con 0x5574601bdec0 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.916+0000 7f528afb5b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574601ce080 con 0x5574601bf990 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.916+0000 7f528afb5b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574601ce240 con 0x5574601befd0 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f528afb5b80 10 client.0 _ll_register_callbacks cb 0x7f5260016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f5274b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 0x5574601cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34564/0 (socket says 172.21.15.5:34564) 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 -- 172.21.15.5:0/1225080332 learned_addr learned my addr 172.21.15.5:0/1225080332 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f5275b9c700 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 -- 172.21.15.5:0/1225080332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 msgr2=0x5574601cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 0x5574601cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 -- 172.21.15.5:0/1225080332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 msgr2=0x5574601cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 -- 172.21.15.5:0/1225080332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55745ff24c00 con 0x5574601bdec0 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f527539b700 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601cc480 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f526c098130 tx=0x7f526c09bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3595e7cb32f4a93 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.917+0000 7f5258ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f5258ff9700 1 -- 172.21.15.5:0/1225080332 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a3730 con 0x5574601bdec0 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 1 -- 172.21.15.5:0/1225080332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f526c0228e0 con 0x5574601bdec0 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f5258ff9700 1 -- 172.21.15.5:0/1225080332 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f526c0b6070 con 0x5574601bdec0 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f5258ff9700 1 -- 172.21.15.5:0/1225080332 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f526c09b020 con 0x5574601bdec0 2023-10-07T00:21:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 10 client.16779 fetch_fsmap learned FSMap version 46 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 1 -- 172.21.15.5:0/1225080332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55745ff3a250 con 0x5574601bdec0 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f5258ff9700 1 -- 172.21.15.5:0/1225080332 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f526c0228e0 con 0x5574601bdec0 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f5258ff9700 1 -- 172.21.15.5:0/1225080332 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f526c09a840 con 0x5574601bdec0 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 10 client.16779 fetch_fsmap finished waiting for FSMap version 46 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 10 client.16779 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 20 client.16779 populate_metadata read hostname 'smithi005' 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557460227320 0x557460229710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 4 client.16779 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.918+0000 7f528afb5b80 1 -- 172.21.15.5:0/1225080332 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557460109ad0 con 0x557460227320 2023-10-07T00:21:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.919+0000 7f5274b9a700 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557460227320 0x557460229710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:21:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.919+0000 7f5274b9a700 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557460227320 0x557460229710 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f36539bb27d12cda server_cookie=8364ba40066ee8d2 in_seq=0 out_seq=0 2023-10-07T00:21:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.919+0000 7f5258ff9700 10 client.16779 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f5258ff9700 1 -- 172.21.15.5:0/1225080332 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557460109ad0 con 0x557460227320 2023-10-07T00:21:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f5258ff9700 10 client.16779 handle_command_reply: tid=0 2023-10-07T00:21:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 client.16779 shutdown 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 -- 172.21.15.5:0/1225080332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 msgr2=0x5574601cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601cc480 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f526c098130 tx=0x7f526c09bdc0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 -- 172.21.15.5:0/1225080332 shutdown_connections 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x557460227320 0x557460229710 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5574601bf990 0x5574601cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574601bdec0 0x5574601cc480 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f5258ff9700 0 client.16779 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 --2- 172.21.15.5:0/1225080332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5574601befd0 0x5574601cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 -- 172.21.15.5:0/1225080332 >> 172.21.15.5:0/1225080332 conn(0x557460132200 msgr2=0x5574601cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 -- 172.21.15.5:0/1225080332 shutdown_connections 2023-10-07T00:21:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.930+0000 7f528afb5b80 1 -- 172.21.15.5:0/1225080332 wait complete. 2023-10-07T00:21:54.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f528afb5b80 20 client.16779 trim_cache size 0 max 16384 2023-10-07T00:21:54.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:21:54.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:21:54.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:21:54.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:21:54.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 -- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f525c0a1480 msgr2=0x7f525c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f525c0a1480 0x7f525c0a3940 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5270074c10 tx=0x7f526000e5d0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 -- 172.21.15.5:0/4229222870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5270073910 msgr2=0x7f5270198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5270073910 0x7f5270198d40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f526c005910 tx=0x7f526c0057d0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 -- 172.21.15.5:0/4229222870 shutdown_connections 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f525c0a1480 0x7f525c0a3940 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5270108dc0 0x7f52701a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5270073910 0x7f5270198d40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 --2- 172.21.15.5:0/4229222870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5270074ef0 0x7f5270199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.931+0000 7f52775ff700 1 -- 172.21.15.5:0/4229222870 >> 172.21.15.5:0/4229222870 conn(0x7f52700fc470 msgr2=0x7f52700fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:21:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.932+0000 7f52775ff700 1 -- 172.21.15.5:0/4229222870 shutdown_connections 2023-10-07T00:21:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:21:54.932+0000 7f52775ff700 1 -- 172.21.15.5:0/4229222870 wait complete. 2023-10-07T00:21:55.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:54 smithi088 ceph-mon[103111]: pgmap v620: 97 pgs: 97 active+clean; 307 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 68 KiB/s wr, 18 op/s 2023-10-07T00:21:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:54 smithi112 ceph-mon[133548]: pgmap v620: 97 pgs: 97 active+clean; 307 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 68 KiB/s wr, 18 op/s 2023-10-07T00:21:55.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:54 smithi005 ceph-mon[129406]: pgmap v620: 97 pgs: 97 active+clean; 307 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 68 KiB/s wr, 18 op/s 2023-10-07T00:21:56.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:55 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:56.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:55 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:56.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:55 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:56 smithi088 ceph-mon[103111]: pgmap v621: 97 pgs: 97 active+clean; 308 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 135 KiB/s wr, 21 op/s 2023-10-07T00:21:57.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:56 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:56 smithi112 ceph-mon[133548]: pgmap v621: 97 pgs: 97 active+clean; 308 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 135 KiB/s wr, 21 op/s 2023-10-07T00:21:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:56 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:57.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:56 smithi005 ceph-mon[129406]: pgmap v621: 97 pgs: 97 active+clean; 308 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 135 KiB/s wr, 21 op/s 2023-10-07T00:21:57.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:56 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:58 smithi088 ceph-mon[103111]: pgmap v622: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 202 KiB/s wr, 43 op/s 2023-10-07T00:21:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:58 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:58 smithi112 ceph-mon[133548]: pgmap v622: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 202 KiB/s wr, 43 op/s 2023-10-07T00:21:59.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:58 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:21:59.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:58 smithi005 ceph-mon[129406]: pgmap v622: 97 pgs: 97 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 202 KiB/s wr, 43 op/s 2023-10-07T00:21:59.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:58 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:00.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:59 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:00.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:21:59 smithi112 ceph-mon[133548]: pgmap v623: 97 pgs: 97 active+clean; 294 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 385 KiB/s wr, 101 op/s 2023-10-07T00:22:00.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:59 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:00.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:21:59 smithi005 ceph-mon[129406]: pgmap v623: 97 pgs: 97 active+clean; 294 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 385 KiB/s wr, 101 op/s 2023-10-07T00:22:00.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:59 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:00.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:21:59 smithi088 ceph-mon[103111]: pgmap v623: 97 pgs: 97 active+clean; 294 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 385 KiB/s wr, 101 op/s 2023-10-07T00:22:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:00 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:01.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:00 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:01.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:00 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:02.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:01 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:02.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:01 smithi112 ceph-mon[133548]: pgmap v624: 97 pgs: 97 active+clean; 284 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 424 KiB/s wr, 165 op/s 2023-10-07T00:22:02.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:01 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:02.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:01 smithi005 ceph-mon[129406]: pgmap v624: 97 pgs: 97 active+clean; 284 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 424 KiB/s wr, 165 op/s 2023-10-07T00:22:02.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:01 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:02.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:01 smithi088 ceph-mon[103111]: pgmap v624: 97 pgs: 97 active+clean; 284 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 424 KiB/s wr, 165 op/s 2023-10-07T00:22:04.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:03 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:04.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:03 smithi112 ceph-mon[133548]: pgmap v625: 97 pgs: 97 active+clean; 280 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 576 KiB/s wr, 199 op/s 2023-10-07T00:22:04.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:03 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:04.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:03 smithi005 ceph-mon[129406]: pgmap v625: 97 pgs: 97 active+clean; 280 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 576 KiB/s wr, 199 op/s 2023-10-07T00:22:04.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:03 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:04.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:03 smithi088 ceph-mon[103111]: pgmap v625: 97 pgs: 97 active+clean; 280 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 576 KiB/s wr, 199 op/s 2023-10-07T00:22:06.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:05 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:06.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:05 smithi112 ceph-mon[133548]: pgmap v626: 97 pgs: 97 active+clean; 271 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 697 KiB/s wr, 258 op/s 2023-10-07T00:22:06.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:05 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:06.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:05 smithi005 ceph-mon[129406]: pgmap v626: 97 pgs: 97 active+clean; 271 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 697 KiB/s wr, 258 op/s 2023-10-07T00:22:06.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:05 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:06.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:05 smithi088 ceph-mon[103111]: pgmap v626: 97 pgs: 97 active+clean; 271 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 697 KiB/s wr, 258 op/s 2023-10-07T00:22:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:06 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:07.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:06 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:07.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:06 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 -- 172.21.15.5:0/3398588394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f248c0ff7f0 msgr2=0x7f248c0ffc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 --2- 172.21.15.5:0/3398588394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f248c0ff7f0 0x7f248c0ffc10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2480009990 tx=0x7f2480009ca0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 -- 172.21.15.5:0/3398588394 shutdown_connections 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 --2- 172.21.15.5:0/3398588394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248c100b10 0x7f248c100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 --2- 172.21.15.5:0/3398588394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f248c0ff7f0 0x7f248c0ffc10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 --2- 172.21.15.5:0/3398588394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c100150 0x7f248c1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 -- 172.21.15.5:0/3398588394 >> 172.21.15.5:0/3398588394 conn(0x7f248c0fb390 msgr2=0x7f248c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 -- 172.21.15.5:0/3398588394 shutdown_connections 2023-10-07T00:22:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.100+0000 7f2492bff700 1 -- 172.21.15.5:0/3398588394 wait complete. 2023-10-07T00:22:08.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.101+0000 7f2492bff700 1 Processor -- start 2023-10-07T00:22:08.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.101+0000 7f2492bff700 1 -- start start 2023-10-07T00:22:08.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f2492bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248c0ff7f0 0x7f248c198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f2492bff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f248c100150 0x7f248c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f2492bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c100b10 0x7f248c1a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f2492bff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1a0870 con 0x7f248c100150 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f2492bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1a09e0 con 0x7f248c100b10 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f2492bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1a0ba0 con 0x7f248c0ff7f0 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f249099b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248c0ff7f0 0x7f248c198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f249099b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248c0ff7f0 0x7f248c198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:33922/0 (socket says 172.21.15.5:33922) 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f249099b700 1 -- 172.21.15.5:0/1934060953 learned_addr learned my addr 172.21.15.5:0/1934060953 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f249119c700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c100b10 0x7f248c1a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.102+0000 7f248bfff700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f248c100150 0x7f248c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f249099b700 1 -- 172.21.15.5:0/1934060953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c100b10 msgr2=0x7f248c1a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f249099b700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c100b10 0x7f248c1a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f249099b700 1 -- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f248c100150 msgr2=0x7f248c199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f249099b700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f248c100150 0x7f248c199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f249099b700 1 -- 172.21.15.5:0/1934060953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24800095f0 con 0x7f248c0ff7f0 2023-10-07T00:22:08.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f249119c700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c100b10 0x7f248c1a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:22:08.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f249099b700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248c0ff7f0 0x7f248c198d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2480005910 tx=0x7f2480005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:08.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f2489ffb700 1 -- 172.21.15.5:0/1934060953 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248001d070 con 0x7f248c0ff7f0 2023-10-07T00:22:08.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f2489ffb700 1 -- 172.21.15.5:0/1934060953 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f248000be10 con 0x7f248c0ff7f0 2023-10-07T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f2492bff700 1 -- 172.21.15.5:0/1934060953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c1a0e20 con 0x7f248c0ff7f0 2023-10-07T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.103+0000 7f2489ffb700 1 -- 172.21.15.5:0/1934060953 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2480022e00 con 0x7f248c0ff7f0 2023-10-07T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.104+0000 7f2492bff700 1 -- 172.21.15.5:0/1934060953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c1a11e0 con 0x7f248c0ff7f0 2023-10-07T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.107+0000 7f2489ffb700 1 -- 172.21.15.5:0/1934060953 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f248000b980 con 0x7f248c0ff7f0 2023-10-07T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.108+0000 7f24a65d4b80 1 Processor -- start 2023-10-07T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f24a65d4b80 1 -- start start 2023-10-07T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf90ec0 0x564eacf912e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf91fd0 0x564eacf92450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacf99220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacef9400 con 0x564eacf91fd0 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eaceeabc0 con 0x564eacf90ec0 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacee84e0 con 0x564eacf92990 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f2489ffb700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f247c0a1500 0x7f247c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f248bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacf99220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f248bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacf99220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:33934/0 (socket says 172.21.15.5:33934) 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f248bfff700 1 -- 172.21.15.5:0/2000146114 learned_addr learned my addr 172.21.15.5:0/2000146114 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f2489ffb700 1 -- 172.21.15.5:0/1934060953 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f24800ce2a0 con 0x7f248c0ff7f0 2023-10-07T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f249099b700 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf91fd0 0x564eacf92450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.109+0000 7f249119c700 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf90ec0 0x564eacf912e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f249119c700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f247c0a1500 0x7f247c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f248bfff700 1 -- 172.21.15.5:0/2000146114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf90ec0 msgr2=0x564eacf912e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f248bfff700 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf90ec0 0x564eacf912e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f248bfff700 1 -- 172.21.15.5:0/2000146114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf91fd0 msgr2=0x564eacf92450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f248bfff700 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf91fd0 0x564eacf92450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f248bfff700 1 -- 172.21.15.5:0/2000146114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eacd0ed80 con 0x564eacf92990 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f248bfff700 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacf99220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2478009d80 tx=0x7f2478011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f90a939e6a59a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f249119c700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f247c0a1500 0x7f247c0a39c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x564eacf90c60 tx=0x7f248400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f2476ffd700 1 -- 172.21.15.5:0/2000146114 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478004230 con 0x564eacf92990 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f2476ffd700 1 -- 172.21.15.5:0/2000146114 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2478004390 con 0x564eacf92990 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.110+0000 7f2476ffd700 1 -- 172.21.15.5:0/2000146114 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478019800 con 0x564eacf92990 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 -- 172.21.15.5:0/2000146114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 msgr2=0x564eacf99220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacf99220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2478009d80 tx=0x7f2478011720 comp rx=0 tx=0).stop 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 -- 172.21.15.5:0/2000146114 shutdown_connections 2023-10-07T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacf99220 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf90ec0 0x564eacf912e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/2000146114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf91fd0 0x564eacf92450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 -- 172.21.15.5:0/2000146114 >> 172.21.15.5:0/2000146114 conn(0x564eacf05200 msgr2=0x564eacf8bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 -- 172.21.15.5:0/2000146114 shutdown_connections 2023-10-07T00:22:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.111+0000 7f24a65d4b80 1 -- 172.21.15.5:0/2000146114 wait complete. 2023-10-07T00:22:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.112+0000 7f24a65d4b80 1 -- start start 2023-10-07T00:22:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.112+0000 7f24a65d4b80 1 Processor -- start 2023-10-07T00:22:08.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacee3dd0 con 0x564eacf90ec0 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eace806b0 con 0x564eacf91fd0 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eace80350 con 0x564eacf92990 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f24a65d4b80 10 client.0 _ll_register_callbacks cb 0x564eaccdd7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f249099b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f249119c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f249099b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37842/0 (socket says 172.21.15.5:37842) 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f249099b700 1 -- 172.21.15.5:0/1396920076 learned_addr learned my addr 172.21.15.5:0/1396920076 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f248bfff700 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f249119c700 1 -- 172.21.15.5:0/1396920076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 msgr2=0x564eacf9b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f249119c700 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f249119c700 1 -- 172.21.15.5:0/1396920076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 msgr2=0x564eacf9ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.113+0000 7f249119c700 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.114+0000 7f249119c700 1 -- 172.21.15.5:0/1396920076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24780099e0 con 0x564eacf92990 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.114+0000 7f249119c700 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa20a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2484009fd0 tx=0x7f2484004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e12ed3500f2fa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.114+0000 7f246bfff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.114+0000 7f246bfff700 1 -- 172.21.15.5:0/1396920076 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248400ee60 con 0x564eacf92990 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.114+0000 7f246bfff700 1 -- 172.21.15.5:0/1396920076 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2484020050 con 0x564eacf92990 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.114+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1396920076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564eacf83d50 con 0x564eacf92990 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.114+0000 7f246bfff700 1 -- 172.21.15.5:0/1396920076 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2484004bb0 con 0x564eacf92990 2023-10-07T00:22:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f24a65d4b80 10 client.26608 fetch_fsmap learned FSMap version 55 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1396920076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x564eaccf7c00 con 0x564eacf92990 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f246bfff700 1 -- 172.21.15.5:0/1396920076 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564eacf83d50 con 0x564eacf92990 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f246bfff700 1 -- 172.21.15.5:0/1396920076 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 55) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f248401b610 con 0x564eacf92990 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f24a65d4b80 10 client.26608 fetch_fsmap finished waiting for FSMap version 55 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f24a65d4b80 10 client.26608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f24a65d4b80 20 client.26608 populate_metadata read hostname 'smithi005' 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564eacfa6ad0 0x564eacfa8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f24a65d4b80 4 client.26608 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.115+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1396920076 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564eacedcdb0 con 0x564eacfa6ad0 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.116+0000 7f249099b700 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564eacfa6ad0 0x564eacfa8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.116+0000 7f249099b700 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564eacfa6ad0 0x564eacfa8ef0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f788ed4e9f20328 server_cookie=270fd459e43e1b62 in_seq=0 out_seq=0 2023-10-07T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.116+0000 7f246bfff700 10 client.26608 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f246bfff700 1 -- 172.21.15.5:0/1396920076 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564eacedcdb0 con 0x564eacfa6ad0 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f246bfff700 10 client.26608 handle_command_reply: tid=0 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 client.26608 shutdown 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1396920076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 msgr2=0x564eacfa20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa20a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2484009fd0 tx=0x7f2484004ad0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1396920076 shutdown_connections 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564eacfa6ad0 0x564eacfa8ef0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa20a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f246bfff700 0 client.26608 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1396920076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1396920076 >> 172.21.15.5:0/1396920076 conn(0x564eacf05200 msgr2=0x564eacf8b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1396920076 shutdown_connections 2023-10-07T00:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.117+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1396920076 wait complete. 2023-10-07T00:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.118+0000 7f24a65d4b80 20 client.26608 trim_cache size 0 max 16384 2023-10-07T00:22:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.134+0000 7f24a65d4b80 1 Processor -- start 2023-10-07T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.134+0000 7f24a65d4b80 1 -- start start 2023-10-07T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.134+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf90ec0 0x564eacf923b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.134+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacfa2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.134+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf92990 0x564eacf8a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.134+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacd648c0 con 0x564eacf92990 2023-10-07T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.134+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacf8d660 con 0x564eacf91fd0 2023-10-07T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.134+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacf9b7a0 con 0x564eacf90ec0 2023-10-07T00:22:08.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249119c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf92990 0x564eacf8a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249099b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf90ec0 0x564eacf923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f248bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacfa2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249099b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf90ec0 0x564eacf923b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:33948/0 (socket says 172.21.15.5:33948) 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249099b700 1 -- 172.21.15.5:0/1182484129 learned_addr learned my addr 172.21.15.5:0/1182484129 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249119c700 1 -- 172.21.15.5:0/1182484129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf90ec0 msgr2=0x564eacf923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249119c700 1 --2- 172.21.15.5:0/1182484129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf90ec0 0x564eacf923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249119c700 1 -- 172.21.15.5:0/1182484129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 msgr2=0x564eacfa2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249119c700 1 --2- 172.21.15.5:0/1182484129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacfa2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249119c700 1 -- 172.21.15.5:0/1182484129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eacd351f0 con 0x564eacf92990 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249099b700 1 --2- 172.21.15.5:0/1182484129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf90ec0 0x564eacf923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.135+0000 7f249119c700 1 --2- 172.21.15.5:0/1182484129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf92990 0x564eacf8a7b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f248401bac0 tx=0x7f2484009080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a75f39861c0c68f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.136+0000 7f24777fe700 1 -- 172.21.15.5:0/1182484129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248400ee40 con 0x564eacf92990 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.136+0000 7f24777fe700 1 -- 172.21.15.5:0/1182484129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f248400f040 con 0x564eacf92990 2023-10-07T00:22:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.136+0000 7f24777fe700 1 -- 172.21.15.5:0/1182484129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484004580 con 0x564eacf92990 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.136+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1182484129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf92990 msgr2=0x564eacf8a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.136+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1182484129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf92990 0x564eacf8a7b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f248401bac0 tx=0x7f2484009080 comp rx=0 tx=0).stop 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1182484129 shutdown_connections 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1182484129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf92990 0x564eacf8a7b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1182484129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf90ec0 0x564eacf923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/1182484129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacfa2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1182484129 >> 172.21.15.5:0/1182484129 conn(0x564eacf05200 msgr2=0x564eacf8bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1182484129 shutdown_connections 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 -- 172.21.15.5:0/1182484129 wait complete. 2023-10-07T00:22:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 -- start start 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.137+0000 7f24a65d4b80 1 Processor -- start 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f24a65d4b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacfa1530 con 0x564eacf90ec0 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacfa16a0 con 0x564eacf91fd0 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f24a65d4b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eacfa1860 con 0x564eacf92990 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f24a65d4b80 10 client.0 _ll_register_callbacks cb 0x564eaccdd7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f248bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f248bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:38588/0 (socket says 172.21.15.5:38588) 2023-10-07T00:22:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f249099b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f248bfff700 1 -- 172.21.15.5:0/35953747 learned_addr learned my addr 172.21.15.5:0/35953747 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.138+0000 7f249119c700 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f248bfff700 1 -- 172.21.15.5:0/35953747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 msgr2=0x564eacfa0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f248bfff700 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f248bfff700 1 -- 172.21.15.5:0/35953747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 msgr2=0x564eacf9faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f248bfff700 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f248bfff700 1 -- 172.21.15.5:0/35953747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c1a11e0 con 0x564eacf91fd0 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f248bfff700 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9ffe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2478009230 tx=0x7f2478005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c91578621cd25114 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f246bfff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f246bfff700 1 -- 172.21.15.5:0/35953747 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478005ce0 con 0x564eacf91fd0 2023-10-07T00:22:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f24a65d4b80 1 -- 172.21.15.5:0/35953747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2478004390 con 0x564eacf91fd0 2023-10-07T00:22:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.139+0000 7f246bfff700 1 -- 172.21.15.5:0/35953747 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f24780056a0 con 0x564eacf91fd0 2023-10-07T00:22:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f246bfff700 1 -- 172.21.15.5:0/35953747 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2478003680 con 0x564eacf91fd0 2023-10-07T00:22:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f24a65d4b80 10 client.26627 fetch_fsmap learned FSMap version 55 2023-10-07T00:22:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f24a65d4b80 1 -- 172.21.15.5:0/35953747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x564eaccf7c00 con 0x564eacf91fd0 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f246bfff700 1 -- 172.21.15.5:0/35953747 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2478004390 con 0x564eacf91fd0 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f246bfff700 1 -- 172.21.15.5:0/35953747 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 55) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f2478004b30 con 0x564eacf91fd0 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f24a65d4b80 10 client.26627 fetch_fsmap finished waiting for FSMap version 55 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f24a65d4b80 10 client.26627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f24a65d4b80 20 client.26627 populate_metadata read hostname 'smithi005' 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564eacffb490 0x564eacffd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f24a65d4b80 4 client.26627 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.140+0000 7f24a65d4b80 1 -- 172.21.15.5:0/35953747 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564eacedcad0 con 0x564eacffb490 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.141+0000 7f249099b700 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564eacffb490 0x564eacffd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:08.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.141+0000 7f249099b700 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564eacffb490 0x564eacffd8b0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=560e3ae4a8419411 server_cookie=49a911c64ef8c763 in_seq=0 out_seq=0 2023-10-07T00:22:08.146 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.141+0000 7f246bfff700 10 client.26627 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:22:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f246bfff700 1 -- 172.21.15.5:0/35953747 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564eacedcad0 con 0x564eacffb490 2023-10-07T00:22:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f246bfff700 10 client.26627 handle_command_reply: tid=0 2023-10-07T00:22:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 client.26627 shutdown 2023-10-07T00:22:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 -- 172.21.15.5:0/35953747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 msgr2=0x564eacf9ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9ffe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2478009230 tx=0x7f2478005270 comp rx=0 tx=0).stop 2023-10-07T00:22:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 -- 172.21.15.5:0/35953747 shutdown_connections 2023-10-07T00:22:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x564eacffb490 0x564eacffd8b0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564eacf92990 0x564eacfa0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564eacf90ec0 0x564eacf9faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 --2- 172.21.15.5:0/35953747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564eacf91fd0 0x564eacf9ffe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f24a65d4b80 1 -- 172.21.15.5:0/35953747 >> 172.21.15.5:0/35953747 conn(0x564eacf05200 msgr2=0x564eacfa28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.162+0000 7f246bfff700 0 client.26627 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:22:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.163+0000 7f24a65d4b80 1 -- 172.21.15.5:0/35953747 shutdown_connections 2023-10-07T00:22:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.163+0000 7f24a65d4b80 1 -- 172.21.15.5:0/35953747 wait complete. 2023-10-07T00:22:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.163+0000 7f24a65d4b80 20 client.26627 trim_cache size 0 max 16384 2023-10-07T00:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 -- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f247c0a1500 msgr2=0x7f247c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f247c0a1500 0x7f247c0a39c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x564eacf90c60 tx=0x7f248400b040 comp rx=0 tx=0).stop 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 -- 172.21.15.5:0/1934060953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248c0ff7f0 msgr2=0x7f248c198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248c0ff7f0 0x7f248c198d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2480005910 tx=0x7f2480005740 comp rx=0 tx=0).stop 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 -- 172.21.15.5:0/1934060953 shutdown_connections 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f247c0a1500 0x7f247c0a39c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c100b10 0x7f248c1a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248c0ff7f0 0x7f248c198d30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 --2- 172.21.15.5:0/1934060953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f248c100150 0x7f248c199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.164+0000 7f2492bff700 1 -- 172.21.15.5:0/1934060953 >> 172.21.15.5:0/1934060953 conn(0x7f248c0fb390 msgr2=0x7f248c0fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.165+0000 7f2492bff700 1 -- 172.21.15.5:0/1934060953 shutdown_connections 2023-10-07T00:22:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:08.165+0000 7f2492bff700 1 -- 172.21.15.5:0/1934060953 wait complete. 2023-10-07T00:22:08.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:07 smithi112 ceph-mon[133548]: pgmap v627: 97 pgs: 97 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 779 KiB/s wr, 309 op/s 2023-10-07T00:22:08.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:07 smithi005 ceph-mon[129406]: pgmap v627: 97 pgs: 97 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 779 KiB/s wr, 309 op/s 2023-10-07T00:22:08.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:07 smithi088 ceph-mon[103111]: pgmap v627: 97 pgs: 97 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 779 KiB/s wr, 309 op/s 2023-10-07T00:22:11.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:10 smithi088 ceph-mon[103111]: pgmap v628: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 932 KiB/s wr, 336 op/s 2023-10-07T00:22:11.249 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:10 smithi112 ceph-mon[133548]: pgmap v628: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 932 KiB/s wr, 336 op/s 2023-10-07T00:22:11.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:10 smithi005 ceph-mon[129406]: pgmap v628: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 932 KiB/s wr, 336 op/s 2023-10-07T00:22:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:12 smithi088 ceph-mon[103111]: pgmap v629: 97 pgs: 97 active+clean; 250 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 795 KiB/s wr, 339 op/s 2023-10-07T00:22:13.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:12 smithi112 ceph-mon[133548]: pgmap v629: 97 pgs: 97 active+clean; 250 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 795 KiB/s wr, 339 op/s 2023-10-07T00:22:13.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:12 smithi005 ceph-mon[129406]: pgmap v629: 97 pgs: 97 active+clean; 250 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 795 KiB/s wr, 339 op/s 2023-10-07T00:22:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:14 smithi088 ceph-mon[103111]: pgmap v630: 97 pgs: 97 active+clean; 241 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 898 KiB/s wr, 313 op/s 2023-10-07T00:22:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:14 smithi112 ceph-mon[133548]: pgmap v630: 97 pgs: 97 active+clean; 241 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 898 KiB/s wr, 313 op/s 2023-10-07T00:22:15.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:14 smithi005 ceph-mon[129406]: pgmap v630: 97 pgs: 97 active+clean; 241 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 898 KiB/s wr, 313 op/s 2023-10-07T00:22:16.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:15 smithi088 ceph-mon[103111]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:16.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:15 smithi112 ceph-mon[133548]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:16.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:15 smithi005 ceph-mon[129406]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-07T00:22:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:16 smithi088 ceph-mon[103111]: pgmap v631: 97 pgs: 97 active+clean; 227 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 846 KiB/s wr, 351 op/s 2023-10-07T00:22:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:16 smithi112 ceph-mon[133548]: pgmap v631: 97 pgs: 97 active+clean; 227 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 846 KiB/s wr, 351 op/s 2023-10-07T00:22:17.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:16 smithi005 ceph-mon[129406]: pgmap v631: 97 pgs: 97 active+clean; 227 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 846 KiB/s wr, 351 op/s 2023-10-07T00:22:19.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:18 smithi088 ceph-mon[103111]: pgmap v632: 97 pgs: 97 active+clean; 219 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 748 KiB/s wr, 341 op/s 2023-10-07T00:22:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:18 smithi112 ceph-mon[133548]: pgmap v632: 97 pgs: 97 active+clean; 219 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 748 KiB/s wr, 341 op/s 2023-10-07T00:22:19.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:18 smithi005 ceph-mon[129406]: pgmap v632: 97 pgs: 97 active+clean; 219 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 748 KiB/s wr, 341 op/s 2023-10-07T00:22:21.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:20 smithi088 ceph-mon[103111]: pgmap v633: 97 pgs: 97 active+clean; 213 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 865 KiB/s wr, 342 op/s 2023-10-07T00:22:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:20 smithi112 ceph-mon[133548]: pgmap v633: 97 pgs: 97 active+clean; 213 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 865 KiB/s wr, 342 op/s 2023-10-07T00:22:21.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:20 smithi005 ceph-mon[129406]: pgmap v633: 97 pgs: 97 active+clean; 213 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 865 KiB/s wr, 342 op/s 2023-10-07T00:22:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.398+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/1578128653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84100eb0 msgr2=0x7f4a841012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.398+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/1578128653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84100eb0 0x7f4a841012d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009990 tx=0x7f4a78009ca0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.399+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/1578128653 shutdown_connections 2023-10-07T00:22:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.399+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/1578128653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a84102a50 0x7f4a84109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.399+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/1578128653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84100eb0 0x7f4a841012d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.399+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/1578128653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a84102090 0x7f4a84102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.399+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/1578128653 >> 172.21.15.5:0/1578128653 conn(0x7f4a840fc470 msgr2=0x7f4a840fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.399+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/1578128653 shutdown_connections 2023-10-07T00:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.399+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/1578128653 wait complete. 2023-10-07T00:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.400+0000 7f4a8b5ff700 1 Processor -- start 2023-10-07T00:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.400+0000 7f4a8b5ff700 1 -- start start 2023-10-07T00:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8b5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a84100eb0 0x7f4a84198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8b5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84102090 0x7f4a84199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8b5ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a84102a50 0x7f4a841a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8b5ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841a0970 con 0x7f4a84102a50 2023-10-07T00:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8b5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841a0ab0 con 0x7f4a84100eb0 2023-10-07T00:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8b5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841a0c40 con 0x7f4a84102090 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8939b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a84100eb0 0x7f4a84198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84102090 0x7f4a84199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8939b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a84100eb0 0x7f4a84198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.5:43730/0 (socket says 172.21.15.5:43730) 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.401+0000 7f4a8939b700 1 -- 172.21.15.5:0/2203407420 learned_addr learned my addr 172.21.15.5:0/2203407420 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.402+0000 7f4a89b9c700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a84102a50 0x7f4a841a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.402+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2203407420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a84100eb0 msgr2=0x7f4a84198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.402+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a84100eb0 0x7f4a84198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.402+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a84102a50 msgr2=0x7f4a841a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.402+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a84102a50 0x7f4a841a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.402+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2203407420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780095f0 con 0x7f4a84102090 2023-10-07T00:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.402+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84102090 0x7f4a84199330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4a84100bd0 tx=0x7f4a8000b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.403+0000 7f4a767fc700 1 -- 172.21.15.5:0/2203407420 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80011830 con 0x7f4a84102090 2023-10-07T00:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.403+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/2203407420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a841a0f20 con 0x7f4a84102090 2023-10-07T00:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.403+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/2203407420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a841a13d0 con 0x7f4a84102090 2023-10-07T00:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.403+0000 7f4a767fc700 1 -- 172.21.15.5:0/2203407420 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a80011e20 con 0x7f4a84102090 2023-10-07T00:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.403+0000 7f4a767fc700 1 -- 172.21.15.5:0/2203407420 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80010d80 con 0x7f4a84102090 2023-10-07T00:22:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.410+0000 7f4a9eebeb80 1 Processor -- start 2023-10-07T00:22:21.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.410+0000 7f4a767fc700 1 -- 172.21.15.5:0/2203407420 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4a80011990 con 0x7f4a84102090 2023-10-07T00:22:21.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.411+0000 7f4a9eebeb80 1 -- start start 2023-10-07T00:22:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.411+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885e6d0 0x5651d885eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.411+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885f7e0 0x5651d885fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.412+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d8866a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.412+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d87be400 con 0x5651d885e6d0 2023-10-07T00:22:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.412+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d87afbc0 con 0x5651d885f7e0 2023-10-07T00:22:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.412+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d87ad4e0 con 0x5651d88601a0 2023-10-07T00:22:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.412+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d8866a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.412+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d8866a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:34598/0 (socket says 172.21.15.5:34598) 2023-10-07T00:22:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.412+0000 7f4a88b9a700 1 -- 172.21.15.5:0/1526452142 learned_addr learned my addr 172.21.15.5:0/1526452142 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.412+0000 7f4a89b9c700 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885e6d0 0x5651d885eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.413+0000 7f4a8939b700 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885f7e0 0x5651d885fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.413+0000 7f4a88b9a700 1 -- 172.21.15.5:0/1526452142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885f7e0 msgr2=0x5651d885fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.413+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885f7e0 0x5651d885fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.413+0000 7f4a88b9a700 1 -- 172.21.15.5:0/1526452142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885e6d0 msgr2=0x5651d885eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.413+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885e6d0 0x5651d885eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.413+0000 7f4a88b9a700 1 -- 172.21.15.5:0/1526452142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651d85d3d80 con 0x5651d88601a0 2023-10-07T00:22:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.413+0000 7f4a767fc700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4a700a1580 0x7f4a700a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.413+0000 7f4a767fc700 1 -- 172.21.15.5:0/2203407420 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4a800cc6f0 con 0x7f4a84102090 2023-10-07T00:22:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.414+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d8866a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4a800d25b0 tx=0x7f4a800d28c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3e2e9593d035825 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.414+0000 7f4a6f7fe700 1 -- 172.21.15.5:0/1526452142 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80010ee0 con 0x5651d88601a0 2023-10-07T00:22:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.414+0000 7f4a6f7fe700 1 -- 172.21.15.5:0/1526452142 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a800b7e90 con 0x5651d88601a0 2023-10-07T00:22:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.414+0000 7f4a6f7fe700 1 -- 172.21.15.5:0/1526452142 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80099760 con 0x5651d88601a0 2023-10-07T00:22:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.414+0000 7f4a89b9c700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4a700a1580 0x7f4a700a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.417+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/1526452142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 msgr2=0x5651d8866a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.417+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d8866a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4a800d25b0 tx=0x7f4a800d28c0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.417+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/1526452142 shutdown_connections 2023-10-07T00:22:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.417+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d8866a30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.417+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885e6d0 0x5651d885eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.417+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/1526452142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885f7e0 0x5651d885fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.417+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/1526452142 >> 172.21.15.5:0/1526452142 conn(0x5651d87ca200 msgr2=0x5651d8850b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:21.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.418+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/1526452142 shutdown_connections 2023-10-07T00:22:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.418+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/1526452142 wait complete. 2023-10-07T00:22:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.419+0000 7f4a9eebeb80 1 -- start start 2023-10-07T00:22:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.419+0000 7f4a89b9c700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4a700a1580 0x7f4a700a3a40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5651d885e470 tx=0x7f4a7c009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.421+0000 7f4a9eebeb80 1 Processor -- start 2023-10-07T00:22:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d88683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d8868930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d886f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d87a8dd0 con 0x5651d885f7e0 2023-10-07T00:22:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d87456b0 con 0x5651d885e6d0 2023-10-07T00:22:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d8745350 con 0x5651d88601a0 2023-10-07T00:22:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a9eebeb80 10 client.0 _ll_register_callbacks cb 0x5651d85a27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:22:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d8868930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d8868930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39326/0 (socket says 172.21.15.5:39326) 2023-10-07T00:22:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.422+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2801161884 learned_addr learned my addr 172.21.15.5:0/2801161884 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.423+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2801161884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 msgr2=0x5651d886f970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T00:22:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.423+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d886f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.423+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2801161884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 msgr2=0x5651d88683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.423+0000 7f4a8939b700 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d88683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.423+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d88683f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.423+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2801161884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a841a13d0 con 0x5651d885f7e0 2023-10-07T00:22:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.424+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d8868930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000bfd0 tx=0x7f4a800107f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef68d148d768a1d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.424+0000 7f4a6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-07T00:22:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.424+0000 7f4a6cff9700 1 -- 172.21.15.5:0/2801161884 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a800992f0 con 0x5651d885f7e0 2023-10-07T00:22:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.424+0000 7f4a6cff9700 1 -- 172.21.15.5:0/2801161884 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4a80011c40 con 0x5651d885f7e0 2023-10-07T00:22:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.425+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2801161884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651d8848d50 con 0x5651d885f7e0 2023-10-07T00:22:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.426+0000 7f4a6cff9700 1 -- 172.21.15.5:0/2801161884 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a80009280 con 0x5651d885f7e0 2023-10-07T00:22:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.426+0000 7f4a9eebeb80 10 client.16806 fetch_fsmap learned FSMap version 56 2023-10-07T00:22:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.426+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2801161884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x5651d85bcc00 con 0x5651d885f7e0 2023-10-07T00:22:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.427+0000 7f4a6cff9700 1 -- 172.21.15.5:0/2801161884 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a800b2020 con 0x5651d885f7e0 2023-10-07T00:22:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.427+0000 7f4a6cff9700 1 -- 172.21.15.5:0/2801161884 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 56) v1 ==== 7962+0+0 (secure 0 0 0) 0x7f4a80010380 con 0x5651d885f7e0 2023-10-07T00:22:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.427+0000 7f4a9eebeb80 10 client.16806 fetch_fsmap finished waiting for FSMap version 56 2023-10-07T00:22:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.427+0000 7f4a9eebeb80 10 client.16806 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:22:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.427+0000 7f4a9eebeb80 20 client.16806 populate_metadata read hostname 'smithi005' 2023-10-07T00:22:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.427+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5651d8884f70 0x5651d8887390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.427+0000 7f4a9eebeb80 4 client.16806 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-07T00:22:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.427+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2801161884 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651d87a1db0 con 0x5651d8884f70 2023-10-07T00:22:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.428+0000 7f4a8939b700 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5651d8884f70 0x5651d8887390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.428+0000 7f4a8939b700 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5651d8884f70 0x5651d8887390 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea2a5f4adf06af03 server_cookie=75e2f30a35fa61b4 in_seq=0 out_seq=0 2023-10-07T00:22:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.428+0000 7f4a6cff9700 10 client.16806 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:22:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.429+0000 7f4a6cff9700 1 -- 172.21.15.5:0/2801161884 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5651d87a1db0 con 0x5651d8884f70 2023-10-07T00:22:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.429+0000 7f4a6cff9700 10 client.16806 handle_command_reply: tid=0 2023-10-07T00:22:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.429+0000 7f4a9eebeb80 1 client.16806 shutdown 2023-10-07T00:22:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2801161884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 msgr2=0x5651d8868930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d8868930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000bfd0 tx=0x7f4a800107f0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2801161884 shutdown_connections 2023-10-07T00:22:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5651d8884f70 0x5651d8887390 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d886f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d88683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2801161884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d8868930 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a6cff9700 0 client.16806 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:22:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.430+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2801161884 >> 172.21.15.5:0/2801161884 conn(0x5651d87ca200 msgr2=0x5651d8850250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.431+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2801161884 shutdown_connections 2023-10-07T00:22:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.431+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2801161884 wait complete. 2023-10-07T00:22:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.432+0000 7f4a9eebeb80 20 client.16806 trim_cache size 0 max 16384 2023-10-07T00:22:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.451+0000 7f4a9eebeb80 1 Processor -- start 2023-10-07T00:22:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.451+0000 7f4a9eebeb80 1 -- start start 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d885e6d0 0x5651d885fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d88601a0 0x5651d88683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d86298c0 con 0x5651d885f7e0 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d88519e0 con 0x5651d88601a0 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d8884b00 con 0x5651d885e6d0 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39338/0 (socket says 172.21.15.5:39338) 2023-10-07T00:22:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2843725912 learned_addr learned my addr 172.21.15.5:0/2843725912 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a89b9c700 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d88601a0 0x5651d88683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.452+0000 7f4a8939b700 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d885e6d0 0x5651d885fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2843725912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d885e6d0 msgr2=0x5651d885fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d885e6d0 0x5651d885fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2843725912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d88601a0 msgr2=0x5651d88683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d88601a0 0x5651d88683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a88b9a700 1 -- 172.21.15.5:0/2843725912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651d85fa1f0 con 0x5651d885f7e0 2023-10-07T00:22:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a8939b700 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d885e6d0 0x5651d885fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:22:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886f890 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000bbe0 tx=0x7f4a80097f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe631e34411f6fc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a6ffff700 1 -- 172.21.15.5:0/2843725912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80009280 con 0x5651d885f7e0 2023-10-07T00:22:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a6ffff700 1 -- 172.21.15.5:0/2843725912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a800b2040 con 0x5651d885f7e0 2023-10-07T00:22:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.453+0000 7f4a6ffff700 1 -- 172.21.15.5:0/2843725912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a800105e0 con 0x5651d885f7e0 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.454+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2843725912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 msgr2=0x5651d886f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.454+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886f890 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000bbe0 tx=0x7f4a80097f40 comp rx=0 tx=0).stop 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.454+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2843725912 shutdown_connections 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.454+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d88601a0 0x5651d88683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.454+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d885e6d0 0x5651d885fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.454+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/2843725912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886f890 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.454+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2843725912 >> 172.21.15.5:0/2843725912 conn(0x5651d87ca200 msgr2=0x5651d88811b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.454+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2843725912 shutdown_connections 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.455+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/2843725912 wait complete. 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.455+0000 7f4a9eebeb80 1 -- start start 2023-10-07T00:22:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.455+0000 7f4a9eebeb80 1 Processor -- start 2023-10-07T00:22:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d886d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a9eebeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d886e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d886ec60 con 0x5651d885f7e0 2023-10-07T00:22:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d886edd0 con 0x5651d885e6d0 2023-10-07T00:22:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a9eebeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651d886ef90 con 0x5651d88601a0 2023-10-07T00:22:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a9eebeb80 10 client.0 _ll_register_callbacks cb 0x5651d85a27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T00:22:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a8939b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d886d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a88b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39352/0 (socket says 172.21.15.5:39352) 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a88b9a700 1 -- 172.21.15.5:0/3659975157 learned_addr learned my addr 172.21.15.5:0/3659975157 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a89b9c700 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d886e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a8939b700 1 -- 172.21.15.5:0/3659975157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 msgr2=0x5651d886e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a8939b700 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d886e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a8939b700 1 -- 172.21.15.5:0/3659975157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 msgr2=0x5651d886d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a8939b700 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a8939b700 1 -- 172.21.15.5:0/3659975157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651d85bcc00 con 0x5651d885e6d0 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.456+0000 7f4a89b9c700 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d886e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.457+0000 7f4a8939b700 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d886d1d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006010 tx=0x7f4a780264a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=436dd2f630b428df server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.457+0000 7f4a6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.457+0000 7f4a6cff9700 1 -- 172.21.15.5:0/3659975157 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78026a00 con 0x5651d885e6d0 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.457+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/3659975157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a800b7e90 con 0x5651d885e6d0 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.457+0000 7f4a6cff9700 1 -- 172.21.15.5:0/3659975157 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4a78026b60 con 0x5651d885e6d0 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.457+0000 7f4a6cff9700 1 -- 172.21.15.5:0/3659975157 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a78026d40 con 0x5651d885e6d0 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.457+0000 7f4a9eebeb80 10 client.26642 fetch_fsmap learned FSMap version 56 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.457+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/3659975157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x5651d85d2250 con 0x5651d885e6d0 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a6cff9700 1 -- 172.21.15.5:0/3659975157 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a800b7e90 con 0x5651d885e6d0 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a6cff9700 1 -- 172.21.15.5:0/3659975157 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 56) v1 ==== 7962+0+0 (secure 0 0 0) 0x7f4a78004620 con 0x5651d885e6d0 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a9eebeb80 10 client.26642 fetch_fsmap finished waiting for FSMap version 56 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a9eebeb80 10 client.26642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a9eebeb80 20 client.26642 populate_metadata read hostname 'smithi005' 2023-10-07T00:22:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5651d88d9a10 0x5651d88dbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a9eebeb80 4 client.26642 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-07T00:22:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/3659975157 --> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5651d87a1ad0 con 0x5651d88d9a10 2023-10-07T00:22:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.458+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5651d88d9a10 0x5651d88dbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.459+0000 7f4a88b9a700 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5651d88d9a10 0x5651d88dbe30 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94fbd1076cc3a708 server_cookie=e00b21f0f59998f7 in_seq=0 out_seq=0 2023-10-07T00:22:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.459+0000 7f4a6cff9700 10 client.26642 ms_handle_connect on v2:172.21.15.88:6838/4013876185 2023-10-07T00:22:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.488+0000 7f4a6cff9700 1 -- 172.21.15.5:0/3659975157 <== mds.0 v2:172.21.15.88:6838/4013876185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5651d87a1ad0 con 0x5651d88d9a10 2023-10-07T00:22:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.488+0000 7f4a6cff9700 10 client.26642 handle_command_reply: tid=0 2023-10-07T00:22:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.488+0000 7f4a9eebeb80 1 client.26642 shutdown 2023-10-07T00:22:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/3659975157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 msgr2=0x5651d886d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d886d1d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006010 tx=0x7f4a780264a0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/3659975157 shutdown_connections 2023-10-07T00:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.88:6838/4013876185,v1:172.21.15.88:6839/4013876185] conn(0x5651d88d9a10 0x5651d88dbe30 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5651d88601a0 0x5651d886e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5651d885e6d0 0x5651d886d1d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a6cff9700 0 client.26642 ms_handle_reset on v2:172.21.15.88:6838/4013876185 2023-10-07T00:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 --2- 172.21.15.5:0/3659975157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651d885f7e0 0x5651d886d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/3659975157 >> 172.21.15.5:0/3659975157 conn(0x5651d87ca200 msgr2=0x5651d8863150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/3659975157 shutdown_connections 2023-10-07T00:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 1 -- 172.21.15.5:0/3659975157 wait complete. 2023-10-07T00:22:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.489+0000 7f4a9eebeb80 20 client.26642 trim_cache size 0 max 16384 2023-10-07T00:22:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-07T00:22:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-07T00:22:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-07T00:22:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4a700a1580 msgr2=0x7f4a700a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4a700a1580 0x7f4a700a3a40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5651d885e470 tx=0x7f4a7c009040 comp rx=0 tx=0).stop 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/2203407420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84102090 msgr2=0x7f4a84199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84102090 0x7f4a84199330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4a84100bd0 tx=0x7f4a8000b7e0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/2203407420 shutdown_connections 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4a700a1580 0x7f4a700a3a40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a84102a50 0x7f4a841a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a84100eb0 0x7f4a84198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 --2- 172.21.15.5:0/2203407420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a84102090 0x7f4a84199330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:21.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/2203407420 >> 172.21.15.5:0/2203407420 conn(0x7f4a840fc470 msgr2=0x7f4a840fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:21.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/2203407420 shutdown_connections 2023-10-07T00:22:21.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-07T00:22:21.490+0000 7f4a8b5ff700 1 -- 172.21.15.5:0/2203407420 wait complete. 2023-10-07T00:22:23.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:22 smithi088 ceph-mon[103111]: pgmap v634: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 720 KiB/s wr, 341 op/s 2023-10-07T00:22:23.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:22 smithi112 ceph-mon[133548]: pgmap v634: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 720 KiB/s wr, 341 op/s 2023-10-07T00:22:23.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:22 smithi005 ceph-mon[129406]: pgmap v634: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 720 KiB/s wr, 341 op/s 2023-10-07T00:22:24.510 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2023-10-07T00:22:24.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-07T00:22:25.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:24 smithi088 ceph-mon[103111]: pgmap v635: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 898 KiB/s wr, 324 op/s 2023-10-07T00:22:25.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:24 smithi112 ceph-mon[133548]: pgmap v635: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 898 KiB/s wr, 324 op/s 2023-10-07T00:22:25.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:24 smithi005 ceph-mon[129406]: pgmap v635: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 898 KiB/s wr, 324 op/s 2023-10-07T00:22:25.564 DEBUG:teuthology.parallel:result is None 2023-10-07T00:22:25.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-07T00:22:25.643 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-07T00:22:25.644 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-07T00:22:25.654 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi005.front.sepia.ceph.com 2023-10-07T00:22:25.665 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-07T00:22:25.674 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-07T00:22:25.674 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-07T00:22:25.675 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-07T00:22:25.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 -- 172.21.15.5:0/3788876331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc100fc0 msgr2=0x7f83bc1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3788876331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc100fc0 0x7f83bc1013e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f83b80099c0 tx=0x7f83b8009cd0 comp rx=0 tx=0).stop 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 -- 172.21.15.5:0/3788876331 shutdown_connections 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3788876331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83bc102b50 0x7f83bc109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3788876331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc100fc0 0x7f83bc1013e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3788876331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc1021b0 0x7f83bc102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 -- 172.21.15.5:0/3788876331 >> 172.21.15.5:0/3788876331 conn(0x7f83bc0fc530 msgr2=0x7f83bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 -- 172.21.15.5:0/3788876331 shutdown_connections 2023-10-07T00:22:25.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.913+0000 7f83c3dff700 1 -- 172.21.15.5:0/3788876331 wait complete. 2023-10-07T00:22:25.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.914+0000 7f83c3dff700 1 Processor -- start 2023-10-07T00:22:25.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.914+0000 7f83c3dff700 1 -- start start 2023-10-07T00:22:25.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c3dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc100fc0 0x7f83bc074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:25.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c3dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc1021b0 0x7f83bc0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c3dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83bc102b50 0x7f83bc0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c3dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc073f80 con 0x7f83bc1021b0 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c3dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0740f0 con 0x7f83bc102b50 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c3dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1a0d10 con 0x7f83bc100fc0 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c139a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc1021b0 0x7f83bc0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c139a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc1021b0 0x7f83bc0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46152/0 (socket says 172.21.15.5:46152) 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c139a700 1 -- 172.21.15.5:0/3239072203 learned_addr learned my addr 172.21.15.5:0/3239072203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c1b9b700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc100fc0 0x7f83bc074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.915+0000 7f83c239c700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83bc102b50 0x7f83bc0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:25.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.916+0000 7f83c139a700 1 -- 172.21.15.5:0/3239072203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc100fc0 msgr2=0x7f83bc074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.916+0000 7f83c139a700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc100fc0 0x7f83bc074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.916+0000 7f83c139a700 1 -- 172.21.15.5:0/3239072203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83bc102b50 msgr2=0x7f83bc0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.916+0000 7f83c139a700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83bc102b50 0x7f83bc0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.916+0000 7f83c139a700 1 -- 172.21.15.5:0/3239072203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80095f0 con 0x7f83bc1021b0 2023-10-07T00:22:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.916+0000 7f83c1b9b700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc100fc0 0x7f83bc074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:22:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.916+0000 7f83c239c700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83bc102b50 0x7f83bc0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T00:22:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.916+0000 7f83c139a700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc1021b0 0x7f83bc0732a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00e9a0 tx=0x7f83ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.917+0000 7f83b2ffd700 1 -- 172.21.15.5:0/3239072203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac009790 con 0x7f83bc1021b0 2023-10-07T00:22:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.917+0000 7f83b2ffd700 1 -- 172.21.15.5:0/3239072203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83ac010430 con 0x7f83bc1021b0 2023-10-07T00:22:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.917+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc1a0ff0 con 0x7f83bc1021b0 2023-10-07T00:22:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.917+0000 7f83b2ffd700 1 -- 172.21.15.5:0/3239072203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00cea0 con 0x7f83bc1021b0 2023-10-07T00:22:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.917+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc1a1470 con 0x7f83bc1021b0 2023-10-07T00:22:25.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.919+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc10c6d0 con 0x7f83bc1021b0 2023-10-07T00:22:25.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.922+0000 7f83b2ffd700 1 -- 172.21.15.5:0/3239072203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f83ac0105a0 con 0x7f83bc1021b0 2023-10-07T00:22:25.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.924+0000 7f83b2ffd700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f83a80a1480 0x7f83a80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:25.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.924+0000 7f83b2ffd700 1 -- 172.21.15.5:0/3239072203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f83ac014070 con 0x7f83bc1021b0 2023-10-07T00:22:25.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.924+0000 7f83c1b9b700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f83a80a1480 0x7f83a80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:25.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.925+0000 7f83c1b9b700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f83a80a1480 0x7f83a80a3940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009fd0 tx=0x7f83b800bfd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:25.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:25.930+0000 7f83b2ffd700 1 -- 172.21.15.5:0/3239072203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83ac052100 con 0x7f83bc1021b0 2023-10-07T00:22:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.142+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83bc1a1690 con 0x7f83bc1021b0 2023-10-07T00:22:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.143+0000 7f83b2ffd700 1 -- 172.21.15.5:0/3239072203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f83ac096510 con 0x7f83bc1021b0 2023-10-07T00:22:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:22:26.145 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:22:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f83a80a1480 msgr2=0x7f83a80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f83a80a1480 0x7f83a80a3940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009fd0 tx=0x7f83b800bfd0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc1021b0 msgr2=0x7f83bc0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc1021b0 0x7f83bc0732a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00e9a0 tx=0x7f83ac00ecb0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 shutdown_connections 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f83a80a1480 0x7f83a80a3940 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83bc102b50 0x7f83bc0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc100fc0 0x7f83bc074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 --2- 172.21.15.5:0/3239072203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc1021b0 0x7f83bc0732a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 >> 172.21.15.5:0/3239072203 conn(0x7f83bc0fc530 msgr2=0x7f83bc0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 shutdown_connections 2023-10-07T00:22:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.146+0000 7f83c3dff700 1 -- 172.21.15.5:0/3239072203 wait complete. 2023-10-07T00:22:26.166 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:22:26.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:22:26.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.372+0000 7f50cbfff700 1 -- 172.21.15.5:0/3829883547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 msgr2=0x7f50c41013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.372+0000 7f50cbfff700 1 --2- 172.21.15.5:0/3829883547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 0x7f50c41013e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f50c00099c0 tx=0x7f50c0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.373+0000 7f50cbfff700 1 -- 172.21.15.5:0/3829883547 shutdown_connections 2023-10-07T00:22:26.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.373+0000 7f50cbfff700 1 --2- 172.21.15.5:0/3829883547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50c4102b50 0x7f50c4109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.373+0000 7f50cbfff700 1 --2- 172.21.15.5:0/3829883547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 0x7f50c41013e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.373+0000 7f50cbfff700 1 --2- 172.21.15.5:0/3829883547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c41021b0 0x7f50c4102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.373+0000 7f50cbfff700 1 -- 172.21.15.5:0/3829883547 >> 172.21.15.5:0/3829883547 conn(0x7f50c40fc530 msgr2=0x7f50c40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:26.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.373+0000 7f50cbfff700 1 -- 172.21.15.5:0/3829883547 shutdown_connections 2023-10-07T00:22:26.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.373+0000 7f50cbfff700 1 -- 172.21.15.5:0/3829883547 wait complete. 2023-10-07T00:22:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50cbfff700 1 Processor -- start 2023-10-07T00:22:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50cbfff700 1 -- start start 2023-10-07T00:22:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50cbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 0x7f50c4196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50cbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50c41021b0 0x7f50c41971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50cbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c4102b50 0x7f50c419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50cbfff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c419e770 con 0x7f50c4100fc0 2023-10-07T00:22:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50cbfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c419e8e0 con 0x7f50c41021b0 2023-10-07T00:22:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50cbfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c419eaa0 con 0x7f50c4102b50 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50c9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 0x7f50c4196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50c9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 0x7f50c4196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46180/0 (socket says 172.21.15.5:46180) 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.374+0000 7f50c9d9b700 1 -- 172.21.15.5:0/2611638823 learned_addr learned my addr 172.21.15.5:0/2611638823 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50ca59c700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c4102b50 0x7f50c419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50c959a700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50c41021b0 0x7f50c41971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50c9d9b700 1 -- 172.21.15.5:0/2611638823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c4102b50 msgr2=0x7f50c419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50c9d9b700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c4102b50 0x7f50c419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50c9d9b700 1 -- 172.21.15.5:0/2611638823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50c41021b0 msgr2=0x7f50c41971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50c9d9b700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50c41021b0 0x7f50c41971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50c9d9b700 1 -- 172.21.15.5:0/2611638823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00095f0 con 0x7f50c4100fc0 2023-10-07T00:22:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50c959a700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50c41021b0 0x7f50c41971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:22:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50c9d9b700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 0x7f50c4196c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009f50 tx=0x7f50c0003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50baffd700 1 -- 172.21.15.5:0/2611638823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c001d070 con 0x7f50c4100fc0 2023-10-07T00:22:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50baffd700 1 -- 172.21.15.5:0/2611638823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50c000bda0 con 0x7f50c4100fc0 2023-10-07T00:22:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c419ed20 con 0x7f50c4100fc0 2023-10-07T00:22:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.375+0000 7f50baffd700 1 -- 172.21.15.5:0/2611638823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c0022e40 con 0x7f50c4100fc0 2023-10-07T00:22:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.376+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c419f140 con 0x7f50c4100fc0 2023-10-07T00:22:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.377+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c410c700 con 0x7f50c4100fc0 2023-10-07T00:22:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.379+0000 7f50baffd700 1 -- 172.21.15.5:0/2611638823 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f50c00225e0 con 0x7f50c4100fc0 2023-10-07T00:22:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.380+0000 7f50baffd700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f50b00a1480 0x7f50b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.380+0000 7f50baffd700 1 -- 172.21.15.5:0/2611638823 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f50c00ce900 con 0x7f50c4100fc0 2023-10-07T00:22:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.380+0000 7f50c959a700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f50b00a1480 0x7f50b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:26.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.381+0000 7f50c959a700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f50b00a1480 0x7f50b00a3940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f50b4005fd0 tx=0x7f50b4005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.382+0000 7f50baffd700 1 -- 172.21.15.5:0/2611638823 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f50c0097f70 con 0x7f50c4100fc0 2023-10-07T00:22:26.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.591+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50c419f2d0 con 0x7f50c4100fc0 2023-10-07T00:22:26.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.591+0000 7f50baffd700 1 -- 172.21.15.5:0/2611638823 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50c009b590 con 0x7f50c4100fc0 2023-10-07T00:22:26.593 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:22:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f50b00a1480 msgr2=0x7f50b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f50b00a1480 0x7f50b00a3940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f50b4005fd0 tx=0x7f50b4005f60 comp rx=0 tx=0).stop 2023-10-07T00:22:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 msgr2=0x7f50c4196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 0x7f50c4196c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009f50 tx=0x7f50c0003b00 comp rx=0 tx=0).stop 2023-10-07T00:22:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 shutdown_connections 2023-10-07T00:22:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f50b00a1480 0x7f50b00a3940 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c4102b50 0x7f50c419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50c4100fc0 0x7f50c4196c80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 --2- 172.21.15.5:0/2611638823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50c41021b0 0x7f50c41971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 >> 172.21.15.5:0/2611638823 conn(0x7f50c40fc530 msgr2=0x7f50c40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 shutdown_connections 2023-10-07T00:22:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.594+0000 7f50cbfff700 1 -- 172.21.15.5:0/2611638823 wait complete. 2023-10-07T00:22:26.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:22:26.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.822+0000 7f4bc97ff700 1 -- 172.21.15.5:0/1878570497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bc4073910 msgr2=0x7f4bc4073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.822+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/1878570497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bc4073910 0x7f4bc4073d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009990 tx=0x7f4bb8009ca0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.822+0000 7f4bc97ff700 1 -- 172.21.15.5:0/1878570497 shutdown_connections 2023-10-07T00:22:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.822+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/1878570497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4108e80 0x7f4bc410b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.822+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/1878570497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc4074ef0 0x7f4bc4073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.822+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/1878570497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bc4073910 0x7f4bc4073d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.822+0000 7f4bc97ff700 1 -- 172.21.15.5:0/1878570497 >> 172.21.15.5:0/1878570497 conn(0x7f4bc40fc530 msgr2=0x7f4bc40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.823+0000 7f4bc97ff700 1 -- 172.21.15.5:0/1878570497 shutdown_connections 2023-10-07T00:22:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.823+0000 7f4bc97ff700 1 -- 172.21.15.5:0/1878570497 wait complete. 2023-10-07T00:22:26.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc97ff700 1 Processor -- start 2023-10-07T00:22:26.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc97ff700 1 -- start start 2023-10-07T00:22:26.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc97ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bc4073910 0x7f4bc4198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc97ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4074ef0 0x7f4bc4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc97ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc4108e80 0x7f4bc41a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc97ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41a0990 con 0x7f4bc4074ef0 2023-10-07T00:22:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc97ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41a0ad0 con 0x7f4bc4073910 2023-10-07T00:22:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc97ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41a0c60 con 0x7f4bc4108e80 2023-10-07T00:22:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4074ef0 0x7f4bc4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4074ef0 0x7f4bc4199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46196/0 (socket says 172.21.15.5:46196) 2023-10-07T00:22:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc27fc700 1 -- 172.21.15.5:0/730381014 learned_addr learned my addr 172.21.15.5:0/730381014 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.824+0000 7f4bc2ffd700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bc4073910 0x7f4bc4198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc37fe700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc4108e80 0x7f4bc41a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc27fc700 1 -- 172.21.15.5:0/730381014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc4108e80 msgr2=0x7f4bc41a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc27fc700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc4108e80 0x7f4bc41a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc27fc700 1 -- 172.21.15.5:0/730381014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bc4073910 msgr2=0x7f4bc4198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc27fc700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bc4073910 0x7f4bc4198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc27fc700 1 -- 172.21.15.5:0/730381014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc009c40 con 0x7f4bc4074ef0 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc37fe700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc4108e80 0x7f4bc41a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc27fc700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4074ef0 0x7f4bc4199350 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8005910 tx=0x7f4bb8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4babfff700 1 -- 172.21.15.5:0/730381014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb801d070 con 0x7f4bc4074ef0 2023-10-07T00:22:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4babfff700 1 -- 172.21.15.5:0/730381014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bb800be30 con 0x7f4bc4074ef0 2023-10-07T00:22:26.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb80095f0 con 0x7f4bc4074ef0 2023-10-07T00:22:26.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.825+0000 7f4babfff700 1 -- 172.21.15.5:0/730381014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8022dd0 con 0x7f4bc4074ef0 2023-10-07T00:22:26.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.826+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc41a11d0 con 0x7f4bc4074ef0 2023-10-07T00:22:26.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.827+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc4107530 con 0x7f4bc4074ef0 2023-10-07T00:22:26.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.829+0000 7f4babfff700 1 -- 172.21.15.5:0/730381014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4bb8022570 con 0x7f4bc4074ef0 2023-10-07T00:22:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.830+0000 7f4babfff700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bac0a1500 0x7f4bac0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.830+0000 7f4babfff700 1 -- 172.21.15.5:0/730381014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4bb80ce170 con 0x7f4bc4074ef0 2023-10-07T00:22:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.830+0000 7f4bc2ffd700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bac0a1500 0x7f4bac0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.831+0000 7f4bc2ffd700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bac0a1500 0x7f4bac0a39c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009c60 tx=0x7f4bb4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:26.834+0000 7f4babfff700 1 -- 172.21.15.5:0/730381014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4bb8097900 con 0x7f4bc4074ef0 2023-10-07T00:22:27.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.057+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bc402d100 con 0x7f4bc4074ef0 2023-10-07T00:22:27.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.058+0000 7f4babfff700 1 -- 172.21.15.5:0/730381014 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4bb809af20 con 0x7f4bc4074ef0 2023-10-07T00:22:27.059 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:22:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bac0a1500 msgr2=0x7f4bac0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bac0a1500 0x7f4bac0a39c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009c60 tx=0x7f4bb4009260 comp rx=0 tx=0).stop 2023-10-07T00:22:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4074ef0 msgr2=0x7f4bc4199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4074ef0 0x7f4bc4199350 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8005910 tx=0x7f4bb8005740 comp rx=0 tx=0).stop 2023-10-07T00:22:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 shutdown_connections 2023-10-07T00:22:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f4bac0a1500 0x7f4bac0a39c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc4108e80 0x7f4bc41a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bc4073910 0x7f4bc4198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 --2- 172.21.15.5:0/730381014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc4074ef0 0x7f4bc4199350 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.060+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 >> 172.21.15.5:0/730381014 conn(0x7f4bc40fc530 msgr2=0x7f4bc40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.061+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 shutdown_connections 2023-10-07T00:22:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.061+0000 7f4bc97ff700 1 -- 172.21.15.5:0/730381014 wait complete. 2023-10-07T00:22:27.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:22:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:26 smithi088 ceph-mon[103111]: pgmap v636: 97 pgs: 97 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 869 KiB/s wr, 356 op/s 2023-10-07T00:22:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:26 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3239072203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:22:27.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:26 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2611638823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:22:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:26 smithi112 ceph-mon[133548]: pgmap v636: 97 pgs: 97 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 869 KiB/s wr, 356 op/s 2023-10-07T00:22:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:26 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3239072203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:22:27.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:26 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2611638823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:22:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 -- 172.21.15.5:0/2739311865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e60100fc0 msgr2=0x7f9e601013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 --2- 172.21.15.5:0/2739311865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e60100fc0 0x7f9e601013e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9e500099c0 tx=0x7f9e50009cd0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 -- 172.21.15.5:0/2739311865 shutdown_connections 2023-10-07T00:22:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 --2- 172.21.15.5:0/2739311865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e60102b50 0x7f9e60109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 --2- 172.21.15.5:0/2739311865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e60100fc0 0x7f9e601013e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 --2- 172.21.15.5:0/2739311865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e601021b0 0x7f9e60102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 -- 172.21.15.5:0/2739311865 >> 172.21.15.5:0/2739311865 conn(0x7f9e600fc530 msgr2=0x7f9e600fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 -- 172.21.15.5:0/2739311865 shutdown_connections 2023-10-07T00:22:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.286+0000 7f9e659ff700 1 -- 172.21.15.5:0/2739311865 wait complete. 2023-10-07T00:22:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.287+0000 7f9e659ff700 1 Processor -- start 2023-10-07T00:22:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.287+0000 7f9e659ff700 1 -- start start 2023-10-07T00:22:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.287+0000 7f9e659ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e60100fc0 0x7f9e60196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.287+0000 7f9e659ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e601021b0 0x7f9e60197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e659ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e60102b50 0x7f9e6019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e659ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6019e770 con 0x7f9e601021b0 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e659ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6019e8b0 con 0x7f9e60100fc0 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e659ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6019ea40 con 0x7f9e60102b50 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e601021b0 0x7f9e60197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e601021b0 0x7f9e60197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46208/0 (socket says 172.21.15.5:46208) 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5e7fc700 1 -- 172.21.15.5:0/3725709068 learned_addr learned my addr 172.21.15.5:0/3725709068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5f7fe700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e60102b50 0x7f9e6019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5effd700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e60100fc0 0x7f9e60196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5e7fc700 1 -- 172.21.15.5:0/3725709068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e60102b50 msgr2=0x7f9e6019e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5e7fc700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e60102b50 0x7f9e6019e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5e7fc700 1 -- 172.21.15.5:0/3725709068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e60100fc0 msgr2=0x7f9e60196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5e7fc700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e60100fc0 0x7f9e60196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5e7fc700 1 -- 172.21.15.5:0/3725709068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e500095f0 con 0x7f9e601021b0 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.288+0000 7f9e5effd700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e60100fc0 0x7f9e60196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.289+0000 7f9e5e7fc700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e601021b0 0x7f9e60197130 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400d950 tx=0x7f9e5400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.289+0000 7f9e649fd700 1 -- 172.21.15.5:0/3725709068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54009940 con 0x7f9e601021b0 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.289+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6019ed20 con 0x7f9e601021b0 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.289+0000 7f9e649fd700 1 -- 172.21.15.5:0/3725709068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e54010460 con 0x7f9e601021b0 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.289+0000 7f9e649fd700 1 -- 172.21.15.5:0/3725709068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5400f620 con 0x7f9e601021b0 2023-10-07T00:22:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.289+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6019f1d0 con 0x7f9e601021b0 2023-10-07T00:22:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.290+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e60107fa0 con 0x7f9e601021b0 2023-10-07T00:22:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.292+0000 7f9e649fd700 1 -- 172.21.15.5:0/3725709068 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9e540105d0 con 0x7f9e601021b0 2023-10-07T00:22:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.293+0000 7f9e649fd700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e480a1480 0x7f9e480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.293+0000 7f9e649fd700 1 -- 172.21.15.5:0/3725709068 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9e540ccba0 con 0x7f9e601021b0 2023-10-07T00:22:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.293+0000 7f9e5effd700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e480a1480 0x7f9e480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.294+0000 7f9e5effd700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e480a1480 0x7f9e480a3940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e50000c00 tx=0x7f9e50005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.297+0000 7f9e649fd700 1 -- 172.21.15.5:0/3725709068 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9e54096180 con 0x7f9e601021b0 2023-10-07T00:22:27.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:26 smithi005 ceph-mon[129406]: pgmap v636: 97 pgs: 97 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 869 KiB/s wr, 356 op/s 2023-10-07T00:22:27.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:26 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3239072203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:22:27.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:26 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2611638823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:22:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.511+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e6002d130 con 0x7f9e601021b0 2023-10-07T00:22:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.512+0000 7f9e649fd700 1 -- 172.21.15.5:0/3725709068 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e540160a0 con 0x7f9e601021b0 2023-10-07T00:22:27.513 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:22:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e480a1480 msgr2=0x7f9e480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e480a1480 0x7f9e480a3940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e50000c00 tx=0x7f9e50005fb0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e601021b0 msgr2=0x7f9e60197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e601021b0 0x7f9e60197130 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400d950 tx=0x7f9e5400dc60 comp rx=0 tx=0).stop 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 shutdown_connections 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f9e480a1480 0x7f9e480a3940 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e60102b50 0x7f9e6019e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e60100fc0 0x7f9e60196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 --2- 172.21.15.5:0/3725709068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e601021b0 0x7f9e60197130 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 >> 172.21.15.5:0/3725709068 conn(0x7f9e600fc530 msgr2=0x7f9e600fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 shutdown_connections 2023-10-07T00:22:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.514+0000 7f9e659ff700 1 -- 172.21.15.5:0/3725709068 wait complete. 2023-10-07T00:22:27.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-07T00:22:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3522542900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb81021a0 msgr2=0x7f8eb8102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3522542900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb81021a0 0x7f8eb8102600 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80099c0 tx=0x7f8ea8009cd0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3522542900 shutdown_connections 2023-10-07T00:22:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3522542900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb8102b40 0x7f8eb81093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3522542900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8eb8100fb0 0x7f8eb81013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3522542900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb81021a0 0x7f8eb8102600 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3522542900 >> 172.21.15.5:0/3522542900 conn(0x7f8eb80fc520 msgr2=0x7f8eb80fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3522542900 shutdown_connections 2023-10-07T00:22:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.737+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3522542900 wait complete. 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.739+0000 7f8ebf5ff700 1 Processor -- start 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.739+0000 7f8ebf5ff700 1 -- start start 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.739+0000 7f8ebf5ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb8100fb0 0x7f8eb8196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.739+0000 7f8ebf5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb81021a0 0x7f8eb8197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.739+0000 7f8ebf5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8eb8102b40 0x7f8eb819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.739+0000 7f8ebf5ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb819e760 con 0x7f8eb8100fb0 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.739+0000 7f8ebf5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb819e8a0 con 0x7f8eb8102b40 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.739+0000 7f8ebf5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb819ea30 con 0x7f8eb81021a0 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb8100fb0 0x7f8eb8196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb8100fb0 0x7f8eb8196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46236/0 (socket says 172.21.15.5:46236) 2023-10-07T00:22:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 -- 172.21.15.5:0/3479357166 learned_addr learned my addr 172.21.15.5:0/3479357166 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebcb9a700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb81021a0 0x7f8eb8197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 -- 172.21.15.5:0/3479357166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb81021a0 msgr2=0x7f8eb8197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebdb9c700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8eb8102b40 0x7f8eb819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb81021a0 0x7f8eb8197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 -- 172.21.15.5:0/3479357166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8eb8102b40 msgr2=0x7f8eb819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8eb8102b40 0x7f8eb819e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 -- 172.21.15.5:0/3479357166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80095f0 con 0x7f8eb8100fb0 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebdb9c700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8eb8102b40 0x7f8eb819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.740+0000 7f8ebd39b700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb8100fb0 0x7f8eb8196be0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400e970 tx=0x7f8eb400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.741+0000 7f8eae7fc700 1 -- 172.21.15.5:0/3479357166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4009790 con 0x7f8eb8100fb0 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.741+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb819ed10 con 0x7f8eb8100fb0 2023-10-07T00:22:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.741+0000 7f8eae7fc700 1 -- 172.21.15.5:0/3479357166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8eb400eec0 con 0x7f8eb8100fb0 2023-10-07T00:22:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.741+0000 7f8eae7fc700 1 -- 172.21.15.5:0/3479357166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4003c10 con 0x7f8eb8100fb0 2023-10-07T00:22:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.741+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb819f1c0 con 0x7f8eb8100fb0 2023-10-07T00:22:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.742+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb810c6c0 con 0x7f8eb8100fb0 2023-10-07T00:22:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.744+0000 7f8eae7fc700 1 -- 172.21.15.5:0/3479357166 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8eb4003db0 con 0x7f8eb8100fb0 2023-10-07T00:22:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.745+0000 7f8eae7fc700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ea40a1480 0x7f8ea40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:22:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.745+0000 7f8eae7fc700 1 -- 172.21.15.5:0/3479357166 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8eb4014070 con 0x7f8eb8100fb0 2023-10-07T00:22:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.746+0000 7f8ebcb9a700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ea40a1480 0x7f8ea40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:22:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.746+0000 7f8ebcb9a700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ea40a1480 0x7f8ea40a3940 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8000c00 tx=0x7f8ea8005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:22:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:27.749+0000 7f8eae7fc700 1 -- 172.21.15.5:0/3479357166 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8eb40965d0 con 0x7f8eb8100fb0 2023-10-07T00:22:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.034+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f8eb8107f60 con 0x7f8eb8100fb0 2023-10-07T00:22:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.044+0000 7f8eae7fc700 1 -- 172.21.15.5:0/3479357166 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733867 (secure 0 0 0) 0x7f8eb4099bf0 con 0x7f8eb8100fb0 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 18, 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "active_gid": 14150, 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "active_name": "x", 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addrs": { 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 227111979 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 227111979 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addr": "172.21.15.5:6801/227111979", 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "active_change": "2023-10-07T00:03:49.552351+0000", 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "active_mgr_features": 4540138322906710015, 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "available": true, 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "standbys": [ 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 14220, 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "y", 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540138322906710015, 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2023-10-07T00:22:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.065 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.066 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.067 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2023-10-07T00:22:28.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.071 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.072 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.075 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2023-10-07T00:22:28.076 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.077 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2023-10-07T00:22:28.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2023-10-07T00:22:28.081 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.082 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.085 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.087 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.088 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-07T00:22:28.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap" 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2023-10-07T00:22:28.092 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.093 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-07T00:22:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2023-10-07T00:22:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-07T00:22:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2023-10-07T00:22:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2023-10-07T00:22:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2023-10-07T00:22:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2023-10-07T00:22:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-07T00:22:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2023-10-07T00:22:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2023-10-07T00:22:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-07T00:22:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2023-10-07T00:22:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2023-10-07T00:22:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.137 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.139 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.140 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.141 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.143 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-07T00:22:28.145 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.145 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:28.147 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.148 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-07T00:22:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.151 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2023-10-07T00:22:28.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2023-10-07T00:22:28.155 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.156 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.157 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2023-10-07T00:22:28.158 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.160 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.161 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.162 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2023-10-07T00:22:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.165 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.166 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.167 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.170 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.170 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.170 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.170 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-07T00:22:28.170 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.170 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.170 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.171 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:28.172 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:28.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:28.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2023-10-07T00:22:28.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2023-10-07T00:22:28.181 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.183 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2023-10-07T00:22:28.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.188 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-07T00:22:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.197 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-07T00:22:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.199 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-07T00:22:28.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-07T00:22:28.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:28.768 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.771 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.771 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.771 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.771 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.771 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.771 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.772 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-07T00:22:28.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-07T00:22:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.901 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-07T00:22:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-07T00:22:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.902 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.903 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.904 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-07T00:22:28.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-07T00:22:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.907 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-07T00:22:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-07T00:22:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.908 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.909 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2023-10-07T00:22:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-07T00:22:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.911 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.912 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.913 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.913 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.913 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-07T00:22:28.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-07T00:22:28.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.914 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.914 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.914 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.915 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.915 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.915 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.915 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.915 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.916 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.916 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-07T00:22:28.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-07T00:22:28.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.917 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.917 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.917 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.917 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.918 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.918 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.918 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.918 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.919 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-07T00:22:28.919 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-07T00:22:28.919 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.919 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.919 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.919 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.920 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.920 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.920 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.920 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.920 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.921 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.921 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.921 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-07T00:22:28.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-07T00:22:28.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.922 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.922 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.922 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.922 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.923 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.923 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.923 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.923 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.923 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.924 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.924 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-07T00:22:28.924 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-07T00:22:28.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.925 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.925 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.925 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.925 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.925 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.926 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.926 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.926 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.926 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.927 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-07T00:22:28.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-07T00:22:28.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.927 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.927 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.928 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.928 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.928 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.928 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.928 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.929 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.929 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.929 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.929 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-07T00:22:28.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-07T00:22:28.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.930 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.930 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.930 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.931 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.931 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.931 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.931 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.931 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.932 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.932 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.932 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-07T00:22:28.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-07T00:22:28.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.933 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.933 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.933 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.933 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.933 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.934 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.934 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.934 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.934 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.934 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2023-10-07T00:22:28.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-07T00:22:28.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.935 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.935 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.936 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.936 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.936 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.936 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.936 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.936 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.937 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.937 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-07T00:22:28.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-07T00:22:28.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.937 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-07T00:22:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-07T00:22:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-07T00:22:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-07T00:22:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-07T00:22:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2023-10-07T00:22:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-07T00:22:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-07T00:22:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-07T00:22:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2023-10-07T00:22:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-07T00:22:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2023-10-07T00:22:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2023-10-07T00:22:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2023-10-07T00:22:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2023-10-07T00:22:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2023-10-07T00:22:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-07T00:22:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2023-10-07T00:22:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-07T00:22:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2023-10-07T00:22:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-07T00:22:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2023-10-07T00:22:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2023-10-07T00:22:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2023-10-07T00:22:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2023-10-07T00:22:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.028 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2023-10-07T00:22:29.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.031 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.032 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.033 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.033 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-07T00:22:29.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.035 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.036 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.036 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.036 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.036 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.036 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.036 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.036 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.037 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.038 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.038 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.038 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.039 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.039 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.039 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.039 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.039 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.040 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2023-10-07T00:22:29.043 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.043 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.043 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.043 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.044 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.044 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.044 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.044 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.044 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.044 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.045 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.047 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.049 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2023-10-07T00:22:29.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.052 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.053 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.054 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.055 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.055 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.055 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.055 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.055 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.055 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.055 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.055 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.056 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.056 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.056 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.056 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.056 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.056 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.056 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.057 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.059 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.060 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.061 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-07T00:22:29.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.064 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.066 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.068 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.071 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2023-10-07T00:22:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2023-10-07T00:22:29.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.074 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.074 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.074 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.074 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.074 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.074 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2023-10-07T00:22:29.075 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.075 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.075 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.075 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2023-10-07T00:22:29.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2023-10-07T00:22:29.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2023-10-07T00:22:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.076 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-07T00:22:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-07T00:22:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2023-10-07T00:22:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.079 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.080 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.081 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.083 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.084 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.085 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.089 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.090 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.092 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.093 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.095 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.096 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.099 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.100 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.100 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.100 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.101 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.102 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.102 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.102 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-07T00:22:29.104 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.104 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.104 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.105 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2023-10-07T00:22:29.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2023-10-07T00:22:29.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.105 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.105 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.106 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-07T00:22:29.106 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.107 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.107 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.108 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.109 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.109 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.109 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.109 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.109 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.109 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.110 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.110 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.110 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.111 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.111 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.112 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.112 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.113 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.113 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.113 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.114 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.114 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.115 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.115 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.115 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.116 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.116 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.116 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.116 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.116 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.117 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.117 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.117 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.117 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.118 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.118 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.119 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.119 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.120 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.120 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.120 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2023-10-07T00:22:29.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-07T00:22:29.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.121 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.123 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.124 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.125 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.127 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.132 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.214 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.214 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.215 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.216 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.217 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.217 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.217 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.217 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.217 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.217 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.218 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.218 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.219 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.219 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.219 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.220 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.220 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.220 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2023-10-07T00:22:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.223 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.223 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.223 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.223 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.223 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.223 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.223 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.223 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:29.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.230 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.230 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2023-10-07T00:22:29.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2023-10-07T00:22:29.232 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.234 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.236 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.238 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.240 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.241 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2023-10-07T00:22:29.243 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.244 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.250 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.251 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.251 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.251 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.251 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.252 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.252 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.252 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.252 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.252 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.253 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.253 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.253 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.253 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.253 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.253 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.253 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.254 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.254 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.255 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.255 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.256 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2023-10-07T00:22:29.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2023-10-07T00:22:29.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.256 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.256 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.257 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.257 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.258 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.260 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:29.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.262 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2023-10-07T00:22:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2023-10-07T00:22:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.263 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2023-10-07T00:22:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.264 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-07T00:22:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-07T00:22:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2023-10-07T00:22:29.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2023-10-07T00:22:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2023-10-07T00:22:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.266 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-07T00:22:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-07T00:22:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-07T00:22:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-07T00:22:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-07T00:22:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2023-10-07T00:22:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2023-10-07T00:22:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2023-10-07T00:22:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2023-10-07T00:22:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.279 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.280 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.281 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.281 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2023-10-07T00:22:29.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2023-10-07T00:22:29.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.282 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.282 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.282 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.283 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.283 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2023-10-07T00:22:29.284 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.284 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.284 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.284 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2023-10-07T00:22:29.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2023-10-07T00:22:29.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.285 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.285 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.285 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.288 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.289 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.289 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.289 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.289 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.289 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.289 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.289 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.291 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.292 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:29.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.299 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.301 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "drive_group_interval": { 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "drive_group_interval", 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300.0", 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.304 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.314 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.314 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.314 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.314 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.314 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.314 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.314 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.314 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.316 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.317 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.317 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.320 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.320 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.364 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2023-10-07T00:22:29.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2023-10-07T00:22:29.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.365 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.365 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.365 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.365 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.365 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.365 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.366 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.369 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.370 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.371 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.372 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.372 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.373 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.374 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2023-10-07T00:22:29.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2023-10-07T00:22:29.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.374 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.374 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.374 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.375 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.376 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.377 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2023-10-07T00:22:29.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.380 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.381 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.382 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.384 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.386 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.387 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.388 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.389 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.390 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.392 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.393 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.394 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.396 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.399 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2023-10-07T00:22:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.416 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2023-10-07T00:22:29.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.419 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.420 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2023-10-07T00:22:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.424 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.425 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-07T00:22:29.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.428 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.429 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2023-10-07T00:22:29.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.433 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.436 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.438 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.440 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.441 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.443 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.448 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.450 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.451 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.521 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.521 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.521 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.521 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.521 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.522 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.523 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2023-10-07T00:22:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.527 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2023-10-07T00:22:29.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.530 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2023-10-07T00:22:29.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.533 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.534 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.535 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.537 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.538 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.539 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2023-10-07T00:22:29.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.541 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.542 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.543 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.544 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.544 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.544 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.544 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.544 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24106, 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "z", 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540138322906710015, 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.545 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.546 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.547 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.548 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.549 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.551 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.552 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.553 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2023-10-07T00:22:29.554 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.555 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.557 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2023-10-07T00:22:29.557 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.557 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.557 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.557 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2023-10-07T00:22:29.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2023-10-07T00:22:29.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.559 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.559 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.559 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2023-10-07T00:22:29.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2023-10-07T00:22:29.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2023-10-07T00:22:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.564 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.565 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.566 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2023-10-07T00:22:29.567 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2023-10-07T00:22:29.568 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2023-10-07T00:22:29.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-07T00:22:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.572 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.573 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2023-10-07T00:22:29.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.575 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-07T00:22:29.576 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.577 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.579 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.579 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.581 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.581 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.581 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.581 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.581 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.582 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.583 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.584 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.585 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-07T00:22:29.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-07T00:22:29.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.587 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.587 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.587 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2023-10-07T00:22:29.587 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.587 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap" 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.588 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.589 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:29.591 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:29.592 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.594 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.595 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.596 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.597 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.598 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.599 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.600 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.601 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.603 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.604 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.604 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.604 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.604 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.604 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-07T00:22:29.604 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.604 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.604 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-07T00:22:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.607 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.608 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.610 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.611 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2023-10-07T00:22:29.614 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.615 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.616 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.617 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.618 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.618 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2023-10-07T00:22:29.618 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.618 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.618 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.618 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2023-10-07T00:22:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2023-10-07T00:22:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-07T00:22:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2023-10-07T00:22:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2023-10-07T00:22:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2023-10-07T00:22:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2023-10-07T00:22:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2023-10-07T00:22:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.709 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2023-10-07T00:22:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-07T00:22:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.712 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.713 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2023-10-07T00:22:29.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.716 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2023-10-07T00:22:29.717 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.718 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-07T00:22:29.719 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.720 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.721 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.722 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.723 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2023-10-07T00:22:29.724 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.725 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2023-10-07T00:22:29.726 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.727 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.728 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.729 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-07T00:22:29.731 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.732 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.733 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2023-10-07T00:22:29.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.735 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-07T00:22:29.736 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.737 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2023-10-07T00:22:29.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.740 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.741 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.742 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2023-10-07T00:22:29.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.745 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.746 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.747 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.748 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.749 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.750 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.751 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.751 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.751 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.831 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.832 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.834 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.835 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:29.838 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:29.841 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-07T00:22:29.841 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-07T00:22:29.841 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.841 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.841 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.841 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:29.841 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.842 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.842 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.842 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.842 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.842 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.842 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.844 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2023-10-07T00:22:29.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.847 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.848 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.849 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-07T00:22:29.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.851 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.852 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-07T00:22:29.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-07T00:22:29.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.852 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.852 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.852 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.852 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.858 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.859 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.861 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-07T00:22:29.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.864 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.865 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:29.867 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.868 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-07T00:22:29.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.871 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.873 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.874 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.875 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.876 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.877 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-07T00:22:29.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.881 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.882 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.883 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.884 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-07T00:22:29.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.888 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2023-10-07T00:22:29.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-07T00:22:29.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.892 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.894 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.895 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-07T00:22:29.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.897 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.899 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.901 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2023-10-07T00:22:29.903 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.904 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.905 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.906 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.907 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:29.987 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.988 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:29.989 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2023-10-07T00:22:29.990 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.991 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-07T00:22:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:29.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:29.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:29.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2023-10-07T00:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-07T00:22:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-07T00:22:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.003 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-07T00:22:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-07T00:22:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-07T00:22:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2023-10-07T00:22:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2023-10-07T00:22:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.005 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.006 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.011 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.014 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.014 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.014 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.014 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.014 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.014 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.014 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.014 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.016 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2023-10-07T00:22:30.018 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.019 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2023-10-07T00:22:30.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2023-10-07T00:22:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2023-10-07T00:22:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.024 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-07T00:22:30.025 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.026 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.027 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.028 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.029 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.031 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.033 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.033 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.033 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.033 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.033 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.035 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.038 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.042 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2023-10-07T00:22:30.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-07T00:22:30.043 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.044 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.045 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.046 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.047 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.048 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.049 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.050 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.051 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2023-10-07T00:22:30.052 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.053 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.055 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.056 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2023-10-07T00:22:30.058 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.059 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.062 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.063 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.065 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.066 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.067 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.069 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.072 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.073 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-07T00:22:30.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.139 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2023-10-07T00:22:30.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2023-10-07T00:22:30.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.140 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.141 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.143 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.144 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.147 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2023-10-07T00:22:30.148 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.148 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.148 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.148 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2023-10-07T00:22:30.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2023-10-07T00:22:30.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.150 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.151 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.151 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.151 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.151 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.154 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.154 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.156 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.171 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2023-10-07T00:22:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2023-10-07T00:22:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.174 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2023-10-07T00:22:30.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2023-10-07T00:22:30.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2023-10-07T00:22:30.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2023-10-07T00:22:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2023-10-07T00:22:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2023-10-07T00:22:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2023-10-07T00:22:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2023-10-07T00:22:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2023-10-07T00:22:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2023-10-07T00:22:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2023-10-07T00:22:30.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2023-10-07T00:22:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-07T00:22:30.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.182 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.183 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.202 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.205 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.207 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.208 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.208 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.208 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.208 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.208 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.208 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.209 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.210 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.211 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-07T00:22:30.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2023-10-07T00:22:30.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.218 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.219 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.224 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.226 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.227 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.229 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.230 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.234 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.238 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-07T00:22:30.240 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.242 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.243 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.244 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.245 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.246 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2023-10-07T00:22:30.248 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:30.249 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.292 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.293 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-07T00:22:30.294 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.295 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.296 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.297 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.300 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.302 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2023-10-07T00:22:30.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2023-10-07T00:22:30.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.303 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.304 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.306 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2023-10-07T00:22:30.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.309 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2023-10-07T00:22:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-07T00:22:30.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.314 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.317 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.318 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2023-10-07T00:22:30.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-07T00:22:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.326 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.327 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.328 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.333 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.335 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:30.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:30.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.335 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.335 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.335 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.335 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.337 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.338 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.339 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.341 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.342 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "drive_group_interval": { 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "drive_group_interval", 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300.0", 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.344 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.346 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.348 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.349 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.350 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.353 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.354 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.355 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.356 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.358 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.359 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.360 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.360 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.360 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.360 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.360 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.360 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.360 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.360 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.361 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2023-10-07T00:22:30.361 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2023-10-07T00:22:30.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.361 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.361 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.361 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2023-10-07T00:22:30.361 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2023-10-07T00:22:30.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.363 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.364 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.365 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2023-10-07T00:22:30.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2023-10-07T00:22:30.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.369 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2023-10-07T00:22:30.370 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.371 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.372 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2023-10-07T00:22:30.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.374 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.375 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2023-10-07T00:22:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.378 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.379 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.382 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.383 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.384 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.392 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.393 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.394 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.395 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.395 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.395 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.397 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.397 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.397 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.397 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.397 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.397 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.399 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.400 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.402 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.403 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.404 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.407 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.408 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.409 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.410 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2023-10-07T00:22:30.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.413 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.414 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.415 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.416 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.417 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.419 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.420 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2023-10-07T00:22:30.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2023-10-07T00:22:30.423 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.424 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.425 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.426 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2023-10-07T00:22:30.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.434 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.436 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.437 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.438 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.438 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.438 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.438 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.438 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.438 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.438 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.441 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.442 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.443 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.444 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.446 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-07T00:22:30.449 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.450 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.451 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.453 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.454 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.455 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.456 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.457 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.458 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.459 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.460 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.462 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.462 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.462 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.462 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.462 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: "modules": [ 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard", 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: "iostat", 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: "nfs", 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: "restful" 2023-10-07T00:22:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.468 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.469 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.473 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.474 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.475 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2023-10-07T00:22:30.476 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.477 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.478 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.479 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2023-10-07T00:22:30.480 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2023-10-07T00:22:30.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-07T00:22:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-07T00:22:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2023-10-07T00:22:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-07T00:22:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap" 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2023-10-07T00:22:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2023-10-07T00:22:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2023-10-07T00:22:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-07T00:22:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2023-10-07T00:22:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2023-10-07T00:22:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-07T00:22:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2023-10-07T00:22:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2023-10-07T00:22:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2023-10-07T00:22:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-07T00:22:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2023-10-07T00:22:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-07T00:22:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-07T00:22:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2023-10-07T00:22:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2023-10-07T00:22:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2023-10-07T00:22:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-07T00:22:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2023-10-07T00:22:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2023-10-07T00:22:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2023-10-07T00:22:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.597 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2023-10-07T00:22:30.597 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2023-10-07T00:22:30.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.598 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.598 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.598 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2023-10-07T00:22:30.598 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.599 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.599 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.601 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2023-10-07T00:22:30.601 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.602 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.602 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.602 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2023-10-07T00:22:30.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2023-10-07T00:22:30.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.603 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.603 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.603 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.603 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.603 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2023-10-07T00:22:30.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-07T00:22:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.606 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.606 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.606 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2023-10-07T00:22:30.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2023-10-07T00:22:30.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.606 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.606 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.608 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2023-10-07T00:22:30.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2023-10-07T00:22:30.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.608 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.608 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.608 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.608 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2023-10-07T00:22:30.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.611 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.612 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.613 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.626 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.626 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.626 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.626 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.627 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.628 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.630 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.630 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.630 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.630 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.630 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.630 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.630 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.631 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.631 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.631 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.631 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.631 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.632 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.632 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.632 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.632 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.632 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.633 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.633 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.633 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.633 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.633 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.633 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.634 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2023-10-07T00:22:30.634 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2023-10-07T00:22:30.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.634 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.634 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.634 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2023-10-07T00:22:30.634 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.635 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.635 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.635 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-07T00:22:30.635 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.635 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.635 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.636 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2023-10-07T00:22:30.636 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2023-10-07T00:22:30.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.636 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.636 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.636 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2023-10-07T00:22:30.637 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.637 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.637 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.637 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-07T00:22:30.637 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.637 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.637 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.637 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.638 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2023-10-07T00:22:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.641 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.644 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.644 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.644 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.644 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.645 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.646 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.648 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-07T00:22:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-07T00:22:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-07T00:22:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-07T00:22:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-07T00:22:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-07T00:22:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-07T00:22:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-07T00:22:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-07T00:22:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-07T00:22:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-07T00:22:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-07T00:22:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-07T00:22:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-07T00:22:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2023-10-07T00:22:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-07T00:22:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.669 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.669 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-07T00:22:30.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-07T00:22:30.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.670 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.670 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.670 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.670 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.670 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.671 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.671 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.671 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.671 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.672 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2023-10-07T00:22:30.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2023-10-07T00:22:30.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.672 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.672 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.673 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.673 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.673 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.673 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.673 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.673 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.674 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.674 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.674 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2023-10-07T00:22:30.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-07T00:22:30.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.674 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.675 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:30.675 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.675 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.675 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.675 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.675 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.675 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.676 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.676 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-07T00:22:30.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-07T00:22:30.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.676 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.676 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.677 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.677 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.677 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.677 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.678 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.678 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.678 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.678 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-07T00:22:30.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-07T00:22:30.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.679 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.680 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.681 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.682 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-07T00:22:30.683 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.684 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.685 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.687 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.688 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.688 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.688 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.688 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.688 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.688 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.688 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.688 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.752 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.752 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-07T00:22:30.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.753 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.754 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.755 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.756 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.757 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.758 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.759 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.759 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.759 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.759 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.759 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-07T00:22:30.759 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.760 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.761 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.762 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.763 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2023-10-07T00:22:30.763 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.763 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.763 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.763 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.771 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.771 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.771 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.771 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-07T00:22:30.771 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.772 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-07T00:22:30.774 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.775 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.777 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.778 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.779 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.779 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.779 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.779 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.779 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.779 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.780 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.781 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.782 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.782 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.782 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.782 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.782 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-07T00:22:30.782 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-07T00:22:30.782 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.783 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.784 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.785 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.786 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2023-10-07T00:22:30.787 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.788 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.789 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.790 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.790 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.790 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.790 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.790 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.791 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.792 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.794 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.795 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.797 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.798 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-07T00:22:30.799 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.801 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.802 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.803 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.804 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.805 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.805 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.805 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.805 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-07T00:22:30.805 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-07T00:22:30.805 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.806 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-07T00:22:30.807 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.808 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.809 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.809 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.809 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.809 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.809 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.809 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.809 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.809 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.810 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.810 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-10-07T00:22:30.810 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.811 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.812 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.813 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.814 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.815 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.816 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.817 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.818 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.821 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2023-10-07T00:22:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.824 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.825 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2023-10-07T00:22:30.826 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.829 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.830 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.832 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.833 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.834 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2023-10-07T00:22:30.835 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.836 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.838 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.839 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.840 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.841 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.844 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.845 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.846 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.847 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.849 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2023-10-07T00:22:30.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2023-10-07T00:22:30.850 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.850 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.850 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.850 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.850 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.850 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.850 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2023-10-07T00:22:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.852 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.853 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.854 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.855 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2023-10-07T00:22:30.856 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2023-10-07T00:22:30.857 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.859 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.862 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.863 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.864 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.865 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.866 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.868 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.869 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.871 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2023-10-07T00:22:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.876 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.877 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.879 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2023-10-07T00:22:30.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.882 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.885 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.888 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2023-10-07T00:22:30.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2023-10-07T00:22:30.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.892 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-07T00:22:30.893 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.894 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.895 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.898 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.900 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.912 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.912 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.912 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.912 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.912 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.912 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.913 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.914 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.915 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.916 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.917 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.919 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.920 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.921 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.922 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.923 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.924 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.925 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.927 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.928 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.929 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.930 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.931 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.934 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.935 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.936 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.940 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.942 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.944 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.945 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2023-10-07T00:22:30.946 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.947 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.949 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.952 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:30.953 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.954 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.957 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.958 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.962 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.963 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.968 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.971 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.973 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.974 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.975 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.978 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.979 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:30.980 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.981 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.982 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.983 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.984 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-07T00:22:30.986 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.987 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.988 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:30.991 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:30.992 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:30.993 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2023-10-07T00:22:30.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.995 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.996 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.997 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:30.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:30.999 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.002 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.004 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.005 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.006 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-07T00:22:31.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.008 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.009 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.010 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.011 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.012 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.012 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.013 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.013 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.013 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.013 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.014 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.015 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.016 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2023-10-07T00:22:31.018 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "drive_group_interval": { 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "drive_group_interval", 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300.0", 2023-10-07T00:22:31.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.020 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.020 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-07T00:22:31.020 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.020 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.020 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.022 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.024 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.027 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.028 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.029 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.033 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.036 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2023-10-07T00:22:31.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.041 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.042 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2023-10-07T00:22:31.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.046 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.047 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.048 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.050 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2023-10-07T00:22:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.053 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.056 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.057 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.058 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.060 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.061 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.063 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.068 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.074 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.075 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.076 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.077 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.079 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:31.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2023-10-07T00:22:31.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.085 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.086 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.088 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.090 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.092 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2023-10-07T00:22:31.093 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.094 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2023-10-07T00:22:31.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.096 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.101 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.102 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.104 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.105 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2023-10-07T00:22:31.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.108 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.113 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.116 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.117 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.120 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2023-10-07T00:22:31.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.123 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.124 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2023-10-07T00:22:31.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.129 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2023-10-07T00:22:31.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-07T00:22:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: "services": { 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard": "https://172.21.15.5:8443/" 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: "always_on_modules": { 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus": [ 2023-10-07T00:22:31.139 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific": [ 2023-10-07T00:22:31.140 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy": [ 2023-10-07T00:22:31.141 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-10-07T00:22:31.142 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "reef": [ 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-10-07T00:22:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: "last_failure_osd_epoch": 3, 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: "active_clients": [ 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-07T00:22:31.144 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2895170237 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "libcephsqlite", 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-07T00:22:31.145 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2217075891 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2721372777 2023-10-07T00:22:31.146 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3241448954 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.147 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:31.148 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:31.148 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-07T00:22:31.148 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:22:31.149 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:27 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/730381014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:22:31.150 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:27 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3725709068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:22:31.150 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:28 smithi112 ceph-mon[133548]: pgmap v637: 97 pgs: 97 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 785 KiB/s wr, 326 op/s 2023-10-07T00:22:31.150 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:28 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3479357166' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-07T00:22:31.150 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:27 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/730381014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:22:31.150 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:27 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3725709068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:22:31.150 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:28 smithi088 ceph-mon[103111]: pgmap v637: 97 pgs: 97 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 785 KiB/s wr, 326 op/s 2023-10-07T00:22:31.150 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:28 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3479357166' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-07T00:22:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ea40a1480 msgr2=0x7f8ea40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ea40a1480 0x7f8ea40a3940 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8000c00 tx=0x7f8ea8005a90 comp rx=0 tx=0).stop 2023-10-07T00:22:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb8100fb0 msgr2=0x7f8eb8196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:22:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb8100fb0 0x7f8eb8196be0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400e970 tx=0x7f8eb400ec80 comp rx=0 tx=0).stop 2023-10-07T00:22:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 shutdown_connections 2023-10-07T00:22:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f8ea40a1480 0x7f8ea40a3940 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8eb8102b40 0x7f8eb819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb8100fb0 0x7f8eb8196be0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 --2- 172.21.15.5:0/3479357166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb81021a0 0x7f8eb8197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:22:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 >> 172.21.15.5:0/3479357166 conn(0x7f8eb80fc520 msgr2=0x7f8eb80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:22:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 shutdown_connections 2023-10-07T00:22:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:22:28.051+0000 7f8ebf5ff700 1 -- 172.21.15.5:0/3479357166 wait complete. 2023-10-07T00:22:31.158 DEBUG:tasks.check_counter:Getting stats from a 2023-10-07T00:22:31.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-07T00:22:31.159 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:27 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/730381014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:22:31.159 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:27 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3725709068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:22:31.159 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:28 smithi005 ceph-mon[129406]: pgmap v637: 97 pgs: 97 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 785 KiB/s wr, 326 op/s 2023-10-07T00:22:31.160 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:28 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3479357166' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-07T00:22:31.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:30 smithi088 ceph-mon[103111]: pgmap v638: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 754 KiB/s wr, 307 op/s 2023-10-07T00:22:31.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:30 smithi005 ceph-mon[129406]: pgmap v638: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 754 KiB/s wr, 307 op/s 2023-10-07T00:22:31.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:30 smithi112 ceph-mon[133548]: pgmap v638: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 754 KiB/s wr, 307 op/s 2023-10-07T00:22:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:22:33.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:32 smithi088 ceph-mon[103111]: pgmap v639: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 483 KiB/s wr, 253 op/s 2023-10-07T00:22:33.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:32 smithi112 ceph-mon[133548]: pgmap v639: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 483 KiB/s wr, 253 op/s 2023-10-07T00:22:33.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:32 smithi005 ceph-mon[129406]: pgmap v639: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 483 KiB/s wr, 253 op/s 2023-10-07T00:22:35.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:34 smithi088 ceph-mon[103111]: pgmap v640: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 403 KiB/s wr, 200 op/s 2023-10-07T00:22:35.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:34 smithi112 ceph-mon[133548]: pgmap v640: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 403 KiB/s wr, 200 op/s 2023-10-07T00:22:35.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:34 smithi005 ceph-mon[129406]: pgmap v640: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 403 KiB/s wr, 200 op/s 2023-10-07T00:22:37.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:36 smithi088 ceph-mon[103111]: pgmap v641: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 178 KiB/s wr, 158 op/s 2023-10-07T00:22:37.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:36 smithi112 ceph-mon[133548]: pgmap v641: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 178 KiB/s wr, 158 op/s 2023-10-07T00:22:37.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:36 smithi005 ceph-mon[129406]: pgmap v641: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 178 KiB/s wr, 158 op/s 2023-10-07T00:22:37.580 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:22:37.580 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 28851, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 31996, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 8883578, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 47110594, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 11, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 3.335541161, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 1.307914413, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.832057616, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.528687988, 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:37.581 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 31994, 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 3.111342840, 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000097247 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 53230, 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.015198361, 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000285 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:22:37.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 276581, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 188618, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 91417125, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 107741480, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 12, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 5, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 27.976252955, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 15.525943418, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 16.744417946, 2023-10-07T00:22:37.583 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.313603180, 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 188616, 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 22.935690378, 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000121599 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 425146, 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.106110592, 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000249 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1728, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 327328 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 18018, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 20979, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 6050493, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 35158305, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 22, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 7, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 2.319383221, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.871913816, 2023-10-07T00:22:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.129468867, 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.478409665, 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 20979, 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2.093659963, 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000099797 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 30464, 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.008097190, 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000265 2023-10-07T00:22:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 708000, 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 129744 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 17634, 2023-10-07T00:22:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 28.550019543, 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001619032 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3228, 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.482251341, 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000149396 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 118275, 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 61707, 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 61707, 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 533.953071264, 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.008653038 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 56568, 2023-10-07T00:22:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 182, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 19, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 431, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 35, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 374, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 22, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 357, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 11958, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 2, 2023-10-07T00:22:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 2, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 6, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 170325, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 71703, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 56067, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 207, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 6, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 1966, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 156, 2023-10-07T00:22:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 8150, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 289, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 1366, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 1323, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 943, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 19065699, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 1323, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2023-10-07T00:22:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 18, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 18, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 1305, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 6, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 13866, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 9572, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 1, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:22:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 136121, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 5801, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 189, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 25464 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 207, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 405, 2023-10-07T00:22:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 9, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 1382, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 1373, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 0, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2023-10-07T00:22:37.595 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 187, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 19, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 50701, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2023-10-07T00:22:37.596 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 50701, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 62, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 62, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 6, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2023-10-07T00:22:37.597 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 91079185, 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8934, 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 31.196002242, 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003491829 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2023-10-07T00:22:37.598 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 43, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 6237, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 6194, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 105, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 445, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 340, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 431, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 15697, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 15266, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 2, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 6348, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 6346, 2023-10-07T00:22:37.599 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 77660, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 198960 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 128260, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 7104, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 118275, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 246, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 13327, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 5810, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 18.071020344, 2023-10-07T00:22:37.600 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003110330 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 286, 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.065023670, 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000227355 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 46696, 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 336.994643369, 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.007216777 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.602 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2023-10-07T00:22:37.603 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.604 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 57, 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.103105453, 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001808867 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.605 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2023-10-07T00:22:37.606 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2113, 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2.559159739, 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001211149 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 86, 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.068192900, 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000792940 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 5769, 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 174.047685379, 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.030169472 2023-10-07T00:22:37.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.608 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2023-10-07T00:22:37.608 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.608 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.608 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.608 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2023-10-07T00:22:37.608 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.608 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 57, 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.813190318, 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.014266496 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.609 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2023-10-07T00:22:37.611 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.612 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 833, 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.231050092, 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001477851 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2023-10-07T00:22:37.613 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 2, 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 1, 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2023-10-07T00:22:37.614 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 3294, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 3294, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 581, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:22:37.615 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:22:37.616 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:22:37.617 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 313933, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 117, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2023-10-07T00:22:37.618 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 7720, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 162, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2023-10-07T00:22:37.619 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 563370, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 4970, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 12935, 2023-10-07T00:22:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 90276252, 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 27, 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 12935, 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 12935, 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 34.723304602, 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002684445 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 12935, 2023-10-07T00:22:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 13293 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 12935, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 1594, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 11341, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 10, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 271, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 9205, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 207, 2023-10-07T00:22:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 0, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 19, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 1637, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 1323, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 20, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:22:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 1, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2023-10-07T00:22:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2023-10-07T00:22:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 88, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 2, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 12, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 12, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 511, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2023-10-07T00:22:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 89 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2023-10-07T00:22:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 14, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 6, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 1373, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 323446, 2023-10-07T00:22:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 77224731, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 323446, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 323446, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 77224731, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 12935, 2023-10-07T00:22:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 90415157, 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 12935, 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 90415157, 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 12935, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 12935, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 12935, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 12935, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 1373, 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 138905, 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 1373, 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 271, 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 138905, 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x55cc7c3c4640": { 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 50701, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 86884881, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 50701, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8934, 2023-10-07T00:22:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 86884881, 2023-10-07T00:22:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:37.636 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:22:38.024 INFO:tasks.check_counter:Daemon mds.a mds.exported=156 2023-10-07T00:22:38.024 INFO:tasks.check_counter:Daemon mds.a mds.imported=289 2023-10-07T00:22:38.024 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=19 2023-10-07T00:22:38.024 DEBUG:tasks.check_counter:Getting stats from d 2023-10-07T00:22:38.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-07T00:22:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:22:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:38 smithi088 ceph-mon[103111]: pgmap v642: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 86 op/s 2023-10-07T00:22:39.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:38 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:22:39.203 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:38 smithi005 ceph-mon[129406]: pgmap v642: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 86 op/s 2023-10-07T00:22:39.203 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:38 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:22:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:38 smithi112 ceph-mon[133548]: pgmap v642: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 86 op/s 2023-10-07T00:22:39.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:38 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-07T00:22:40.337 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:22:40.337 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:22:40.337 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1065, 2023-10-07T00:22:40.337 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1067, 2023-10-07T00:22:40.337 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 8868869, 2023-10-07T00:22:40.337 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 331216, 2023-10-07T00:22:40.337 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 7, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 3, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.137867379, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.054633053, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.037690371, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.031322589, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1065, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.063761349, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000059869 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.338 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1184, 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1149, 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 21888658, 2023-10-07T00:22:40.339 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 411918, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.162120403, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.040074786, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.087381166, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.030302548, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1149, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.077533321, 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000067478 2023-10-07T00:22:40.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 676896, 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 117344 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 293, 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 439, 2023-10-07T00:22:40.341 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 8462186, 2023-10-07T00:22:40.342 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 417543, 2023-10-07T00:22:40.342 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2023-10-07T00:22:40.342 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2023-10-07T00:22:40.342 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.057731924, 2023-10-07T00:22:40.342 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.019890701, 2023-10-07T00:22:40.342 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.023301966, 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.009786054, 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 437, 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.022721953, 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000051995 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 326720 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-07T00:22:40.344 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3930, 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.115631425, 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000029422 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.345 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 0, 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 0, 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.346 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 2473, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 0, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 2473, 2023-10-07T00:22:40.347 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 2473, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 207, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 1, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 0, 2023-10-07T00:22:40.348 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2023-10-07T00:22:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 0, 2023-10-07T00:22:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 0 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2023-10-07T00:22:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:22:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2023-10-07T00:22:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 36183, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 44, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2023-10-07T00:22:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 42096506, 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 42095368, 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 36183 2023-10-07T00:22:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 13, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 3113, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 3100, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 11, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 163, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 152, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 2473, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 6894, 2023-10-07T00:22:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 4421, 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 0, 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 0, 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 0, 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 53124, 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 207152 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 0, 2023-10-07T00:22:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 0, 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 0, 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2023-10-07T00:22:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2023-10-07T00:22:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2023-10-07T00:22:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2023-10-07T00:22:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 0, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 0, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 2358, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:22:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:22:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:22:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:22:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 214447, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 65, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 7720, 2023-10-07T00:22:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 162, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 1763968, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 10020, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 2304, 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 21, 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 3, 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 2304, 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2304, 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.657966802, 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000719603 2023-10-07T00:22:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2304, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2305 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 2304, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 2304, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 0, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2023-10-07T00:22:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 1260, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 1042, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2023-10-07T00:22:40.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 1, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:22:40.381 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2023-10-07T00:22:40.382 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 88, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 2, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2023-10-07T00:22:40.383 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 0, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 2, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 0 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 0, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.384 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 0, 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 0, 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 0, 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.385 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 2538, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 38976508, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 2538, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2538, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 38976508, 2023-10-07T00:22:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-07T00:22:40.387 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 2304, 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 37902457, 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2304, 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 37902457, 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 2304, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 2304, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2304, 2023-10-07T00:22:40.389 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 2304, 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:40.390 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.391 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x56037111ea00": { 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:40.392 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:40.393 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:22:40.777 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2023-10-07T00:22:40.777 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2023-10-07T00:22:40.778 INFO:tasks.check_counter:Daemon mds.d mds.dir_split=0 2023-10-07T00:22:40.778 DEBUG:tasks.check_counter:Getting stats from g 2023-10-07T00:22:40.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-07T00:22:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:40 smithi005 ceph-mon[129406]: pgmap v643: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 45 KiB/s wr, 43 op/s 2023-10-07T00:22:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:22:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:22:41.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:40 smithi005 ceph-mon[129406]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:22:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:40 smithi088 ceph-mon[103111]: pgmap v643: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 45 KiB/s wr, 43 op/s 2023-10-07T00:22:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:22:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:22:41.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:40 smithi088 ceph-mon[103111]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:22:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:40 smithi112 ceph-mon[133548]: pgmap v643: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 45 KiB/s wr, 43 op/s 2023-10-07T00:22:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-07T00:22:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-07T00:22:41.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:40 smithi112 ceph-mon[133548]: from='mgr.14150 172.21.15.5:0/1190697298' entity='mgr.x' 2023-10-07T00:22:41.524 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:22:43.081 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:22:43.081 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:22:43.081 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 21688, 2023-10-07T00:22:43.081 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 20296, 2023-10-07T00:22:43.081 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 11657590, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 24075569, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 11, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 5, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 2.479621805, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 1.262108156, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.417968736, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.111097336, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 20294, 2023-10-07T00:22:43.082 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2.897798781, 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000142790 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 32718, 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.008660041, 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000264 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:22:43.083 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 164321, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 59810, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 56126200, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 32719652, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 14, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 7, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 13.740150008, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 7.736107499, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 8.505919182, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.031761132, 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:43.084 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 59808, 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 6.542159396, 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000109386 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 212869, 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.038220177, 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000179 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 327872 2023-10-07T00:22:43.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 5320, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 5371, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 2254673, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 18754445, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 18, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 10, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.549722654, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.235919249, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.268728900, 2023-10-07T00:22:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.075999788, 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 5371, 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.574715687, 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000107003 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 5556, 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.001657988, 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000298 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.087 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 691216, 2023-10-07T00:22:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 133552 2023-10-07T00:22:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2023-10-07T00:22:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2023-10-07T00:22:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2023-10-07T00:22:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2023-10-07T00:22:43.088 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 5647, 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 4.915676065, 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000870493 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 5510, 2023-10-07T00:22:43.089 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.410564577, 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000074512 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 41370, 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 38351, 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 38351, 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 158.526978434, 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.004133581 2023-10-07T00:22:43.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 3019, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 29, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 2, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 19, 2023-10-07T00:22:43.091 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 3, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 2, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 14, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 14, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 2175, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 0, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 0, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 6, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 85017, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 40650, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 3019, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 313, 2023-10-07T00:22:43.092 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 6, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 4126, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 100, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 1196, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 86, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 3623, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 205, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2023-10-07T00:22:43.093 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 943, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 19065699, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 205, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 205, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 48, 2023-10-07T00:22:43.094 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 1336, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4002, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 117537, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 698, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 219, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 7292 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2023-10-07T00:22:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2023-10-07T00:22:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2023-10-07T00:22:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2023-10-07T00:22:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 341, 2023-10-07T00:22:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 311, 2023-10-07T00:22:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2023-10-07T00:22:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2023-10-07T00:22:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:22:43.096 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 2463, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 2463, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 0, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:22:43.097 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 107, 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 2, 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 36183, 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2023-10-07T00:22:43.098 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 36183, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 44, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 44, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2023-10-07T00:22:43.099 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 42096506, 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2858, 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 18.224012575, 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.006376491 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 27, 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 3139, 2023-10-07T00:22:43.100 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 3112, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 30, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 214, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 184, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 50, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 7506, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 7456, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 0, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 3091, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 3091, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 70248, 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 198960 2023-10-07T00:22:43.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 48005, 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 2017, 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 41370, 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 140, 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 4039, 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 694, 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 43.005268725, 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.061967246 2023-10-07T00:22:43.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2023-10-07T00:22:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 34342, 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 14.554700114, 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000423816 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.104 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.106 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 369, 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.155586833, 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000421644 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 125, 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.088530776, 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000708246 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 736, 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 97.958228973, 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.133095419 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2023-10-07T00:22:43.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.112 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2023-10-07T00:22:43.112 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.112 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.112 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.113 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2023-10-07T00:22:43.113 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.113 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.113 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.114 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2023-10-07T00:22:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2085, 2023-10-07T00:22:43.116 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2.764663013, 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001325977 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2023-10-07T00:22:43.117 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 5063, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 5063, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 588, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.118 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:22:43.119 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:22:43.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2023-10-07T00:22:43.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 323981, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 130, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2023-10-07T00:22:43.122 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 7720, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 162, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 138293, 2023-10-07T00:22:43.123 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 936, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 6618, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 38567070, 2023-10-07T00:22:43.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 26, 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 6618, 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6618, 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 15.628688615, 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002361542 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6618, 2023-10-07T00:22:43.125 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 6800 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 6618, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 549, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 6069, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 10, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 344, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 3202, 2023-10-07T00:22:43.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 263, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 0, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 2, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 2484, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 205, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 20, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:22:43.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2023-10-07T00:22:43.128 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2023-10-07T00:22:43.129 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 88, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 2, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 12, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 12, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 201, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 69 2023-10-07T00:22:43.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2023-10-07T00:22:43.131 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 6, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 6, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 2463, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 191325, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 52803428, 2023-10-07T00:22:43.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 191325, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 191325, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 52803428, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.133 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 6618, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 38815833, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 6618, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 38815833, 2023-10-07T00:22:43.134 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-07T00:22:43.135 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 6618, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 6618, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 6618, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 6618, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 2463, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 248763, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 2463, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 344, 2023-10-07T00:22:43.137 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 248763, 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x55d1c7d70640": { 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:43.138 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 36183, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 37902202, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 36183, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2858, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 37902202, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:43.139 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:43.140 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.140 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:43.140 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:22:43.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:42 smithi005 ceph-mon[129406]: pgmap v644: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.4 KiB/s wr, 14 op/s 2023-10-07T00:22:43.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:42 smithi112 ceph-mon[133548]: pgmap v644: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.4 KiB/s wr, 14 op/s 2023-10-07T00:22:43.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:42 smithi088 ceph-mon[103111]: pgmap v644: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.4 KiB/s wr, 14 op/s 2023-10-07T00:22:43.623 INFO:tasks.check_counter:Daemon mds.g mds.exported=100 2023-10-07T00:22:43.623 INFO:tasks.check_counter:Daemon mds.g mds.imported=86 2023-10-07T00:22:43.623 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=2 2023-10-07T00:22:43.624 DEBUG:tasks.check_counter:Getting stats from j 2023-10-07T00:22:43.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-07T00:22:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-07T00:22:45.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:44 smithi112 ceph-mon[133548]: pgmap v645: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2023-10-07T00:22:45.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:44 smithi005 ceph-mon[129406]: pgmap v645: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2023-10-07T00:22:45.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:44 smithi088 ceph-mon[103111]: pgmap v645: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2023-10-07T00:22:45.852 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-07T00:22:45.852 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:22:45.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 203, 2023-10-07T00:22:45.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 198, 2023-10-07T00:22:45.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 470112, 2023-10-07T00:22:45.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 117744, 2023-10-07T00:22:45.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.037413752, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.014483904, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.016275575, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.004704290, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 198, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.014362799, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000072539 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 470112, 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 117744 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1, 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 149, 2023-10-07T00:22:45.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 160, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 102656, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.014286713, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.010892955, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.001601882, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 147, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.009763268, 2023-10-07T00:22:45.855 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000066416 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 102656 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2023-10-07T00:22:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.000959562, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000824203, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2023-10-07T00:22:45.858 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:22:45.859 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:22:45.860 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:22:45.861 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:22:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148967, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 29, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2023-10-07T00:22:45.863 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2023-10-07T00:22:45.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 200, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 439042, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 200, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 200, 2023-10-07T00:22:45.865 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 439042, 2023-10-07T00:22:45.866 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-07T00:22:45.866 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-07T00:22:45.866 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-07T00:22:45.866 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-07T00:22:45.866 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:45.866 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-07T00:22:45.866 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-07T00:22:46.279 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:46 smithi005 ceph-mon[129406]: pgmap v646: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-07T00:22:46.357 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-07T00:22:46.357 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-07T00:22:46.357 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-10-07T00:22:46.357 DEBUG:tasks.check_counter:Getting stats from b 2023-10-07T00:22:46.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-07T00:22:46.446 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:46 smithi088 ceph-mon[103111]: pgmap v646: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-07T00:22:46.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:46 smithi112 ceph-mon[133548]: pgmap v646: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-07T00:22:47.124 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:22:49.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:48 smithi088 ceph-mon[103111]: pgmap v647: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-10-07T00:22:49.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:48 smithi112 ceph-mon[133548]: pgmap v647: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-10-07T00:22:49.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:48 smithi005 ceph-mon[129406]: pgmap v647: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-10-07T00:22:49.485 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-10-07T00:22:49.485 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:22:49.485 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 17448, 2023-10-07T00:22:49.485 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 15762, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 8740674, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 19117735, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 10, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 4, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 1.425958816, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.580102401, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.892978352, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.101895352, 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:49.486 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 15762, 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 2.479999937, 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000157340 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 25691, 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.004862554, 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000189 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:22:49.487 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 5128, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 5266, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 1762353, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 13375087, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 13, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 6, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.456773920, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.189100530, 2023-10-07T00:22:49.488 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.166173395, 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.101330955, 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 5267, 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 3.850328818, 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000731028 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3463, 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000680387, 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000196 2023-10-07T00:22:49.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 303328 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 114605, 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 52751, 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 39200528, 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 29073972, 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 133, 2023-10-07T00:22:49.490 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 10, 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 7.820697321, 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 3.177877947, 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 6.278805839, 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.255778419, 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 52746, 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 2.786543797, 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000052829 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.491 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 158201, 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.025719624, 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000162 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 771504, 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 155600 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: "cct": { 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: "total_workers": 1, 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: "unhealthy_workers": 0 2023-10-07T00:22:49.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-MDSRank": { 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 5855, 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 3.771081033, 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000644078 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-PurgeQueue": { 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2023-10-07T00:22:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2654, 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.139588028, 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000052595 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: "request": 38123, 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: "reply": 30466, 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: "reply_latency": { 2023-10-07T00:22:49.494 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 30466, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 108.811154748, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.003571560 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_reply": 0, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "forward": 7657, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_complete": 0, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_keys": 0, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_commit": 1012, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_split": 6, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_merge": 0, 2023-10-07T00:22:49.495 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes": 111, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_top": 3, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_bottom": 94, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pin_tail": 14, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pinned": 106, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_expired": 3001, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_with_caps": 2, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": 2, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "subtrees": 6, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse": 72482, 2023-10-07T00:22:49.496 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_hit": 31117, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_forward": 7649, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_discover": 169, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_remote_ino": 0, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_lock": 2, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "load_cent": 839, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "q": 0, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "exported": 78, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "exported_inodes": 1918, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "imported": 35, 2023-10-07T00:22:49.497 INFO:teuthology.orchestra.run.smithi088.stdout: "imported_inodes": 2095, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_dir_fetch": 0, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_backtrace_fetch": 144, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_peer_discover": 0, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rfiles": 4, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rbytes": 246, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rsnaps": 0, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_fetch": 144, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_set_tag": 0, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:22:49.498 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_inodes": 50, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_base_inodes": 5, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dirfrag_rstats": 45, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_file_inodes": 94, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_inode_file_caps": 2, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_revoke": 1504, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_grant": 3133, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_trunc": 5, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:22:49.499 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps": 71778, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps_dirty": 1230, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_cap_release": 110, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "process_request_cap_release": 5385 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache": { 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update": 0, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update_receipt": 0, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_try_discover": 0, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_send_discover": 185, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_handle_discover": 129, 2023-10-07T00:22:49.500 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays": 1, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_delayed": 0, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_created": 1217, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_enqueued": 1216, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_reintegrated": 0, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_migrated": 0, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_processing": 0, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_started": 0, 2023-10-07T00:22:49.501 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_completed": 0, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_enqueue_scrub": 5, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_exportdir": 83, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_flush": 0, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragmentdir": 6, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragstats": 0, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_inodestats": 0 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log": { 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "evlrg": 0, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "evadd": 22904, 2023-10-07T00:22:49.502 INFO:teuthology.orchestra.run.smithi088.stdout: "evex": 22807, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "evtrm": 22807, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "ev": 97, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "evexg": 0, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "evexd": 852, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "segadd": 58, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "segex": 57, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "segtrm": 57, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "seg": 1, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "segmjr": 1, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "segexg": 0, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "segexd": 1, 2023-10-07T00:22:49.503 INFO:teuthology.orchestra.run.smithi088.stdout: "expos": 30869242, 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "wrpos": 30944052, 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "rdpos": 0, 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "jlat": { 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2416, 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 7.055535697, 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.002920337 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "replayed": 0 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_mem": { 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "ino": 27, 2023-10-07T00:22:49.504 INFO:teuthology.orchestra.run.smithi088.stdout: "ino+": 2397, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "ino-": 2370, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "dir": 26, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "dir+": 183, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "dir-": 157, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "dn": 111, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "dn+": 5084, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "dn-": 4973, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "cap": 2, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "cap+": 2354, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "cap-": 2352, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "rss": 71572, 2023-10-07T00:22:49.505 INFO:teuthology.orchestra.run.smithi088.stdout: "heap": 207152 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_server": { 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_client_request": 42630, 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_server_request": 911, 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_request": 38123, 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_session": 111, 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_peer_request": 2280, 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "req_create_latency": { 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1044, 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 37.814932639, 2023-10-07T00:22:49.506 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.036221199 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getattr_latency": { 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 380, 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.157976464, 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000415727 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getfilelock_latency": { 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: "req_link_latency": { 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookup_latency": { 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 26645, 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 12.441704744, 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000466943 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookuphash_latency": { 2023-10-07T00:22:49.508 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupino_latency": { 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupname_latency": { 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.509 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupparent_latency": { 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupsnap_latency": { 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.510 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lssnap_latency": { 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mkdir_latency": { 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 16, 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.023791802, 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001486987 2023-10-07T00:22:49.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mknod_latency": { 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mksnap_latency": { 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "req_open_latency": { 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 447, 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.184953103, 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000413765 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "req_readdir_latency": { 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 113, 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.466606487, 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.004129260 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.513 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rename_latency": { 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 672, 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 56.166968275, 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.083581798 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: "req_renamesnap_latency": { 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.514 INFO:teuthology.orchestra.run.smithi088.stdout: "req_snapdiff_latency": { 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmdir_latency": { 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 5, 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.030256640, 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.006051328 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.515 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmsnap_latency": { 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmxattr_latency": { 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setattr_latency": { 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1, 2023-10-07T00:22:49.516 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.001608188, 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001608188 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setdirlayout_latency": { 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setfilelock_latency": { 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.517 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setlayout_latency": { 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setxattr_latency": { 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 6, 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.019172182, 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.003195363 2023-10-07T00:22:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "req_symlink_latency": { 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3, 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.002773019, 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000924339 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "req_unlink_latency": { 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1134, 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 1.500411205, 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001323113 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:22:49.519 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getvxattr_latency": { 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sessions": { 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "session_count": 1, 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "session_add": 2, 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "session_remove": 1, 2023-10-07T00:22:49.520 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_open": 1, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_stale": 0, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "total_load": 2599, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "average_load": 2599, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "avg_session_uptime": 594, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "mdthresh_evicted": 0 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool": { 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_bytes": 360, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_items": 360, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:22:49.521 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:22:49.522 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_items": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_items": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_items": 0, 2023-10-07T00:22:49.523 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_items": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_bytes": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_items": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_bytes": 298418, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_items": 115, 2023-10-07T00:22:49.524 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_items": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_bytes": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_items": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_items": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_items": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_bytes": 7720, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_items": 162, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:22:49.525 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_bytes": 0, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_items": 0, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_bytes": 178306, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_items": 1493, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_bytes": 0, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_items": 0, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_bytes": 0, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_items": 0 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter": { 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "op_active": 0, 2023-10-07T00:22:49.526 INFO:teuthology.orchestra.run.smithi088.stdout: "op_laggy": 0, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send": 8124, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send_bytes": 30509017, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "op_resend": 37, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "op_reply": 8124, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "op_latency": { 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 8124, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 102.017850787, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.012557588 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "op_inflight": 0, 2023-10-07T00:22:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: "oplen_avg": { 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 8124, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 14437 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "op": 8124, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "op_r": 281, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "op_w": 7843, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "op_rmw": 0, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "op_pg": 0, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_stat": 929, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_create": 2147, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_read": 132, 2023-10-07T00:22:49.528 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_write": 2543, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writefull": 240, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writesame": 0, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_append": 0, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_zero": 0, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_truncate": 6, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_delete": 1740, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_mapext": 0, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_sparse_read": 0, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_clonerange": 0, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_getxattr": 149, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_setxattr": 4295, 2023-10-07T00:22:49.529 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_rmxattr": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_call": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_watch": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_notify": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_other": 5, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_active": 0, 2023-10-07T00:22:49.530 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_send": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_resend": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_ping": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_active": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_send": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_resend": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_active": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_send": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_resend": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_active": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_send": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_resend": 0, 2023-10-07T00:22:49.531 INFO:teuthology.orchestra.run.smithi088.stdout: "command_active": 0, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "command_send": 0, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "command_resend": 0, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "map_epoch": 88, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "map_full": 0, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "map_inc": 3, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_sessions": 12, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_open": 12, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_close": 0, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_laggy": 0, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_wr": 1959, 2023-10-07T00:22:49.532 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_rd": 0, 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_del": 292 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "oft": { 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_objs": 1, 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_updates": 0, 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_removes": 0 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "osd-slow-ops": { 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_ops_count": 0 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.533 INFO:teuthology.orchestra.run.smithi088.stdout: "purge_queue": { 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops": 0, 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops_high_water": 6, 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing": 0, 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_high_water": 6, 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed": 1216, 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_item_in_journal": 0 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2023-10-07T00:22:49.534 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 137177, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 37334213, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 137177, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 137177, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 37334213, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.535 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_bytes": { 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:49.536 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 8124, 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 30631833, 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 8124, 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 30631833, 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_ops": { 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:49.537 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 1024, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 8124, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 8124, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 8124, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 8124, 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:49.538 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 1216, 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 122816, 2023-10-07T00:22:49.539 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 1216, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 127, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 122816, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:49.540 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle-0x5638e3f84640": { 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 22904, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 26749748, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 22904, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2416, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 26749748, 2023-10-07T00:22:49.541 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:49.542 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:49.542 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:49.542 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:49.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:49.542 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-10-07T00:22:50.096 INFO:tasks.check_counter:Daemon mds.b mds.exported=78 2023-10-07T00:22:50.096 INFO:tasks.check_counter:Daemon mds.b mds.imported=35 2023-10-07T00:22:50.097 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=6 2023-10-07T00:22:50.097 DEBUG:tasks.check_counter:Getting stats from e 2023-10-07T00:22:50.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-07T00:22:50.825 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:22:51.175 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:50 smithi088 ceph-mon[103111]: pgmap v648: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 10 op/s 2023-10-07T00:22:51.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:50 smithi112 ceph-mon[133548]: pgmap v648: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 10 op/s 2023-10-07T00:22:51.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:50 smithi005 ceph-mon[129406]: pgmap v648: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 10 op/s 2023-10-07T00:22:52.351 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 765, 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 767, 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 8585741, 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 237979, 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 7, 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 3, 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.094460190, 2023-10-07T00:22:52.352 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.030254306, 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.032037046, 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.020944698, 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 765, 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.041950270, 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000054836 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:52.353 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 956, 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 920, 2023-10-07T00:22:52.354 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 11282905, 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 341472, 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 4, 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 3, 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.126125629, 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.031723294, 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.060183193, 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.028698961, 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:52.355 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 919, 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.045691341, 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000049718 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.356 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 692208, 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 118480 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 855, 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 1001, 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 4469642, 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 565998, 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 5, 2023-10-07T00:22:52.357 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 4, 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.115744228, 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.039770471, 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.031953645, 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.030492218, 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1000, 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.063526836, 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000063526 2023-10-07T00:22:52.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 301648 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: "cct": { 2023-10-07T00:22:52.359 INFO:teuthology.orchestra.run.smithi088.stdout: "total_workers": 1, 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "unhealthy_workers": 0 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-MDSRank": { 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3999, 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.124317571, 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000031087 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-PurgeQueue": { 2023-10-07T00:22:52.360 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "request": 0, 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "reply": 0, 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "reply_latency": { 2023-10-07T00:22:52.361 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_reply": 0, 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: "forward": 0, 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_complete": 0, 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_keys": 0, 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_commit": 0, 2023-10-07T00:22:52.362 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_split": 0, 2023-10-07T00:22:52.363 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_merge": 0, 2023-10-07T00:22:52.363 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes": 1470, 2023-10-07T00:22:52.363 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_top": 0, 2023-10-07T00:22:52.363 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_bottom": 0, 2023-10-07T00:22:52.363 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pin_tail": 1470, 2023-10-07T00:22:52.363 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pinned": 1470, 2023-10-07T00:22:52.363 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_expired": 195, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_with_caps": 0, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": 0, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "subtrees": 1, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse": 0, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_hit": 0, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_forward": 0, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_discover": 0, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:22:52.364 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_remote_ino": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_lock": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "load_cent": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "q": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "exported": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "exported_inodes": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "imported": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "imported_inodes": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_dir_fetch": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_backtrace_fetch": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_peer_discover": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rfiles": 0, 2023-10-07T00:22:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rbytes": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rsnaps": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_fetch": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_set_tag": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_inodes": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dirfrag_rstats": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_file_inodes": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_inode_file_caps": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_revoke": 0, 2023-10-07T00:22:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_grant": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_trunc": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps_dirty": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_cap_release": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "process_request_cap_release": 0 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache": { 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update_receipt": 0, 2023-10-07T00:22:52.367 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_try_discover": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_send_discover": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_handle_discover": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_delayed": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_created": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_enqueued": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_reintegrated": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_migrated": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_processing": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:22:52.368 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_started": 0, 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_completed": 0, 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_exportdir": 0, 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_flush": 0, 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragmentdir": 0, 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragstats": 0, 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_inodestats": 0 2023-10-07T00:22:52.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log": { 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "evlrg": 0, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "evadd": 0, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "evex": 0, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "evtrm": 0, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "ev": 23112, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "evexg": 0, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "evexd": 0, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "segadd": 0, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "segex": 0, 2023-10-07T00:22:52.370 INFO:teuthology.orchestra.run.smithi088.stdout: "segtrm": 0, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "seg": 28, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "segmjr": 3, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "segexg": 0, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "segexd": 0, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "expos": 4194304, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "wrpos": 27188853, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "rdpos": 27188254, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "jlat": { 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.371 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "replayed": 23112 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_mem": { 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "ino": 13, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "ino+": 2140, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "ino-": 2127, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "dir": 11, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "dir+": 130, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "dir-": 119, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "dn": 1470, 2023-10-07T00:22:52.372 INFO:teuthology.orchestra.run.smithi088.stdout: "dn+": 4802, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "dn-": 3332, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "cap": 0, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "cap+": 0, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "cap-": 0, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "rss": 51284, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "heap": 207152 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_server": { 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_client_request": 0, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_server_request": 0, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_request": 0, 2023-10-07T00:22:52.373 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_session": 0, 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_peer_request": 0, 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "req_create_latency": { 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getattr_latency": { 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.374 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getfilelock_latency": { 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "req_link_latency": { 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookup_latency": { 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.375 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookuphash_latency": { 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupino_latency": { 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupname_latency": { 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupparent_latency": { 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupsnap_latency": { 2023-10-07T00:22:52.377 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lssnap_latency": { 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.378 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mkdir_latency": { 2023-10-07T00:22:52.379 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.379 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.379 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.379 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mknod_latency": { 2023-10-07T00:22:52.379 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.379 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.379 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mksnap_latency": { 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "req_open_latency": { 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.380 INFO:teuthology.orchestra.run.smithi088.stdout: "req_readdir_latency": { 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rename_latency": { 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "req_renamesnap_latency": { 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.381 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: "req_snapdiff_latency": { 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmdir_latency": { 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.382 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmsnap_latency": { 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmxattr_latency": { 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.383 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setattr_latency": { 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setdirlayout_latency": { 2023-10-07T00:22:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setfilelock_latency": { 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setlayout_latency": { 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.385 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setxattr_latency": { 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: "req_symlink_latency": { 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: "req_unlink_latency": { 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getvxattr_latency": { 2023-10-07T00:22:52.387 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sessions": { 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "session_count": 1, 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "session_add": 1, 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "session_remove": 0, 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_open": 1, 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_stale": 0, 2023-10-07T00:22:52.388 INFO:teuthology.orchestra.run.smithi088.stdout: "total_load": 0, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "average_load": 0, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "avg_session_uptime": 2288, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "mdthresh_evicted": 0 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool": { 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_items": 0, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:22:52.389 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:22:52.390 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:22:52.390 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:22:52.390 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:22:52.390 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:22:52.390 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:22:52.390 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_items": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_items": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:22:52.391 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:22:52.392 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:22:52.392 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:22:52.392 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:22:52.392 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:22:52.392 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_items": 0, 2023-10-07T00:22:52.392 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:22:52.392 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:22:52.392 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_items": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_bytes": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_items": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_bytes": 206327, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_items": 60, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:22:52.393 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_items": 0, 2023-10-07T00:22:52.394 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_bytes": 0, 2023-10-07T00:22:52.394 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_items": 0, 2023-10-07T00:22:52.394 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:22:52.394 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_items": 0, 2023-10-07T00:22:52.394 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:22:52.394 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_items": 0, 2023-10-07T00:22:52.394 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_bytes": 7720, 2023-10-07T00:22:52.394 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_items": 162, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_bytes": 0, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_items": 0, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_bytes": 1065880, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_items": 6008, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_bytes": 0, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_items": 0, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_bytes": 0, 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_items": 0 2023-10-07T00:22:52.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter": { 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "op_active": 0, 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "op_laggy": 0, 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send": 2332, 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send_bytes": 21, 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "op_resend": 3, 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "op_reply": 2332, 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "op_latency": { 2023-10-07T00:22:52.396 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2332, 2023-10-07T00:22:52.397 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 1.593966399, 2023-10-07T00:22:52.397 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000683519 2023-10-07T00:22:52.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.397 INFO:teuthology.orchestra.run.smithi088.stdout: "op_inflight": 0, 2023-10-07T00:22:52.397 INFO:teuthology.orchestra.run.smithi088.stdout: "oplen_avg": { 2023-10-07T00:22:52.397 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2332, 2023-10-07T00:22:52.397 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 2333 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: "op": 2332, 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: "op_r": 2332, 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: "op_w": 0, 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: "op_rmw": 0, 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: "op_pg": 0, 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_stat": 1289, 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_create": 0, 2023-10-07T00:22:52.398 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_read": 1041, 2023-10-07T00:22:52.399 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_write": 0, 2023-10-07T00:22:52.399 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writefull": 0, 2023-10-07T00:22:52.399 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writesame": 0, 2023-10-07T00:22:52.399 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_append": 0, 2023-10-07T00:22:52.399 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_zero": 0, 2023-10-07T00:22:52.399 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_truncate": 0, 2023-10-07T00:22:52.399 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_delete": 0, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_mapext": 0, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_sparse_read": 0, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_clonerange": 0, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_getxattr": 1, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_setxattr": 0, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_rmxattr": 0, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:22:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_call": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_watch": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_notify": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_other": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_active": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_send": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_resend": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_ping": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_active": 0, 2023-10-07T00:22:52.401 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_send": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_resend": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_active": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_send": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_resend": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_active": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_send": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_resend": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "command_active": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "command_send": 0, 2023-10-07T00:22:52.402 INFO:teuthology.orchestra.run.smithi088.stdout: "command_resend": 0, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "map_epoch": 88, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "map_full": 0, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "map_inc": 2, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_sessions": 7, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_open": 7, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_close": 0, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_laggy": 0, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_wr": 0, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_rd": 2, 2023-10-07T00:22:52.403 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_del": 0 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "oft": { 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_objs": 0, 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_updates": 0, 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_removes": 0 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "osd-slow-ops": { 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_ops_count": 0 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "purge_queue": { 2023-10-07T00:22:52.404 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops": 0, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops_high_water": 0, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing": 0, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_high_water": 0, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed": 0, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_item_in_journal": 0 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:52.405 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 2572, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 24091751, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 2572, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2572, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 24091751, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.406 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_bytes": { 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2023-10-07T00:22:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 2332, 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 22994554, 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2332, 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 22994554, 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_ops": { 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 1024, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 2332, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 2332, 2023-10-07T00:22:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2332, 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 2332, 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:52.410 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 0, 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:52.411 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle-0x556c4435ea00": { 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:52.412 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 0, 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 0, 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:52.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:52.414 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-10-07T00:22:52.901 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-07T00:22:52.902 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-07T00:22:52.902 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2023-10-07T00:22:52.902 DEBUG:tasks.check_counter:Getting stats from h 2023-10-07T00:22:52.902 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-07T00:22:53.206 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:52 smithi088 ceph-mon[103111]: pgmap v649: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:22:53.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:52 smithi112 ceph-mon[133548]: pgmap v649: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:22:53.393 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:52 smithi005 ceph-mon[129406]: pgmap v649: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:22:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:22:55.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:54 smithi088 ceph-mon[103111]: pgmap v650: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:22:55.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:54 smithi112 ceph-mon[133548]: pgmap v650: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:22:55.285 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-10-07T00:22:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:22:55.285 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 134721, 2023-10-07T00:22:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 64126, 2023-10-07T00:22:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 48493923, 2023-10-07T00:22:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 35216541, 2023-10-07T00:22:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 16, 2023-10-07T00:22:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 3, 2023-10-07T00:22:55.286 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 8.828880966, 2023-10-07T00:22:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 3.741644023, 2023-10-07T00:22:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 7.199168786, 2023-10-07T00:22:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.039374752, 2023-10-07T00:22:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 64124, 2023-10-07T00:22:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 1.757780409, 2023-10-07T00:22:55.287 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000027412 2023-10-07T00:22:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 189516, 2023-10-07T00:22:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.031335367, 2023-10-07T00:22:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000165 2023-10-07T00:22:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.288 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:22:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:22:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:22:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 4113, 2023-10-07T00:22:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 4255, 2023-10-07T00:22:55.289 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 1302956, 2023-10-07T00:22:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 12159677, 2023-10-07T00:22:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 18, 2023-10-07T00:22:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 6, 2023-10-07T00:22:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.360080732, 2023-10-07T00:22:55.290 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.141769786, 2023-10-07T00:22:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.169317124, 2023-10-07T00:22:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.059927027, 2023-10-07T00:22:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4253, 2023-10-07T00:22:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.175878013, 2023-10-07T00:22:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000041353 2023-10-07T00:22:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.291 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3950, 2023-10-07T00:22:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000801001, 2023-10-07T00:22:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000202 2023-10-07T00:22:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-07T00:22:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 302672 2023-10-07T00:22:55.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 7792, 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 7155, 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 3885540, 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 7535091, 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 10, 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 5, 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.638907441, 2023-10-07T00:22:55.293 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.286861333, 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.391381881, 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.038271700, 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 7155, 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.243148711, 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000033983 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:55.294 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 11212, 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.002139875, 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000190 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 706896, 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 124672 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "cct": { 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "total_workers": 1, 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: "unhealthy_workers": 0 2023-10-07T00:22:55.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-MDSRank": { 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 5645, 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 3.024511409, 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000535785 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-PurgeQueue": { 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2023-10-07T00:22:55.296 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3087, 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.331664995, 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000107439 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "request": 38525, 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "reply": 35975, 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "reply_latency": { 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 35975, 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 171.266400699, 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.004760706 2023-10-07T00:22:55.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_reply": 0, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "forward": 2550, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_complete": 0, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_keys": 0, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_commit": 56, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_split": 5, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_merge": 0, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes": 20, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_top": 4, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_bottom": 3, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pin_tail": 13, 2023-10-07T00:22:55.298 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pinned": 13, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_expired": 2090, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_with_caps": 1, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": 1, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "subtrees": 6, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse": 80611, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_hit": 35964, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_forward": 2549, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_discover": 330, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_remote_ino": 0, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_lock": 4, 2023-10-07T00:22:55.299 INFO:teuthology.orchestra.run.smithi088.stdout: "load_cent": 0, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "q": 0, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "exported": 77, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "exported_inodes": 1046, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "imported": 42, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "imported_inodes": 1984, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_dir_fetch": 0, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_backtrace_fetch": 113, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_peer_discover": 0, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rfiles": 943, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rbytes": 19065699, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rsnaps": 0, 2023-10-07T00:22:55.300 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_fetch": 113, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_set_tag": 0, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_inodes": 0, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dirfrag_rstats": 0, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_file_inodes": 113, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_inode_file_caps": 7, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_revoke": 1255, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_grant": 3111, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_trunc": 0, 2023-10-07T00:22:55.301 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps": 77336, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps_dirty": 764, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_cap_release": 102, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "process_request_cap_release": 5705 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache": { 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update": 0, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update_receipt": 0, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_try_discover": 0, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_send_discover": 357, 2023-10-07T00:22:55.302 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_handle_discover": 309, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_delayed": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_created": 1460, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_enqueued": 1460, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_reintegrated": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_migrated": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_processing": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_started": 0, 2023-10-07T00:22:55.303 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_completed": 0, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_exportdir": 79, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_flush": 0, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragmentdir": 5, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragstats": 0, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_inodestats": 0 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log": { 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "evlrg": 0, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "evadd": 23112, 2023-10-07T00:22:55.304 INFO:teuthology.orchestra.run.smithi088.stdout: "evex": 0, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "evtrm": 0, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "ev": 23112, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "evexg": 0, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "evexd": 0, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "segadd": 28, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "segex": 0, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "segtrm": 0, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "seg": 28, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "segmjr": 3, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "segexg": 0, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "segexd": 0, 2023-10-07T00:22:55.305 INFO:teuthology.orchestra.run.smithi088.stdout: "expos": 4194304, 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "wrpos": 27188853, 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "rdpos": 0, 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "jlat": { 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2721, 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 8.462958243, 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.003110238 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "replayed": 0 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.306 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_mem": { 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "ino": 27, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "ino+": 2187, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "ino-": 2160, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "dir": 26, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "dir+": 175, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "dir-": 149, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "dn": 20, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "dn+": 5578, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "dn-": 5558, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "cap": 1, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "cap+": 2184, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "cap-": 2183, 2023-10-07T00:22:55.307 INFO:teuthology.orchestra.run.smithi088.stdout: "rss": 66972, 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "heap": 198960 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_server": { 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_client_request": 44271, 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_server_request": 2349, 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_request": 38525, 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_session": 166, 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_peer_request": 3961, 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "req_create_latency": { 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 762, 2023-10-07T00:22:55.308 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 40.501073358, 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.053151014 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getattr_latency": { 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1, 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000651130, 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000651130 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getfilelock_latency": { 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "req_link_latency": { 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookup_latency": { 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 32646, 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 12.575052545, 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000385194 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookuphash_latency": { 2023-10-07T00:22:55.310 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupino_latency": { 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.311 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupname_latency": { 2023-10-07T00:22:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupparent_latency": { 2023-10-07T00:22:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupsnap_latency": { 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lssnap_latency": { 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.313 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mkdir_latency": { 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mknod_latency": { 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.314 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mksnap_latency": { 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "req_open_latency": { 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 351, 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.116300467, 2023-10-07T00:22:55.315 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000331340 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "req_readdir_latency": { 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 111, 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.076720524, 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000691175 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rename_latency": { 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 761, 2023-10-07T00:22:55.316 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 116.155459021, 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.152635294 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "req_renamesnap_latency": { 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "req_snapdiff_latency": { 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.317 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmdir_latency": { 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmsnap_latency": { 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.318 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmxattr_latency": { 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setattr_latency": { 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.319 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setdirlayout_latency": { 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setfilelock_latency": { 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setlayout_latency": { 2023-10-07T00:22:55.320 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setxattr_latency": { 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "req_symlink_latency": { 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.321 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "req_unlink_latency": { 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1343, 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 1.841143654, 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001370918 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getvxattr_latency": { 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.322 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sessions": { 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "session_count": 1, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "session_add": 1, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "session_remove": 0, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_open": 1, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_stale": 0, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "total_load": 3902, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "average_load": 3902, 2023-10-07T00:22:55.323 INFO:teuthology.orchestra.run.smithi088.stdout: "avg_session_uptime": 602, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "mdthresh_evicted": 0 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool": { 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_items": 0, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:22:55.324 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_items": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_items": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:22:55.325 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_items": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_items": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_bytes": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_items": 0, 2023-10-07T00:22:55.326 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_bytes": 363315, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_items": 136, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_items": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_bytes": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_items": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_items": 0, 2023-10-07T00:22:55.327 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_items": 0, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_bytes": 7720, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_items": 162, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_bytes": 0, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_items": 0, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_bytes": 108453, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_items": 514, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_bytes": 0, 2023-10-07T00:22:55.328 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_items": 0, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_bytes": 0, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_items": 0 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter": { 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "op_active": 0, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "op_laggy": 0, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send": 4871, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send_bytes": 23904966, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "op_resend": 27, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "op_reply": 4871, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "op_latency": { 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4871, 2023-10-07T00:22:55.329 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 12.290740797, 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.002523247 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "op_inflight": 0, 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "oplen_avg": { 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4871, 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 5083 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "op": 4871, 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "op_r": 251, 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "op_w": 4620, 2023-10-07T00:22:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: "op_rmw": 0, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "op_pg": 0, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_stat": 0, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_create": 10, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_read": 138, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_write": 2859, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writefull": 124, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writesame": 0, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_append": 0, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_zero": 0, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_truncate": 5, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_delete": 1477, 2023-10-07T00:22:55.331 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_mapext": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_sparse_read": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_clonerange": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_getxattr": 113, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_setxattr": 20, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_rmxattr": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_call": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_watch": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_notify": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:22:55.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_other": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_active": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_send": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_resend": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_ping": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_active": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_send": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_resend": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_active": 0, 2023-10-07T00:22:55.333 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_send": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_resend": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_active": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_send": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_resend": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "command_active": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "command_send": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "command_resend": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "map_epoch": 88, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "map_full": 0, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "map_inc": 2, 2023-10-07T00:22:55.334 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_sessions": 12, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_open": 12, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_close": 0, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_laggy": 0, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_wr": 273, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_rd": 0, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_del": 64 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "oft": { 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_objs": 1, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:22:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_updates": 0, 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_removes": 0 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "osd-slow-ops": { 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_ops_count": 0 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "purge_queue": { 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops": 0, 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops_high_water": 6, 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing": 0, 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_high_water": 6, 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed": 1460, 2023-10-07T00:22:55.336 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_item_in_journal": 0 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 146622, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 40470101, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 146622, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:55.337 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 146622, 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 40470101, 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_bytes": { 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2023-10-07T00:22:55.338 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 4871, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 24052426, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 4871, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 24052426, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.339 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_ops": { 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 1024, 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2023-10-07T00:22:55.340 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 4871, 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 4871, 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 4871, 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 4871, 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:22:55.341 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 1460, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 147460, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 1460, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 138, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 147460, 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:55.342 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle-0x55cbefc3e640": { 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 23112, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 22994549, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:55.343 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 23112, 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2721, 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 22994549, 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-10-07T00:22:55.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:54 smithi005 ceph-mon[129406]: pgmap v650: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:22:55.801 INFO:tasks.check_counter:Daemon mds.h mds.exported=77 2023-10-07T00:22:55.801 INFO:tasks.check_counter:Daemon mds.h mds.imported=42 2023-10-07T00:22:55.801 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=5 2023-10-07T00:22:55.802 DEBUG:tasks.check_counter:Getting stats from k 2023-10-07T00:22:55.802 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-07T00:22:56.528 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-07T00:22:57.189 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:56 smithi088 ceph-mon[103111]: pgmap v651: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:22:57.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:56 smithi112 ceph-mon[133548]: pgmap v651: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:22:57.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:56 smithi005 ceph-mon[129406]: pgmap v651: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:22:58.148 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-10-07T00:22:58.148 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:22:58.148 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 0, 2023-10-07T00:22:58.148 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 2, 2023-10-07T00:22:58.148 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 0, 2023-10-07T00:22:58.148 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 0, 2023-10-07T00:22:58.148 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 4, 2023-10-07T00:22:58.148 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 0, 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.002986320, 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.000000000, 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.000634711, 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:58.149 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 207, 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 202, 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 471200, 2023-10-07T00:22:58.150 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 120240, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 2, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 1, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.037018546, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.011705437, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.019979730, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.005694986, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 202, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.014239955, 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000070494 2023-10-07T00:22:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 471200, 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 120240 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 1, 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 152, 2023-10-07T00:22:58.152 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 160, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 72560, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 3, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 2, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.011350680, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.007568506, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.001337555, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 150, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.011320393, 2023-10-07T00:22:58.153 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000075469 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 72560 2023-10-07T00:22:58.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: "cct": { 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: "total_workers": 0, 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: "unhealthy_workers": 0 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool": { 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_items": 0, 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:22:58.155 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_items": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_items": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:22:58.157 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:22:58.158 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:22:58.158 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:22:58.158 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:22:58.158 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_items": 0, 2023-10-07T00:22:58.158 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:22:58.158 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:22:58.158 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_items": 0, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_bytes": 0, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_items": 0, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_bytes": 148967, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_items": 29, 2023-10-07T00:22:58.159 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_items": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_bytes": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_items": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_items": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_items": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_bytes": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_items": 0, 2023-10-07T00:22:58.160 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_bytes": 0, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_items": 0, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_bytes": 928, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_items": 2, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_bytes": 0, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_items": 0, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_bytes": 0, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_items": 0 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-07T00:22:58.161 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 204, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 439562, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 204, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 204, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 439562, 2023-10-07T00:22:58.162 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2023-10-07T00:22:58.163 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2023-10-07T00:22:58.163 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2023-10-07T00:22:58.163 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2023-10-07T00:22:58.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:58.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-07T00:22:58.163 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-10-07T00:22:58.602 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-10-07T00:22:58.602 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-10-07T00:22:58.602 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2023-10-07T00:22:58.602 DEBUG:tasks.check_counter:Getting stats from c 2023-10-07T00:22:58.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-07T00:22:58.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:22:58 smithi112 ceph-mon[133548]: pgmap v652: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:22:59.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:22:58 smithi088 ceph-mon[103111]: pgmap v652: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:22:59.352 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:22:59.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:22:58 smithi005 ceph-mon[129406]: pgmap v652: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:23:00.861 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-07T00:23:00.861 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:23:00.861 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1069, 2023-10-07T00:23:00.861 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 1070, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 8719727, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 332158, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 6, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.138550334, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.038430234, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.046580858, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.037130109, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1068, 2023-10-07T00:23:00.862 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.063956398, 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000059884 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.863 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 693, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 839, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 10148516, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 517266, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.082308193, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.029173733, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.028145110, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.017543398, 2023-10-07T00:23:00.864 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 838, 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.049765359, 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000059385 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 303232 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 926, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 890, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 9254507, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 332451, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 3, 2023-10-07T00:23:00.866 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.119120027, 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.040175022, 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.049304142, 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.023072526, 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 889, 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.047933696, 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000053918 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.867 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 692304, 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 119104 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2023-10-07T00:23:00.868 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4146, 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.161033389, 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000038840 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 0, 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 0, 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.870 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 0, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 0, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 325, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 154, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 75, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 96, 2023-10-07T00:23:00.871 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 104, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 932, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 0, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 0, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 2, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 0, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 0, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2023-10-07T00:23:00.872 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 4, 2023-10-07T00:23:00.873 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 246, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2023-10-07T00:23:00.874 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 0, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 0, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 0, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 0, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 0, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 0 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2023-10-07T00:23:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2023-10-07T00:23:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2023-10-07T00:23:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 0, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 22904, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 0, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2023-10-07T00:23:00.878 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 2, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 44, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 30869242, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 30944052, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 30940288, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.879 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 22904 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 23, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 2348, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 2325, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 18, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 128, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 110, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 325, 2023-10-07T00:23:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 4645, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 4320, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 0, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 0, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 0, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 50428, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 207152 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 0, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 0, 2023-10-07T00:23:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 0, 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2023-10-07T00:23:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2023-10-07T00:23:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2023-10-07T00:23:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2023-10-07T00:23:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2023-10-07T00:23:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.891 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2023-10-07T00:23:00.893 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.894 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.895 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 2, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 1, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 1, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 0, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 0, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 2364, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2023-10-07T00:23:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:23:00.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:23:00.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:23:00.899 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 198247, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 56, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2023-10-07T00:23:00.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 7720, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 162, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 299191, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 1658, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2023-10-07T00:23:00.901 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 2442, 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 26, 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 4, 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 2442, 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2442, 2023-10-07T00:23:00.902 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.455962569, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000596217 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2442, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2443 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 2442, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 2442, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-07T00:23:00.903 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 1386, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 1053, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-07T00:23:00.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 2, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:23:00.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-07T00:23:00.906 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 88, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 2, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 6, 2023-10-07T00:23:00.907 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 6, 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 0, 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:23:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 0, 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 0, 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 0, 2023-10-07T00:23:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2684, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 27866087, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2684, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:00.910 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2684, 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 27866087, 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2023-10-07T00:23:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2442, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 26749758, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2442, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 26749758, 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:00.912 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:00.913 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2442, 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 2442, 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2442, 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2442, 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:00.915 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x56455cc06a00": { 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2023-10-07T00:23:00.916 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:00.917 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:00.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:00.918 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-07T00:23:01.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:00 smithi088 ceph-mon[103111]: pgmap v653: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-07T00:23:01.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:00 smithi112 ceph-mon[133548]: pgmap v653: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-07T00:23:01.324 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-10-07T00:23:01.324 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-10-07T00:23:01.325 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2023-10-07T00:23:01.325 DEBUG:tasks.check_counter:Getting stats from f 2023-10-07T00:23:01.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-07T00:23:01.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:00 smithi005 ceph-mon[129406]: pgmap v653: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-07T00:23:02.054 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:23:03.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:02 smithi088 ceph-mon[103111]: pgmap v654: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:03.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:02 smithi112 ceph-mon[133548]: pgmap v654: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:03.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:02 smithi005 ceph-mon[129406]: pgmap v654: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:03.597 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1475, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 1476, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 33988741, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 458421, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 8, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.196398536, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.055356188, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.075780591, 2023-10-07T00:23:03.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.045958584, 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1474, 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.086069234, 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000058391 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 763, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 725, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 28990965, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 281336, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.130035088, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.031151913, 2023-10-07T00:23:03.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.073750066, 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.020452288, 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 725, 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.041302238, 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000056968 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 695696, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 120176 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 455, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 605, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 25281325, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 445914, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 6, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 5, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.083769158, 2023-10-07T00:23:03.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.017006883, 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.048872034, 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.011944143, 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 603, 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.029848463, 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000049499 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.603 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 304720 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-07T00:23:03.604 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4195, 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.128469820, 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000030624 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 0, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 0, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2023-10-07T00:23:03.606 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 0, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 0, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 2170, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 0, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 0, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 2170, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 2170, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 175, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 0, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 0, 2023-10-07T00:23:03.607 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 1, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2023-10-07T00:23:03.608 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:23:03.609 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 0, 2023-10-07T00:23:03.610 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 0 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:23:03.611 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2023-10-07T00:23:03.612 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 0, 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 0, 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2023-10-07T00:23:03.613 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 50701, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 0, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 62, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 6, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2023-10-07T00:23:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 91079185, 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 91077534, 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 50701 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 22, 2023-10-07T00:23:03.615 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 6117, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 6095, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 83, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 385, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 302, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 2170, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 13418, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 11248, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 0, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 0, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 0, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 55796, 2023-10-07T00:23:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 207152 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 0, 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 0, 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 0, 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.618 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.619 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.621 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.622 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.623 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2023-10-07T00:23:03.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.626 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2023-10-07T00:23:03.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2023-10-07T00:23:03.630 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 2, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 1, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 1, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 0, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 0, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 2370, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:23:03.631 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:23:03.632 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:23:03.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 231391, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 75, 2023-10-07T00:23:03.634 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 7720, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 162, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 1672505, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 13120, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-07T00:23:03.636 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 2446, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 21, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 3, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 2446, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2446, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.890951392, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000773079 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-07T00:23:03.637 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2446, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2447 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 2446, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 2446, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 1321, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 1123, 2023-10-07T00:23:03.638 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 1, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-07T00:23:03.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-07T00:23:03.640 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-07T00:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 88, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 2, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 10, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 10, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.642 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 0, 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 0, 2023-10-07T00:23:03.643 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 0, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 0, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2689, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 88003860, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:03.644 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2689, 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2689, 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 88003860, 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2023-10-07T00:23:03.645 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2446, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 86885561, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2446, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 86885561, 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:03.646 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2446, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 2446, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2446, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2446, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-07T00:23:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x5652fac24a00": { 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:03.651 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-07T00:23:04.126 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-10-07T00:23:04.126 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-10-07T00:23:04.126 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-10-07T00:23:04.126 DEBUG:tasks.check_counter:Getting stats from i 2023-10-07T00:23:04.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-07T00:23:04.850 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:23:05.190 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:04 smithi112 ceph-mon[133548]: pgmap v655: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:23:05.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:04 smithi088 ceph-mon[103111]: pgmap v655: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:23:05.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:04 smithi005 ceph-mon[129406]: pgmap v655: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:23:06.379 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-07T00:23:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 18374, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 16723, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 10220805, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 18535704, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 19, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 1.490035422, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.634688405, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.973802786, 2023-10-07T00:23:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.068834295, 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 16722, 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.548119553, 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000032778 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 27906, 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.005515971, 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000197 2023-10-07T00:23:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 699488, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 126464 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 171787, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 51739, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 58406606, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 39123364, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 15, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 7, 2023-10-07T00:23:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 10.212960286, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 4.344319609, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 8.695147897, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.051654982, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 51735, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.535232421, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000029674 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 212358, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.031163770, 2023-10-07T00:23:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000146 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 304464 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 8017, 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 8225, 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 3410998, 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 11620386, 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 10, 2023-10-07T00:23:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 5, 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.636017991, 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.270144124, 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.395016098, 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.041943370, 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 8226, 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.278908997, 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000033905 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 12455, 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.002635099, 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000211 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 448 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 5304, 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 3.664582932, 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000690909 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-07T00:23:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 5510, 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.438982104, 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000079670 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 37607, 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 35762, 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 35762, 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 135.578845096, 2023-10-07T00:23:06.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.003791142 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 1845, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 65, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 6, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 27, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 6, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 5, 2023-10-07T00:23:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 16, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 16, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 907, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 1, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 1, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 6, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 77207, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 36186, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 1843, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 228, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:23:06.390 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 4, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 3000, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 3, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 106, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 277, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 65, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 3519, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 153, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2023-10-07T00:23:06.391 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 943, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 19065699, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 153, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 153, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 54, 2023-10-07T00:23:06.392 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 1138, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 4208, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 131725, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 676, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 244, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 7374 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2023-10-07T00:23:06.393 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 260, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 196, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 2, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 2528, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 2526, 2023-10-07T00:23:06.394 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 113, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 6, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2023-10-07T00:23:06.395 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 33164, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 33164, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 39, 2023-10-07T00:23:06.396 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 39, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 4, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 39734217, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 0, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2648, 2023-10-07T00:23:06.397 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 13.242650687, 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.005001001 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 0 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 32, 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 2749, 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 2717, 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 31, 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 213, 2023-10-07T00:23:06.398 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 182, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 27, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 7658, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 7631, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 1, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 2748, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 2747, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 71000, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 198960 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2023-10-07T00:23:06.399 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 42816, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 1778, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 37607, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 114, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 3198, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 674, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 38.264586893, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.056772384 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 30, 2023-10-07T00:23:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.008289601, 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000276320 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.401 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 31534, 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 16.643655530, 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000527800 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.403 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2023-10-07T00:23:06.404 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.405 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 387, 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.128271792, 2023-10-07T00:23:06.406 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000331451 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 178, 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.123554271, 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000694125 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 654, 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 77.233755287, 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.118094427 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2023-10-07T00:23:06.408 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 5, 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.062485019, 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.012497003 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.409 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.410 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.412 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2300, 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 3.114246703, 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001354020 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.413 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 1, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 0, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 1, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 5485, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 5485, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 610, 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2023-10-07T00:23:06.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:23:06.415 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:23:06.416 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2023-10-07T00:23:06.417 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 296379, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 105, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:23:06.418 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 7720, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 162, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 130989, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 795, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2023-10-07T00:23:06.419 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 6197, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 36672436, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 27, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 6197, 2023-10-07T00:23:06.420 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 6197, 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 14.114636768, 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002277656 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 6197, 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 6412 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 6197, 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 404, 2023-10-07T00:23:06.421 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 5793, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 10, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 251, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 2899, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 193, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-07T00:23:06.422 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 6, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 2546, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 153, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 20, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-07T00:23:06.423 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-07T00:23:06.424 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 88, 2023-10-07T00:23:06.425 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 2, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 12, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 12, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 263, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 71 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2023-10-07T00:23:06.426 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 1, 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 6, 2023-10-07T00:23:06.427 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 6, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 2526, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 198174, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 54186413, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:06.428 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 198174, 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 198174, 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 54186413, 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.429 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 6197, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 36927562, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 6197, 2023-10-07T00:23:06.430 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 36927562, 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:06.431 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 6197, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 6197, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 6197, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 6197, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.432 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2526, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 255126, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2526, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 251, 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 255126, 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x55751d756640": { 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 33164, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 35539913, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 33164, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2648, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 35539913, 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:06.436 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-07T00:23:07.028 INFO:tasks.check_counter:Daemon mds.i mds.exported=106 2023-10-07T00:23:07.028 INFO:tasks.check_counter:Daemon mds.i mds.imported=65 2023-10-07T00:23:07.028 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=6 2023-10-07T00:23:07.028 DEBUG:tasks.check_counter:Getting stats from l 2023-10-07T00:23:07.029 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-07T00:23:07.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:06 smithi088 ceph-mon[103111]: pgmap v656: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:07.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:06 smithi112 ceph-mon[133548]: pgmap v656: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:07.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:06 smithi005 ceph-mon[129406]: pgmap v656: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:07.756 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-07T00:23:08.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:08 smithi112 ceph-mon[133548]: pgmap v657: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:23:09.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:08 smithi088 ceph-mon[103111]: pgmap v657: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:23:09.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:08 smithi005 ceph-mon[129406]: pgmap v657: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-07T00:23:09.412 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-07T00:23:09.412 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2023-10-07T00:23:09.412 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1308, 2023-10-07T00:23:09.412 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 1310, 2023-10-07T00:23:09.412 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 12974713, 2023-10-07T00:23:09.412 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 406789, 2023-10-07T00:23:09.412 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 7, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 3, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.160697736, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.050791746, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.051357321, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.040722093, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1308, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.069784492, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000053352 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.413 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1128, 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 1092, 2023-10-07T00:23:09.414 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 17693666, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 397531, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.137828507, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.050073999, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.054323121, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.026914284, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1091, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.065931351, 2023-10-07T00:23:09.415 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000060432 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 694384, 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 123472 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 198, 2023-10-07T00:23:09.416 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 350, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 6231941, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 367479, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.036034675, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.012017157, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.015590388, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.004537587, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 349, 2023-10-07T00:23:09.417 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.021393898, 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000061300 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 307456 2023-10-07T00:23:09.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4093, 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.119119406, 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000029103 2023-10-07T00:23:09.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 0, 2023-10-07T00:23:09.420 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 0, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 0, 2023-10-07T00:23:09.421 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 0, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 2567, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 0, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 0, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 2567, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 2567, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 219, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 0, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 0, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 1, 2023-10-07T00:23:09.422 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2023-10-07T00:23:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2023-10-07T00:23:09.424 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 0, 2023-10-07T00:23:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 0, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 0 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 0, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2023-10-07T00:23:09.426 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2023-10-07T00:23:09.427 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 0, 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 0, 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2023-10-07T00:23:09.428 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 33164, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 0, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 39, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 4, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2023-10-07T00:23:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 39734217, 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 39733079, 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 33164 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 15, 2023-10-07T00:23:09.430 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 2721, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 2706, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 13, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 173, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 160, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 2567, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 7043, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 4476, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 0, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 0, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 0, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 53240, 2023-10-07T00:23:09.431 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 207152 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 0, 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 0, 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 0, 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.432 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2023-10-07T00:23:09.434 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.435 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.436 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.438 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2023-10-07T00:23:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2023-10-07T00:23:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2023-10-07T00:23:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 1, 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 0, 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 1, 2023-10-07T00:23:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 0, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 0, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 2375, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2023-10-07T00:23:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2023-10-07T00:23:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-07T00:23:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 216032, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 70, 2023-10-07T00:23:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 7720, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 162, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2023-10-07T00:23:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 1836254, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 10575, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-07T00:23:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 2382, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 21, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 3, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 2382, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2382, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.342965474, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000563797 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2023-10-07T00:23:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2382, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2383 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 2382, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 2382, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 1321, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-07T00:23:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 1059, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-07T00:23:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 1, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-07T00:23:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-07T00:23:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 88, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 2, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 8, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 8, 2023-10-07T00:23:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 0, 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2023-10-07T00:23:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 0, 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 0, 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 0, 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2630, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 36648147, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2630, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2630, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 36648147, 2023-10-07T00:23:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2382, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 35539918, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2382, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 35539918, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2382, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 2382, 2023-10-07T00:23:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2382, 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2382, 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x55d3221f4a00": { 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-07T00:23:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-07T00:23:09.468 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-07T00:23:09.929 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-07T00:23:09.930 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-07T00:23:09.930 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2023-10-07T00:23:09.930 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-07T00:23:09.941 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-07T00:23:09.941 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:23:09.942 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-07T00:23:09.992 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:23:09.992 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-07T00:23:10.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:23:10.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.284+0000 7fe251dff700 1 -- 172.21.15.5:0/2834536909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe24c100fb0 msgr2=0x7fe24c1013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.284+0000 7fe251dff700 1 --2- 172.21.15.5:0/2834536909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe24c100fb0 0x7fe24c1013d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009990 tx=0x7fe23c009ca0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.285+0000 7fe251dff700 1 -- 172.21.15.5:0/2834536909 shutdown_connections 2023-10-07T00:23:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.285+0000 7fe251dff700 1 --2- 172.21.15.5:0/2834536909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c102b40 0x7fe24c1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.285+0000 7fe251dff700 1 --2- 172.21.15.5:0/2834536909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe24c100fb0 0x7fe24c1013d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.285+0000 7fe251dff700 1 --2- 172.21.15.5:0/2834536909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24c1021a0 0x7fe24c102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.285+0000 7fe251dff700 1 -- 172.21.15.5:0/2834536909 >> 172.21.15.5:0/2834536909 conn(0x7fe24c0fc520 msgr2=0x7fe24c0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.285+0000 7fe251dff700 1 -- 172.21.15.5:0/2834536909 shutdown_connections 2023-10-07T00:23:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.285+0000 7fe251dff700 1 -- 172.21.15.5:0/2834536909 wait complete. 2023-10-07T00:23:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.286+0000 7fe251dff700 1 Processor -- start 2023-10-07T00:23:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.286+0000 7fe251dff700 1 -- start start 2023-10-07T00:23:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.286+0000 7fe251dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c100fb0 0x7fe24c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.286+0000 7fe251dff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24c1021a0 0x7fe24c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.286+0000 7fe251dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe24c102b40 0x7fe24c1a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.286+0000 7fe251dff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c1a09c0 con 0x7fe24c1021a0 2023-10-07T00:23:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.286+0000 7fe251dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c1a0b00 con 0x7fe24c100fb0 2023-10-07T00:23:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.286+0000 7fe251dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c1a0c90 con 0x7fe24c102b40 2023-10-07T00:23:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24c1021a0 0x7fe24c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24c1021a0 0x7fe24c199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47976/0 (socket says 172.21.15.5:47976) 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 -- 172.21.15.5:0/4053263582 learned_addr learned my addr 172.21.15.5:0/4053263582 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe24c102b40 0x7fe24c1a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24b7fe700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c100fb0 0x7fe24c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 -- 172.21.15.5:0/4053263582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe24c102b40 msgr2=0x7fe24c1a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe24c102b40 0x7fe24c1a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 -- 172.21.15.5:0/4053263582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c100fb0 msgr2=0x7fe24c198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c100fb0 0x7fe24c198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 -- 172.21.15.5:0/4053263582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c0095f0 con 0x7fe24c1021a0 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.287+0000 7fe24affd700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24c1021a0 0x7fe24c199380 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe24000e9a0 tx=0x7fe24000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.288+0000 7fe248ff9700 1 -- 172.21.15.5:0/4053263582 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240009790 con 0x7fe24c1021a0 2023-10-07T00:23:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.288+0000 7fe248ff9700 1 -- 172.21.15.5:0/4053263582 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe240010430 con 0x7fe24c1021a0 2023-10-07T00:23:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.288+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c1a0f70 con 0x7fe24c1021a0 2023-10-07T00:23:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.288+0000 7fe248ff9700 1 -- 172.21.15.5:0/4053263582 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24000cea0 con 0x7fe24c1021a0 2023-10-07T00:23:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.288+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c1a13f0 con 0x7fe24c1021a0 2023-10-07T00:23:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.289+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c10c6c0 con 0x7fe24c1021a0 2023-10-07T00:23:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.291+0000 7fe248ff9700 1 -- 172.21.15.5:0/4053263582 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe2400105a0 con 0x7fe24c1021a0 2023-10-07T00:23:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.292+0000 7fe248ff9700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe2340a1480 0x7fe2340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.293+0000 7fe248ff9700 1 -- 172.21.15.5:0/4053263582 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe240014070 con 0x7fe24c1021a0 2023-10-07T00:23:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.293+0000 7fe24b7fe700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe2340a1480 0x7fe2340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.293+0000 7fe24b7fe700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe2340a1480 0x7fe2340a3940 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00b2e0 tx=0x7fe23c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.296+0000 7fe248ff9700 1 -- 172.21.15.5:0/4053263582 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe240052100 con 0x7fe24c1021a0 2023-10-07T00:23:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.510+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe24c1a15e0 con 0x7fe24c1021a0 2023-10-07T00:23:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.511+0000 7fe248ff9700 1 -- 172.21.15.5:0/4053263582 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7fe2400964f0 con 0x7fe24c1021a0 2023-10-07T00:23:10.513 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:23:10.513 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:23:10.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe2340a1480 msgr2=0x7fe2340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe2340a1480 0x7fe2340a3940 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00b2e0 tx=0x7fe23c005fd0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24c1021a0 msgr2=0x7fe24c199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24c1021a0 0x7fe24c199380 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe24000e9a0 tx=0x7fe24000ecb0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 shutdown_connections 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fe2340a1480 0x7fe2340a3940 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe24c102b40 0x7fe24c1a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c100fb0 0x7fe24c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 --2- 172.21.15.5:0/4053263582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24c1021a0 0x7fe24c199380 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 >> 172.21.15.5:0/4053263582 conn(0x7fe24c0fc520 msgr2=0x7fe24c0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 shutdown_connections 2023-10-07T00:23:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.514+0000 7fe251dff700 1 -- 172.21.15.5:0/4053263582 wait complete. 2023-10-07T00:23:10.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:23:10.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:23:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.740+0000 7f512b7ff700 1 -- 172.21.15.5:0/3689826046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124102b50 msgr2=0x7f5124109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.740+0000 7f512b7ff700 1 --2- 172.21.15.5:0/3689826046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124102b50 0x7f5124109400 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f511c00b0d0 tx=0x7f511c00b3e0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.740+0000 7f512b7ff700 1 -- 172.21.15.5:0/3689826046 shutdown_connections 2023-10-07T00:23:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.740+0000 7f512b7ff700 1 --2- 172.21.15.5:0/3689826046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124102b50 0x7f5124109400 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.740+0000 7f512b7ff700 1 --2- 172.21.15.5:0/3689826046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5124100fc0 0x7f51241013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.740+0000 7f512b7ff700 1 --2- 172.21.15.5:0/3689826046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51241021b0 0x7f5124102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.740+0000 7f512b7ff700 1 -- 172.21.15.5:0/3689826046 >> 172.21.15.5:0/3689826046 conn(0x7f51240fc530 msgr2=0x7f51240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.740+0000 7f512b7ff700 1 -- 172.21.15.5:0/3689826046 shutdown_connections 2023-10-07T00:23:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.741+0000 7f512b7ff700 1 -- 172.21.15.5:0/3689826046 wait complete. 2023-10-07T00:23:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.742+0000 7f512b7ff700 1 Processor -- start 2023-10-07T00:23:10.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.742+0000 7f512b7ff700 1 -- start start 2023-10-07T00:23:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512b7ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124100fc0 0x7f5124196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512b7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51241021b0 0x7f51241971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512b7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5124102b50 0x7f512419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512b7ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512419e7e0 con 0x7f5124100fc0 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512b7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512419e950 con 0x7f5124102b50 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512b7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512419eb10 con 0x7f51241021b0 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512959b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124100fc0 0x7f5124196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f5128d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51241021b0 0x7f51241971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512959b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124100fc0 0x7f5124196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47984/0 (socket says 172.21.15.5:47984) 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512959b700 1 -- 172.21.15.5:0/4289331580 learned_addr learned my addr 172.21.15.5:0/4289331580 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f5129d9c700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5124102b50 0x7f512419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512959b700 1 -- 172.21.15.5:0/4289331580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51241021b0 msgr2=0x7f51241971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512959b700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51241021b0 0x7f51241971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512959b700 1 -- 172.21.15.5:0/4289331580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5124102b50 msgr2=0x7f512419e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512959b700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5124102b50 0x7f512419e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.743+0000 7f512959b700 1 -- 172.21.15.5:0/4289331580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c009d00 con 0x7f5124100fc0 2023-10-07T00:23:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.744+0000 7f512959b700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124100fc0 0x7f5124196c70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f512000d980 tx=0x7f512000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.744+0000 7f511a7fc700 1 -- 172.21.15.5:0/4289331580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512000f890 con 0x7f5124100fc0 2023-10-07T00:23:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.744+0000 7f511a7fc700 1 -- 172.21.15.5:0/4289331580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f512000fe80 con 0x7f5124100fc0 2023-10-07T00:23:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.744+0000 7f511a7fc700 1 -- 172.21.15.5:0/4289331580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5120019360 con 0x7f5124100fc0 2023-10-07T00:23:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.744+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512419edf0 con 0x7f5124100fc0 2023-10-07T00:23:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.744+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512419f220 con 0x7f5124100fc0 2023-10-07T00:23:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.745+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512410c680 con 0x7f5124100fc0 2023-10-07T00:23:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.747+0000 7f511a7fc700 1 -- 172.21.15.5:0/4289331580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f512000f9f0 con 0x7f5124100fc0 2023-10-07T00:23:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.748+0000 7f511a7fc700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51100a1480 0x7f51100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.749+0000 7f511a7fc700 1 -- 172.21.15.5:0/4289331580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f51200cc780 con 0x7f5124100fc0 2023-10-07T00:23:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.749+0000 7f5128d9a700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51100a1480 0x7f51100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.749+0000 7f5128d9a700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51100a1480 0x7f51100a3940 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5124198170 tx=0x7f511400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.753+0000 7f511a7fc700 1 -- 172.21.15.5:0/4289331580 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5120095d60 con 0x7f5124100fc0 2023-10-07T00:23:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.968+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5124107ee0 con 0x7f5124100fc0 2023-10-07T00:23:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.968+0000 7f511a7fc700 1 -- 172.21.15.5:0/4289331580 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5120099380 con 0x7f5124100fc0 2023-10-07T00:23:10.970 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:23:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51100a1480 msgr2=0x7f51100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51100a1480 0x7f51100a3940 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5124198170 tx=0x7f511400b410 comp rx=0 tx=0).stop 2023-10-07T00:23:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124100fc0 msgr2=0x7f5124196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124100fc0 0x7f5124196c70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f512000d980 tx=0x7f512000dc90 comp rx=0 tx=0).stop 2023-10-07T00:23:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 shutdown_connections 2023-10-07T00:23:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f51100a1480 0x7f51100a3940 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5124102b50 0x7f512419e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5124100fc0 0x7f5124196c70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 --2- 172.21.15.5:0/4289331580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51241021b0 0x7f51241971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 >> 172.21.15.5:0/4289331580 conn(0x7f51240fc530 msgr2=0x7f51240fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 shutdown_connections 2023-10-07T00:23:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:10.971+0000 7f512b7ff700 1 -- 172.21.15.5:0/4289331580 wait complete. 2023-10-07T00:23:10.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:23:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 -- 172.21.15.5:0/4190348753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29841021b0 msgr2=0x7f2984102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 --2- 172.21.15.5:0/4190348753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29841021b0 0x7f2984102610 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f296c0099c0 tx=0x7f296c009cd0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 -- 172.21.15.5:0/4190348753 shutdown_connections 2023-10-07T00:23:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 --2- 172.21.15.5:0/4190348753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2984102b50 0x7f2984109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 --2- 172.21.15.5:0/4190348753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2984100fc0 0x7f29841013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 --2- 172.21.15.5:0/4190348753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29841021b0 0x7f2984102610 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 -- 172.21.15.5:0/4190348753 >> 172.21.15.5:0/4190348753 conn(0x7f29840fc530 msgr2=0x7f29840fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 -- 172.21.15.5:0/4190348753 shutdown_connections 2023-10-07T00:23:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.197+0000 7f2988fff700 1 -- 172.21.15.5:0/4190348753 wait complete. 2023-10-07T00:23:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.198+0000 7f2988fff700 1 Processor -- start 2023-10-07T00:23:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.198+0000 7f2988fff700 1 -- start start 2023-10-07T00:23:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.198+0000 7f2988fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2984100fc0 0x7f2984198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.198+0000 7f2988fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29841021b0 0x7f2984199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.198+0000 7f2988fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2984102b50 0x7f29841a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.198+0000 7f2988fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29841a09a0 con 0x7f2984102b50 2023-10-07T00:23:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.198+0000 7f2988fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29841a0ae0 con 0x7f2984100fc0 2023-10-07T00:23:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.198+0000 7f2988fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29841a0c70 con 0x7f29841021b0 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2984102b50 0x7f29841a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2984102b50 0x7f29841a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48002/0 (socket says 172.21.15.5:48002) 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 -- 172.21.15.5:0/2858379189 learned_addr learned my addr 172.21.15.5:0/2858379189 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f297bfff700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29841021b0 0x7f2984199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f298259c700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2984100fc0 0x7f2984198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 -- 172.21.15.5:0/2858379189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29841021b0 msgr2=0x7f2984199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29841021b0 0x7f2984199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 -- 172.21.15.5:0/2858379189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2984100fc0 msgr2=0x7f2984198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2984100fc0 0x7f2984198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 -- 172.21.15.5:0/2858379189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c0095f0 con 0x7f2984102b50 2023-10-07T00:23:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f298259c700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2984100fc0 0x7f2984198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T00:23:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f2982d9d700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2984102b50 0x7f29841a03d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f297c00ef30 tx=0x7f297c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f297b7fe700 1 -- 172.21.15.5:0/2858379189 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c018070 con 0x7f2984102b50 2023-10-07T00:23:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f297b7fe700 1 -- 172.21.15.5:0/2858379189 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f297c00f040 con 0x7f2984102b50 2023-10-07T00:23:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.199+0000 7f297b7fe700 1 -- 172.21.15.5:0/2858379189 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00cc70 con 0x7f2984102b50 2023-10-07T00:23:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.200+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29841a0ef0 con 0x7f2984102b50 2023-10-07T00:23:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.200+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29841a1320 con 0x7f2984102b50 2023-10-07T00:23:11.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:10 smithi088 ceph-mon[103111]: pgmap v658: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-07T00:23:11.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:10 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4053263582' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:23:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.201+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298410c6e0 con 0x7f2984102b50 2023-10-07T00:23:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.203+0000 7f297b7fe700 1 -- 172.21.15.5:0/2858379189 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f297c007500 con 0x7f2984102b50 2023-10-07T00:23:11.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.204+0000 7f297b7fe700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29700a1500 0x7f29700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:11.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.204+0000 7f297b7fe700 1 -- 172.21.15.5:0/2858379189 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f297c0cc870 con 0x7f2984102b50 2023-10-07T00:23:11.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.204+0000 7f298259c700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29700a1500 0x7f29700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:11.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.205+0000 7f298259c700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29700a1500 0x7f29700a39c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2974005950 tx=0x7f29740058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.208+0000 7f297b7fe700 1 -- 172.21.15.5:0/2858379189 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f297c095ee0 con 0x7f2984102b50 2023-10-07T00:23:11.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:10 smithi112 ceph-mon[133548]: pgmap v658: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-07T00:23:11.248 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:10 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4053263582' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:23:11.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:10 smithi005 ceph-mon[129406]: pgmap v658: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-07T00:23:11.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:10 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4053263582' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:23:11.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.420+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29841a1510 con 0x7f2984102b50 2023-10-07T00:23:11.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.420+0000 7f297b7fe700 1 -- 172.21.15.5:0/2858379189 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f297c099500 con 0x7f2984102b50 2023-10-07T00:23:11.422 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:23:11.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29700a1500 msgr2=0x7f29700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29700a1500 0x7f29700a39c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2974005950 tx=0x7f29740058e0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2984102b50 msgr2=0x7f29841a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2984102b50 0x7f29841a03d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f297c00ef30 tx=0x7f297c00c3a0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 shutdown_connections 2023-10-07T00:23:11.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f29700a1500 0x7f29700a39c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2984102b50 0x7f29841a03d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2984100fc0 0x7f2984198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 --2- 172.21.15.5:0/2858379189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29841021b0 0x7f2984199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 >> 172.21.15.5:0/2858379189 conn(0x7f29840fc530 msgr2=0x7f29840fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:11.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 shutdown_connections 2023-10-07T00:23:11.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.423+0000 7f2988fff700 1 -- 172.21.15.5:0/2858379189 wait complete. 2023-10-07T00:23:11.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:23:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.647+0000 7f605c1ff700 1 -- 172.21.15.5:0/446861129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6054102b50 msgr2=0x7f6054109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.647+0000 7f605c1ff700 1 --2- 172.21.15.5:0/446861129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6054102b50 0x7f6054109400 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f604c00b0d0 tx=0x7f604c00b3e0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.648+0000 7f605c1ff700 1 -- 172.21.15.5:0/446861129 shutdown_connections 2023-10-07T00:23:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.648+0000 7f605c1ff700 1 --2- 172.21.15.5:0/446861129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6054102b50 0x7f6054109400 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.648+0000 7f605c1ff700 1 --2- 172.21.15.5:0/446861129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6054100fc0 0x7f60541013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.648+0000 7f605c1ff700 1 --2- 172.21.15.5:0/446861129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60541021b0 0x7f6054102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.648+0000 7f605c1ff700 1 -- 172.21.15.5:0/446861129 >> 172.21.15.5:0/446861129 conn(0x7f60540fc530 msgr2=0x7f60540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.648+0000 7f605c1ff700 1 -- 172.21.15.5:0/446861129 shutdown_connections 2023-10-07T00:23:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.648+0000 7f605c1ff700 1 -- 172.21.15.5:0/446861129 wait complete. 2023-10-07T00:23:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605c1ff700 1 Processor -- start 2023-10-07T00:23:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605c1ff700 1 -- start start 2023-10-07T00:23:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605c1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6054100fc0 0x7f6054196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605c1ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60541021b0 0x7f60541971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605c1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6054102b50 0x7f605419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605c1ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605419e810 con 0x7f60541021b0 2023-10-07T00:23:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605c1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605419e980 con 0x7f6054100fc0 2023-10-07T00:23:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605c1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605419eb40 con 0x7f6054102b50 2023-10-07T00:23:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.649+0000 7f605979a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60541021b0 0x7f60541971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605979a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60541021b0 0x7f60541971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48022/0 (socket says 172.21.15.5:48022) 2023-10-07T00:23:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605979a700 1 -- 172.21.15.5:0/1441918758 learned_addr learned my addr 172.21.15.5:0/1441918758 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f6059f9b700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6054100fc0 0x7f6054196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605a79c700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6054102b50 0x7f605419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605979a700 1 -- 172.21.15.5:0/1441918758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6054102b50 msgr2=0x7f605419e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605979a700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6054102b50 0x7f605419e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605979a700 1 -- 172.21.15.5:0/1441918758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6054100fc0 msgr2=0x7f6054196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605979a700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6054100fc0 0x7f6054196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605979a700 1 -- 172.21.15.5:0/1441918758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c009d00 con 0x7f60541021b0 2023-10-07T00:23:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605979a700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60541021b0 0x7f60541971e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f604400d950 tx=0x7f604400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f604affd700 1 -- 172.21.15.5:0/1441918758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604400f890 con 0x7f60541021b0 2023-10-07T00:23:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f604affd700 1 -- 172.21.15.5:0/1441918758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f604400fe80 con 0x7f60541021b0 2023-10-07T00:23:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f604affd700 1 -- 172.21.15.5:0/1441918758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604400e3b0 con 0x7f60541021b0 2023-10-07T00:23:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.650+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605419ee20 con 0x7f60541021b0 2023-10-07T00:23:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.651+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605419f250 con 0x7f60541021b0 2023-10-07T00:23:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.652+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6054107ea0 con 0x7f60541021b0 2023-10-07T00:23:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.654+0000 7f604affd700 1 -- 172.21.15.5:0/1441918758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6044010460 con 0x7f60541021b0 2023-10-07T00:23:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.655+0000 7f604affd700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60400a1500 0x7f60400a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.655+0000 7f604affd700 1 -- 172.21.15.5:0/1441918758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f60440ccac0 con 0x7f60541021b0 2023-10-07T00:23:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.655+0000 7f6059f9b700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60400a1500 0x7f60400a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.656+0000 7f6059f9b700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60400a1500 0x7f60400a39c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6054197b70 tx=0x7f605000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.659+0000 7f604affd700 1 -- 172.21.15.5:0/1441918758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f60440960a0 con 0x7f60541021b0 2023-10-07T00:23:11.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.871+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f605402d220 con 0x7f60541021b0 2023-10-07T00:23:11.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.871+0000 7f604affd700 1 -- 172.21.15.5:0/1441918758 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60440160a0 con 0x7f60541021b0 2023-10-07T00:23:11.873 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:23:11.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60400a1500 msgr2=0x7f60400a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60400a1500 0x7f60400a39c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6054197b70 tx=0x7f605000b410 comp rx=0 tx=0).stop 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60541021b0 msgr2=0x7f60541971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60541021b0 0x7f60541971e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f604400d950 tx=0x7f604400dc60 comp rx=0 tx=0).stop 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 shutdown_connections 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f60400a1500 0x7f60400a39c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6054102b50 0x7f605419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6054100fc0 0x7f6054196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 --2- 172.21.15.5:0/1441918758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60541021b0 0x7f60541971e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:11.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 >> 172.21.15.5:0/1441918758 conn(0x7f60540fc530 msgr2=0x7f60540fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 shutdown_connections 2023-10-07T00:23:11.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:11.874+0000 7f605c1ff700 1 -- 172.21.15.5:0/1441918758 wait complete. 2023-10-07T00:23:11.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-07T00:23:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.099+0000 7fd3bebff700 1 -- 172.21.15.5:0/100313711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 msgr2=0x7fd3b8102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.099+0000 7fd3bebff700 1 --2- 172.21.15.5:0/100313711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 0x7fd3b8102610 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40099c0 tx=0x7fd3a4009cd0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.099+0000 7fd3bebff700 1 -- 172.21.15.5:0/100313711 shutdown_connections 2023-10-07T00:23:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.099+0000 7fd3bebff700 1 --2- 172.21.15.5:0/100313711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b8102b50 0x7fd3b8109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.099+0000 7fd3bebff700 1 --2- 172.21.15.5:0/100313711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3b8100fc0 0x7fd3b81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.099+0000 7fd3bebff700 1 --2- 172.21.15.5:0/100313711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 0x7fd3b8102610 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.099+0000 7fd3bebff700 1 -- 172.21.15.5:0/100313711 >> 172.21.15.5:0/100313711 conn(0x7fd3b80fc530 msgr2=0x7fd3b80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.100+0000 7fd3bebff700 1 -- 172.21.15.5:0/100313711 shutdown_connections 2023-10-07T00:23:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.100+0000 7fd3bebff700 1 -- 172.21.15.5:0/100313711 wait complete. 2023-10-07T00:23:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bebff700 1 Processor -- start 2023-10-07T00:23:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bebff700 1 -- start start 2023-10-07T00:23:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bebff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3b8100fc0 0x7fd3b8198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bebff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 0x7fd3b8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bebff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b8102b50 0x7fd3b81a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bebff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b81a0970 con 0x7fd3b81021b0 2023-10-07T00:23:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bebff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b81a0ab0 con 0x7fd3b8102b50 2023-10-07T00:23:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bebff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b81a0c40 con 0x7fd3b8100fc0 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 0x7fd3b8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 0x7fd3b8199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55178/0 (socket says 172.21.15.5:55178) 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3b7fff700 1 -- 172.21.15.5:0/2882481281 learned_addr learned my addr 172.21.15.5:0/2882481281 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.101+0000 7fd3bc99b700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3b8100fc0 0x7fd3b8198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b7fff700 1 -- 172.21.15.5:0/2882481281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3b8100fc0 msgr2=0x7fd3b8198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b7fff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3b8100fc0 0x7fd3b8198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b7fff700 1 -- 172.21.15.5:0/2882481281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b8102b50 msgr2=0x7fd3b81a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3bd19c700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b8102b50 0x7fd3b81a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b7fff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b8102b50 0x7fd3b81a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b7fff700 1 -- 172.21.15.5:0/2882481281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a40095f0 con 0x7fd3b81021b0 2023-10-07T00:23:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3bd19c700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b8102b50 0x7fd3b81a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:23:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b7fff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 0x7fd3b8199330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c00 tx=0x7fd3a400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b5ffb700 1 -- 172.21.15.5:0/2882481281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a401d070 con 0x7fd3b81021b0 2023-10-07T00:23:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b5ffb700 1 -- 172.21.15.5:0/2882481281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3a400fe70 con 0x7fd3b81021b0 2023-10-07T00:23:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b81a0ec0 con 0x7fd3b81021b0 2023-10-07T00:23:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.102+0000 7fd3b5ffb700 1 -- 172.21.15.5:0/2882481281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40173f0 con 0x7fd3b81021b0 2023-10-07T00:23:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.103+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b81a12e0 con 0x7fd3b81021b0 2023-10-07T00:23:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.103+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b810c6e0 con 0x7fd3b81021b0 2023-10-07T00:23:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.105+0000 7fd3b5ffb700 1 -- 172.21.15.5:0/2882481281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd3a4022470 con 0x7fd3b81021b0 2023-10-07T00:23:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.107+0000 7fd3b5ffb700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3a80a1500 0x7fd3a80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.107+0000 7fd3b5ffb700 1 -- 172.21.15.5:0/2882481281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd3a40cdf20 con 0x7fd3b81021b0 2023-10-07T00:23:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.107+0000 7fd3bc99b700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3a80a1500 0x7fd3a80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.107+0000 7fd3bc99b700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3a80a1500 0x7fd3a80a39c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8102010 tx=0x7fd3ac00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.110+0000 7fd3b5ffb700 1 -- 172.21.15.5:0/2882481281 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd3a4097590 con 0x7fd3b81021b0 2023-10-07T00:23:12.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:11 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/4289331580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:11 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2858379189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:11 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1441918758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:11 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/4289331580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:11 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2858379189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:11 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1441918758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.337+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd3b81a14d0 con 0x7fd3b81021b0 2023-10-07T00:23:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.338+0000 7fd3b5ffb700 1 -- 172.21.15.5:0/2882481281 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+579 (secure 0 0 0) 0x7fd3a4095e60 con 0x7fd3b81021b0 2023-10-07T00:23:12.339 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3752148220 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:12.339 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3458915809 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:12.339 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/4185885324 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:12.339 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/968817192 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:12.339 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/2264485294 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:12.339 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/804878757 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:12.340 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/2264485294 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:12.340 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3863337165 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:12.340 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1918673890 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:12.340 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/968817192 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3a80a1500 msgr2=0x7fd3a80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3a80a1500 0x7fd3a80a39c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8102010 tx=0x7fd3ac00b040 comp rx=0 tx=0).stop 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 msgr2=0x7fd3b8199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 0x7fd3b8199330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c00 tx=0x7fd3a400fa00 comp rx=0 tx=0).stop 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 shutdown_connections 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7fd3a80a1500 0x7fd3a80a39c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b8102b50 0x7fd3b81a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3b8100fc0 0x7fd3b8198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 --2- 172.21.15.5:0/2882481281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3b81021b0 0x7fd3b8199330 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 >> 172.21.15.5:0/2882481281 conn(0x7fd3b80fc530 msgr2=0x7fd3b80fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.340+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 shutdown_connections 2023-10-07T00:23:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.341+0000 7fd3bebff700 1 -- 172.21.15.5:0/2882481281 wait complete. 2023-10-07T00:23:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:listed 10 entries 2023-10-07T00:23:12.357 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:11 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/4289331580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:11 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2858379189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:11 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1441918758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:23:12.360 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-07T00:23:12.360 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-07T00:23:12.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T00:23:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.647+0000 7f3fc53ff700 1 -- 172.21.15.5:0/30174357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc0100fc0 msgr2=0x7f3fc01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.647+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/30174357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc0100fc0 0x7f3fc01013e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00099c0 tx=0x7f3fb0009cd0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.647+0000 7f3fc53ff700 1 -- 172.21.15.5:0/30174357 shutdown_connections 2023-10-07T00:23:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.647+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/30174357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fc0102b50 0x7f3fc0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.647+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/30174357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc0100fc0 0x7f3fc01013e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.647+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/30174357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fc01021b0 0x7f3fc0102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.647+0000 7f3fc53ff700 1 -- 172.21.15.5:0/30174357 >> 172.21.15.5:0/30174357 conn(0x7f3fc00fc530 msgr2=0x7f3fc00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.648+0000 7f3fc53ff700 1 -- 172.21.15.5:0/30174357 shutdown_connections 2023-10-07T00:23:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.648+0000 7f3fc53ff700 1 -- 172.21.15.5:0/30174357 wait complete. 2023-10-07T00:23:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.649+0000 7f3fc53ff700 1 Processor -- start 2023-10-07T00:23:12.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.649+0000 7f3fc53ff700 1 -- start start 2023-10-07T00:23:12.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fc53ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fc0100fc0 0x7f3fc0196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:12.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fc53ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc01021b0 0x7f3fc0197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:12.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fc53ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fc0102b50 0x7f3fc019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:12.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fc53ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc019e760 con 0x7f3fc01021b0 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fc53ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc019e8a0 con 0x7f3fc0102b50 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fc53ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc019ea30 con 0x7f3fc0100fc0 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fbe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc01021b0 0x7f3fc0197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fbe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc01021b0 0x7f3fc0197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55194/0 (socket says 172.21.15.5:55194) 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fbe7fc700 1 -- 172.21.15.5:0/334454183 learned_addr learned my addr 172.21.15.5:0/334454183 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fbf7fe700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fc0102b50 0x7f3fc019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.650+0000 7f3fbeffd700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fc0100fc0 0x7f3fc0196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fbe7fc700 1 -- 172.21.15.5:0/334454183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fc0100fc0 msgr2=0x7f3fc0196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fbe7fc700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fc0100fc0 0x7f3fc0196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fbe7fc700 1 -- 172.21.15.5:0/334454183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fc0102b50 msgr2=0x7f3fc019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fbe7fc700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fc0102b50 0x7f3fc019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fbe7fc700 1 -- 172.21.15.5:0/334454183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009520 con 0x7f3fc01021b0 2023-10-07T00:23:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fbe7fc700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc01021b0 0x7f3fc0197120 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400eb30 tx=0x7f3fb400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fa7fff700 1 -- 172.21.15.5:0/334454183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4009880 con 0x7f3fc01021b0 2023-10-07T00:23:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb00095f0 con 0x7f3fc01021b0 2023-10-07T00:23:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fa7fff700 1 -- 172.21.15.5:0/334454183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fb40044b0 con 0x7f3fc01021b0 2023-10-07T00:23:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fa7fff700 1 -- 172.21.15.5:0/334454183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4003df0 con 0x7f3fc01021b0 2023-10-07T00:23:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.651+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc019f0e0 con 0x7f3fc01021b0 2023-10-07T00:23:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.652+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc010c680 con 0x7f3fc01021b0 2023-10-07T00:23:12.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.654+0000 7f3fa7fff700 1 -- 172.21.15.5:0/334454183 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3fb4003f50 con 0x7f3fc01021b0 2023-10-07T00:23:12.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.656+0000 7f3fa7fff700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3fa80a1500 0x7f3fa80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:12.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.656+0000 7f3fa7fff700 1 -- 172.21.15.5:0/334454183 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3fb4014070 con 0x7f3fc01021b0 2023-10-07T00:23:12.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.656+0000 7f3fbeffd700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3fa80a1500 0x7f3fa80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.657+0000 7f3fbeffd700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3fa80a1500 0x7f3fa80a39c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009fd0 tx=0x7f3fb001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.658+0000 7f3fa7fff700 1 -- 172.21.15.5:0/334454183 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3fb4096860 con 0x7f3fc01021b0 2023-10-07T00:23:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.871+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fc010c870 con 0x7f3fc01021b0 2023-10-07T00:23:12.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.873+0000 7f3fa7fff700 1 -- 172.21.15.5:0/334454183 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f3fb4099e80 con 0x7f3fc01021b0 2023-10-07T00:23:12.874 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-07T00:23:12.875 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"bdea4c58-64a4-11ee-8db5-212e2dc638e7","created":"2023-10-07T00:02:48.269587+0000","modified":"2023-10-07T00:11:50.722865+0000","last_up_change":"2023-10-07T00:10:16.198629+0000","last_in_change":"2023-10-07T00:09:56.269833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T00:06:22.182853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T00:11:11.418184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T00:11:12.803328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"304d532a-fc49-46fd-917c-11a6a7e57a15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6803","nonce":42244744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6805","nonce":42244744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6809","nonce":42244744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":42244744},{"type":"v1","addr":"172.21.15.5:6807","nonce":42244744}]},"public_addr":"172.21.15.5:6803/42244744","cluster_addr":"172.21.15.5:6805/42244744","heartbeat_back_addr":"172.21.15.5:6809/42244744","heartbeat_front_addr":"172.21.15.5:6807/42244744","state":["exists","up"]},{"osd":1,"uuid":"2b42a81d-5935-43e5-8c4f-743744701183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6801","nonce":124757240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6803","nonce":124757240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6807","nonce":124757240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":124757240},{"type":"v1","addr":"172.21.15.88:6805","nonce":124757240}]},"public_addr":"172.21.15.88:6801/124757240","cluster_addr":"172.21.15.88:6803/124757240","heartbeat_back_addr":"172.21.15.88:6807/124757240","heartbeat_front_addr":"172.21.15.88:6805/124757240","state":["exists","up"]},{"osd":2,"uuid":"30a1f350-e80f-4763-8656-377a6d1df25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6801","nonce":2199456889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6803","nonce":2199456889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6807","nonce":2199456889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2199456889},{"type":"v1","addr":"172.21.15.112:6805","nonce":2199456889}]},"public_addr":"172.21.15.112:6801/2199456889","cluster_addr":"172.21.15.112:6803/2199456889","heartbeat_back_addr":"172.21.15.112:6807/2199456889","heartbeat_front_addr":"172.21.15.112:6805/2199456889","state":["exists","up"]},{"osd":3,"uuid":"fe56dbb3-3194-4c53-a7ff-58ac27c5cd3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6811","nonce":2022754248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6813","nonce":2022754248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6817","nonce":2022754248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2022754248},{"type":"v1","addr":"172.21.15.5:6815","nonce":2022754248}]},"public_addr":"172.21.15.5:6811/2022754248","cluster_addr":"172.21.15.5:6813/2022754248","heartbeat_back_addr":"172.21.15.5:6817/2022754248","heartbeat_front_addr":"172.21.15.5:6815/2022754248","state":["exists","up"]},{"osd":4,"uuid":"b07843b0-41cf-41ce-8b9a-18d7ed18b507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6809","nonce":4020627890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6811","nonce":4020627890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6815","nonce":4020627890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4020627890},{"type":"v1","addr":"172.21.15.88:6813","nonce":4020627890}]},"public_addr":"172.21.15.88:6809/4020627890","cluster_addr":"172.21.15.88:6811/4020627890","heartbeat_back_addr":"172.21.15.88:6815/4020627890","heartbeat_front_addr":"172.21.15.88:6813/4020627890","state":["exists","up"]},{"osd":5,"uuid":"f42eebd0-36c3-4da8-84ae-a22714f37531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6809","nonce":2766325588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6811","nonce":2766325588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6815","nonce":2766325588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2766325588},{"type":"v1","addr":"172.21.15.112:6813","nonce":2766325588}]},"public_addr":"172.21.15.112:6809/2766325588","cluster_addr":"172.21.15.112:6811/2766325588","heartbeat_back_addr":"172.21.15.112:6815/2766325588","heartbeat_front_addr":"172.21.15.112:6813/2766325588","state":["exists","up"]},{"osd":6,"uuid":"e925e93d-2647-46d2-9322-bd2c7e018774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6819","nonce":4273879818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6821","nonce":4273879818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6825","nonce":4273879818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4273879818},{"type":"v1","addr":"172.21.15.5:6823","nonce":4273879818}]},"public_addr":"172.21.15.5:6819/4273879818","cluster_addr":"172.21.15.5:6821/4273879818","heartbeat_back_addr":"172.21.15.5:6825/4273879818","heartbeat_front_addr":"172.21.15.5:6823/4273879818","state":["exists","up"]},{"osd":7,"uuid":"755b1bc2-edc1-4eb5-a496-7809d5c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6817","nonce":3620600284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6819","nonce":3620600284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6823","nonce":3620600284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3620600284},{"type":"v1","addr":"172.21.15.88:6821","nonce":3620600284}]},"public_addr":"172.21.15.88:6817/3620600284","cluster_addr":"172.21.15.88:6819/3620600284","heartbeat_back_addr":"172.21.15.88:6823/3620600284","heartbeat_front_addr":"172.21.15.88:6821/3620600284","state":["exists","up"]},{"osd":8,"uuid":"0051cf8a-fe25-4699-a03e-4dad5450fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6817","nonce":857535520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6819","nonce":857535520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6823","nonce":857535520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":857535520},{"type":"v1","addr":"172.21.15.112:6821","nonce":857535520}]},"public_addr":"172.21.15.112:6817/857535520","cluster_addr":"172.21.15.112:6819/857535520","heartbeat_back_addr":"172.21.15.112:6823/857535520","heartbeat_front_addr":"172.21.15.112:6821/857535520","state":["exists","up"]},{"osd":9,"uuid":"c2411c33-6e83-4a69-8cd3-6f08472b288a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6827","nonce":1378383866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6829","nonce":1378383866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6833","nonce":1378383866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1378383866},{"type":"v1","addr":"172.21.15.5:6831","nonce":1378383866}]},"public_addr":"172.21.15.5:6827/1378383866","cluster_addr":"172.21.15.5:6829/1378383866","heartbeat_back_addr":"172.21.15.5:6833/1378383866","heartbeat_front_addr":"172.21.15.5:6831/1378383866","state":["exists","up"]},{"osd":10,"uuid":"23623dd7-34f4-471f-8c60-c99314accd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6825","nonce":4083736515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6827","nonce":4083736515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6831","nonce":4083736515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4083736515},{"type":"v1","addr":"172.21.15.88:6829","nonce":4083736515}]},"public_addr":"172.21.15.88:6825/4083736515","cluster_addr":"172.21.15.88:6827/4083736515","heartbeat_back_addr":"172.21.15.88:6831/4083736515","heartbeat_front_addr":"172.21.15.88:6829/4083736515","state":["exists","up"]},{"osd":11,"uuid":"44ce1587-7ab8-4271-b6b1-443ae111ab2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6825","nonce":4122527507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6827","nonce":4122527507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6831","nonce":4122527507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4122527507},{"type":"v1","addr":"172.21.15.112:6829","nonce":4122527507}]},"public_addr":"172.21.15.112:6825/4122527507","cluster_addr":"172.21.15.112:6827/4122527507","heartbeat_back_addr":"172.21.15.112:6831/4122527507","heartbeat_front_addr":"172.21.15.112:6829/4122527507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:26.804734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:05:52.557646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:18.847483+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:06:45.657135+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:11.896257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:07:38.064103+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:04.121823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:30.051518+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:08:56.335623+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:22.558013+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:09:48.960909+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T00:10:14.883427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3752148220":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/3458915809":"2023-10-08T00:03:49.552201+0000","172.21.15.5:0/4185885324":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6801/968817192":"2023-10-08T00:03:49.552201+0000","172.21.15.5:6800/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/804878757":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6801/2264485294":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/3863337165":"2023-10-08T00:03:22.989140+0000","172.21.15.5:0/1918673890":"2023-10-08T00:03:22.989140+0000","172.21.15.5:6800/968817192":"2023-10-08T00:03:49.552201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T00:23:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3fa80a1500 msgr2=0x7f3fa80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3fa80a1500 0x7f3fa80a39c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009fd0 tx=0x7f3fb001a040 comp rx=0 tx=0).stop 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc01021b0 msgr2=0x7f3fc0197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc01021b0 0x7f3fc0197120 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400eb30 tx=0x7f3fb400ee40 comp rx=0 tx=0).stop 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 shutdown_connections 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f3fa80a1500 0x7f3fa80a39c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fc0102b50 0x7f3fc019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fc0100fc0 0x7f3fc0196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 --2- 172.21.15.5:0/334454183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fc01021b0 0x7f3fc0197120 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.875+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 >> 172.21.15.5:0/334454183 conn(0x7f3fc00fc530 msgr2=0x7f3fc00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.876+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 shutdown_connections 2023-10-07T00:23:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:12.876+0000 7f3fc53ff700 1 -- 172.21.15.5:0/334454183 wait complete. 2023-10-07T00:23:12.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T00:06:22.182853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T00:11:11.418184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T00:11:12.803328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-07T00:23:12.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T00:23:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 -- 172.21.15.5:0/4164917928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890100fc0 msgr2=0x7f08901013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 --2- 172.21.15.5:0/4164917928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890100fc0 0x7f08901013e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0880009990 tx=0x7f0880009ca0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 -- 172.21.15.5:0/4164917928 shutdown_connections 2023-10-07T00:23:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 --2- 172.21.15.5:0/4164917928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0890102b50 0x7f0890109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 --2- 172.21.15.5:0/4164917928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890100fc0 0x7f08901013e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 --2- 172.21.15.5:0/4164917928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08901021b0 0x7f0890102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 -- 172.21.15.5:0/4164917928 >> 172.21.15.5:0/4164917928 conn(0x7f08900fc530 msgr2=0x7f08900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 -- 172.21.15.5:0/4164917928 shutdown_connections 2023-10-07T00:23:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.104+0000 7f08953ff700 1 -- 172.21.15.5:0/4164917928 wait complete. 2023-10-07T00:23:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.105+0000 7f08953ff700 1 Processor -- start 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.105+0000 7f08953ff700 1 -- start start 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.105+0000 7f08953ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0890100fc0 0x7f0890198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f08953ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08901021b0 0x7f0890199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f08953ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890102b50 0x7f08901a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f08953ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08901a0980 con 0x7f08901021b0 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f08953ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08901a0ac0 con 0x7f0890100fc0 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f08953ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08901a0c50 con 0x7f0890102b50 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08901021b0 0x7f0890199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08901021b0 0x7f0890199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55208/0 (socket says 172.21.15.5:55208) 2023-10-07T00:23:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088e7fc700 1 -- 172.21.15.5:0/1793248358 learned_addr learned my addr 172.21.15.5:0/1793248358 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088effd700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0890100fc0 0x7f0890198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088f7fe700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890102b50 0x7f08901a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088e7fc700 1 -- 172.21.15.5:0/1793248358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890102b50 msgr2=0x7f08901a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088e7fc700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890102b50 0x7f08901a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088e7fc700 1 -- 172.21.15.5:0/1793248358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0890100fc0 msgr2=0x7f0890198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088e7fc700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0890100fc0 0x7f0890198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088e7fc700 1 -- 172.21.15.5:0/1793248358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800095f0 con 0x7f08901021b0 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.106+0000 7f088f7fe700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890102b50 0x7f08901a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.107+0000 7f088e7fc700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08901021b0 0x7f0890199340 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f088400e9a0 tx=0x7f088400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.107+0000 7f0877fff700 1 -- 172.21.15.5:0/1793248358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884009790 con 0x7f08901021b0 2023-10-07T00:23:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.107+0000 7f0877fff700 1 -- 172.21.15.5:0/1793248358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f088400cbd0 con 0x7f08901021b0 2023-10-07T00:23:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.107+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08901a0f30 con 0x7f08901021b0 2023-10-07T00:23:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.107+0000 7f0877fff700 1 -- 172.21.15.5:0/1793248358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884018680 con 0x7f08901021b0 2023-10-07T00:23:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.107+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08901a13b0 con 0x7f08901021b0 2023-10-07T00:23:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.108+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08901934c0 con 0x7f08901021b0 2023-10-07T00:23:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.110+0000 7f0877fff700 1 -- 172.21.15.5:0/1793248358 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f088400cd40 con 0x7f08901021b0 2023-10-07T00:23:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.112+0000 7f0877fff700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08780a1480 0x7f08780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.112+0000 7f0877fff700 1 -- 172.21.15.5:0/1793248358 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0884014070 con 0x7f08901021b0 2023-10-07T00:23:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.112+0000 7f088effd700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08780a1480 0x7f08780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.113+0000 7f088effd700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08780a1480 0x7f08780a3940 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f088000b2e0 tx=0x7f0880005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.116+0000 7f0877fff700 1 -- 172.21.15.5:0/1793248358 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0884052100 con 0x7f08901021b0 2023-10-07T00:23:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:12 smithi088 ceph-mon[103111]: pgmap v659: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:13.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:12 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2882481281' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-07T00:23:13.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:12 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/334454183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:23:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:12 smithi112 ceph-mon[133548]: pgmap v659: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:12 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2882481281' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-07T00:23:13.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:12 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/334454183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:23:13.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.328+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f089002d1e0 con 0x7f08901021b0 2023-10-07T00:23:13.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.329+0000 7f0877fff700 1 -- 172.21.15.5:0/1793248358 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08840d0030 con 0x7f08901021b0 2023-10-07T00:23:13.330 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-07T00:23:13.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08780a1480 msgr2=0x7f08780a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08780a1480 0x7f08780a3940 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f088000b2e0 tx=0x7f0880005fb0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08901021b0 msgr2=0x7f0890199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08901021b0 0x7f0890199340 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f088400e9a0 tx=0x7f088400ecb0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 shutdown_connections 2023-10-07T00:23:13.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f08780a1480 0x7f08780a3940 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890102b50 0x7f08901a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0890100fc0 0x7f0890198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 --2- 172.21.15.5:0/1793248358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08901021b0 0x7f0890199340 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 >> 172.21.15.5:0/1793248358 conn(0x7f08900fc530 msgr2=0x7f0890107b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:13.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 shutdown_connections 2023-10-07T00:23:13.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.331+0000 7f08953ff700 1 -- 172.21.15.5:0/1793248358 wait complete. 2023-10-07T00:23:13.348 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:12 smithi005 ceph-mon[129406]: pgmap v659: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-07T00:23:13.350 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:12 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2882481281' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-07T00:23:13.350 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:12 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/334454183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-07T00:23:13.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T00:23:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.555+0000 7f7646fff700 1 -- 172.21.15.5:0/2212070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640102b50 msgr2=0x7f7640109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.555+0000 7f7646fff700 1 --2- 172.21.15.5:0/2212070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640102b50 0x7f7640109400 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f763800b0d0 tx=0x7f763800b3e0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.556+0000 7f7646fff700 1 -- 172.21.15.5:0/2212070 shutdown_connections 2023-10-07T00:23:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.556+0000 7f7646fff700 1 --2- 172.21.15.5:0/2212070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640102b50 0x7f7640109400 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.556+0000 7f7646fff700 1 --2- 172.21.15.5:0/2212070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7640100fc0 0x7f76401013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.556+0000 7f7646fff700 1 --2- 172.21.15.5:0/2212070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76401021b0 0x7f7640102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.556+0000 7f7646fff700 1 -- 172.21.15.5:0/2212070 >> 172.21.15.5:0/2212070 conn(0x7f76400fc530 msgr2=0x7f76400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.556+0000 7f7646fff700 1 -- 172.21.15.5:0/2212070 shutdown_connections 2023-10-07T00:23:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.556+0000 7f7646fff700 1 -- 172.21.15.5:0/2212070 wait complete. 2023-10-07T00:23:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.557+0000 7f7646fff700 1 Processor -- start 2023-10-07T00:23:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.557+0000 7f7646fff700 1 -- start start 2023-10-07T00:23:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.557+0000 7f7646fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640100fc0 0x7f7640198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.557+0000 7f7646fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76401021b0 0x7f7640199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.557+0000 7f7646fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7640102b50 0x7f76401a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.557+0000 7f7646fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401a09b0 con 0x7f7640100fc0 2023-10-07T00:23:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.557+0000 7f7646fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401a0af0 con 0x7f7640102b50 2023-10-07T00:23:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.557+0000 7f7646fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401a0c80 con 0x7f76401021b0 2023-10-07T00:23:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640100fc0 0x7f7640198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640100fc0 0x7f7640198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55220/0 (socket says 172.21.15.5:55220) 2023-10-07T00:23:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 -- 172.21.15.5:0/235069254 learned_addr learned my addr 172.21.15.5:0/235069254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f763ffff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76401021b0 0x7f7640199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f764559c700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7640102b50 0x7f76401a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 -- 172.21.15.5:0/235069254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76401021b0 msgr2=0x7f7640199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76401021b0 0x7f7640199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 -- 172.21.15.5:0/235069254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7640102b50 msgr2=0x7f76401a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7640102b50 0x7f76401a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 -- 172.21.15.5:0/235069254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7638009d00 con 0x7f7640100fc0 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.558+0000 7f7644d9b700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640100fc0 0x7f7640198e30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f763400e970 tx=0x7f763400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.559+0000 7f763dffb700 1 -- 172.21.15.5:0/235069254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634009790 con 0x7f7640100fc0 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.559+0000 7f763dffb700 1 -- 172.21.15.5:0/235069254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f763400c7e0 con 0x7f7640100fc0 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.559+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76401a0f60 con 0x7f7640100fc0 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.559+0000 7f763dffb700 1 -- 172.21.15.5:0/235069254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634003bd0 con 0x7f7640100fc0 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.559+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76401a1380 con 0x7f7640100fc0 2023-10-07T00:23:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.560+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7640193470 con 0x7f7640100fc0 2023-10-07T00:23:13.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.562+0000 7f763dffb700 1 -- 172.21.15.5:0/235069254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f763400c950 con 0x7f7640100fc0 2023-10-07T00:23:13.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.563+0000 7f763dffb700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76300a1480 0x7f76300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:13.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.563+0000 7f763dffb700 1 -- 172.21.15.5:0/235069254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7634014070 con 0x7f7640100fc0 2023-10-07T00:23:13.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.563+0000 7f763ffff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76300a1480 0x7f76300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:13.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.564+0000 7f763ffff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76300a1480 0x7f76300a3940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f762c009c60 tx=0x7f762c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.567+0000 7f763dffb700 1 -- 172.21.15.5:0/235069254 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7634096540 con 0x7f7640100fc0 2023-10-07T00:23:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.778+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f764002d020 con 0x7f7640100fc0 2023-10-07T00:23:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.778+0000 7f763dffb700 1 -- 172.21.15.5:0/235069254 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7634099b60 con 0x7f7640100fc0 2023-10-07T00:23:13.780 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-07T00:23:13.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.780+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76300a1480 msgr2=0x7f76300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.780+0000 7f7646fff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76300a1480 0x7f76300a3940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f762c009c60 tx=0x7f762c009260 comp rx=0 tx=0).stop 2023-10-07T00:23:13.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.780+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640100fc0 msgr2=0x7f7640198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:13.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.780+0000 7f7646fff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640100fc0 0x7f7640198e30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f763400e970 tx=0x7f763400ec80 comp rx=0 tx=0).stop 2023-10-07T00:23:13.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.781+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 shutdown_connections 2023-10-07T00:23:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.781+0000 7f7646fff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f76300a1480 0x7f76300a3940 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.781+0000 7f7646fff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7640102b50 0x7f76401a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.781+0000 7f7646fff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7640100fc0 0x7f7640198e30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.781+0000 7f7646fff700 1 --2- 172.21.15.5:0/235069254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76401021b0 0x7f7640199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.781+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 >> 172.21.15.5:0/235069254 conn(0x7f76400fc530 msgr2=0x7f7640107aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.781+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 shutdown_connections 2023-10-07T00:23:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:13.781+0000 7f7646fff700 1 -- 172.21.15.5:0/235069254 wait complete. 2023-10-07T00:23:13.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T00:23:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.013+0000 7f442abff700 1 -- 172.21.15.5:0/1952486941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424100fc0 msgr2=0x7f44241013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.013+0000 7f442abff700 1 --2- 172.21.15.5:0/1952486941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424100fc0 0x7f44241013e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f44180099c0 tx=0x7f4418009cd0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.013+0000 7f442abff700 1 -- 172.21.15.5:0/1952486941 shutdown_connections 2023-10-07T00:23:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.013+0000 7f442abff700 1 --2- 172.21.15.5:0/1952486941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4424102b50 0x7f4424109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.013+0000 7f442abff700 1 --2- 172.21.15.5:0/1952486941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424100fc0 0x7f44241013e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.013+0000 7f442abff700 1 --2- 172.21.15.5:0/1952486941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44241021b0 0x7f4424102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.013+0000 7f442abff700 1 -- 172.21.15.5:0/1952486941 >> 172.21.15.5:0/1952486941 conn(0x7f44240fc530 msgr2=0x7f44240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.013+0000 7f442abff700 1 -- 172.21.15.5:0/1952486941 shutdown_connections 2023-10-07T00:23:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.014+0000 7f442abff700 1 -- 172.21.15.5:0/1952486941 wait complete. 2023-10-07T00:23:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.014+0000 7f442abff700 1 Processor -- start 2023-10-07T00:23:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442abff700 1 -- start start 2023-10-07T00:23:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442abff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4424100fc0 0x7f4424196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442abff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44241021b0 0x7f4424197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442abff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424102b50 0x7f442419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442abff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442419e770 con 0x7f4424102b50 2023-10-07T00:23:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442abff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442419e8b0 con 0x7f44241021b0 2023-10-07T00:23:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442abff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442419ea40 con 0x7f4424100fc0 2023-10-07T00:23:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442919c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424102b50 0x7f442419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442919c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424102b50 0x7f442419e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55242/0 (socket says 172.21.15.5:55242) 2023-10-07T00:23:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.015+0000 7f442919c700 1 -- 172.21.15.5:0/3344545418 learned_addr learned my addr 172.21.15.5:0/3344545418 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442899b700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4424100fc0 0x7f4424196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f4423fff700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44241021b0 0x7f4424197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442919c700 1 -- 172.21.15.5:0/3344545418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4424100fc0 msgr2=0x7f4424196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442919c700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4424100fc0 0x7f4424196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442919c700 1 -- 172.21.15.5:0/3344545418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44241021b0 msgr2=0x7f4424197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442919c700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44241021b0 0x7f4424197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442919c700 1 -- 172.21.15.5:0/3344545418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180095f0 con 0x7f4424102b50 2023-10-07T00:23:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442919c700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424102b50 0x7f442419e1a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f441c007ee0 tx=0x7f441c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f4421ffb700 1 -- 172.21.15.5:0/3344545418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c017070 con 0x7f4424102b50 2023-10-07T00:23:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442419ed20 con 0x7f4424102b50 2023-10-07T00:23:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f4421ffb700 1 -- 172.21.15.5:0/3344545418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f441c00f040 con 0x7f4424102b50 2023-10-07T00:23:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f4421ffb700 1 -- 172.21.15.5:0/3344545418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c005710 con 0x7f4424102b50 2023-10-07T00:23:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.016+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442419f180 con 0x7f4424102b50 2023-10-07T00:23:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.018+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4424107fa0 con 0x7f4424102b50 2023-10-07T00:23:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.019+0000 7f4421ffb700 1 -- 172.21.15.5:0/3344545418 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f441c005870 con 0x7f4424102b50 2023-10-07T00:23:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.021+0000 7f4421ffb700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44140a1480 0x7f44140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.021+0000 7f4421ffb700 1 -- 172.21.15.5:0/3344545418 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f441c0cc630 con 0x7f4424102b50 2023-10-07T00:23:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.021+0000 7f442899b700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44140a1480 0x7f44140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.022+0000 7f442899b700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44140a1480 0x7f44140a3940 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4418000c00 tx=0x7f4418005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.025+0000 7f4421ffb700 1 -- 172.21.15.5:0/3344545418 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f441c095c10 con 0x7f4424102b50 2023-10-07T00:23:14.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:13 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/1793248358' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:23:14.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:13 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/235069254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:23:14.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:13 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/1793248358' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:23:14.204 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:13 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/235069254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:23:14.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.239+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f442402d1e0 con 0x7f4424102b50 2023-10-07T00:23:14.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.239+0000 7f4421ffb700 1 -- 172.21.15.5:0/3344545418 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f441c099230 con 0x7f4424102b50 2023-10-07T00:23:14.241 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-07T00:23:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.241+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44140a1480 msgr2=0x7f44140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.241+0000 7f442abff700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44140a1480 0x7f44140a3940 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4418000c00 tx=0x7f4418005fb0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424102b50 msgr2=0x7f442419e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424102b50 0x7f442419e1a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f441c007ee0 tx=0x7f441c00d3b0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 shutdown_connections 2023-10-07T00:23:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f44140a1480 0x7f44140a3940 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4424102b50 0x7f442419e1a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4424100fc0 0x7f4424196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 --2- 172.21.15.5:0/3344545418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44241021b0 0x7f4424197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 >> 172.21.15.5:0/3344545418 conn(0x7f44240fc530 msgr2=0x7f44240fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 shutdown_connections 2023-10-07T00:23:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.242+0000 7f442abff700 1 -- 172.21.15.5:0/3344545418 wait complete. 2023-10-07T00:23:14.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:13 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/1793248358' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-07T00:23:14.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:13 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/235069254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-07T00:23:14.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-07T00:23:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.464+0000 7f418abff700 1 -- 172.21.15.5:0/2449370370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41841021b0 msgr2=0x7f4184102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.464+0000 7f418abff700 1 --2- 172.21.15.5:0/2449370370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41841021b0 0x7f4184102610 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f41700099c0 tx=0x7f4170009cd0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.464+0000 7f418abff700 1 -- 172.21.15.5:0/2449370370 shutdown_connections 2023-10-07T00:23:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.464+0000 7f418abff700 1 --2- 172.21.15.5:0/2449370370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4184102b50 0x7f4184109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.464+0000 7f418abff700 1 --2- 172.21.15.5:0/2449370370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4184100fc0 0x7f41841013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.464+0000 7f418abff700 1 --2- 172.21.15.5:0/2449370370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41841021b0 0x7f4184102610 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.464+0000 7f418abff700 1 -- 172.21.15.5:0/2449370370 >> 172.21.15.5:0/2449370370 conn(0x7f41840fc530 msgr2=0x7f41840fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.465+0000 7f418abff700 1 -- 172.21.15.5:0/2449370370 shutdown_connections 2023-10-07T00:23:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.465+0000 7f418abff700 1 -- 172.21.15.5:0/2449370370 wait complete. 2023-10-07T00:23:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.466+0000 7f418abff700 1 Processor -- start 2023-10-07T00:23:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.466+0000 7f418abff700 1 -- start start 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418abff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4184100fc0 0x7f4184196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418abff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41841021b0 0x7f4184197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418abff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4184102b50 0x7f418419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418abff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418419e760 con 0x7f4184100fc0 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418abff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418419e8d0 con 0x7f4184102b50 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418abff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418419ea90 con 0x7f41841021b0 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418899b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4184100fc0 0x7f4184196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418899b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4184100fc0 0x7f4184196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55264/0 (socket says 172.21.15.5:55264) 2023-10-07T00:23:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418899b700 1 -- 172.21.15.5:0/2335618483 learned_addr learned my addr 172.21.15.5:0/2335618483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-07T00:23:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f4183fff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41841021b0 0x7f4184197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418919c700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4184102b50 0x7f418419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418899b700 1 -- 172.21.15.5:0/2335618483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41841021b0 msgr2=0x7f4184197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418899b700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41841021b0 0x7f4184197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418899b700 1 -- 172.21.15.5:0/2335618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4184102b50 msgr2=0x7f418419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418899b700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4184102b50 0x7f418419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.467+0000 7f418899b700 1 -- 172.21.15.5:0/2335618483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41700095f0 con 0x7f4184100fc0 2023-10-07T00:23:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.468+0000 7f418899b700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4184100fc0 0x7f4184196c20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f417800e970 tx=0x7f417800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.468+0000 7f4181ffb700 1 -- 172.21.15.5:0/2335618483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178009790 con 0x7f4184100fc0 2023-10-07T00:23:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.468+0000 7f4181ffb700 1 -- 172.21.15.5:0/2335618483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f417800eec0 con 0x7f4184100fc0 2023-10-07T00:23:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.468+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418419ed70 con 0x7f4184100fc0 2023-10-07T00:23:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.468+0000 7f4181ffb700 1 -- 172.21.15.5:0/2335618483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178003c10 con 0x7f4184100fc0 2023-10-07T00:23:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.468+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418419f1d0 con 0x7f4184100fc0 2023-10-07T00:23:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.469+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4184107f70 con 0x7f4184100fc0 2023-10-07T00:23:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.472+0000 7f4181ffb700 1 -- 172.21.15.5:0/2335618483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4178004870 con 0x7f4184100fc0 2023-10-07T00:23:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.473+0000 7f4181ffb700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41740a1480 0x7f41740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T00:23:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.473+0000 7f4181ffb700 1 -- 172.21.15.5:0/2335618483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4178014070 con 0x7f4184100fc0 2023-10-07T00:23:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.473+0000 7f4183fff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41740a1480 0x7f41740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T00:23:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.474+0000 7f4183fff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41740a1480 0x7f41740a3940 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4170000c00 tx=0x7f4170005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T00:23:14.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.475+0000 7f4181ffb700 1 -- 172.21.15.5:0/2335618483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f41780966e0 con 0x7f4184100fc0 2023-10-07T00:23:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.703+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f418410c950 con 0x7f4184100fc0 2023-10-07T00:23:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.703+0000 7f4181ffb700 1 -- 172.21.15.5:0/2335618483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+579 (secure 0 0 0) 0x7f4178099d00 con 0x7f4184100fc0 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3752148220 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3458915809 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/4185885324 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/968817192 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/2264485294 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/804878757 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/2264485294 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3863337165 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1918673890 2023-10-08T00:03:22.989140+0000 2023-10-07T00:23:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/968817192 2023-10-08T00:03:49.552201+0000 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41740a1480 msgr2=0x7f41740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41740a1480 0x7f41740a3940 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4170000c00 tx=0x7f4170005a90 comp rx=0 tx=0).stop 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4184100fc0 msgr2=0x7f4184196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4184100fc0 0x7f4184196c20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f417800e970 tx=0x7f417800ec80 comp rx=0 tx=0).stop 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 shutdown_connections 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:6800/227111979,v1:172.21.15.5:6801/227111979] conn(0x7f41740a1480 0x7f41740a3940 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4184102b50 0x7f418419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4184100fc0 0x7f4184196c20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 --2- 172.21.15.5:0/2335618483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41841021b0 0x7f4184197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T00:23:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 >> 172.21.15.5:0/2335618483 conn(0x7f41840fc530 msgr2=0x7f41840fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T00:23:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 shutdown_connections 2023-10-07T00:23:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-07T00:23:14.706+0000 7f418abff700 1 -- 172.21.15.5:0/2335618483 wait complete. 2023-10-07T00:23:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:listed 10 entries 2023-10-07T00:23:14.725 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2023-10-07T00:23:14.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:23:14.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-07T00:23:14.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[191740]: fuse finished with error 0 and tester_r 0 2023-10-07T00:23:14.798 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T00:23:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:14 smithi005 ceph-mon[129406]: pgmap v660: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:23:15.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:14 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/3344545418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:23:15.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:14 smithi005 ceph-mon[129406]: from='client.? 172.21.15.5:0/2335618483' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-07T00:23:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:14 smithi088 ceph-mon[103111]: pgmap v660: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:23:15.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:14 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/3344545418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:23:15.203 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:14 smithi088 ceph-mon[103111]: from='client.? 172.21.15.5:0/2335618483' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-07T00:23:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:14 smithi112 ceph-mon[133548]: pgmap v660: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-07T00:23:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:14 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/3344545418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-07T00:23:15.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:14 smithi112 ceph-mon[133548]: from='client.? 172.21.15.5:0/2335618483' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-07T00:23:17.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:16 smithi088 ceph-mon[103111]: pgmap v661: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:23:17.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:16 smithi112 ceph-mon[133548]: pgmap v661: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:23:17.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:16 smithi005 ceph-mon[129406]: pgmap v661: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-07T00:23:19.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:18 smithi112 ceph-mon[133548]: pgmap v662: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-10-07T00:23:19.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:18 smithi005 ceph-mon[129406]: pgmap v662: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-10-07T00:23:19.452 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:18 smithi088 ceph-mon[103111]: pgmap v662: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-10-07T00:23:20.900 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-07T00:23:20.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:23:20.901 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T00:23:20.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:23:20.951 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-07T00:23:20.998 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T00:23:20.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:23:20.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T00:23:21.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T00:23:21.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-07T00:23:21.185 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-07T00:23:21.195 INFO:tasks.cephadm:Teardown begin 2023-10-07T00:23:21.195 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/cephadm.py", line 1756, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-07T00:23:21.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:23:21.208 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:20 smithi005 ceph-mon[129406]: pgmap v663: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-10-07T00:23:21.247 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:20 smithi112 ceph-mon[133548]: pgmap v663: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-10-07T00:23:21.271 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:23:21.341 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:20 smithi088 ceph-mon[103111]: pgmap v663: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-10-07T00:23:21.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:23:21.432 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-07T00:23:21.433 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-07T00:23:21.476 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-07T00:23:21.523 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-07T00:23:21.568 INFO:tasks.cephadm:Stopping all daemons... 2023-10-07T00:23:21.569 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-07T00:23:21.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.a 2023-10-07T00:23:22.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:21 smithi005 systemd[1]: Stopping Ceph mon.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:22.330 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a[129381]: 2023-10-07T00:23:22.073+0000 7f38e84a4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:23:22.330 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a[129381]: 2023-10-07T00:23:22.073+0000 7f38e84a4700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-07T00:23:22.610 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 07 00:23:22 smithi005 bash[246180]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-a 2023-10-07T00:23:22.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-07T00:23:22.905 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:22.905 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-07T00:23:22.905 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-07T00:23:22.905 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.b 2023-10-07T00:23:23.429 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:22 smithi088 systemd[1]: Stopping Ceph mon.b for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:23.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:23 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-b[103087]: 2023-10-07T00:23:23.425+0000 7f40d31a0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:23:23.702 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:23 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-b[103087]: 2023-10-07T00:23:23.426+0000 7f40d31a0700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-07T00:23:24.202 INFO:journalctl@ceph.mon.b.smithi088.stdout:Oct 07 00:23:23 smithi088 bash[143707]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-b 2023-10-07T00:23:24.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-07T00:23:24.517 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:24.517 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-07T00:23:24.517 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-07T00:23:24.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.c 2023-10-07T00:23:24.997 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:24 smithi112 systemd[1]: Stopping Ceph mon.c for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:25.389 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-c[133524]: 2023-10-07T00:23:25.064+0000 7f0b0d9ae700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:23:25.389 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-c[133524]: 2023-10-07T00:23:25.064+0000 7f0b0d9ae700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-07T00:23:25.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 07 00:23:25 smithi112 bash[175833]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mon-c 2023-10-07T00:23:25.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-07T00:23:25.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:25.888 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-07T00:23:25.889 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-07T00:23:25.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.x 2023-10-07T00:23:26.361 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:23:25 smithi005 systemd[1]: Stopping Ceph mgr.x for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:26.652 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:23:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x[129653]: 2023-10-07T00:23:26.397+0000 7f275bfbc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:23:27.107 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 07 00:23:26 smithi005 bash[246324]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-x 2023-10-07T00:23:27.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-07T00:23:27.222 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:27.223 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-07T00:23:27.223 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-07T00:23:27.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.y 2023-10-07T00:23:27.702 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:23:27 smithi088 systemd[1]: Stopping Ceph mgr.y for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:28.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:23:28 smithi088 bash[143865]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-y 2023-10-07T00:23:28.533 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-07T00:23:28.594 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:23:28 smithi088 systemd[1]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-07T00:23:28.594 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:23:28 smithi088 systemd[1]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.y.service: Failed with result 'exit-code'. 2023-10-07T00:23:28.594 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Oct 07 00:23:28 smithi088 systemd[1]: Stopped Ceph mgr.y for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:23:28.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:28.620 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-07T00:23:28.620 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-07T00:23:28.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.z 2023-10-07T00:23:28.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:23:28 smithi112 systemd[1]: Stopping Ceph mgr.z for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:29.706 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:23:29 smithi112 bash[175984]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mgr-z 2023-10-07T00:23:29.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-07T00:23:29.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:23:29 smithi112 systemd[1]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-07T00:23:29.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:23:29 smithi112 systemd[1]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mgr.z.service: Failed with result 'exit-code'. 2023-10-07T00:23:29.997 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Oct 07 00:23:29 smithi112 systemd[1]: Stopped Ceph mgr.z for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:23:30.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:30.031 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-07T00:23:30.031 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-07T00:23:30.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.0 2023-10-07T00:23:30.358 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:23:30 smithi005 systemd[1]: Stopping Ceph osd.0 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:30.858 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:23:30 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-0[144022]: 2023-10-07T00:23:30.547+0000 7f9ccbd5b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:23:31.082 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:23:30 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-0[144022]: 2023-10-07T00:23:30.547+0000 7f9ccbd5b700 -1 osd.0 88 *** Got signal Terminated *** 2023-10-07T00:23:31.082 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:23:30 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-0[144022]: 2023-10-07T00:23:30.547+0000 7f9ccbd5b700 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:23:36.609 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 07 00:23:36 smithi005 bash[246472]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-0 2023-10-07T00:23:38.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-07T00:23:38.495 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:38.496 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-07T00:23:38.496 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-07T00:23:38.496 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.1 2023-10-07T00:23:38.952 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:23:38 smithi088 systemd[1]: Stopping Ceph osd.1 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:39.452 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:23:39 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-1[108219]: 2023-10-07T00:23:39.037+0000 7f9204c50700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:23:39.453 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:23:39 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-1[108219]: 2023-10-07T00:23:39.037+0000 7f9204c50700 -1 osd.1 88 *** Got signal Terminated *** 2023-10-07T00:23:39.453 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:23:39 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-1[108219]: 2023-10-07T00:23:39.037+0000 7f9204c50700 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:23:45.202 INFO:journalctl@ceph.osd.1.smithi088.stdout:Oct 07 00:23:44 smithi088 bash[144016]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-1 2023-10-07T00:23:46.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-07T00:23:46.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:46.725 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-07T00:23:46.725 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-07T00:23:46.725 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.2 2023-10-07T00:23:47.240 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:23:46 smithi112 systemd[1]: Stopping Ceph osd.2 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:47.497 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:23:47 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-2[139370]: 2023-10-07T00:23:47.238+0000 7f738d209700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:23:47.497 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:23:47 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-2[139370]: 2023-10-07T00:23:47.238+0000 7f738d209700 -1 osd.2 88 *** Got signal Terminated *** 2023-10-07T00:23:47.497 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:23:47 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-2[139370]: 2023-10-07T00:23:47.238+0000 7f738d209700 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:23:53.497 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 07 00:23:53 smithi112 bash[176147]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-2 2023-10-07T00:23:55.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-07T00:23:55.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:23:55.159 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-07T00:23:55.160 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-07T00:23:55.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.3 2023-10-07T00:23:55.608 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:23:55 smithi005 systemd[1]: Stopping Ceph osd.3 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:23:56.109 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:23:55 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3[152539]: 2023-10-07T00:23:55.668+0000 7f21b5c3f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:23:56.109 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:23:55 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3[152539]: 2023-10-07T00:23:55.668+0000 7f21b5c3f700 -1 osd.3 88 *** Got signal Terminated *** 2023-10-07T00:23:56.109 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:23:55 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3[152539]: 2023-10-07T00:23:55.668+0000 7f21b5c3f700 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:23:57.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:23:57 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:23:57.305+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:23:57.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:23:57 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:23:57.537+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:23:58.108 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:23:57 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:23:57.609+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:23:58.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:23:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:23:58.151+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:23:58.599 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:23:58 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:23:58.299+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:23:58.599 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:23:58 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3[152539]: 2023-10-07T00:23:58.452+0000 7f21af22f700 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.550307+0000 front 2023-10-07T00:23:34.550210+0000 (oldest deadline 2023-10-07T00:23:57.450275+0000) 2023-10-07T00:23:58.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:23:58 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:23:58.597+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:23:58.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:23:58 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:23:58.491+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:23:58.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:23:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:23:58.723+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:23:59.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:23:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:23:59.062+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:23:59.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:23:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:23:59.106+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:23:59.608 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:23:59 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3[152539]: 2023-10-07T00:23:59.434+0000 7f21af22f700 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.550307+0000 front 2023-10-07T00:23:34.550210+0000 (oldest deadline 2023-10-07T00:23:57.450275+0000) 2023-10-07T00:23:59.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:23:59 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:23:59.283+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:23:59.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:23:59 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:23:59.482+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:23:59.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:23:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:23:59.696+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:00.108 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:23:59 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:23:59.617+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:00.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:00.014+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:00.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:00.114+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:00.604 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:24:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3[152539]: 2023-10-07T00:24:00.460+0000 7f21af22f700 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.550307+0000 front 2023-10-07T00:23:34.550210+0000 (oldest deadline 2023-10-07T00:23:57.450275+0000) 2023-10-07T00:24:00.605 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:00.317+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:00.702 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:00 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:00.447+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:00.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:00 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:00.603+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:00.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:00.732+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:01.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:01.028+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:01.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:01.150+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:01.575 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 07 00:24:01 smithi005 bash[246762]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-3 2023-10-07T00:24:01.578 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:01 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:01.307+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:01.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:01 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:01.573+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:01.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:01 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:01.452+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:01.982 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:01.695+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:02.247 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:01.980+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:02.120+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:02.547 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:02 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:02.267+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:02.843 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:02 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:02.545+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:02.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:02 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:02.466+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:02.985 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:02.721+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:03.248 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:02.984+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:03.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:03.162+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:03.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-07T00:24:03.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:24:03.367 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-07T00:24:03.368 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-07T00:24:03.368 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.4 2023-10-07T00:24:03.562 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:03 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:03.304+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:03.702 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:03 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:03.510+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:03.702 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:24:03 smithi088 systemd[1]: Stopping Ceph osd.4 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:24:03.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:03 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:03.561+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:03.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:03.742+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:04.202 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:24:03 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4[116032]: 2023-10-07T00:24:03.892+0000 7f5a3e12b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:24:04.202 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:24:03 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4[116032]: 2023-10-07T00:24:03.892+0000 7f5a3e12b700 -1 osd.4 88 *** Got signal Terminated *** 2023-10-07T00:24:04.202 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:24:03 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4[116032]: 2023-10-07T00:24:03.892+0000 7f5a3e12b700 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:24:04.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:04.010+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:04.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:04.209+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:04.586 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:04 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:04.268+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:04.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:04 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:04.585+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:04.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:04 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:04.487+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:05.043 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:04.773+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:05.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:05.042+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:05.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:05.042+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:05.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:05.160+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:05.595 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:05 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:05.294+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:05.702 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:05 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:05.446+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:05.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:05 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:05.594+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:06.205 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:05.780+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:06.206 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:06.019+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:06.206 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:06.019+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:06.407 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:06 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:06.089+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:06.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:06.204+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:06.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:06.204+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:06.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:06 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:06.296+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:06.702 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:06 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:06.406+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:06.702 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:06 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:06.406+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:07.113 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:06 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:06.629+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:07.242 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:06.990+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:07.242 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:06.990+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:07.243 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:06.800+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:07.243 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:06 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:06.800+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:07.421 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:07 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:07.088+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:07.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:07 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:07.240+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:07.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:07 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:07.240+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:07.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:07 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:07.589+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:07.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:07 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:07.339+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:07.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:07 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:07.339+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:07.707 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:24:07 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4[116032]: 2023-10-07T00:24:07.666+0000 7f5a38f1e700 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.332057+0000 front 2023-10-07T00:23:43.332085+0000 (oldest deadline 2023-10-07T00:24:06.832258+0000) 2023-10-07T00:24:07.708 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:07 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:07.419+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:07.708 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:07 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:07.419+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:08.248 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:08.017+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:08.248 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:08.017+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:08.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:07 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:07.810+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:08.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:07 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:07.810+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:08.453 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:08 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:08.132+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:08.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:08 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:08.297+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:08.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:08 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:08.297+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:08.716 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:08 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:08.451+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:08.717 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:08 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:08.451+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:08.747 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:08.251+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:08.747 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:08.251+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:08.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:08 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:08.603+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:08.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:08 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:08.603+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:09.134 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:24:08 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4[116032]: 2023-10-07T00:24:08.714+0000 7f5a38f1e700 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.332057+0000 front 2023-10-07T00:23:43.332085+0000 (oldest deadline 2023-10-07T00:24:06.832258+0000) 2023-10-07T00:24:09.247 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:09.055+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:09.247 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:09.055+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:09.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:08.827+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:09.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:08 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:08.827+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:09.453 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:09 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:09.131+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:09.598 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:09 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:09.303+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:09.599 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:09 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:09.303+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:09.747 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:09.269+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:09.747 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:09.269+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:09.772 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:09 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:09.472+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:09.772 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:09 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:09.472+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:09.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:09 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:09.597+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:09.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:09 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:09.597+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:10.051 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:09.796+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:10.051 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:09.796+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:10.110 INFO:journalctl@ceph.osd.4.smithi088.stdout:Oct 07 00:24:09 smithi088 bash[144289]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-4 2023-10-07T00:24:10.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:10 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:10.108+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:10.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:10 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:10.225+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:10.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:10 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:10.225+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:10.498 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:10 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:10.049+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:10.498 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:10 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:10.049+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:10.610 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:10 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:10.297+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:10.611 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:10 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:10.297+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:10.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:10 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:10.507+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:10.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:10 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:10.507+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:11.108 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:10 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:10.618+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:11.108 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:10 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:10.618+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:11.244 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:11 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:11.023+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:11.244 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:11 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:11.023+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:11.245 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:10 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:10.778+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:11.245 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:10 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:10.778+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:11.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:11 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:11.101+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:11.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:11 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:11.243+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:11.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:11 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:11.243+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:11.585 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:11 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:11.286+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:11.585 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:11 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:11.286+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:11.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-07T00:24:11.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:24:11.685 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-07T00:24:11.686 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-07T00:24:11.686 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.5 2023-10-07T00:24:11.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:11 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:11.584+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:11.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:11 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:11.584+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:11.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:11 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:11.510+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:11.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:11 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:11.510+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:12.041 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:11 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:11.776+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:12.041 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:11 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:11.776+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:12.041 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:11 smithi112 systemd[1]: Stopping Ceph osd.5 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:24:12.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:12 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:12.090+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:12.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:12.197+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:12.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:12.197+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:12.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:12.039+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:12.498 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:12.039+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:12.498 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:12.210+0000 7f0ad464e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:24:12.498 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:12.210+0000 7f0ad464e700 -1 osd.5 88 *** Got signal Terminated *** 2023-10-07T00:24:12.498 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:12.210+0000 7f0ad464e700 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:24:12.588 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:12 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:12.268+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:12.588 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:12 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:12.268+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:12.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:12 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:12.587+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:12.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:12 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:12.587+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:12.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:12 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:12.550+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:12.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:12 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:12.550+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:13.156 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:13 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:13.059+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:13.156 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:13 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:13.059+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:13.156 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:12.816+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:13.156 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:12 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:12.816+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:13.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:13 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:13.108+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:13.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:13 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:13.154+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:13.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:13 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:13.154+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:13.573 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:13 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:13.274+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:13.573 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:13 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:13.274+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:13.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:13 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:13.572+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:13.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:13 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:13.572+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:13.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:13 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:13.565+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:13.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:13 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:13.565+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:14.127 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:13 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:13.856+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:14.127 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:13 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:13.856+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:14.128 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:14 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:14.095+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:14.128 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:14 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:14.095+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:14.128 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:14 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:14.095+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:49.612473+0000 front 2023-10-07T00:23:49.612437+0000 (oldest deadline 2023-10-07T00:24:13.112653+0000) 2023-10-07T00:24:14.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:14 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:14.092+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:14.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:14 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:14.125+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:14.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:14 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:14.126+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:14.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:14.260+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:14.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:14.260+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:14.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:14 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:14.589+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:14.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:14 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:14.589+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:14.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:14 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:14.589+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:15.069 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:14 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:14.813+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:15.070 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:14 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:14.813+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:15.108 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:14.621+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:15.109 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:14 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:14.621+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:15.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:15 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:15.065+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:15.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:15.068+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:15.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:15.068+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:15.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:15.068+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:49.612473+0000 front 2023-10-07T00:23:49.612437+0000 (oldest deadline 2023-10-07T00:24:13.112653+0000) 2023-10-07T00:24:15.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:15.113+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:15.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:15.113+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:15.582 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:15.212+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:15.582 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:15.212+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:15.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:15.581+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:15.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:15.581+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:15.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:15 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:15.544+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:15.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:15 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:15.544+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:15.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:15 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:15.544+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:16.073 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:16.027+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:16.074 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:16.027+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:16.074 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:16.027+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:49.612473+0000 front 2023-10-07T00:23:49.612437+0000 (oldest deadline 2023-10-07T00:24:13.112653+0000) 2023-10-07T00:24:16.074 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:15.812+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:16.074 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:15.812+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:16.074 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:15 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:15.812+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:16.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:16 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:16.081+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:16.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:16 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:16.081+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:16.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:16.072+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:16.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:16.072+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:16.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:16.072+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:16.545 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:16 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:16.200+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:16.546 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:16 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:16.200+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:16.546 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:16 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:16.200+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:16.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:16 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:16.544+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:16.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:16 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:16.544+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:16.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:16 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:16.570+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:16.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:16 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:16.570+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:16.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:16 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:16.570+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:17.027 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:16.772+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:17.027 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:16.772+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:17.027 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:16 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:16.772+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:17.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:17 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:17.115+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:17.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:17 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:17.115+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:17.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:17.025+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.907981+0000 front 2023-10-07T00:23:32.907843+0000 (oldest deadline 2023-10-07T00:23:58.108414+0000) 2023-10-07T00:24:17.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:17.025+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:42.710802+0000 front 2023-10-07T00:23:42.710751+0000 (oldest deadline 2023-10-07T00:24:05.010637+0000) 2023-10-07T00:24:17.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5[147743]: 2023-10-07T00:24:17.025+0000 7f0acec40700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:49.612473+0000 front 2023-10-07T00:23:49.612437+0000 (oldest deadline 2023-10-07T00:24:13.112653+0000) 2023-10-07T00:24:17.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:17.030+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:17.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:17.030+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:17.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:17.030+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:17.531 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:17 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:17.247+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:17.531 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:17 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:17.247+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:17.531 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:17 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:17.247+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:17.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:17 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:17.530+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:17.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:17 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:17.530+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:17.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:17 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:17.530+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:17.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:17 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:17.606+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:17.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:17 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:17.606+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:17.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:17 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:17.606+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:18.028 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:17.772+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:18.028 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:17.772+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:18.029 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:17 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:17.772+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:18.029 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:18 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:18.013+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:18.029 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:18 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:18.013+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:18.029 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:18 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:18.013+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:18.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:18 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:18.134+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:18.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:18 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:18.135+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:18.495 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:18.234+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:18.495 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:18.234+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:18.495 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:18.234+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:18.497 INFO:journalctl@ceph.osd.5.smithi112.stdout:Oct 07 00:24:18 smithi112 bash[176413]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-5 2023-10-07T00:24:18.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:18.494+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:18.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:18.494+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:18.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:18 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:18.494+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:18.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:18 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:18.622+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:18.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:18 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:18.622+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:18.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:18 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:18.622+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:19.115 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:18 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:18.784+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:19.115 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:18 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:18.784+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:19.115 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:18 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:18.784+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:19.115 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:19 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:19.026+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:19.116 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:19 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:19.026+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:19.116 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:19 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:19.026+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:19.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:19 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:19.089+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:19.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:19 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:19.089+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:19.608 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:19.464+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:19.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:19.464+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:19.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:19.464+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:19.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:19.219+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:19.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:19.219+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:19.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:19.219+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:19.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:19 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:19.589+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:19.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:19 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:19.589+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:19.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:19 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:19.589+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:19.972 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:19 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:19.739+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:19.972 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:19 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:19.739+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:19.972 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:19 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:19.739+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:19.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-07T00:24:20.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:24:20.087 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-07T00:24:20.087 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-07T00:24:20.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.6 2023-10-07T00:24:20.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:20 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:20.069+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:20.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:20 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:20.069+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:20.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:20 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:20.069+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:20.440 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:20 smithi005 systemd[1]: Stopping Ceph osd.6 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:24:20.440 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:20.228+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:20.440 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:20.228+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:20.440 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:20.228+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:20.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:20 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:20.080+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:20.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:20 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:20.080+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:20.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:20.439+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:20.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:20.439+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:20.858 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:20.439+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:20.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:20.589+0000 7fed26567700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:24:20.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:20.590+0000 7fed26567700 -1 osd.6 88 *** Got signal Terminated *** 2023-10-07T00:24:20.859 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:20 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:20.590+0000 7fed26567700 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:24:20.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:20 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:20.594+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:20.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:20 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:20.594+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:20.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:20 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:20.594+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:21.062 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:20 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:20.747+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:21.062 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:20 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:20.747+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:21.062 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:20 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:20.747+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:21.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:21 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:21.063+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:21.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:21 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:21.063+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:21.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:21 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:21.061+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:21.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:21 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:21.061+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:21.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:21 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:21.061+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:21.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:21.481+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:21.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:21.481+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:21.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:21.481+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:21.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:21.275+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:21.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:21.275+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:21.610 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:21 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:21.275+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:21.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:21 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:21.617+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:21.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:21 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:21.617+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:21.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:21 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:21.617+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:21.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:21 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:21.617+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:21.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:21 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:21.701+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:21.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:21 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:21.701+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:21.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:21 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:21.701+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:21.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:21 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:21.701+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:22.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:22 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:22.092+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:22.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:22 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:22.092+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:22.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:22 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:22.056+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:22.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:22 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:22.056+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:22.498 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:22 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:22.056+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:22.608 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:22.434+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:22.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:22.434+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:22.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:22.434+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:22.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:22.264+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:22.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:22.264+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:22.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:22 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:22.264+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:22.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:22 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:22.663+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:22.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:22 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:22.663+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:22.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:22 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:22.663+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:22.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:22 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:22.663+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:22.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:22 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:22.723+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:22.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:22 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:22.723+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:22.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:22 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:22.723+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:22.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:22 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:22.723+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:23.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:23 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:23.139+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:23.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:23 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:23.139+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:23.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:23 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:23.092+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:23.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:23 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:23.092+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:23.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:23 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:23.092+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:23.608 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:23.404+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:23.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:23.404+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:23.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:23.404+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:23.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:23.280+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:23.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:23.280+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:23.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:23.280+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:23.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:23 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:23.280+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:23.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:23 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:23.688+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:23.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:23 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:23.688+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:23.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:23 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:23.688+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:23.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:23 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:23.688+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:23.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:23 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:23.674+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:23.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:23 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:23.674+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:23.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:23 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:23.674+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:23.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:23 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:23.674+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:24.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:24 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:24.104+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:24.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:24 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:24.104+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:24.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:24 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:24.050+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:24.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:24 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:24.050+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:24.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:24 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:24.050+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:24.608 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:24 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:24.374+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:24.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:24 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:24.374+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:24.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:24 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:24.374+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:24.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:24 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:24.284+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:24.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:24 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:24.284+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:24.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:24 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:24.284+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:24.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:24 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:24.284+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:24.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:24 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:24.686+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:24.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:24 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:24.686+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:24.954 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:24 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:24.686+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:24.954 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:24 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:24.686+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:24.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:24 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:24.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:24.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:24 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:24.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:24.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:24 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:24.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:24.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:24 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:24.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:25.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:25 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:25.054+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:25.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:25 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:25.055+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:25.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:25 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:25.055+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:25.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:25.045+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:25.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:25.045+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:25.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:25.045+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:25.608 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:25 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:25.369+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.926548+0000 front 2023-10-07T00:23:33.926621+0000 (oldest deadline 2023-10-07T00:23:57.426800+0000) 2023-10-07T00:24:25.608 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:25 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:25.369+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:43.229088+0000 front 2023-10-07T00:23:43.229050+0000 (oldest deadline 2023-10-07T00:24:07.929323+0000) 2023-10-07T00:24:25.609 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:25 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6[161104]: 2023-10-07T00:24:25.369+0000 7fed22b5d700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.030654+0000 front 2023-10-07T00:23:52.030946+0000 (oldest deadline 2023-10-07T00:24:17.231492+0000) 2023-10-07T00:24:25.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:25 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:25.297+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:25.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:25 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:25.297+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:25.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:25 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:25.297+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:25.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:25 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:25.297+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:25.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:25 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:25.698+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:25.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:25 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:25.698+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:25.952 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:25 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:25.698+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:25.953 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:25 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:25.698+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:25.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:25.696+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:25.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:25.696+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:25.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:25.696+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:25.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:25 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:25.696+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:26.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:26.013+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:26.453 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:26.013+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:26.453 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:26.013+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:26.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:26 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:26.017+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:26.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:26 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:26.017+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:26.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:26 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:26.017+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:26.608 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 07 00:24:26 smithi005 bash[247033]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-6 2023-10-07T00:24:26.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:26.304+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:26.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:26.304+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:26.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:26.304+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:26.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:26.304+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:26.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:26 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:26.725+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:26.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:26 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:26.725+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:26.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:26 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:26.725+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:26.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:26 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:26.725+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:27.205 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:26.743+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:27.205 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:26.743+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:27.205 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:26.743+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:27.206 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:26.743+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:27.206 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:26.966+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:27.206 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:26.966+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:27.206 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:26 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:26.966+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:27.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:27 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:27.061+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:27.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:27 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:27.061+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:27.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:27 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:27.061+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:27.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:27.348+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:27.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:27.348+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:27.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:27.348+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:27.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:27 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:27.348+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:27.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:27 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:27.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:27.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:27 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:27.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:27.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:27 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:27.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:27.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:27 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:27.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:28.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-07T00:24:28.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:24:28.094 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-07T00:24:28.094 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-07T00:24:28.095 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.7 2023-10-07T00:24:28.161 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:27 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:27.946+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:28.162 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:27 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:27.946+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:28.162 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:27 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:27.946+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:28.162 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:27 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:27.779+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:28.162 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:27 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:27.779+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:28.162 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:27 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:27.779+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:28.162 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:27 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:27.779+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:28.452 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:28 smithi088 systemd[1]: Stopping Ceph osd.7 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:24:28.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:28.032+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:28.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:28.032+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:28.497 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:28.032+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:28.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:28 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:28.336+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:28.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:28 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:28.336+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:28.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:28 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:28.336+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:28.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:28 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:28.336+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:28.938 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:28.611+0000 7fc60c568700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:24:28.938 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:28.611+0000 7fc60c568700 -1 osd.7 88 *** Got signal Terminated *** 2023-10-07T00:24:28.938 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:28.611+0000 7fc60c568700 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:24:28.938 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:28.783+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:28.938 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:28.783+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:28.938 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:28.783+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:28.938 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:28.783+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:28.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:28.989+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:28.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:28.989+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:28.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:28.989+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:28.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:28.746+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:28.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:28.746+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:28.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:28.746+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:28.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:28 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:28.746+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:29.202 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:28.936+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:29.202 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:28.936+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:29.202 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:28 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:28.936+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:29.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:29 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:29.296+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:29.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:29 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:29.296+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:29.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:29 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:29.296+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:29.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:29 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:29.296+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:30.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:29.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:30.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:29.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:30.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:29.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:30.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:29.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:30.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:29.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:30.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:29.903+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:30.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:29.903+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:30.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:29.903+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:30.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:29 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:29.903+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:04.531052+0000 front 2023-10-07T00:24:04.531090+0000 (oldest deadline 2023-10-07T00:24:29.831249+0000) 2023-10-07T00:24:30.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:29 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:29.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:30.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:29 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:29.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:30.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:29 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:29.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:30.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:29 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:29.760+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:30.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:29 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:29.760+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:30.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:29 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:29.760+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:30.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:29 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:29.760+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:30.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:29 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:29.760+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:30.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:30 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:30.316+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:30.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:30 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:30.316+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:30.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:30 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:30.316+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:30.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:30 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:30.316+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:30.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:30 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:30.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:30.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:30 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:30.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:30.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:30 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:30.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:30.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:30 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:30.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:30.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:30 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:30.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:30.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:30 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:30.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:30.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:30 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:30.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:30.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:30 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:30.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:31.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:30.809+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:31.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:30.809+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:31.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:30.809+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:31.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:30.809+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:31.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:30.809+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:31.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:30.904+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:31.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:30.904+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:31.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:30.904+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:31.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:30 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:30.904+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:04.531052+0000 front 2023-10-07T00:24:04.531090+0000 (oldest deadline 2023-10-07T00:24:29.831249+0000) 2023-10-07T00:24:31.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:31 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:31.331+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:31.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:31 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:31.331+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:31.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:31 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:31.331+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:31.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:31 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:31.331+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:31.948 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:31 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:31.692+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:31.949 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:31 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:31.692+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:31.949 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:31 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:31.692+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:31.949 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:31 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:31.693+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:31.949 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:31 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:31.693+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:32.202 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:31.917+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:32.202 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:31.917+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:32.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:31.917+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:32.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:31.917+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:04.531052+0000 front 2023-10-07T00:24:04.531090+0000 (oldest deadline 2023-10-07T00:24:29.831249+0000) 2023-10-07T00:24:32.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:31.803+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:32.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:31.803+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:32.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:31.803+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:32.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:31.803+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:32.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:31.803+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:32.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:31 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:31.947+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:32.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:31 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:31.947+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:32.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:31 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:31.947+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:32.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:32 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:32.349+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:32.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:32 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:32.349+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:32.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:32 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:32.349+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:32.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:32 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:32.349+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:32.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:32.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:32.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:32.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:32.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:32.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:32.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:32.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:32.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:32.717+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:32.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:32.717+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:32.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:32.717+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:32.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:32.717+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:32.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:32 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:32.718+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:33.202 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:32.925+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:39.927190+0000 front 2023-10-07T00:23:39.927223+0000 (oldest deadline 2023-10-07T00:24:05.227204+0000) 2023-10-07T00:24:33.202 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:32.925+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.628942+0000 front 2023-10-07T00:23:51.629235+0000 (oldest deadline 2023-10-07T00:24:15.729031+0000) 2023-10-07T00:24:33.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:32.925+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.729566+0000 front 2023-10-07T00:23:55.729590+0000 (oldest deadline 2023-10-07T00:24:24.530393+0000) 2023-10-07T00:24:33.203 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7[124448]: 2023-10-07T00:24:32.925+0000 7fc604b56700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:04.531052+0000 front 2023-10-07T00:24:04.531090+0000 (oldest deadline 2023-10-07T00:24:29.831249+0000) 2023-10-07T00:24:33.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:32.791+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:33.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:32.791+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:33.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:32.791+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:33.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:32.791+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:33.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:32 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:32.791+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:33.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:33 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:33.321+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:33.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:33 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:33.321+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:33.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:33 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:33.321+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:33.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:33 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:33.321+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:33.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:33.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:33.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:33.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:33.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:33.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:33.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:33.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:33.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:33.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:33.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:33.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:33.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:33.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:33.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:33.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:33.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:33 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:33.700+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:34.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:33 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:33.825+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:34.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:33 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:33.825+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:34.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:33 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:33.825+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:34.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:33 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:33.825+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:34.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:33 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:33.825+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:34.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:34 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:34.335+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:34.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:34 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:34.335+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:34.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:34 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:34.335+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:34.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:34 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:34.335+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:34.702 INFO:journalctl@ceph.osd.7.smithi088.stdout:Oct 07 00:24:34 smithi088 bash[144551]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-7 2023-10-07T00:24:35.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:34 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:34.808+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:35.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:34 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:34.808+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:35.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:34 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:34.808+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:35.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:34 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:34.808+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:35.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:34 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:34.808+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:35.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:34.890+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:35.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:34.890+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:35.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:34.890+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:35.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:34.890+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:35.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:34.748+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:35.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:34.748+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:35.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:34.748+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:35.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:34.748+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:35.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:34 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:34.748+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:35.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:35 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:35.354+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:35.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:35 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:35.354+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:35.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:35 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:35.354+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:35.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:35 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:35.354+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:36.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:35 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:35.820+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:36.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:35 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:35.820+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:36.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:35 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:35.820+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:36.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:35 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:35.820+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:36.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:35 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:35.820+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:36.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:35.893+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:36.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:35.893+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:36.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:35.893+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:36.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:35.893+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:36.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:35.754+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:36.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:35.754+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:36.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:35.754+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:36.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:35.755+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:36.248 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:35 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:35.755+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:36.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-07T00:24:36.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:24:36.344 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-07T00:24:36.344 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-07T00:24:36.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.8 2023-10-07T00:24:36.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:36 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:36.305+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:36.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:36 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:36.305+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:36.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:36 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:36.305+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:36.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:36 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:36.305+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:36.708 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 systemd[1]: Stopping Ceph osd.8 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:24:36.708 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:36.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:36.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:36.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:36.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:36.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:36.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:36.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:36.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:36.706+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:36.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:36.840+0000 7f7f3edf5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:24:36.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:36.840+0000 7f7f3edf5700 -1 osd.8 88 *** Got signal Terminated *** 2023-10-07T00:24:36.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:36.840+0000 7f7f3edf5700 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:24:36.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:36.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:36.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:36.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:36.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:36.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:36.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:36 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:36.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:37.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:36 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:36.862+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:37.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:36 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:36.862+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:37.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:36 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:36.862+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:37.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:36 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:36.862+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:37.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:36 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:36.862+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:37.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:37 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:37.302+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:37.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:37 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:37.302+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:37.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:37 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:37.302+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:37.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:37 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:37.302+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:37.960 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:37.661+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:37.960 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:37.661+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:37.960 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:37.661+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:37.960 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:37.661+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:37.961 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:37.661+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:38.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:37 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:37.893+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:38.205 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:37 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:37.893+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:38.205 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:37 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:37.893+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:38.205 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:37 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:37.893+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:38.205 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:37 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:37.893+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:38.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:37.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:38.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:37.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:38.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:37.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:38.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:37 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:37.959+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:38.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:38 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:38.290+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:38.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:38 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:38.290+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:38.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:38 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:38.290+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:38.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:38 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:38.290+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:38.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:38 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:38.290+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:38.919 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:38.644+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:38.919 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:38.644+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:38.919 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:38.644+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:38.919 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:38.644+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:38.919 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:38.644+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:39.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:38 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:38.860+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:39.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:38 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:38.860+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:39.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:38 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:38.860+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:39.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:38 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:38.860+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:39.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:38 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:38.860+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:39.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:38.918+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:39.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:38.918+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:39.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:38.918+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:39.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:38 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:38.918+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:39.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:39 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:39.268+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:39.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:39 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:39.268+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:39.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:39 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:39.268+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:39.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:39 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:39.268+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:39.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:39 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:39.268+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:39.939 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:39.667+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:39.939 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:39.667+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:39.939 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:39.667+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:39.939 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:39.667+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:39.939 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:39.667+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:39.939 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:39.667+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.447976+0000 front 2023-10-07T00:24:15.448043+0000 (oldest deadline 2023-10-07T00:24:39.548008+0000) 2023-10-07T00:24:40.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:39 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:39.896+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:40.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:39 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:39.896+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:40.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:39 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:39.896+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:40.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:39 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:39.896+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:40.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:39 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:39.896+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:40.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:39.938+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:40.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:39.938+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:40.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:39.938+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:40.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:39 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:39.938+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:40.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:40 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:40.230+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:40.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:40 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:40.230+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:40.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:40 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:40.230+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:40.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:40 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:40.230+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:40.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:40 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:40.230+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:40.997 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:40.713+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:40.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:40.713+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:40.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:40.713+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:40.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:40.713+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:40.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:40.713+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:40.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:40.713+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.447976+0000 front 2023-10-07T00:24:15.448043+0000 (oldest deadline 2023-10-07T00:24:39.548008+0000) 2023-10-07T00:24:40.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:40.925+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:40.999 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:40.925+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:40.999 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:40.925+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:40.999 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:40 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:40.925+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:41.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:40 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:40.920+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:41.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:40 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:40.920+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:41.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:40 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:40.920+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:41.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:40 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:40.920+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:41.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:40 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:40.920+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:41.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:41.220+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:41.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:41.220+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:41.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:41.221+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:41.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:41.221+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:41.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:41 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:41.221+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:41.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:41.886+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:41.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:41.886+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:41.997 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:41.886+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:41.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:41.886+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:41.998 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:41.886+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:41.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:41.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:34.139166+0000 front 2023-10-07T00:23:34.139245+0000 (oldest deadline 2023-10-07T00:23:58.239317+0000) 2023-10-07T00:24:41.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:41.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:38.240031+0000 front 2023-10-07T00:23:38.240047+0000 (oldest deadline 2023-10-07T00:24:05.840922+0000) 2023-10-07T00:24:41.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:41.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:52.143352+0000 front 2023-10-07T00:23:52.143379+0000 (oldest deadline 2023-10-07T00:24:15.643230+0000) 2023-10-07T00:24:41.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:41.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:55.643900+0000 front 2023-10-07T00:23:55.643868+0000 (oldest deadline 2023-10-07T00:24:21.543780+0000) 2023-10-07T00:24:41.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:41.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.546051+0000 front 2023-10-07T00:24:08.546080+0000 (oldest deadline 2023-10-07T00:24:29.646226+0000) 2023-10-07T00:24:41.998 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:41 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8[155641]: 2023-10-07T00:24:41.738+0000 7f7f3abea700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.447976+0000 front 2023-10-07T00:24:15.448043+0000 (oldest deadline 2023-10-07T00:24:39.548008+0000) 2023-10-07T00:24:42.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:41 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:41.889+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:42.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:41 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:41.889+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:42.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:41 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:41.889+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:42.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:41 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:41.889+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:42.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:41 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:41.889+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:42.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:42.218+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:42.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:42.218+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:42.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:42.218+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:42.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:42.218+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:42.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:42 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:42.218+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:42.898 INFO:journalctl@ceph.osd.8.smithi112.stdout:Oct 07 00:24:42 smithi112 bash[176688]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-8 2023-10-07T00:24:43.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:42 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:42.875+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:43.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:42 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:42.875+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:43.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:42 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:42.875+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:43.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:42 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:42.875+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:43.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:42 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:42.875+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:43.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:42 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:42.875+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:43.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:42 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:42.896+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:43.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:42 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:42.896+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:43.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:42 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:42.896+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:43.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:42 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:42.896+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:43.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:42 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:42.896+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:43.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:43 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:43.212+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:43.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:43 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:43.213+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:43.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:43 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:43.213+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:43.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:43 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:43.213+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:43.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:43 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:43.213+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:44.180 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:43 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:43.905+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:44.180 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:43 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:43.905+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:44.181 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:43 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:43.905+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:44.181 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:43 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:43.905+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:44.181 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:43 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:43.905+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:44.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:43 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:43.841+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:44.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:43 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:43.841+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:44.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:43 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:43.841+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:44.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:43 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:43.841+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:44.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:43 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:43.841+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:44.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:43 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:43.841+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:44.524 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-07T00:24:44.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:44 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:44.258+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:44.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:44 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:44.258+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:44.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:44 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:44.258+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:44.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:44 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:44.258+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:44.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:44 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:44.258+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:44.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:24:44.611 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-07T00:24:44.611 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-07T00:24:44.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.9 2023-10-07T00:24:45.109 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:44 smithi005 systemd[1]: Stopping Ceph osd.9 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:24:45.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:44 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:44.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:45.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:44 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:44.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:45.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:44 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:44.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:45.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:44 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:44.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:45.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:44 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:44.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:45.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:44 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:44.822+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:45.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:44 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:44.863+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:45.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:44 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:44.863+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:45.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:44 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:44.863+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:45.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:44 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:44.863+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:45.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:44 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:44.863+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:45.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:45.128+0000 7fc3dae2a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:24:45.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:45.128+0000 7fc3dae2a700 -1 osd.9 88 *** Got signal Terminated *** 2023-10-07T00:24:45.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:45.128+0000 7fc3dae2a700 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:24:45.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:45.208+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:45.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:45.208+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:45.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:45.208+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:45.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:45.208+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:45.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:45 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:45.208+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:46.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:45 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:45.844+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:46.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:45 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:45.844+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:46.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:45 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:45.844+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:46.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:45 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:45.844+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:46.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:45 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:45.844+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:46.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:45 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:45.844+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:46.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:45 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:45.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:46.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:45 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:45.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:46.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:45 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:45.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:46.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:45 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:45.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:46.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:45 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:45.895+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:46.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:46.242+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:46.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:46.242+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:46.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:46.242+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:46.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:46.242+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:46.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:46 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:46.242+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:47.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:46 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:46.887+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:47.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:46 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:46.887+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:47.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:46 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:46.887+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:47.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:46 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:46.887+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:47.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:46 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:46.887+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:47.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:46 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:46.887+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:47.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:46 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:46.859+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:47.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:46 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:46.859+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:47.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:46 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:46.859+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:47.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:46 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:46.859+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:47.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:46 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:46.859+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:47.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:47 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:47.275+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:47.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:47 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:47.275+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:47.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:47 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:47.275+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:47.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:47 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:47.275+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:47.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:47 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:47.275+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:48.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:47 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:47.885+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:48.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:47 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:47.885+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:48.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:47 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:47.885+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:48.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:47 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:47.885+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:48.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:47 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:47.885+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:48.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:47 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:47.885+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:48.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:47 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:47.885+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:48.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:47 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:47.833+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:48.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:47 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:47.833+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:48.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:47 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:47.833+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:48.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:47 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:47.833+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:48.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:47 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:47.833+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:48.611 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:48 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:48.299+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:48.612 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:48 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:48.299+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:48.612 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:48 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:48.299+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:48.612 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:48 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:48.299+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:48.612 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:48 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:48.299+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:49.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:48 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:48.874+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:49.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:48 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:48.874+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:49.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:48 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:48.874+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:49.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:48 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:48.874+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:49.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:48 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:48.874+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:49.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:48 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:48.874+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:49.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:48 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:48.874+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:49.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:48 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:48.842+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:49.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:48 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:48.842+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:49.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:48 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:48.842+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:49.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:48 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:48.842+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:49.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:48 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:48.842+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:49.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:49.329+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.774112+0000 front 2023-10-07T00:23:33.774256+0000 (oldest deadline 2023-10-07T00:23:57.274322+0000) 2023-10-07T00:24:49.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:49.329+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.975401+0000 front 2023-10-07T00:23:41.975224+0000 (oldest deadline 2023-10-07T00:24:06.675125+0000) 2023-10-07T00:24:49.608 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:49.329+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:47.176514+0000 front 2023-10-07T00:23:47.176306+0000 (oldest deadline 2023-10-07T00:24:15.377077+0000) 2023-10-07T00:24:49.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:49.329+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:58.878174+0000 front 2023-10-07T00:23:58.878026+0000 (oldest deadline 2023-10-07T00:24:22.378160+0000) 2023-10-07T00:24:49.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:49.329+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:15.681713+0000 front 2023-10-07T00:24:15.681688+0000 (oldest deadline 2023-10-07T00:24:37.981417+0000) 2023-10-07T00:24:49.609 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:49 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9[169710]: 2023-10-07T00:24:49.329+0000 7fc3d441a700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:23.882451+0000 front 2023-10-07T00:24:23.882475+0000 (oldest deadline 2023-10-07T00:24:48.582653+0000) 2023-10-07T00:24:50.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:49.843+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:50.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:49.843+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:50.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:49.843+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:50.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:49.843+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:50.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:49.843+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:50.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:49.843+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:50.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:49 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:49.843+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:50.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:49 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:49.842+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:50.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:49 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:49.843+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:50.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:49 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:49.843+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:50.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:49 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:49.843+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:50.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:49 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:49.843+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:51.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:50 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:50.796+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:51.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:50 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:50.796+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:51.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:50 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:50.796+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:51.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:50 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:50.796+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:51.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:50 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:50.796+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:51.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:50 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:50.796+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:51.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:50 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:50.796+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:51.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:50 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:50.852+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:51.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:50 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:50.852+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:51.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:50 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:50.852+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:51.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:50 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:50.852+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:51.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:50 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:50.852+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:51.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:50 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:50.852+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:51.359 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 07 00:24:50 smithi005 bash[247312]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-9 2023-10-07T00:24:52.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:51 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:51.763+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:52.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:51 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:51.763+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:52.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:51 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:51.763+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:52.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:51 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:51.763+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:52.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:51 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:51.763+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:52.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:51 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:51.763+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:52.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:51 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:51.763+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:52.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:51 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:51.898+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:52.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:51 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:51.898+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:52.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:51 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:51.898+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:52.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:51 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:51.898+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:52.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:51 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:51.898+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:52.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:51 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:51.898+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:52.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-07T00:24:52.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:24:52.933 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-07T00:24:52.934 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-07T00:24:52.934 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.10 2023-10-07T00:24:53.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:52.794+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:53.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:52.794+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:53.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:52.794+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:53.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:52.794+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:53.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:52.794+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:53.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:52.794+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:53.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:52 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:52.794+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:53.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 systemd[1]: Stopping Ceph osd.10 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:24:53.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:52 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:52.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:53.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:52 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:52.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:53.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:52 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:52.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:53.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:52 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:52.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:53.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:52 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:52.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:53.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:52 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:52.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:53.823 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.456+0000 7fbd51158700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:24:53.823 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.456+0000 7fbd51158700 -1 osd.10 88 *** Got signal Terminated *** 2023-10-07T00:24:53.824 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.456+0000 7fbd51158700 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:24:54.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.823+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:54.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.823+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:54.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.823+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:54.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.823+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:54.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.823+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:54.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.823+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:54.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:53.823+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:54.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:53 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:53.882+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:54.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:53 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:53.882+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:54.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:53 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:53.882+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:54.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:53 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:53.882+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:54.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:53 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:53.882+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:54.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:53 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:53.882+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:55.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:54 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:54.832+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:55.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:54 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:54.832+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:55.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:54 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:54.832+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:55.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:54 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:54.832+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:55.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:54 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:54.832+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:55.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:54 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:54.832+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:55.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:54 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:54.832+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:55.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:54 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:54.930+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:55.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:54 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:54.930+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:55.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:54 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:54.930+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:55.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:54 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:54.930+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:55.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:54 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:54.930+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:55.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:54 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:54.930+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:55.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:54 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:54.930+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:24:56.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:55 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:55.871+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:56.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:55 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:55.871+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:56.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:55 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:55.871+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:56.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:55 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:55.871+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:56.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:55 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:55.871+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:56.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:55 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:55.871+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:56.204 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:55 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:55.871+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:56.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:55 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:55.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:56.249 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:55 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:55.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:56.249 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:55 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:55.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:56.249 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:55 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:55.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:56.249 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:55 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:55.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:56.250 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:55 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:55.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:56.250 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:55 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:55.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:24:57.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:56 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:56.886+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:57.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:56 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:56.886+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:57.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:56 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:56.886+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:57.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:56 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:56.886+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:57.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:56 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:56.886+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:57.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:56 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:56.886+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:57.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:56 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:56.886+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:57.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:56.922+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:57.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:56.922+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:57.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:56.922+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:57.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:56.922+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:57.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:56.922+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:57.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:56.922+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:57.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:56.922+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:24:58.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:57 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:57.869+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:32.300487+0000 front 2023-10-07T00:23:32.300463+0000 (oldest deadline 2023-10-07T00:23:57.000557+0000) 2023-10-07T00:24:58.202 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:57 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:57.869+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.502783+0000 front 2023-10-07T00:23:41.502832+0000 (oldest deadline 2023-10-07T00:24:06.202892+0000) 2023-10-07T00:24:58.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:57 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:57.869+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:50.304106+0000 front 2023-10-07T00:23:50.304022+0000 (oldest deadline 2023-10-07T00:24:13.803857+0000) 2023-10-07T00:24:58.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:57 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:57.869+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-07T00:23:59.105045+0000 front 2023-10-07T00:23:59.105004+0000 (oldest deadline 2023-10-07T00:24:21.405052+0000) 2023-10-07T00:24:58.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:57 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:57.869+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:06.006662+0000 front 2023-10-07T00:24:06.006676+0000 (oldest deadline 2023-10-07T00:24:29.506760+0000) 2023-10-07T00:24:58.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:57 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:57.869+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:17.008962+0000 front 2023-10-07T00:24:17.008984+0000 (oldest deadline 2023-10-07T00:24:42.308938+0000) 2023-10-07T00:24:58.203 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:57 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10[132932]: 2023-10-07T00:24:57.869+0000 7fbd4bf4b700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:22.309707+0000 front 2023-10-07T00:24:22.309748+0000 (oldest deadline 2023-10-07T00:24:47.609631+0000) 2023-10-07T00:24:58.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:57 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:57.955+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:58.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:57 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:57.955+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:58.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:57 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:57.955+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:58.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:57 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:57.955+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:58.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:57 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:57.955+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:58.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:57 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:57.955+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:58.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:57 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:57.955+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:24:59.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:58.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:24:59.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:58.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:24:59.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:58.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:24:59.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:58.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:24:59.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:58.944+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:24:59.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:58.945+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:24:59.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:58 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:58.945+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:24:59.702 INFO:journalctl@ceph.osd.10.smithi088.stdout:Oct 07 00:24:59 smithi088 bash[144821]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-10 2023-10-07T00:25:00.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:59.906+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:25:00.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:59.906+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:25:00.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:59.906+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:25:00.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:59.906+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:25:00.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:59.906+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:25:00.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:59.906+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:25:00.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:24:59 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:24:59.906+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:25:01.157 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-07T00:25:01.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:01.245 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-07T00:25:01.246 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-07T00:25:01.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.11 2023-10-07T00:25:01.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:00.870+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:25:01.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:00.870+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:25:01.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:00.870+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:25:01.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:00.870+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:25:01.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:00.870+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:25:01.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:00.870+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:25:01.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:00.870+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:25:01.747 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 systemd[1]: Stopping Ceph osd.11 for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:02.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.761+0000 7f9af3a65700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.761+0000 7f9af3a65700 -1 osd.11 88 *** Got signal Terminated *** 2023-10-07T00:25:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.761+0000 7f9af3a65700 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-07T00:25:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.881+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:25:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.881+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:25:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.881+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:25:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.881+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:25:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.881+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:25:02.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.881+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:25:02.249 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:01 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:01.881+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:25:03.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:02.883+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:25:03.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:02.883+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:25:03.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:02.883+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:25:03.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:02.883+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:25:03.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:02.883+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:25:03.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:02.883+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:25:03.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:02 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:02.883+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:25:04.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:03.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:25:04.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:03.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:25:04.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:03.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:25:04.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:03.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:25:04.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:03.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:25:04.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:03.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:25:04.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:03 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:03.887+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:25:05.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:04.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:25:05.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:04.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:25:05.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:04.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:25:05.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:04.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:25:05.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:04.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:25:05.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:04.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:25:05.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:04 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:04.911+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:25:06.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:05.891+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-07T00:23:33.862447+0000 front 2023-10-07T00:23:33.862466+0000 (oldest deadline 2023-10-07T00:23:57.362436+0000) 2023-10-07T00:25:06.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:05.891+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2023-10-07T00:23:41.463779+0000 front 2023-10-07T00:23:41.463936+0000 (oldest deadline 2023-10-07T00:24:05.563758+0000) 2023-10-07T00:25:06.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:05.891+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2023-10-07T00:23:51.965273+0000 front 2023-10-07T00:23:51.965362+0000 (oldest deadline 2023-10-07T00:24:15.465612+0000) 2023-10-07T00:25:06.247 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:05.891+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2023-10-07T00:24:08.269006+0000 front 2023-10-07T00:24:08.268876+0000 (oldest deadline 2023-10-07T00:24:32.368601+0000) 2023-10-07T00:25:06.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:05.891+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2023-10-07T00:24:16.970123+0000 front 2023-10-07T00:24:16.970065+0000 (oldest deadline 2023-10-07T00:24:41.670140+0000) 2023-10-07T00:25:06.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:05.891+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-07T00:24:24.571043+0000 front 2023-10-07T00:24:24.571123+0000 (oldest deadline 2023-10-07T00:24:49.870903+0000) 2023-10-07T00:25:06.248 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11[164241]: 2023-10-07T00:25:05.891+0000 7f9aef85a700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2023-10-07T00:24:29.871608+0000 front 2023-10-07T00:24:29.871532+0000 (oldest deadline 2023-10-07T00:24:54.571329+0000) 2023-10-07T00:25:07.747 INFO:journalctl@ceph.osd.11.smithi112.stdout:Oct 07 00:25:07 smithi112 bash[176971]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-osd-11 2023-10-07T00:25:09.297 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-07T00:25:09.385 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:09.385 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-07T00:25:09.385 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-07T00:25:09.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.a 2023-10-07T00:25:09.859 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:25:09 smithi005 systemd[1]: Stopping Ceph mds.a for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:10.358 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:25:09 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:25:09.883+0000 7fc7482bf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:10.359 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:25:09 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a[178318]: 2023-10-07T00:25:09.883+0000 7fc7482bf700 -1 mds.a *** got signal Terminated *** 2023-10-07T00:25:15.261 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 07 00:25:14 smithi005 bash[247583]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-a 2023-10-07T00:25:15.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-07T00:25:15.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:15.375 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-07T00:25:15.375 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-07T00:25:15.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.d 2023-10-07T00:25:15.608 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:25:15 smithi005 systemd[1]: Stopping Ceph mds.d for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:16.358 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:25:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-d[177279]: 2023-10-07T00:25:15.882+0000 7f69bfee1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:16.358 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:25:15 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-d[177279]: 2023-10-07T00:25:15.882+0000 7f69bfee1700 -1 mds.d *** got signal Terminated *** 2023-10-07T00:25:18.608 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 07 00:25:18 smithi005 bash[247726]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-d 2023-10-07T00:25:18.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-07T00:25:18.725 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:18.725 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-07T00:25:18.725 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-07T00:25:18.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.g 2023-10-07T00:25:19.108 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:25:18 smithi005 systemd[1]: Stopping Ceph mds.g for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:19.608 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:25:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-g[177933]: 2023-10-07T00:25:19.214+0000 7ff0f178d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:19.608 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:25:19 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-g[177933]: 2023-10-07T00:25:19.214+0000 7ff0f178d700 -1 mds.g *** got signal Terminated *** 2023-10-07T00:25:25.359 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 07 00:25:25 smithi005 bash[247873]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-g 2023-10-07T00:25:25.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-07T00:25:25.553 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:25.553 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-07T00:25:25.553 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-07T00:25:25.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.j 2023-10-07T00:25:25.858 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:25:25 smithi005 systemd[1]: Stopping Ceph mds.j for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:26.359 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:25:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-j[176892]: 2023-10-07T00:25:26.088+0000 7fde317c9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:26.359 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:25:26 smithi005 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-j[176892]: 2023-10-07T00:25:26.088+0000 7fde317c9700 -1 mds.j *** got signal Terminated *** 2023-10-07T00:25:30.568 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:25:30 smithi005 bash[248018]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-j 2023-10-07T00:25:30.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-07T00:25:30.833 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:25:30 smithi005 systemd[1]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.j.service: Succeeded. 2023-10-07T00:25:30.833 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 07 00:25:30 smithi005 systemd[1]: Stopped Ceph mds.j for bdea4c58-64a4-11ee-8db5-212e2dc638e7. 2023-10-07T00:25:30.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:30.855 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-07T00:25:30.855 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-07T00:25:30.855 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.b 2023-10-07T00:25:31.202 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:25:30 smithi088 systemd[1]: Stopping Ceph mds.b for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:31.702 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:25:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-b[139175]: 2023-10-07T00:25:31.381+0000 7f831da3c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:31.702 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:25:31 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-b[139175]: 2023-10-07T00:25:31.381+0000 7f831da3c700 -1 mds.b *** got signal Terminated *** 2023-10-07T00:25:40.452 INFO:journalctl@ceph.mds.b.smithi088.stdout:Oct 07 00:25:40 smithi088 bash[145095]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-b 2023-10-07T00:25:40.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-07T00:25:40.561 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:40.561 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-07T00:25:40.561 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-07T00:25:40.561 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.e 2023-10-07T00:25:40.952 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:25:40 smithi088 systemd[1]: Stopping Ceph mds.e for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:41.452 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:25:41 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-e[138487]: 2023-10-07T00:25:41.062+0000 7f0343fa8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:41.452 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:25:41 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-e[138487]: 2023-10-07T00:25:41.062+0000 7f0343fa8700 -1 mds.e *** got signal Terminated *** 2023-10-07T00:25:45.441 INFO:journalctl@ceph.mds.e.smithi088.stdout:Oct 07 00:25:45 smithi088 bash[145234]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-e 2023-10-07T00:25:45.740 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-07T00:25:45.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:45.823 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-07T00:25:45.823 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-07T00:25:45.824 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.h 2023-10-07T00:25:46.202 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:25:45 smithi088 systemd[1]: Stopping Ceph mds.h for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:46.702 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:25:46 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-h[138827]: 2023-10-07T00:25:46.310+0000 7f813fd9d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:46.702 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:25:46 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-h[138827]: 2023-10-07T00:25:46.310+0000 7f813fd9d700 -1 mds.h *** got signal Terminated *** 2023-10-07T00:25:52.380 INFO:journalctl@ceph.mds.h.smithi088.stdout:Oct 07 00:25:52 smithi088 bash[145371]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-h 2023-10-07T00:25:52.418 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-07T00:25:52.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:52.506 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-07T00:25:52.506 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-07T00:25:52.506 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.k 2023-10-07T00:25:52.703 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:25:52 smithi088 systemd[1]: Stopping Ceph mds.k for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:53.452 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:25:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-k[138146]: 2023-10-07T00:25:53.000+0000 7f6e3ab28700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:53.453 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:25:53 smithi088 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-k[138146]: 2023-10-07T00:25:53.000+0000 7f6e3ab28700 -1 mds.k *** got signal Terminated *** 2023-10-07T00:25:56.186 INFO:journalctl@ceph.mds.k.smithi088.stdout:Oct 07 00:25:55 smithi088 bash[145510]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-k 2023-10-07T00:25:56.340 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-07T00:25:56.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:25:56.423 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-07T00:25:56.423 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-07T00:25:56.423 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.c 2023-10-07T00:25:56.747 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:25:56 smithi112 systemd[1]: Stopping Ceph mds.c for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:25:57.247 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:25:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-c[170296]: 2023-10-07T00:25:56.938+0000 7fee90249700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:25:57.247 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:25:56 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-c[170296]: 2023-10-07T00:25:56.938+0000 7fee90249700 -1 mds.c *** got signal Terminated *** 2023-10-07T00:25:59.997 INFO:journalctl@ceph.mds.c.smithi112.stdout:Oct 07 00:25:59 smithi112 bash[177255]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-c 2023-10-07T00:26:00.109 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-07T00:26:00.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:26:00.194 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-07T00:26:00.194 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-07T00:26:00.194 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.f 2023-10-07T00:26:00.497 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:26:00 smithi112 systemd[1]: Stopping Ceph mds.f for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:26:00.997 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:26:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-f[169955]: 2023-10-07T00:26:00.687+0000 7fecdaa79700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:26:00.997 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:26:00 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-f[169955]: 2023-10-07T00:26:00.687+0000 7fecdaa79700 -1 mds.f *** got signal Terminated *** 2023-10-07T00:26:04.997 INFO:journalctl@ceph.mds.f.smithi112.stdout:Oct 07 00:26:04 smithi112 bash[177401]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-f 2023-10-07T00:26:05.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-07T00:26:05.141 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:26:05.141 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-07T00:26:05.141 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-07T00:26:05.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.i 2023-10-07T00:26:05.497 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:26:05 smithi112 systemd[1]: Stopping Ceph mds.i for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:26:05.997 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:26:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-i[170637]: 2023-10-07T00:26:05.636+0000 7f51c1104700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:26:05.997 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:26:05 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-i[170637]: 2023-10-07T00:26:05.636+0000 7f51c1104700 -1 mds.i *** got signal Terminated *** 2023-10-07T00:26:08.497 INFO:journalctl@ceph.mds.i.smithi112.stdout:Oct 07 00:26:08 smithi112 bash[177543]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-i 2023-10-07T00:26:08.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-07T00:26:08.674 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:26:08.675 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-07T00:26:08.675 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-07T00:26:08.675 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.l 2023-10-07T00:26:08.997 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:26:08 smithi112 systemd[1]: Stopping Ceph mds.l for bdea4c58-64a4-11ee-8db5-212e2dc638e7... 2023-10-07T00:26:09.497 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:26:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-l[169609]: 2023-10-07T00:26:09.160+0000 7f4871d45700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-07T00:26:09.497 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:26:09 smithi112 ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-l[169609]: 2023-10-07T00:26:09.160+0000 7f4871d45700 -1 mds.l *** got signal Terminated *** 2023-10-07T00:26:12.878 INFO:journalctl@ceph.mds.l.smithi112.stdout:Oct 07 00:26:12 smithi112 bash[177683]: ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7-mds-l 2023-10-07T00:26:13.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bdea4c58-64a4-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-07T00:26:13.319 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-07T00:26:13.319 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-07T00:26:13.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-07T00:26:13.726 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:26:17.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-07T00:26:17.483 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting cluster with fsid: bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:26:20.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-07T00:26:20.998 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:26:24.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:26:24.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:26:24.385 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-07T00:26:24.457 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-07T00:26:24.463 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi005/crash 2023-10-07T00:26:24.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash -- . 2023-10-07T00:26:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-07T00:26:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2023-10-07T00:26:24.542 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi088/crash 2023-10-07T00:26:24.543 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash -- . 2023-10-07T00:26:24.653 INFO:teuthology.orchestra.run.smithi088.stderr:tar: /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-07T00:26:24.653 INFO:teuthology.orchestra.run.smithi088.stderr:tar: Error is not recoverable: exiting now 2023-10-07T00:26:24.656 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi112/crash 2023-10-07T00:26:24.657 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash -- . 2023-10-07T00:26:24.750 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-07T00:26:24.750 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2023-10-07T00:26:24.752 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-07T00:26:24.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-07T00:26:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:grep: /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-07T00:26:24.841 INFO:tasks.cephadm:Compressing logs... 2023-10-07T00:26:24.841 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-07T00:26:24.847 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-07T00:26:24.851 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-07T00:26:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-07T00:26:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:: No such file or directory 2023-10-07T00:26:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-07T00:26:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-07T00:26:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-07T00:26:24.915 INFO:teuthology.orchestra.run.smithi088.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2023-10-07T00:26:24.915 INFO:teuthology.orchestra.run.smithi088.stderr:-5 --verbose -- /var/log/ceph/cephadm.log 2023-10-07T00:26:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-07T00:26:24.916 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.10.log 2023-10-07T00:26:24.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-07T00:26:24.917 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-07T00:26:24.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.10.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-07T00:26:24.919 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-07T00:26:24.919 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-07T00:26:24.919 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-07T00:26:24.919 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-07T00:26:24.921 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-07T00:26:24.921 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.3.log: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-07T00:26:24.921 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-07T00:26:24.922 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-07T00:26:24.922 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-07T00:26:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-07T00:26:24.923 INFO:teuthology.orchestra.run.smithi112.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-07T00:26:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-07T00:26:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-07T00:26:24.924 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-07T00:26:24.924 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-07T00:26:24.925 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-07T00:26:24.925 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-07T00:26:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-07T00:26:24.926 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-07T00:26:24.927 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-07T00:26:24.929 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-07T00:26:24.931 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log: /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.7.log: 94.6% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-07T00:26:24.931 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-07T00:26:24.935 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-07T00:26:24.935 INFO:teuthology.orchestra.run.smithi088.stderr: 90.9% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-07T00:26:24.937 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.c.log: 92.9% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-07T00:26:24.938 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-07T00:26:24.938 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.i.log: /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-07T00:26:24.942 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-07T00:26:24.947 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-07T00:26:24.956 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-07T00:26:24.957 INFO:teuthology.orchestra.run.smithi112.stderr: 90.9% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-07T00:26:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-07T00:26:24.973 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: 92.7% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-07T00:26:24.982 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.j.log: 94.6%gzip -5 --verbose -- /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-07T00:26:24.982 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-07T00:26:24.982 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-07T00:26:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-10-07T00:26:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.a.log: /var/log/ceph/ceph-client.0.log: 90.1% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-07T00:26:25.344 INFO:teuthology.orchestra.run.smithi088.stderr: 92.2% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-07T00:26:25.542 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 91.9% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-07T00:26:25.772 INFO:teuthology.orchestra.run.smithi088.stderr: 94.5% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-07T00:26:26.105 INFO:teuthology.orchestra.run.smithi112.stderr: 94.2% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-07T00:26:26.557 INFO:teuthology.orchestra.run.smithi112.stderr: 94.4% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-07T00:26:26.738 INFO:teuthology.orchestra.run.smithi005.stderr: 94.2% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-07T00:26:26.808 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-07T00:26:28.298 INFO:teuthology.orchestra.run.smithi112.stderr: 94.9% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-07T00:26:28.630 INFO:teuthology.orchestra.run.smithi112.stderr: 91.0% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-07T00:26:29.535 INFO:teuthology.orchestra.run.smithi088.stderr: 91.0% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-07T00:26:29.816 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-07T00:26:29.922 INFO:teuthology.orchestra.run.smithi112.stderr: 90.8% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-07T00:26:30.056 INFO:teuthology.orchestra.run.smithi112.stderr: 91.0% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-07T00:26:30.187 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-07T00:26:30.823 INFO:teuthology.orchestra.run.smithi112.stderr: 91.1% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-07T00:26:30.930 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-07T00:26:31.000 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-07T00:26:31.188 INFO:teuthology.orchestra.run.smithi088.stderr: 90.9% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-07T00:26:31.271 INFO:teuthology.orchestra.run.smithi088.stderr: 91.1% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-07T00:26:32.653 INFO:teuthology.orchestra.run.smithi088.stderr: 90.6% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-07T00:26:42.867 INFO:teuthology.orchestra.run.smithi088.stderr: 94.2% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-07T00:26:43.737 INFO:teuthology.orchestra.run.smithi088.stderr: 94.1% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-07T00:26:43.742 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-10-07T00:26:43.742 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m18.852s 2023-10-07T00:26:43.742 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m58.297s 2023-10-07T00:26:43.742 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m4.754s 2023-10-07T00:26:47.714 INFO:teuthology.orchestra.run.smithi112.stderr: 94.3% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-07T00:26:47.718 INFO:teuthology.orchestra.run.smithi112.stderr: 2023-10-07T00:26:47.718 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m22.827s 2023-10-07T00:26:47.718 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m45.100s 2023-10-07T00:26:47.718 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m3.646s 2023-10-07T00:26:50.514 INFO:teuthology.orchestra.run.smithi005.stderr: 94.2% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-07T00:27:18.599 INFO:teuthology.orchestra.run.smithi005.stderr: 93.5% -- replaced with /var/log/ceph/bdea4c58-64a4-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-07T00:27:58.341 INFO:teuthology.orchestra.run.smithi005.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-10-07T00:27:58.345 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-10-07T00:27:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:real 1m33.462s 2023-10-07T00:27:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:user 3m2.592s 2023-10-07T00:27:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m13.840s 2023-10-07T00:27:58.346 INFO:tasks.cephadm:Archiving logs... 2023-10-07T00:27:58.347 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi005/log 2023-10-07T00:27:58.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-07T00:28:24.307 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi088/log 2023-10-07T00:28:24.308 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-07T00:28:31.825 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi112/log 2023-10-07T00:28:31.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-07T00:28:37.710 INFO:tasks.cephadm:Removing cluster... 2023-10-07T00:28:37.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 --force 2023-10-07T00:28:38.115 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:28:39.138 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 --force 2023-10-07T00:28:39.531 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting cluster with fsid: bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:28:40.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bdea4c58-64a4-11ee-8db5-212e2dc638e7 --force 2023-10-07T00:28:40.702 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: bdea4c58-64a4-11ee-8db5-212e2dc638e7 2023-10-07T00:28:41.538 INFO:tasks.cephadm:Removing cephadm ... 2023-10-07T00:28:41.539 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-07T00:28:41.587 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-07T00:28:41.636 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-07T00:28:41.679 INFO:tasks.cephadm:Teardown complete 2023-10-07T00:28:41.679 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-07T00:28:41.692 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-07T00:28:41.692 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-07T00:28:41.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-07T00:28:41.698 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-07T00:28:41.703 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-07T00:28:41.863 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-07T00:28:41.874 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-07T00:28:41.874 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T00:28:41.879 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T00:28:41.883 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T00:28:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2023-10-07T00:28:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-10-07T00:28:41.924 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2023-10-07T00:28:41.926 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T00:28:41.926 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-10-07T00:28:41.926 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 -915us[ -915us] +/- 84ms 2023-10-07T00:28:41.926 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv02.front.sepia.ceph.com 3 6 377 33 +387us[ +410us] +/- 78ms 2023-10-07T00:28:41.926 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +535us[ +535us] +/- 81ms 2023-10-07T00:28:41.926 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T00:28:41.928 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T00:28:41.928 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-10-07T00:28:41.928 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 32 -1014us[-1014us] +/- 83ms 2023-10-07T00:28:41.929 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv02.front.sepia.ceph.com 3 8 377 158 +369us[ +377us] +/- 76ms 2023-10-07T00:28:41.929 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 95 +481us[ +481us] +/- 80ms 2023-10-07T00:28:41.929 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T00:28:41.931 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T00:28:41.931 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2023-10-07T00:28:41.931 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 -937us[ -937us] +/- 84ms 2023-10-07T00:28:41.931 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 +389us[ +392us] +/- 78ms 2023-10-07T00:28:41.931 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +531us[ +533us] +/- 81ms 2023-10-07T00:28:41.931 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T00:28:41.932 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-07T00:28:41.943 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-07T00:28:41.943 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-07T00:28:41.953 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-07T00:28:42.150 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-07T00:28:42.318 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-07T00:28:42.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T00:28:42.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T00:28:42.563 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T00:28:42.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T00:28:42.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T00:28:42.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T00:28:42.715 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-07T00:28:42.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-07T00:28:42.735 INFO:teuthology.task.internal:Duration was 2612.948657 seconds 2023-10-07T00:28:42.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-07T00:28:42.746 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-07T00:28:42.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-07T00:28:42.750 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-07T00:28:42.755 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-07T00:28:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T00:28:42.868 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T00:28:42.871 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T00:28:43.139 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-07T00:28:43.139 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2023-10-07T00:28:43.139 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-07T00:28:43.199 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2023-10-07T00:28:43.199 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-07T00:28:43.258 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2023-10-07T00:28:43.258 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-07T00:28:43.316 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-07T00:28:43.316 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-07T00:28:43.321 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-07T00:28:43.325 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-07T00:28:43.418 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-07T00:28:43.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-07T00:28:43.423 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-07T00:28:43.428 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-07T00:28:43.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-07T00:28:43.599 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-07T00:28:43.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-07T00:28:43.669 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-07T00:28:43.737 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-07T00:28:43.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-07T00:28:43.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-07T00:28:43.824 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-07T00:28:43.829 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-07T00:28:43.888 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2023-10-07T00:28:43.891 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2023-10-07T00:28:43.895 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2023-10-07T00:28:43.959 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-07T00:28:44.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T00:28:44.001 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-07T00:28:44.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T00:28:44.042 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-07T00:28:44.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T00:28:44.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-07T00:28:44.096 INFO:teuthology.task.internal:Transferring archived files... 2023-10-07T00:28:44.097 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi005 2023-10-07T00:28:44.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-07T00:28:44.181 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi088 2023-10-07T00:28:44.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-07T00:28:44.262 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797/remote/smithi112 2023-10-07T00:28:44.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-07T00:28:44.342 INFO:teuthology.task.internal:Removing archive directory... 2023-10-07T00:28:44.342 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-07T00:28:44.347 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-07T00:28:44.351 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-07T00:28:44.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-07T00:28:44.410 INFO:teuthology.task.internal:Not uploading archives. 2023-10-07T00:28:44.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-07T00:28:44.422 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-07T00:28:44.422 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-07T00:28:44.430 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-07T00:28:44.435 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-07T00:28:44.469 INFO:teuthology.orchestra.run.smithi005.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 7 00:28 /home/ubuntu/cephtest 2023-10-07T00:28:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 7 00:28 /home/ubuntu/cephtest 2023-10-07T00:28:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 7 00:28 /home/ubuntu/cephtest 2023-10-07T00:28:44.480 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-07T00:28:44.492 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-07T00:28:44.504 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-07T00:28:44.504 INFO:teuthology.nuke:Checking targets against current locks 2023-10-07T00:28:44.529 DEBUG:teuthology.nuke:shortname: smithi005 2023-10-07T00:28:44.530 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T00:28:44.556 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 23:34:31.878706', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-07T00:28:44.557 DEBUG:teuthology.nuke:shortname: smithi088 2023-10-07T00:28:44.557 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T00:28:44.581 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 23:34:31.877309', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-07T00:28:44.586 DEBUG:teuthology.nuke:shortname: smithi112 2023-10-07T00:28:44.587 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T00:28:44.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414797', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 23:34:31.875884', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-07T00:28:44.617 INFO:teuthology.orchestra.console.smithi005:Power off 2023-10-07T00:28:44.617 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-07T00:28:44.630 INFO:teuthology.orchestra.console.smithi088:Power off 2023-10-07T00:28:44.631 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-07T00:28:44.642 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-10-07T00:28:44.642 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:44.658 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-10-07T00:28:44.658 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:44.675 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-07T00:28:44.683 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-10-07T00:28:44.691 INFO:teuthology.orchestra.console.smithi112:Power off 2023-10-07T00:28:44.691 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-07T00:28:44.712 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-10-07T00:28:44.712 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:44.733 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-10-07T00:28:48.676 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:48.684 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:48.734 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:48.786 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-07T00:28:48.793 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-10-07T00:28:48.844 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-10-07T00:28:52.791 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:52.799 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:52.845 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T00:28:52.901 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-10-07T00:28:52.909 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-10-07T00:28:52.954 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-10-07T00:28:53.002 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-10-07T00:28:53.010 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-10-07T00:28:53.055 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-10-07T00:28:53.161 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} duration: 2612.948657274246 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default mon.a-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c mon.b-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c mon.c-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c owner: scheduled_rishabh@teuthology status: fail success: false 2023-10-07T00:28:53.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-07T00:28:53.241 INFO:teuthology.run:FAIL